[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:12:21.188026  6030 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.227.190:42631
I20260709 13:12:21.189652  6030 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:12:21.190814  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:21.208559  6037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:21.208573  6039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:21.208590  6036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:22.426615  6038 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1216 milliseconds
I20260709 13:12:22.426815  6030 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 13:12:22.428169  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:22.428444  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:22.428668  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602742428639 us; error 0 us; skew 500 ppm
I20260709 13:12:22.429530  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:22.435148  6030 webserver.cc:533] Webserver started at http://127.5.227.190:44691/ using document root <none> and password file <none>
I20260709 13:12:22.436122  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:22.436374  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:22.436868  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:22.442963  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/master-0-root/instance:
uuid: "d7af61d9ccde44978924d3122b0fc037"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-tbwl"
I20260709 13:12:22.451440  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:22.456944  6045 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.458271  6030 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:22.458701  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/master-0-root
uuid: "d7af61d9ccde44978924d3122b0fc037"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-tbwl"
I20260709 13:12:22.459093  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:22.516187  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:22.517859  6030 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:12:22.518396  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:22.594172  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.190:42631
I20260709 13:12:22.594251  6096 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.190:42631 every 8 connection(s)
I20260709 13:12:22.602741  6097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.624907  6097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037: Bootstrap starting.
I20260709 13:12:22.631033  6097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.632947  6097 log.cc:826] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037: Log is configured to *not* fsync() on all Append() calls
I20260709 13:12:22.637825  6097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037: No bootstrap required, opened a new log
I20260709 13:12:22.658974  6097 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7af61d9ccde44978924d3122b0fc037" member_type: VOTER }
I20260709 13:12:22.659554  6097 raft_consensus.cc:385] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.659763  6097 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7af61d9ccde44978924d3122b0fc037, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.660753  6097 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7af61d9ccde44978924d3122b0fc037" member_type: VOTER }
I20260709 13:12:22.661248  6097 raft_consensus.cc:399] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:22.661494  6097 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:22.661799  6097 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.666069  6097 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7af61d9ccde44978924d3122b0fc037" member_type: VOTER }
I20260709 13:12:22.666885  6097 leader_election.cc:304] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7af61d9ccde44978924d3122b0fc037; no voters: 
I20260709 13:12:22.668624  6097 leader_election.cc:290] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:22.668987  6100 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:22.671391  6100 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [term 1 LEADER]: Becoming Leader. State: Replica: d7af61d9ccde44978924d3122b0fc037, State: Running, Role: LEADER
I20260709 13:12:22.672526  6100 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7af61d9ccde44978924d3122b0fc037" member_type: VOTER }
I20260709 13:12:22.673498  6097 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:22.684285  6102 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7af61d9ccde44978924d3122b0fc037. Latest consensus state: current_term: 1 leader_uuid: "d7af61d9ccde44978924d3122b0fc037" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7af61d9ccde44978924d3122b0fc037" member_type: VOTER } }
I20260709 13:12:22.684276  6101 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7af61d9ccde44978924d3122b0fc037" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7af61d9ccde44978924d3122b0fc037" member_type: VOTER } }
I20260709 13:12:22.685396  6101 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:22.685377  6102 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:22.691581  6109 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:22.704879  6109 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:22.707544  6030 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:22.724057  6109 catalog_manager.cc:1383] Generated new cluster ID: 6026cca1bb1b4416b4d473b13c8ed180
I20260709 13:12:22.724396  6109 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:22.763343  6109 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:22.765043  6109 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:22.783771  6109 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037: Generated new TSK 0
I20260709 13:12:22.784765  6109 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:22.839223  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:22.848984  6119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:22.850427  6120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:22.855584  6030 server_base.cc:1061] running on GCE node
W20260709 13:12:22.855659  6122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:22.856839  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:22.857136  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:22.857336  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602742857320 us; error 0 us; skew 500 ppm
I20260709 13:12:22.858148  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:22.862365  6030 webserver.cc:533] Webserver started at http://127.5.227.129:41189/ using document root <none> and password file <none>
I20260709 13:12:22.863153  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:22.863412  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:22.863788  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:22.865376  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-0-root/instance:
uuid: "0993a7f6a0e845038f017bf489411850"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-tbwl"
I20260709 13:12:22.872466  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:12:22.877920  6127 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.878860  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:22.879233  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-0-root
uuid: "0993a7f6a0e845038f017bf489411850"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-tbwl"
I20260709 13:12:22.879640  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:22.899860  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:22.901710  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:22.904569  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:22.910324  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:22.910714  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:12:22.911055  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:22.911283  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:23.004889  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.129:37153
I20260709 13:12:23.004947  6189 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.129:37153 every 8 connection(s)
I20260709 13:12:23.013026  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:23.027793  6194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:23.031243  6195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:23.040838  6197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:23.048918  6030 server_base.cc:1061] running on GCE node
I20260709 13:12:23.050021  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:23.050329  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:23.050565  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602743050534 us; error 0 us; skew 500 ppm
I20260709 13:12:23.051424  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:23.054718  6030 webserver.cc:533] Webserver started at http://127.5.227.130:37253/ using document root <none> and password file <none>
I20260709 13:12:23.055173  6190 heartbeater.cc:344] Connected to a master server at 127.5.227.190:42631
I20260709 13:12:23.055419  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:23.055671  6190 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:23.055691  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:23.056180  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:23.057005  6190 heartbeater.cc:507] Master 127.5.227.190:42631 requested a full tablet report, sending...
I20260709 13:12:23.057739  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-1-root/instance:
uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
format_stamp: "Formatted at 2026-07-09 13:12:23 on dist-test-slave-tbwl"
I20260709 13:12:23.060807  6062 ts_manager.cc:194] Registered new tserver with Master: 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153)
I20260709 13:12:23.063995  6062 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58970
I20260709 13:12:23.064457  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:12:23.070344  6202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:23.071318  6030 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:12:23.071689  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-1-root
uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
format_stamp: "Formatted at 2026-07-09 13:12:23 on dist-test-slave-tbwl"
I20260709 13:12:23.072062  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:23.092805  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:23.094569  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:23.097254  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:23.101100  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:23.101387  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:23.101686  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:23.101907  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:23.191486  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.130:37685
I20260709 13:12:23.191550  6264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.130:37685 every 8 connection(s)
I20260709 13:12:23.198787  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:23.207125  6268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:23.210676  6269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:23.213719  6265 heartbeater.cc:344] Connected to a master server at 127.5.227.190:42631
I20260709 13:12:23.214167  6265 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:23.215605  6265 heartbeater.cc:507] Master 127.5.227.190:42631 requested a full tablet report, sending...
I20260709 13:12:23.219017  6062 ts_manager.cc:194] Registered new tserver with Master: 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:23.219106  6030 server_base.cc:1061] running on GCE node
W20260709 13:12:23.219779  6271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:23.220930  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:23.220986  6062 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58974
W20260709 13:12:23.221371  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:23.221655  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602743221633 us; error 0 us; skew 500 ppm
I20260709 13:12:23.222476  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:23.225471  6030 webserver.cc:533] Webserver started at http://127.5.227.131:45537/ using document root <none> and password file <none>
I20260709 13:12:23.226006  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:23.226240  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:23.226521  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:23.227622  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-2-root/instance:
uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
format_stamp: "Formatted at 2026-07-09 13:12:23 on dist-test-slave-tbwl"
I20260709 13:12:23.232618  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:12:23.244097  6276 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:23.245059  6030 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.001s	sys 0.000s
I20260709 13:12:23.245440  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-2-root
uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
format_stamp: "Formatted at 2026-07-09 13:12:23 on dist-test-slave-tbwl"
I20260709 13:12:23.245860  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602741015013-6030-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:23.274008  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:23.275697  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:23.278374  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:23.282362  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:23.282714  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:12:23.283012  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:23.283216  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:23.370007  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.131:34845
I20260709 13:12:23.370077  6338 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.131:34845 every 8 connection(s)
I20260709 13:12:23.387637  6339 heartbeater.cc:344] Connected to a master server at 127.5.227.190:42631
I20260709 13:12:23.388091  6339 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:23.389099  6339 heartbeater.cc:507] Master 127.5.227.190:42631 requested a full tablet report, sending...
I20260709 13:12:23.391487  6062 ts_manager.cc:194] Registered new tserver with Master: 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:23.392341  6030 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016433235s
I20260709 13:12:23.393142  6062 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58988
I20260709 13:12:23.444471  6062 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59004:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:23.448421  6062 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:23.583178  6229 tablet_service.cc:1511] Processing CreateTablet for tablet b3fe14d690ad43168d833eb7e7c60d8d (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:23.584368  6228 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec2790c669f414cb9c6f234631f9eff (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:23.585081  6229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fe14d690ad43168d833eb7e7c60d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.586131  6228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec2790c669f414cb9c6f234631f9eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.587996  6225 tablet_service.cc:1511] Processing CreateTablet for tablet 37c161ae65b746a8926d7ea53a3206b9 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:23.589535  6225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c161ae65b746a8926d7ea53a3206b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.589809  6155 tablet_service.cc:1511] Processing CreateTablet for tablet 72d55d74fe6e4a84ba7162db97c40a41 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:23.591317  6155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d55d74fe6e4a84ba7162db97c40a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.591270  6151 tablet_service.cc:1511] Processing CreateTablet for tablet 30c69dd0a6c240448ea23867b94b5105 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:23.592769  6151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c69dd0a6c240448ea23867b94b5105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.596208  6149 tablet_service.cc:1511] Processing CreateTablet for tablet f50f534426eb41c4bf42432aff145c02 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:23.597147  6226 tablet_service.cc:1511] Processing CreateTablet for tablet 30c69dd0a6c240448ea23867b94b5105 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:23.597743  6149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50f534426eb41c4bf42432aff145c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.603088  6226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c69dd0a6c240448ea23867b94b5105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.602198  6154 tablet_service.cc:1511] Processing CreateTablet for tablet b3fe14d690ad43168d833eb7e7c60d8d (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:23.603652  6227 tablet_service.cc:1511] Processing CreateTablet for tablet d03f616cc448403886e32ff890623a14 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:23.610133  6154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fe14d690ad43168d833eb7e7c60d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.605636  6230 tablet_service.cc:1511] Processing CreateTablet for tablet 72d55d74fe6e4a84ba7162db97c40a41 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:23.600807  6153 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec2790c669f414cb9c6f234631f9eff (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:23.596223  6152 tablet_service.cc:1511] Processing CreateTablet for tablet d03f616cc448403886e32ff890623a14 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:23.599406  6150 tablet_service.cc:1511] Processing CreateTablet for tablet 37c161ae65b746a8926d7ea53a3206b9 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:23.620615  6153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec2790c669f414cb9c6f234631f9eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.619573  6227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03f616cc448403886e32ff890623a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.620474  6224 tablet_service.cc:1511] Processing CreateTablet for tablet f50f534426eb41c4bf42432aff145c02 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:23.624572  6230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d55d74fe6e4a84ba7162db97c40a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.629319  6152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03f616cc448403886e32ff890623a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.633355  6224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50f534426eb41c4bf42432aff145c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.639258  6150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c161ae65b746a8926d7ea53a3206b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.654090  6303 tablet_service.cc:1511] Processing CreateTablet for tablet b3fe14d690ad43168d833eb7e7c60d8d (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:23.655740  6303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fe14d690ad43168d833eb7e7c60d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.655519  6304 tablet_service.cc:1511] Processing CreateTablet for tablet 72d55d74fe6e4a84ba7162db97c40a41 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:23.656968  6304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d55d74fe6e4a84ba7162db97c40a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.678800  6300 tablet_service.cc:1511] Processing CreateTablet for tablet 30c69dd0a6c240448ea23867b94b5105 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:23.678833  6302 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec2790c669f414cb9c6f234631f9eff (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:23.681190  6357 tablet_bootstrap.cc:492] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850: Bootstrap starting.
I20260709 13:12:23.674218  6299 tablet_service.cc:1511] Processing CreateTablet for tablet 37c161ae65b746a8926d7ea53a3206b9 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:23.685405  6301 tablet_service.cc:1511] Processing CreateTablet for tablet d03f616cc448403886e32ff890623a14 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:23.687063  6298 tablet_service.cc:1511] Processing CreateTablet for tablet f50f534426eb41c4bf42432aff145c02 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:23.707193  6300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c69dd0a6c240448ea23867b94b5105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.712296  6301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03f616cc448403886e32ff890623a14. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:23.712342  6110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:23.720764  6155 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9a983b2fc94b55890c843a6311b151 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:23.722175  6155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9a983b2fc94b55890c843a6311b151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.724438  6223 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9a983b2fc94b55890c843a6311b151 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:23.724833  6302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec2790c669f414cb9c6f234631f9eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.726594  6223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9a983b2fc94b55890c843a6311b151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.730600  6299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c161ae65b746a8926d7ea53a3206b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.748430  6298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50f534426eb41c4bf42432aff145c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.759687  6297 tablet_service.cc:1511] Processing CreateTablet for tablet 8f9a983b2fc94b55890c843a6311b151 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:23.785411  6148 tablet_service.cc:1511] Processing CreateTablet for tablet d489934293c849a79033ddf7345aa8e2 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:23.790153  6148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d489934293c849a79033ddf7345aa8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.812083  6357 tablet_bootstrap.cc:654] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.806591  6358 tablet_bootstrap.cc:492] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1: Bootstrap starting.
I20260709 13:12:23.819886  6297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f9a983b2fc94b55890c843a6311b151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.830480  6229 tablet_service.cc:1511] Processing CreateTablet for tablet d489934293c849a79033ddf7345aa8e2 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:23.831877  6229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d489934293c849a79033ddf7345aa8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.849411  6296 tablet_service.cc:1511] Processing CreateTablet for tablet d489934293c849a79033ddf7345aa8e2 (DEFAULT_TABLE table=test-workload [id=ec94643af073482cb5975632281b6d71]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:23.851907  6296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d489934293c849a79033ddf7345aa8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:23.891896  6359 tablet_bootstrap.cc:492] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4: Bootstrap starting.
I20260709 13:12:23.899221  6358 tablet_bootstrap.cc:654] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.911288  6357 tablet_bootstrap.cc:492] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850: No bootstrap required, opened a new log
I20260709 13:12:23.911827  6357 ts_tablet_manager.cc:1403] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850: Time spent bootstrapping tablet: real 0.236s	user 0.000s	sys 0.022s
I20260709 13:12:23.916693  6358 tablet_bootstrap.cc:492] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1: No bootstrap required, opened a new log
I20260709 13:12:23.922411  6358 ts_tablet_manager.cc:1403] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.006s
I20260709 13:12:23.922852  6359 tablet_bootstrap.cc:654] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.925581  6358 raft_consensus.cc:359] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:23.926374  6358 raft_consensus.cc:385] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.915944  6357 raft_consensus.cc:359] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:23.926724  6358 raft_consensus.cc:740] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.927003  6357 raft_consensus.cc:385] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.927452  6357 raft_consensus.cc:740] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.927562  6358 consensus_queue.cc:260] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:23.935058  6357 consensus_queue.cc:260] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:23.936254  6363 raft_consensus.cc:493] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.936977  6363 raft_consensus.cc:515] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:23.940054  6359 tablet_bootstrap.cc:492] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4: No bootstrap required, opened a new log
I20260709 13:12:23.940659  6359 ts_tablet_manager.cc:1403] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.009s
I20260709 13:12:23.942740  6190 heartbeater.cc:499] Master 127.5.227.190:42631 was elected leader, sending a full tablet report...
I20260709 13:12:23.944820  6265 heartbeater.cc:499] Master 127.5.227.190:42631 was elected leader, sending a full tablet report...
I20260709 13:12:23.943446  6357 ts_tablet_manager.cc:1434] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.009s
I20260709 13:12:23.950215  6357 tablet_bootstrap.cc:492] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850: Bootstrap starting.
I20260709 13:12:23.953119  6358 ts_tablet_manager.cc:1434] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.015s
I20260709 13:12:23.954238  6358 tablet_bootstrap.cc:492] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1: Bootstrap starting.
I20260709 13:12:23.961436  6358 tablet_bootstrap.cc:654] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.962090  6357 tablet_bootstrap.cc:654] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.965075  6359 raft_consensus.cc:359] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:23.965896  6359 raft_consensus.cc:385] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.966224  6359 raft_consensus.cc:740] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.967115  6363 leader_election.cc:290] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:23.967021  6359 consensus_queue.cc:260] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:23.972785  6339 heartbeater.cc:499] Master 127.5.227.190:42631 was elected leader, sending a full tablet report...
I20260709 13:12:23.972784  6359 ts_tablet_manager.cc:1434] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:12:23.981001  6359 tablet_bootstrap.cc:492] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4: Bootstrap starting.
I20260709 13:12:23.985740  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
W20260709 13:12:23.992913  6131 leader_election.cc:343] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.004621  6359 tablet_bootstrap.cc:654] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.012149  6358 tablet_bootstrap.cc:492] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1: No bootstrap required, opened a new log
I20260709 13:12:24.012708  6358 ts_tablet_manager.cc:1403] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent bootstrapping tablet: real 0.059s	user 0.031s	sys 0.016s
W20260709 13:12:24.013345  6191 tablet.cc:2406] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:24.017138  6314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
W20260709 13:12:24.022915  6130 leader_election.cc:343] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.027505  6358 raft_consensus.cc:359] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.028615  6358 raft_consensus.cc:385] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.023452  6130 leader_election.cc:304] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0993a7f6a0e845038f017bf489411850; no voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.028975  6358 raft_consensus.cc:740] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.029739  6363 raft_consensus.cc:2749] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.030045  6358 consensus_queue.cc:260] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.032852  6358 ts_tablet_manager.cc:1434] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 13:12:24.036202  6358 tablet_bootstrap.cc:492] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1: Bootstrap starting.
I20260709 13:12:24.040465  6357 tablet_bootstrap.cc:492] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850: No bootstrap required, opened a new log
I20260709 13:12:24.042136  6357 ts_tablet_manager.cc:1403] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850: Time spent bootstrapping tablet: real 0.092s	user 0.035s	sys 0.023s
I20260709 13:12:24.044994  6358 tablet_bootstrap.cc:654] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.045558  6357 raft_consensus.cc:359] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.046464  6357 raft_consensus.cc:385] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.046896  6357 raft_consensus.cc:740] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.047927  6357 consensus_queue.cc:260] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.050401  6357 ts_tablet_manager.cc:1434] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:12:24.050704  6359 tablet_bootstrap.cc:492] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4: No bootstrap required, opened a new log
I20260709 13:12:24.051365  6359 ts_tablet_manager.cc:1403] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.004s
I20260709 13:12:24.051527  6357 tablet_bootstrap.cc:492] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850: Bootstrap starting.
I20260709 13:12:24.056474  6359 raft_consensus.cc:359] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:24.057225  6359 raft_consensus.cc:385] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.057440  6358 tablet_bootstrap.cc:492] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1: No bootstrap required, opened a new log
I20260709 13:12:24.057552  6359 raft_consensus.cc:740] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.057953  6358 ts_tablet_manager.cc:1403] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.006s
I20260709 13:12:24.058544  6359 consensus_queue.cc:260] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:24.060859  6359 ts_tablet_manager.cc:1434] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:24.061280  6358 raft_consensus.cc:359] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.061784  6359 tablet_bootstrap.cc:492] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4: Bootstrap starting.
I20260709 13:12:24.061995  6358 raft_consensus.cc:385] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.062320  6358 raft_consensus.cc:740] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.063644  6358 consensus_queue.cc:260] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.066275  6358 ts_tablet_manager.cc:1434] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:12:24.067262  6358 tablet_bootstrap.cc:492] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1: Bootstrap starting.
I20260709 13:12:24.074131  6358 tablet_bootstrap.cc:654] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.076151  6359 tablet_bootstrap.cc:654] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.059648  6357 tablet_bootstrap.cc:654] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.077919  6363 raft_consensus.cc:493] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.078414  6363 raft_consensus.cc:515] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.080767  6363 leader_election.cc:290] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.086969  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:24.089690  6314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
W20260709 13:12:24.091913  6130 leader_election.cc:343] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:24.093595  6131 leader_election.cc:343] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.094393  6359 tablet_bootstrap.cc:492] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4: No bootstrap required, opened a new log
I20260709 13:12:24.094230  6131 leader_election.cc:304] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0993a7f6a0e845038f017bf489411850; no voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.095131  6359 ts_tablet_manager.cc:1403] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.011s
I20260709 13:12:24.095472  6363 raft_consensus.cc:2749] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.098975  6359 raft_consensus.cc:359] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.100075  6359 raft_consensus.cc:385] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.100715  6359 raft_consensus.cc:740] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.102057  6359 consensus_queue.cc:260] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.104592  6359 ts_tablet_manager.cc:1434] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:24.105259  6358 tablet_bootstrap.cc:492] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1: No bootstrap required, opened a new log
I20260709 13:12:24.105588  6359 tablet_bootstrap.cc:492] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4: Bootstrap starting.
I20260709 13:12:24.105738  6358 ts_tablet_manager.cc:1403] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.010s
I20260709 13:12:24.109202  6358 raft_consensus.cc:359] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.110076  6358 raft_consensus.cc:385] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.110404  6358 raft_consensus.cc:740] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.111244  6358 consensus_queue.cc:260] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.114019  6358 ts_tablet_manager.cc:1434] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:12:24.115079  6358 tablet_bootstrap.cc:492] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1: Bootstrap starting.
I20260709 13:12:24.122444  6358 tablet_bootstrap.cc:654] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.123740  6357 tablet_bootstrap.cc:492] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850: No bootstrap required, opened a new log
I20260709 13:12:24.124336  6357 ts_tablet_manager.cc:1403] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.018s
I20260709 13:12:24.127004  6359 tablet_bootstrap.cc:654] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.130375  6358 tablet_bootstrap.cc:492] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1: No bootstrap required, opened a new log
I20260709 13:12:24.130198  6357 raft_consensus.cc:359] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.131007  6358 ts_tablet_manager.cc:1403] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:12:24.131018  6357 raft_consensus.cc:385] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.131539  6357 raft_consensus.cc:740] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.132236  6357 consensus_queue.cc:260] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.133981  6357 ts_tablet_manager.cc:1434] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:12:24.134310  6358 raft_consensus.cc:359] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.134881  6357 tablet_bootstrap.cc:492] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850: Bootstrap starting.
I20260709 13:12:24.135190  6358 raft_consensus.cc:385] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.135565  6358 raft_consensus.cc:740] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.136332  6358 consensus_queue.cc:260] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.137003  6359 tablet_bootstrap.cc:492] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4: No bootstrap required, opened a new log
I20260709 13:12:24.137848  6359 ts_tablet_manager.cc:1403] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.004s
I20260709 13:12:24.138785  6358 ts_tablet_manager.cc:1434] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:12:24.139814  6358 tablet_bootstrap.cc:492] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1: Bootstrap starting.
I20260709 13:12:24.141062  6359 raft_consensus.cc:359] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.142004  6359 raft_consensus.cc:385] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.142489  6359 raft_consensus.cc:740] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.143548  6359 consensus_queue.cc:260] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.144906  6357 tablet_bootstrap.cc:654] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.148841  6359 ts_tablet_manager.cc:1434] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:12:24.150308  6359 tablet_bootstrap.cc:492] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4: Bootstrap starting.
I20260709 13:12:24.151556  6358 tablet_bootstrap.cc:654] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.163914  6357 tablet_bootstrap.cc:492] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850: No bootstrap required, opened a new log
I20260709 13:12:24.164469  6357 ts_tablet_manager.cc:1403] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.008s
I20260709 13:12:24.165709  6358 tablet_bootstrap.cc:492] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1: No bootstrap required, opened a new log
I20260709 13:12:24.166275  6358 ts_tablet_manager.cc:1403] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.009s
I20260709 13:12:24.167636  6357 raft_consensus.cc:359] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.168471  6357 raft_consensus.cc:385] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.168790  6357 raft_consensus.cc:740] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.169479  6358 raft_consensus.cc:359] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.169584  6357 consensus_queue.cc:260] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.170308  6358 raft_consensus.cc:385] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.170439  6359 tablet_bootstrap.cc:654] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.170781  6358 raft_consensus.cc:740] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.171721  6358 consensus_queue.cc:260] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.172302  6357 ts_tablet_manager.cc:1434] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:24.173442  6357 tablet_bootstrap.cc:492] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850: Bootstrap starting.
I20260709 13:12:24.174469  6358 ts_tablet_manager.cc:1434] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:12:24.175566  6358 tablet_bootstrap.cc:492] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1: Bootstrap starting.
I20260709 13:12:24.182313  6358 tablet_bootstrap.cc:654] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.182648  6357 tablet_bootstrap.cc:654] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.186403  6359 tablet_bootstrap.cc:492] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4: No bootstrap required, opened a new log
I20260709 13:12:24.187040  6359 ts_tablet_manager.cc:1403] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.007s
I20260709 13:12:24.191186  6359 raft_consensus.cc:359] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.192317  6359 raft_consensus.cc:385] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.192767  6359 raft_consensus.cc:740] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.193826  6359 consensus_queue.cc:260] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.196412  6357 tablet_bootstrap.cc:492] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850: No bootstrap required, opened a new log
I20260709 13:12:24.196910  6357 ts_tablet_manager.cc:1403] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.003s
I20260709 13:12:24.200037  6357 raft_consensus.cc:359] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.200817  6357 raft_consensus.cc:385] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.201104  6357 raft_consensus.cc:740] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.201821  6357 consensus_queue.cc:260] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.203958  6359 ts_tablet_manager.cc:1434] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:12:24.205212  6357 ts_tablet_manager.cc:1434] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:24.206220  6357 tablet_bootstrap.cc:492] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850: Bootstrap starting.
I20260709 13:12:24.207485  6369 raft_consensus.cc:493] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.208001  6369 raft_consensus.cc:515] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.208899  6358 tablet_bootstrap.cc:492] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1: No bootstrap required, opened a new log
I20260709 13:12:24.209404  6358 ts_tablet_manager.cc:1403] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.009s
I20260709 13:12:24.210127  6364 raft_consensus.cc:493] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.210651  6364 raft_consensus.cc:515] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.212404  6363 raft_consensus.cc:493] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.212937  6363 raft_consensus.cc:515] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.213374  6364 leader_election.cc:290] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.220608  6369 leader_election.cc:290] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:24.223031  6363 leader_election.cc:290] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.227602  6357 tablet_bootstrap.cc:654] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.223560  6359 tablet_bootstrap.cc:492] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4: Bootstrap starting.
I20260709 13:12:24.233038  6314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f534426eb41c4bf42432aff145c02" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
I20260709 13:12:24.242693  6314 raft_consensus.cc:2468] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 0.
I20260709 13:12:24.244462  6130 leader_election.cc:304] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:24.244727  6358 raft_consensus.cc:359] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.245436  6358 raft_consensus.cc:385] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.245368  6363 raft_consensus.cc:2804] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.245932  6358 raft_consensus.cc:740] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.246064  6363 raft_consensus.cc:493] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.246595  6363 raft_consensus.cc:3060] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.246762  6358 consensus_queue.cc:260] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.263007  6369 raft_consensus.cc:493] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.263581  6369 raft_consensus.cc:515] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.266065  6369 leader_election.cc:290] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:24.268455  6358 ts_tablet_manager.cc:1434] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.001s
I20260709 13:12:24.269840  6358 tablet_bootstrap.cc:492] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1: Bootstrap starting.
I20260709 13:12:24.275002  6363 raft_consensus.cc:515] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.283870  6363 leader_election.cc:290] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.285290  6314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f534426eb41c4bf42432aff145c02" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:24.285929  6314 raft_consensus.cc:3060] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.294488  6314 raft_consensus.cc:2468] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 1.
I20260709 13:12:24.300787  6130 leader_election.cc:304] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:24.305899  6359 tablet_bootstrap.cc:654] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.302016  6363 raft_consensus.cc:2804] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.307363  6363 raft_consensus.cc:697] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 1 LEADER]: Becoming Leader. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:24.308550  6363 consensus_queue.cc:237] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.313320  6358 tablet_bootstrap.cc:654] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.325136  6364 raft_consensus.cc:493] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.326467  6364 raft_consensus.cc:515] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.325663  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f534426eb41c4bf42432aff145c02" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:24.327750  6240 raft_consensus.cc:2468] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 0.
I20260709 13:12:24.332034  6364 leader_election.cc:290] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.359200  6364 raft_consensus.cc:493] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.360001  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:24.359724  6364 raft_consensus.cc:515] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.361964  6239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:24.364856  6240 raft_consensus.cc:2468] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 0.
I20260709 13:12:24.367033  6239 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 0.
I20260709 13:12:24.370903  6358 tablet_bootstrap.cc:492] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1: No bootstrap required, opened a new log
I20260709 13:12:24.371349  6358 ts_tablet_manager.cc:1403] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.011s
I20260709 13:12:24.370457  6364 leader_election.cc:290] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.372519  6280 leader_election.cc:304] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:24.373440  6314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
I20260709 13:12:24.373951  6369 raft_consensus.cc:2804] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.374344  6369 raft_consensus.cc:493] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.375385  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
I20260709 13:12:24.374961  6369 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.375939  6280 leader_election.cc:304] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:24.383199  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
I20260709 13:12:24.385485  6313 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 0.
I20260709 13:12:24.383044  6365 raft_consensus.cc:493] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:24.383075  6205 leader_election.cc:343] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.391366  6164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:24.392521  6364 raft_consensus.cc:493] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.391021  6365 raft_consensus.cc:515] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
W20260709 13:12:24.395205  6278 leader_election.cc:343] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.393174  6364 raft_consensus.cc:515] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.399298  6239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f534426eb41c4bf42432aff145c02" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:24.399917  6239 raft_consensus.cc:3060] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.399827  6205 leader_election.cc:304] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:24.400498  6357 tablet_bootstrap.cc:492] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850: No bootstrap required, opened a new log
I20260709 13:12:24.402841  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:24.407771  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d489934293c849a79033ddf7345aa8e2" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
I20260709 13:12:24.406008  6357 ts_tablet_manager.cc:1403] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850: Time spent bootstrapping tablet: real 0.200s	user 0.018s	sys 0.016s
I20260709 13:12:24.410853  6369 raft_consensus.cc:515] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.405216  6365 leader_election.cc:290] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
W20260709 13:12:24.414450  6278 leader_election.cc:343] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:24.419106  6130 leader_election.cc:343] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.406864  6061 catalog_manager.cc:5697] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0993a7f6a0e845038f017bf489411850 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "0993a7f6a0e845038f017bf489411850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.422516  6314 raft_consensus.cc:2393] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07a287b5d0a24534b4ae9ee9444f59c1 in current term 1: Already voted for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in this term.
I20260709 13:12:24.426265  6369 leader_election.cc:290] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:24.432582  6365 raft_consensus.cc:493] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.435222  6365 raft_consensus.cc:515] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.476438  6358 raft_consensus.cc:359] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:24.477133  6358 raft_consensus.cc:385] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.477382  6358 raft_consensus.cc:740] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.478685  6358 consensus_queue.cc:260] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:24.480945  6358 ts_tablet_manager.cc:1434] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
W20260709 13:12:24.463613  6205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:34845, user_credentials={real_user=slave}} blocked reactor thread for 63824.1us
I20260709 13:12:24.460824  6369 raft_consensus.cc:2804] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.482003  6358 tablet_bootstrap.cc:492] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1: Bootstrap starting.
I20260709 13:12:24.484475  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d489934293c849a79033ddf7345aa8e2" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:24.485343  6240 raft_consensus.cc:2468] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 0.
I20260709 13:12:24.487098  6364 leader_election.cc:290] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.482501  6369 raft_consensus.cc:493] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:24.475873  6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:37685, user_credentials={real_user=slave}} blocked reactor thread for 98738.3us
I20260709 13:12:24.490727  6394 raft_consensus.cc:493] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.491370  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:24.491214  6394 raft_consensus.cc:515] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.493072  6395 raft_consensus.cc:2804] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.491336  6131 leader_election.cc:304] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.496454  6363 raft_consensus.cc:2804] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.496618  6365 leader_election.cc:290] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.496889  6363 raft_consensus.cc:493] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.497278  6363 raft_consensus.cc:3060] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.493628  6395 raft_consensus.cc:493] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.497817  6395 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.498860  6164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:24.489485  6369 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.499217  6394 leader_election.cc:290] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.487090  6357 raft_consensus.cc:359] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.524705  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:24.525369  6240 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.507994  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
I20260709 13:12:24.531678  6392 raft_consensus.cc:493] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.502174  6314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
I20260709 13:12:24.501948  6357 raft_consensus.cc:385] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.532240  6392 raft_consensus.cc:515] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:24.536751  6395 raft_consensus.cc:515] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.538160  6392 leader_election.cc:290] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153)
I20260709 13:12:24.543723  6395 leader_election.cc:290] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.532083  6313 raft_consensus.cc:2468] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 0.
I20260709 13:12:24.544925  6363 raft_consensus.cc:515] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.535264  6357 raft_consensus.cc:740] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.532505  6164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:24.507980  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:24.539748  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:24.548803  6359 tablet_bootstrap.cc:492] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4: No bootstrap required, opened a new log
I20260709 13:12:24.549142  6164 raft_consensus.cc:2468] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 0.
I20260709 13:12:24.548736  6312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
I20260709 13:12:24.549755  6359 ts_tablet_manager.cc:1403] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent bootstrapping tablet: real 0.326s	user 0.029s	sys 0.013s
I20260709 13:12:24.552222  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:24.549151  6165 raft_consensus.cc:2468] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 0.
I20260709 13:12:24.507571  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
W20260709 13:12:24.557134  6204 leader_election.cc:343] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.558702  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:24.558883  6238 raft_consensus.cc:2468] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 0.
I20260709 13:12:24.558948  6204 leader_election.cc:304] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1; no voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.561365  6312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d489934293c849a79033ddf7345aa8e2" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:24.558373  6363 leader_election.cc:290] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.562259  6204 leader_election.cc:304] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 
I20260709 13:12:24.562534  6237 raft_consensus.cc:2468] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 0.
W20260709 13:12:24.562826  6130 leader_election.cc:343] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.563112  6394 raft_consensus.cc:2804] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.563520  6394 raft_consensus.cc:493] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.555114  6239 raft_consensus.cc:2468] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 1.
I20260709 13:12:24.563894  6394 raft_consensus.cc:3060] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.565481  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d489934293c849a79033ddf7345aa8e2" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:24.565825  6359 raft_consensus.cc:359] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.566771  6237 raft_consensus.cc:3060] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.566915  6359 raft_consensus.cc:385] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.562531  6358 tablet_bootstrap.cc:654] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.567305  6359 raft_consensus.cc:740] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.560645  6357 consensus_queue.cc:260] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.569748  6163 raft_consensus.cc:2468] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 0.
I20260709 13:12:24.567461  6369 raft_consensus.cc:515] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
W20260709 13:12:24.572973  6205 leader_election.cc:343] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.568336  6359 consensus_queue.cc:260] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.573666  6369 leader_election.cc:290] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
W20260709 13:12:24.572938  6278 leader_election.cc:343] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.576133  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:24.577157  6204 leader_election.cc:304] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.577464  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:24.578131  6162 raft_consensus.cc:2468] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 0.
I20260709 13:12:24.578246  6237 raft_consensus.cc:2468] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 1.
W20260709 13:12:24.578378  6204 leader_election.cc:343] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.578613  6359 ts_tablet_manager.cc:1434] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 13:12:24.579226  6312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:24.579849  6359 tablet_bootstrap.cc:492] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4: Bootstrap starting.
I20260709 13:12:24.579958  6312 raft_consensus.cc:2393] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 07a287b5d0a24534b4ae9ee9444f59c1 in current term 1: Already voted for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in this term.
I20260709 13:12:24.581928  6394 raft_consensus.cc:515] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.584270  6396 raft_consensus.cc:2804] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.584149  6131 leader_election.cc:304] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.584704  6396 raft_consensus.cc:493] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.585052  6396 raft_consensus.cc:3060] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.586014  6363 raft_consensus.cc:2804] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.586162  6131 leader_election.cc:304] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.587018  6363 raft_consensus.cc:493] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.587635  6365 raft_consensus.cc:2804] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.571573  6240 raft_consensus.cc:2468] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 1.
I20260709 13:12:24.589746  6363 raft_consensus.cc:3060] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.590930  6312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
W20260709 13:12:24.591276  6204 leader_election.cc:343] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.591579  6312 raft_consensus.cc:3060] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.591750  6204 leader_election.cc:304] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1; no voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.596884  6364 raft_consensus.cc:2749] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.586302  6394 leader_election.cc:290] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.574978  6280 leader_election.cc:304] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:24.593360  6395 raft_consensus.cc:2749] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.602149  6204 leader_election.cc:304] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.606580  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:24.606963  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:24.610606  6312 raft_consensus.cc:2468] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 1.
I20260709 13:12:24.613835  6205 leader_election.cc:304] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:24.607372  6369 raft_consensus.cc:2804] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.614825  6364 raft_consensus.cc:2804] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.614864  6369 raft_consensus.cc:493] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:24.614022  6278 leader_election.cc:343] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.617617  6369 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.619596  6364 raft_consensus.cc:697] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Becoming Leader. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:24.616897  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:24.615661  6394 raft_consensus.cc:2804] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.617262  6365 raft_consensus.cc:697] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 1 LEADER]: Becoming Leader. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:24.623452  6392 raft_consensus.cc:493] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.624172  6392 raft_consensus.cc:515] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.621601  6394 raft_consensus.cc:493] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.626015  6394 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.623479  6240 raft_consensus.cc:2393] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in current term 1: Already voted for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in this term.
I20260709 13:12:24.626605  6364 consensus_queue.cc:237] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.621258  6280 leader_election.cc:304] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 0993a7f6a0e845038f017bf489411850
I20260709 13:12:24.655339  6357 ts_tablet_manager.cc:1434] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850: Time spent starting tablet: real 0.243s	user 0.010s	sys 0.031s
I20260709 13:12:24.656845  6357 tablet_bootstrap.cc:492] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850: Bootstrap starting.
I20260709 13:12:24.660583  6359 tablet_bootstrap.cc:654] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:24.666555  6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:37685, user_credentials={real_user=slave}} blocked reactor thread for 46443.6us
I20260709 13:12:24.673102  6358 tablet_bootstrap.cc:492] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1: No bootstrap required, opened a new log
I20260709 13:12:24.673197  6392 leader_election.cc:290] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:24.673616  6358 ts_tablet_manager.cc:1403] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent bootstrapping tablet: real 0.192s	user 0.020s	sys 0.016s
I20260709 13:12:24.673813  6392 raft_consensus.cc:2804] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.667065  6396 raft_consensus.cc:515] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.667519  6280 leader_election.cc:304] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850
I20260709 13:12:24.676817  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:24.677477  6162 raft_consensus.cc:2468] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 0.
I20260709 13:12:24.677547  6358 raft_consensus.cc:359] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.678251  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:24.678859  6278 leader_election.cc:304] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:24.678285  6358 raft_consensus.cc:385] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.681934  6358 raft_consensus.cc:740] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.666143  6365 consensus_queue.cc:237] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.696724  6358 consensus_queue.cc:260] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.698222  6392 raft_consensus.cc:697] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:24.699148  6392 consensus_queue.cc:237] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.700102  6240 raft_consensus.cc:2393] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in current term 1: Already voted for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in this term.
I20260709 13:12:24.702255  6358 ts_tablet_manager.cc:1434] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.010s
I20260709 13:12:24.695596  6369 raft_consensus.cc:515] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:24.708480  6363 raft_consensus.cc:515] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.716393  6402 raft_consensus.cc:2749] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.716439  6163 raft_consensus.cc:2393] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 07a287b5d0a24534b4ae9ee9444f59c1 in current term 1: Already voted for candidate 0993a7f6a0e845038f017bf489411850 in this term.
I20260709 13:12:24.719803  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:24.721611  6396 leader_election.cc:290] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.718395  6059 catalog_manager.cc:5697] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.722560  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:24.726202  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:24.726773  6369 leader_election.cc:290] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153)
I20260709 13:12:24.723965  6312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:24.726819  6240 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.726318  6163 raft_consensus.cc:3060] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.722698  6357 tablet_bootstrap.cc:654] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.722440  6363 leader_election.cc:290] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.729498  6312 raft_consensus.cc:2393] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0993a7f6a0e845038f017bf489411850 in current term 1: Already voted for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in this term.
I20260709 13:12:24.717581  6407 raft_consensus.cc:2804] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.727196  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:24.730841  6407 raft_consensus.cc:493] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.731245  6407 raft_consensus.cc:3060] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.720031  6394 raft_consensus.cc:515] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.732327  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:24.733335  6130 leader_election.cc:304] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0993a7f6a0e845038f017bf489411850; no voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.733865  6162 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.740643  6363 raft_consensus.cc:2749] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.760735  6394 leader_election.cc:290] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.759199  6060 catalog_manager.cc:5697] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.761747  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:24.762710  6165 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.763167  6312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
W20260709 13:12:24.765012  6205 leader_election.cc:343] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.770372  6162 raft_consensus.cc:2468] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 1.
I20260709 13:12:24.771711  6278 leader_election.cc:304] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:24.774847  6392 raft_consensus.cc:2804] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.775496  6392 raft_consensus.cc:697] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:24.759385  6240 raft_consensus.cc:2468] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 1.
W20260709 13:12:24.780344  6110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:24.776386  6407 raft_consensus.cc:515] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.781606  6313 raft_consensus.cc:2393] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 07a287b5d0a24534b4ae9ee9444f59c1 in current term 1: Already voted for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in this term.
I20260709 13:12:24.787240  6163 raft_consensus.cc:2468] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 1.
I20260709 13:12:24.790174  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:24.790488  6204 leader_election.cc:304] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.791374  6162 raft_consensus.cc:2393] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in current term 1: Already voted for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in this term.
I20260709 13:12:24.791810  6394 raft_consensus.cc:2804] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.792356  6394 raft_consensus.cc:697] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Becoming Leader. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:24.776543  6392 consensus_queue.cc:237] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:24.793185  6394 consensus_queue.cc:237] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.794091  6165 raft_consensus.cc:2468] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 1.
I20260709 13:12:24.798539  6407 leader_election.cc:290] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:24.806746  6363 consensus_queue.cc:1048] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:24.807457  6204 leader_election.cc:304] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:24.809001  6396 raft_consensus.cc:2804] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.809681  6396 raft_consensus.cc:697] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Becoming Leader. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:24.810803  6396 consensus_queue.cc:237] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.816846  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:24.819414  6359 tablet_bootstrap.cc:492] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4: No bootstrap required, opened a new log
I20260709 13:12:24.806085  6059 catalog_manager.cc:5697] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0993a7f6a0e845038f017bf489411850 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "0993a7f6a0e845038f017bf489411850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.827497  6359 ts_tablet_manager.cc:1403] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent bootstrapping tablet: real 0.248s	user 0.015s	sys 0.010s
I20260709 13:12:24.837666  6280 leader_election.cc:304] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850
I20260709 13:12:24.838804  6407 raft_consensus.cc:2749] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:24.841939  6359 raft_consensus.cc:359] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.842950  6359 raft_consensus.cc:385] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.843286  6359 raft_consensus.cc:740] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.846328  6359 consensus_queue.cc:260] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.830019  6357 tablet_bootstrap.cc:492] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850: No bootstrap required, opened a new log
I20260709 13:12:24.855129  6357 ts_tablet_manager.cc:1403] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850: Time spent bootstrapping tablet: real 0.199s	user 0.022s	sys 0.031s
I20260709 13:12:24.860095  6359 ts_tablet_manager.cc:1434] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:12:24.861737  6359 tablet_bootstrap.cc:492] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4: Bootstrap starting.
I20260709 13:12:24.870427  6059 catalog_manager.cc:5697] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.875234  6357 raft_consensus.cc:359] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.874924  6060 catalog_manager.cc:5697] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.875984  6357 raft_consensus.cc:385] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.876312  6357 raft_consensus.cc:740] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.879253  6357 consensus_queue.cc:260] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.887703  6359 tablet_bootstrap.cc:654] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.889140  6357 ts_tablet_manager.cc:1434] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:12:24.898088  6396 raft_consensus.cc:493] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.898844  6357 tablet_bootstrap.cc:492] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850: Bootstrap starting.
I20260709 13:12:24.898600  6396 raft_consensus.cc:515] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.900774  6396 leader_election.cc:290] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.902591  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9a983b2fc94b55890c843a6311b151" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:24.903357  6165 raft_consensus.cc:2468] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 0.
I20260709 13:12:24.904189  6365 consensus_queue.cc:1048] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.905921  6357 tablet_bootstrap.cc:654] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.908136  6312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9a983b2fc94b55890c843a6311b151" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
I20260709 13:12:24.910599  6204 leader_election.cc:304] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 
I20260709 13:12:24.911691  6394 raft_consensus.cc:2804] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:24.912075  6394 raft_consensus.cc:493] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.912415  6394 raft_consensus.cc:3060] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:24.915298  6205 leader_election.cc:343] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:24.917100  6359 tablet_bootstrap.cc:492] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4: No bootstrap required, opened a new log
I20260709 13:12:24.917567  6359 ts_tablet_manager.cc:1403] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.003s
I20260709 13:12:24.921598  6394 raft_consensus.cc:515] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.924453  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9a983b2fc94b55890c843a6311b151" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:24.925102  6165 raft_consensus.cc:3060] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.928627  6359 raft_consensus.cc:359] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.929353  6359 raft_consensus.cc:385] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.929764  6359 raft_consensus.cc:740] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.929373  6062 catalog_manager.cc:5697] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.930442  6359 consensus_queue.cc:260] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.932080  6165 raft_consensus.cc:2468] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 1.
I20260709 13:12:24.934216  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9a983b2fc94b55890c843a6311b151" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:24.934917  6313 raft_consensus.cc:3060] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:24.935490  6204 leader_election.cc:304] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 
I20260709 13:12:24.936398  6396 raft_consensus.cc:2804] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:24.936851  6396 raft_consensus.cc:697] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Becoming Leader. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:24.937633  6396 consensus_queue.cc:237] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.938567  6357 tablet_bootstrap.cc:492] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850: No bootstrap required, opened a new log
I20260709 13:12:24.939047  6357 ts_tablet_manager.cc:1403] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.000s
I20260709 13:12:24.941287  6394 leader_election.cc:290] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 1 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:24.941857  6359 ts_tablet_manager.cc:1434] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:12:24.942830  6359 tablet_bootstrap.cc:492] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4: Bootstrap starting.
I20260709 13:12:24.947917  6313 raft_consensus.cc:2468] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 1.
I20260709 13:12:24.948416  6357 raft_consensus.cc:359] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.949132  6357 raft_consensus.cc:385] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.949400  6357 raft_consensus.cc:740] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.950191  6357 consensus_queue.cc:260] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.952234  6357 ts_tablet_manager.cc:1434] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:12:24.953159  6062 catalog_manager.cc:5697] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.954360  6359 tablet_bootstrap.cc:654] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.955295  6357 tablet_bootstrap.cc:492] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850: Bootstrap starting.
I20260709 13:12:24.964695  6357 tablet_bootstrap.cc:654] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:24.976128  6357 tablet_bootstrap.cc:492] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850: No bootstrap required, opened a new log
I20260709 13:12:24.976723  6357 ts_tablet_manager.cc:1403] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 13:12:24.979431  6357 raft_consensus.cc:359] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.980094  6357 raft_consensus.cc:385] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.980367  6357 raft_consensus.cc:740] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.981252  6357 consensus_queue.cc:260] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.983417  6357 ts_tablet_manager.cc:1434] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:24.985855  6359 tablet_bootstrap.cc:492] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4: No bootstrap required, opened a new log
I20260709 13:12:24.986344  6359 ts_tablet_manager.cc:1403] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.008s
I20260709 13:12:24.989159  6359 raft_consensus.cc:359] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.989622  6359 raft_consensus.cc:385] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:24.989801  6359 raft_consensus.cc:740] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.990391  6359 consensus_queue.cc:260] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:24.994266  6359 ts_tablet_manager.cc:1434] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:25.009644  6392 raft_consensus.cc:493] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.010216  6392 raft_consensus.cc:515] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:25.012395  6392 leader_election.cc:290] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:25.013303  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:25.013441  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:25.014122  6165 raft_consensus.cc:2393] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in current term 1: Already voted for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in this term.
I20260709 13:12:25.015183  6278 leader_election.cc:304] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850
I20260709 13:12:25.015956  6392 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.022239  6392 raft_consensus.cc:2749] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.052443  6365 raft_consensus.cc:493] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.053001  6365 raft_consensus.cc:515] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:25.055160  6365 leader_election.cc:290] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:25.055905  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:25.056608  6237 raft_consensus.cc:2393] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0993a7f6a0e845038f017bf489411850 in current term 1: Already voted for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in this term.
I20260709 13:12:25.056394  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" is_pre_election: true
I20260709 13:12:25.057250  6313 raft_consensus.cc:2393] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0993a7f6a0e845038f017bf489411850 in current term 1: Already voted for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in this term.
I20260709 13:12:25.058411  6130 leader_election.cc:304] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0993a7f6a0e845038f017bf489411850; no voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:25.059222  6365 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.063850  6365 raft_consensus.cc:2749] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.074126  6396 consensus_queue.cc:1048] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.083567  6364 consensus_queue.cc:1048] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.132835  6392 raft_consensus.cc:493] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.133394  6392 raft_consensus.cc:515] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:25.135619  6392 leader_election.cc:290] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:25.137022  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d489934293c849a79033ddf7345aa8e2" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:25.137022  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d489934293c849a79033ddf7345aa8e2" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:25.138072  6237 raft_consensus.cc:2393] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in current term 1: Already voted for candidate 0993a7f6a0e845038f017bf489411850 in this term.
I20260709 13:12:25.138095  6163 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.139390  6280 leader_election.cc:304] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850
I20260709 13:12:25.140200  6407 raft_consensus.cc:3060] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:25.145035  6407 raft_consensus.cc:2749] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:25.146603  6407 consensus_queue.cc:1048] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.158269  6369 consensus_queue.cc:1048] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.195035  6369 consensus_queue.cc:1048] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.209187  6405 consensus_queue.cc:1048] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.271631  6365 consensus_queue.cc:1048] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.283696  6401 consensus_queue.cc:1048] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:25.302731  6364 consensus_queue.cc:1048] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.319692  6394 consensus_queue.cc:1048] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.369801  6364 consensus_queue.cc:1048] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.383839  6395 consensus_queue.cc:1048] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.394063  6395 consensus_queue.cc:1048] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:25.406977  6395 consensus_queue.cc:1048] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:25.787317  6110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:26.352654  6405 raft_consensus.cc:493] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.353116  6405 raft_consensus.cc:515] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:26.356678  6405 leader_election.cc:290] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:26.356949  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850" is_pre_election: true
I20260709 13:12:26.357239  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" is_pre_election: true
I20260709 13:12:26.357589  6163 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 1.
I20260709 13:12:26.357844  6237 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 1.
I20260709 13:12:26.358775  6278 leader_election.cc:304] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:26.359434  6405 raft_consensus.cc:2804] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:26.359769  6405 raft_consensus.cc:493] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.360050  6405 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:26.364677  6405 raft_consensus.cc:515] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:26.366278  6405 leader_election.cc:290] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:26.367304  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:26.367479  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:26.367897  6237 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:26.368022  6163 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:26.372535  6163 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 2.
I20260709 13:12:26.372536  6237 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 2.
I20260709 13:12:26.373679  6278 leader_election.cc:304] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:26.374466  6405 raft_consensus.cc:2804] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:26.375434  6405 raft_consensus.cc:697] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 LEADER]: Becoming Leader. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:26.376268  6405 consensus_queue.cc:237] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:26.383920  6060 catalog_manager.cc:5697] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 reported cstate change: term changed from 0 to 2, leader changed from <none> to 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.960388  6313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41"
dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
mode: GRACEFUL
new_leader_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:12:26.960944  6313 raft_consensus.cc:606] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 LEADER]: Received request to transfer leadership to TS 0993a7f6a0e845038f017bf489411850
I20260709 13:12:26.965756  6313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d"
dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
mode: GRACEFUL
new_leader_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:12:26.966226  6313 raft_consensus.cc:606] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 LEADER]: Received request to transfer leadership to TS 0993a7f6a0e845038f017bf489411850
I20260709 13:12:26.971431  6237 raft_consensus.cc:1275] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Refusing update from remote peer 31e90d2ac36a47c98a7b4af139bb9ee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:26.972750  6405 consensus_queue.cc:1048] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:26.977986  6163 raft_consensus.cc:1275] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Refusing update from remote peer 31e90d2ac36a47c98a7b4af139bb9ee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:26.979632  6405 consensus_queue.cc:1048] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:26.983506  6240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
mode: GRACEFUL
new_leader_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:60008
I20260709 13:12:26.984127  6240 raft_consensus.cc:606] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Received request to transfer leadership to TS 0993a7f6a0e845038f017bf489411850
I20260709 13:12:26.992237  6237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d03f616cc448403886e32ff890623a14"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
mode: GRACEFUL
new_leader_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:60008
I20260709 13:12:26.993147  6237 raft_consensus.cc:606] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Received request to transfer leadership to TS 0993a7f6a0e845038f017bf489411850
I20260709 13:12:27.006897  6313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9"
dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
mode: GRACEFUL
new_leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:12:27.007570  6313 raft_consensus.cc:606] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 LEADER]: Received request to transfer leadership to TS 07a287b5d0a24534b4ae9ee9444f59c1
I20260709 13:12:27.017877  6457 raft_consensus.cc:993] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1: : Instructing follower 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:27.018402  6457 raft_consensus.cc:1081] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Signalling peer 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:27.023027  6163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d03f616cc448403886e32ff890623a14"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:57304
I20260709 13:12:27.023947  6163 raft_consensus.cc:493] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.024428  6163 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.028954  6165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50f534426eb41c4bf42432aff145c02"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
mode: GRACEFUL
new_leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:12:27.029665  6165 raft_consensus.cc:606] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 1 LEADER]: Received request to transfer leadership to TS 07a287b5d0a24534b4ae9ee9444f59c1
I20260709 13:12:27.031075  6163 raft_consensus.cc:515] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.033226  6163 leader_election.cc:290] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:27.033941  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:27.034503  6240 raft_consensus.cc:3055] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.034447  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:27.034924  6240 raft_consensus.cc:740] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:27.035058  6313 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.035734  6240 consensus_queue.cc:260] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.036773  6240 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.039800  6313 raft_consensus.cc:2468] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:27.040930  6130 leader_election.cc:304] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:27.041707  6401 raft_consensus.cc:2804] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.041513  6240 raft_consensus.cc:2468] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:27.043205  6401 raft_consensus.cc:697] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Becoming Leader. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:27.044106  6401 consensus_queue.cc:237] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.045893  6163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d489934293c849a79033ddf7345aa8e2"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
mode: GRACEFUL
new_leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:12:27.046448  6163 raft_consensus.cc:606] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 1 LEADER]: Received request to transfer leadership to TS 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:27.051797  6062 catalog_manager.cc:5697] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 reported cstate change: term changed from 1 to 2, leader changed from 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130) to 0993a7f6a0e845038f017bf489411850 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "0993a7f6a0e845038f017bf489411850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.151806  6454 raft_consensus.cc:993] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4: : Instructing follower 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:27.152266  6441 raft_consensus.cc:1081] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 LEADER]: Signalling peer 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:27.153863  6163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:57290
I20260709 13:12:27.154361  6163 raft_consensus.cc:493] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.154701  6163 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.159082  6163 raft_consensus.cc:515] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.160768  6163 leader_election.cc:290] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:27.161687  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:27.162209  6240 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.162279  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:27.162921  6313 raft_consensus.cc:3055] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.163209  6313 raft_consensus.cc:740] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:27.163866  6313 consensus_queue.cc:260] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.164963  6313 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.167265  6240 raft_consensus.cc:2468] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:27.168380  6131 leader_election.cc:304] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 
I20260709 13:12:27.169215  6401 raft_consensus.cc:2804] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.169631  6401 raft_consensus.cc:697] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Becoming Leader. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:27.170373  6313 raft_consensus.cc:2468] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:27.170343  6401 consensus_queue.cc:237] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.177562  6062 catalog_manager.cc:5697] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 reported cstate change: term changed from 1 to 2, leader changed from 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131) to 0993a7f6a0e845038f017bf489411850 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "0993a7f6a0e845038f017bf489411850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.217211  6454 raft_consensus.cc:993] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4: : Instructing follower 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:27.217618  6441 raft_consensus.cc:1081] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 LEADER]: Signalling peer 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:27.218997  6163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:57290
I20260709 13:12:27.219435  6163 raft_consensus.cc:493] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.219689  6163 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.224277  6163 raft_consensus.cc:515] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:27.225946  6163 leader_election.cc:290] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:27.226773  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:27.227048  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:27.227367  6240 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.227587  6313 raft_consensus.cc:3055] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.227934  6313 raft_consensus.cc:740] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:27.228569  6313 consensus_queue.cc:260] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:27.229498  6313 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.232378  6240 raft_consensus.cc:2468] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:27.233526  6131 leader_election.cc:304] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 
I20260709 13:12:27.234457  6401 raft_consensus.cc:2804] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.234563  6313 raft_consensus.cc:2468] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:27.235036  6401 raft_consensus.cc:697] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Becoming Leader. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:27.235904  6401 consensus_queue.cc:237] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:27.244850  6062 catalog_manager.cc:5697] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 reported cstate change: term changed from 1 to 2, leader changed from 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131) to 0993a7f6a0e845038f017bf489411850 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "0993a7f6a0e845038f017bf489411850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.316476  6459 raft_consensus.cc:993] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850: : Instructing follower 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:27.316992  6401 raft_consensus.cc:1081] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 1 LEADER]: Signalling peer 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:27.318536  6240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f50f534426eb41c4bf42432aff145c02"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:12:27.319175  6240 raft_consensus.cc:493] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.319499  6240 raft_consensus.cc:3060] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.324963  6240 raft_consensus.cc:515] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.326848  6240 leader_election.cc:290] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 2 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:27.327817  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f534426eb41c4bf42432aff145c02" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:27.327769  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50f534426eb41c4bf42432aff145c02" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:27.328504  6163 raft_consensus.cc:3055] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.328469  6313 raft_consensus.cc:3060] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.328924  6163 raft_consensus.cc:740] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:27.329737  6163 consensus_queue.cc:260] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.330950  6163 raft_consensus.cc:3060] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.335453  6313 raft_consensus.cc:2468] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 2.
I20260709 13:12:27.336635  6205 leader_election.cc:304] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:27.337278  6163 raft_consensus.cc:2468] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 2.
I20260709 13:12:27.337329  6457 raft_consensus.cc:2804] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.337803  6457 raft_consensus.cc:697] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 LEADER]: Becoming Leader. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:27.338594  6457 consensus_queue.cc:237] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.345326  6062 catalog_manager.cc:5697] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 reported cstate change: term changed from 1 to 2, leader changed from 0993a7f6a0e845038f017bf489411850 (127.5.227.129) to 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130). New cstate: current_term: 2 leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.350057  6458 raft_consensus.cc:993] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1: : Instructing follower 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:27.350528  6457 raft_consensus.cc:1081] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Signalling peer 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:27.352243  6163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:57304
I20260709 13:12:27.352828  6163 raft_consensus.cc:493] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.353166  6163 raft_consensus.cc:3060] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.357826  6163 raft_consensus.cc:515] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.359442  6163 leader_election.cc:290] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:27.360415  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:27.360489  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:27.361023  6240 raft_consensus.cc:3055] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.361088  6313 raft_consensus.cc:3060] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.361328  6240 raft_consensus.cc:740] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:27.362106  6240 consensus_queue.cc:260] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.363102  6240 raft_consensus.cc:3060] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.367126  6459 raft_consensus.cc:993] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850: : Instructing follower 31e90d2ac36a47c98a7b4af139bb9ee4 to start an election
I20260709 13:12:27.367350  6313 raft_consensus.cc:2468] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:27.367637  6401 raft_consensus.cc:1081] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 1 LEADER]: Signalling peer 31e90d2ac36a47c98a7b4af139bb9ee4 to start an election
I20260709 13:12:27.368571  6130 leader_election.cc:304] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:27.369278  6401 raft_consensus.cc:2804] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.369278  6240 raft_consensus.cc:2468] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:27.369884  6401 raft_consensus.cc:697] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Becoming Leader. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:27.370055  6313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d489934293c849a79033ddf7345aa8e2"
dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
 from {username='slave'} at 127.0.0.1:60460
I20260709 13:12:27.370702  6313 raft_consensus.cc:493] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.370772  6401 consensus_queue.cc:237] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.371150  6313 raft_consensus.cc:3060] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.377364  6313 raft_consensus.cc:515] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.379701  6313 leader_election.cc:290] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:27.379112  6062 catalog_manager.cc:5697] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 reported cstate change: term changed from 1 to 2, leader changed from 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130) to 0993a7f6a0e845038f017bf489411850 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "0993a7f6a0e845038f017bf489411850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.380136  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d489934293c849a79033ddf7345aa8e2" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:27.380313  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d489934293c849a79033ddf7345aa8e2" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:27.380807  6163 raft_consensus.cc:3055] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.380944  6240 raft_consensus.cc:3060] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.381188  6163 raft_consensus.cc:740] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:27.382148  6163 consensus_queue.cc:260] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.383190  6163 raft_consensus.cc:3060] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.387256  6240 raft_consensus.cc:2468] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 2.
I20260709 13:12:27.388584  6280 leader_election.cc:304] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:27.389400  6441 raft_consensus.cc:2804] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.389442  6163 raft_consensus.cc:2468] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 2.
I20260709 13:12:27.390030  6441 raft_consensus.cc:697] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 LEADER]: Becoming Leader. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:27.390937  6441 consensus_queue.cc:237] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.398324  6062 catalog_manager.cc:5697] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 reported cstate change: term changed from 1 to 2, leader changed from 0993a7f6a0e845038f017bf489411850 (127.5.227.129) to 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.429931  6240 raft_consensus.cc:1275] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.431308  6401 consensus_queue.cc:1048] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.442734  6313 raft_consensus.cc:1275] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.445111  6471 consensus_queue.cc:1048] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.469102  6454 raft_consensus.cc:993] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4: : Instructing follower 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:27.469584  6441 raft_consensus.cc:1081] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 LEADER]: Signalling peer 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:27.471105  6240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:54016
I20260709 13:12:27.471637  6240 raft_consensus.cc:493] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.471951  6240 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:27.476974  6240 raft_consensus.cc:515] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.478793  6240 leader_election.cc:290] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 3 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:27.479586  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:27.479892  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:27.480193  6163 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:27.480465  6313 raft_consensus.cc:3055] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:27.480784  6313 raft_consensus.cc:740] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:27.481412  6313 consensus_queue.cc:260] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.482442  6313 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:27.485001  6163 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 3.
I20260709 13:12:27.486120  6204 leader_election.cc:304] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 
I20260709 13:12:27.486877  6457 raft_consensus.cc:2804] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:27.487385  6457 raft_consensus.cc:697] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Becoming Leader. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:27.487524  6313 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 3.
I20260709 13:12:27.488242  6457 consensus_queue.cc:237] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:27.494952  6061 catalog_manager.cc:5697] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 reported cstate change: term changed from 2 to 3, leader changed from 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131) to 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130). New cstate: current_term: 3 leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.652580  6240 raft_consensus.cc:1275] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.653977  6471 consensus_queue.cc:1048] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.662698  6313 raft_consensus.cc:1275] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.664431  6470 consensus_queue.cc:1048] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.749323  6163 raft_consensus.cc:1275] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.750501  6457 consensus_queue.cc:1048] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.752746  6313 raft_consensus.cc:1275] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.754288  6470 consensus_queue.cc:1048] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.757277  6240 raft_consensus.cc:1275] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.759284  6459 consensus_queue.cc:1048] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.760543  6312 raft_consensus.cc:1275] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.763382  6457 consensus_queue.cc:1048] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.774003  6237 raft_consensus.cc:1275] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.777225  6471 consensus_queue.cc:1048] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.779599  6313 raft_consensus.cc:1275] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.781380  6471 consensus_queue.cc:1048] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.832957  6240 raft_consensus.cc:1275] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Refusing update from remote peer 31e90d2ac36a47c98a7b4af139bb9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.834184  6441 consensus_queue.cc:1048] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.843762  6163 raft_consensus.cc:1275] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Refusing update from remote peer 31e90d2ac36a47c98a7b4af139bb9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.845245  6441 consensus_queue.cc:1048] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.876237  6163 raft_consensus.cc:1275] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:27.877337  6458 consensus_queue.cc:1048] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.884861  6313 raft_consensus.cc:1275] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:27.886314  6458 consensus_queue.cc:1048] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.079941  6030 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:12:30.080806  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:30.096952  6240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
mode: GRACEFUL
new_leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
 from {username='slave'} at 127.0.0.1:60012
I20260709 13:12:30.097549  6240 raft_consensus.cc:606] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Received request to transfer leadership to TS 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:30.108228  6165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
mode: GRACEFUL
new_leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
 from {username='slave'} at 127.0.0.1:46478
I20260709 13:12:30.108722  6165 raft_consensus.cc:606] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Received request to transfer leadership to TS 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:30.109864  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:30.110333  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:30.461073  6487 raft_consensus.cc:993] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1: : Instructing follower 31e90d2ac36a47c98a7b4af139bb9ee4 to start an election
I20260709 13:12:30.461701  6492 raft_consensus.cc:1081] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Signalling peer 31e90d2ac36a47c98a7b4af139bb9ee4 to start an election
I20260709 13:12:30.463338  6313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9"
dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:12:30.463794  6313 raft_consensus.cc:493] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:30.464088  6313 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:30.468027  6313 raft_consensus.cc:515] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:30.469573  6313 leader_election.cc:290] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 4 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:30.470404  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:30.470715  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:30.471009  6165 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:30.471267  6240 raft_consensus.cc:3055] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:30.471582  6240 raft_consensus.cc:740] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:30.472229  6240 consensus_queue.cc:260] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:30.473047  6240 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:30.476401  6165 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 4.
I20260709 13:12:30.477599  6240 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 4.
I20260709 13:12:30.477599  6278 leader_election.cc:304] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:30.478559  6486 raft_consensus.cc:2804] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:30.479750  6486 raft_consensus.cc:697] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 LEADER]: Becoming Leader. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:30.480525  6486 consensus_queue.cc:237] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:30.487298  6059 catalog_manager.cc:5697] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 reported cstate change: term changed from 3 to 4, leader changed from 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130) to 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131). New cstate: current_term: 4 leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:30.694832  6491 raft_consensus.cc:993] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850: : Instructing follower 31e90d2ac36a47c98a7b4af139bb9ee4 to start an election
I20260709 13:12:30.695360  6459 raft_consensus.cc:1081] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Signalling peer 31e90d2ac36a47c98a7b4af139bb9ee4 to start an election
I20260709 13:12:30.696956  6313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41"
dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
 from {username='slave'} at 127.0.0.1:60460
I20260709 13:12:30.697393  6313 raft_consensus.cc:493] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:30.697638  6313 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:30.701725  6313 raft_consensus.cc:515] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:30.703291  6313 leader_election.cc:290] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 3 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153)
I20260709 13:12:30.704188  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:30.704365  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:30.704731  6240 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:30.704903  6165 raft_consensus.cc:3055] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:30.705284  6165 raft_consensus.cc:740] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:30.705988  6165 consensus_queue.cc:260] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:30.707058  6165 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:30.709077  6240 raft_consensus.cc:2468] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 3.
I20260709 13:12:30.710110  6280 leader_election.cc:304] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:30.710866  6486 raft_consensus.cc:2804] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:30.711341  6486 raft_consensus.cc:697] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 LEADER]: Becoming Leader. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:30.712462  6165 raft_consensus.cc:2468] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 3.
I20260709 13:12:30.712167  6486 consensus_queue.cc:237] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:30.719254  6059 catalog_manager.cc:5697] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 reported cstate change: term changed from 2 to 3, leader changed from 0993a7f6a0e845038f017bf489411850 (127.5.227.129) to 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.900094  6240 raft_consensus.cc:1275] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Refusing update from remote peer 31e90d2ac36a47c98a7b4af139bb9ee4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:30.901350  6486 consensus_queue.cc:1048] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:30.911583  6165 raft_consensus.cc:1275] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Refusing update from remote peer 31e90d2ac36a47c98a7b4af139bb9ee4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:30.913533  6486 consensus_queue.cc:1048] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:31.111117  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:31.121269  6313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41"
dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
mode: GRACEFUL
new_leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:12:31.121739  6313 raft_consensus.cc:606] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 LEADER]: Received request to transfer leadership to TS 07a287b5d0a24534b4ae9ee9444f59c1
I20260709 13:12:31.126502  6165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
mode: GRACEFUL
new_leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:12:31.127063  6165 raft_consensus.cc:606] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Received request to transfer leadership to TS 07a287b5d0a24534b4ae9ee9444f59c1
I20260709 13:12:31.131685  6165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
mode: GRACEFUL
new_leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:12:31.132352  6165 raft_consensus.cc:606] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Received request to transfer leadership to TS 07a287b5d0a24534b4ae9ee9444f59c1
I20260709 13:12:31.137306  6165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d03f616cc448403886e32ff890623a14"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
mode: GRACEFUL
new_leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:46468
I20260709 13:12:31.137904  6165 raft_consensus.cc:606] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Received request to transfer leadership to TS 07a287b5d0a24534b4ae9ee9444f59c1
I20260709 13:12:31.138796  6240 raft_consensus.cc:1275] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Refusing update from remote peer 31e90d2ac36a47c98a7b4af139bb9ee4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.139961  6486 consensus_queue.cc:1048] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.146056  6493 raft_consensus.cc:993] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4: : Instructing follower 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:31.146776  6486 raft_consensus.cc:1081] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 LEADER]: Signalling peer 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:31.147686  6313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9"
dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
mode: GRACEFUL
new_leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:12:31.148417  6313 raft_consensus.cc:606] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 LEADER]: Received request to transfer leadership to TS 07a287b5d0a24534b4ae9ee9444f59c1
I20260709 13:12:31.148381  6237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:54016
I20260709 13:12:31.149168  6237 raft_consensus.cc:493] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.149539  6237 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:31.155790  6237 raft_consensus.cc:515] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:31.156718  6240 raft_consensus.cc:1240] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Rejecting Update request from peer 31e90d2ac36a47c98a7b4af139bb9ee4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:31.158928  6237 leader_election.cc:290] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 4 election: Requested vote from peers 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845), 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153)
I20260709 13:12:31.158851  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:31.158854  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d55d74fe6e4a84ba7162db97c40a41" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:31.159662  6313 raft_consensus.cc:3055] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:31.159924  6165 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:31.160023  6313 raft_consensus.cc:740] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:31.161912  6506 consensus_queue.cc:1059] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:31.166002  6313 consensus_queue.cc:260] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:31.166798  6313 raft_consensus.cc:3060] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:31.169245  6165 raft_consensus.cc:2468] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 4.
I20260709 13:12:31.169878  6163 raft_consensus.cc:1240] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Rejecting Update request from peer 31e90d2ac36a47c98a7b4af139bb9ee4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:31.170491  6204 leader_election.cc:304] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 
I20260709 13:12:31.171398  6492 raft_consensus.cc:2804] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:31.171447  6313 raft_consensus.cc:2468] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 4.
I20260709 13:12:31.173730  6492 raft_consensus.cc:697] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 LEADER]: Becoming Leader. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:31.174696  6492 consensus_queue.cc:237] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } }
I20260709 13:12:31.180655  6060 catalog_manager.cc:5697] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 reported cstate change: term changed from 3 to 4, leader changed from 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131) to 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130). New cstate: current_term: 4 leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.299507  6459 raft_consensus.cc:993] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850: : Instructing follower 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:31.300426  6509 raft_consensus.cc:1081] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Signalling peer 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:31.302848  6237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:12:31.303428  6237 raft_consensus.cc:493] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.303762  6237 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.309326  6237 raft_consensus.cc:515] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.311300  6237 leader_election.cc:290] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 3 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:31.312659  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:31.313099  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:31.313495  6313 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.313648  6163 raft_consensus.cc:3055] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:31.313977  6163 raft_consensus.cc:740] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:31.315125  6163 consensus_queue.cc:260] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.316861  6163 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.322042  6313 raft_consensus.cc:2468] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 3.
I20260709 13:12:31.323354  6205 leader_election.cc:304] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:31.323887  6163 raft_consensus.cc:2468] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 3.
I20260709 13:12:31.324254  6492 raft_consensus.cc:2804] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:31.324867  6492 raft_consensus.cc:697] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Becoming Leader. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:31.325969  6492 consensus_queue.cc:237] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.328490  6506 raft_consensus.cc:993] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4: : Instructing follower 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:31.329188  6493 raft_consensus.cc:1081] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 LEADER]: Signalling peer 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:31.331351  6237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:54016
I20260709 13:12:31.331899  6237 raft_consensus.cc:493] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.332245  6237 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:31.336071  6060 catalog_manager.cc:5697] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 reported cstate change: term changed from 2 to 3, leader changed from 0993a7f6a0e845038f017bf489411850 (127.5.227.129) to 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130). New cstate: current_term: 3 leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.337661  6237 raft_consensus.cc:515] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.339581  6237 leader_election.cc:290] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 5 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:31.341104  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:31.341842  6163 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:31.347478  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:31.348086  6313 raft_consensus.cc:3055] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:31.348392  6313 raft_consensus.cc:740] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:31.349395  6163 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 5.
I20260709 13:12:31.349236  6313 consensus_queue.cc:260] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.350734  6459 raft_consensus.cc:993] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850: : Instructing follower 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:31.350728  6313 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:31.351105  6204 leader_election.cc:304] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 
I20260709 13:12:31.351392  6509 raft_consensus.cc:1081] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Signalling peer 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:31.352061  6492 raft_consensus.cc:2804] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:31.352697  6492 raft_consensus.cc:697] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 5 LEADER]: Becoming Leader. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:31.353612  6237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d03f616cc448403886e32ff890623a14"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:12:31.354120  6237 raft_consensus.cc:493] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.354539  6237 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.354056  6492 consensus_queue.cc:237] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.357748  6313 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 5.
I20260709 13:12:31.361821  6237 raft_consensus.cc:515] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.364001  6237 leader_election.cc:290] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 3 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:31.364598  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:31.364974  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:31.365278  6163 raft_consensus.cc:3055] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:31.363904  6060 catalog_manager.cc:5697] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 reported cstate change: term changed from 4 to 5, leader changed from 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131) to 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130). New cstate: current_term: 5 leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.365613  6313 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.365715  6163 raft_consensus.cc:740] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:31.366580  6163 consensus_queue.cc:260] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.367662  6163 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.370774  6313 raft_consensus.cc:2468] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 3.
I20260709 13:12:31.371963  6205 leader_election.cc:304] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:31.373103  6163 raft_consensus.cc:2468] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 3.
I20260709 13:12:31.373060  6492 raft_consensus.cc:2804] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:31.373813  6492 raft_consensus.cc:697] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Becoming Leader. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:31.374765  6492 consensus_queue.cc:237] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.382220  6060 catalog_manager.cc:5697] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 reported cstate change: term changed from 2 to 3, leader changed from 0993a7f6a0e845038f017bf489411850 (127.5.227.129) to 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130). New cstate: current_term: 3 leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.394690  6459 raft_consensus.cc:993] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850: : Instructing follower 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:31.395246  6509 raft_consensus.cc:1081] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Signalling peer 07a287b5d0a24534b4ae9ee9444f59c1 to start an election
I20260709 13:12:31.396835  6237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:12:31.397330  6237 raft_consensus.cc:493] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.397655  6237 raft_consensus.cc:3060] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.402268  6237 raft_consensus.cc:515] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.404244  6237 leader_election.cc:290] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 3 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:31.405071  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:31.405350  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2790c669f414cb9c6f234631f9eff" candidate_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:31.405612  6163 raft_consensus.cc:3055] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:31.405959  6163 raft_consensus.cc:740] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:31.405993  6313 raft_consensus.cc:3060] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.406749  6163 consensus_queue.cc:260] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.407768  6163 raft_consensus.cc:3060] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.410504  6313 raft_consensus.cc:2468] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 3.
I20260709 13:12:31.411548  6205 leader_election.cc:304] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:31.412060  6163 raft_consensus.cc:2468] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a287b5d0a24534b4ae9ee9444f59c1 in term 3.
I20260709 13:12:31.412568  6492 raft_consensus.cc:2804] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:31.413093  6492 raft_consensus.cc:697] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Becoming Leader. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:31.413918  6492 consensus_queue.cc:237] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:31.420925  6060 catalog_manager.cc:5697] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 reported cstate change: term changed from 2 to 3, leader changed from 0993a7f6a0e845038f017bf489411850 (127.5.227.129) to 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130). New cstate: current_term: 3 leader_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.601749  6313 raft_consensus.cc:1275] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:31.603027  6492 consensus_queue.cc:1048] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:31.613503  6163 raft_consensus.cc:1275] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:31.615471  6507 consensus_queue.cc:1048] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:31.752292  6163 raft_consensus.cc:1275] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 5 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:31.753501  6507 consensus_queue.cc:1048] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:31.761116  6313 raft_consensus.cc:1275] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 5 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:31.763667  6492 consensus_queue.cc:1048] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:31.766033  6313 raft_consensus.cc:1275] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.768141  6516 consensus_queue.cc:1048] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:31.779798  6163 raft_consensus.cc:1275] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.781445  6517 consensus_queue.cc:1048] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:31.837154  6312 raft_consensus.cc:1275] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.838454  6517 consensus_queue.cc:1048] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.847818  6163 raft_consensus.cc:1275] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.849193  6492 consensus_queue.cc:1048] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.971361  6312 raft_consensus.cc:1275] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.972640  6492 consensus_queue.cc:1048] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:31.981657  6163 raft_consensus.cc:1275] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Refusing update from remote peer 07a287b5d0a24534b4ae9ee9444f59c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:31.983566  6516 consensus_queue.cc:1048] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:33.675648  6261 debug-util.cc:398] Leaking SignalData structure 0x7b0800083240 after lost signal to thread 6033
W20260709 13:12:33.676379  6261 debug-util.cc:398] Leaking SignalData structure 0x7b0800082b00 after lost signal to thread 6096
W20260709 13:12:33.677081  6261 debug-util.cc:398] Leaking SignalData structure 0x7b080017b6e0 after lost signal to thread 6189
W20260709 13:12:33.677954  6261 debug-util.cc:398] Leaking SignalData structure 0x7b08000a1c20 after lost signal to thread 6264
W20260709 13:12:33.678901  6261 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6620 after lost signal to thread 6338
I20260709 13:12:34.267184  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:34.274971  6237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
mode: GRACEFUL
new_leader_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:60012
I20260709 13:12:34.275591  6237 raft_consensus.cc:606] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Received request to transfer leadership to TS 0993a7f6a0e845038f017bf489411850
I20260709 13:12:34.278497  6237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
mode: GRACEFUL
new_leader_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:60012
I20260709 13:12:34.279105  6237 raft_consensus.cc:606] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 5 LEADER]: Received request to transfer leadership to TS 0993a7f6a0e845038f017bf489411850
I20260709 13:12:34.281730  6237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f9a983b2fc94b55890c843a6311b151"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
mode: GRACEFUL
new_leader_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:60012
I20260709 13:12:34.282259  6237 raft_consensus.cc:606] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Received request to transfer leadership to TS 0993a7f6a0e845038f017bf489411850
I20260709 13:12:34.284742  6237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
mode: GRACEFUL
new_leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
 from {username='slave'} at 127.0.0.1:60012
I20260709 13:12:34.285259  6237 raft_consensus.cc:606] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Received request to transfer leadership to TS 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:34.287695  6237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d03f616cc448403886e32ff890623a14"
dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
mode: GRACEFUL
new_leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
 from {username='slave'} at 127.0.0.1:60012
I20260709 13:12:34.288213  6237 raft_consensus.cc:606] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Received request to transfer leadership to TS 31e90d2ac36a47c98a7b4af139bb9ee4
I20260709 13:12:34.289433  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:34.289907  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:34.644515  6517 raft_consensus.cc:993] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1: : Instructing follower 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:34.645066  6528 raft_consensus.cc:1081] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Signalling peer 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:34.646767  6163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f9a983b2fc94b55890c843a6311b151"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:57304
I20260709 13:12:34.647318  6163 raft_consensus.cc:493] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:34.647668  6163 raft_consensus.cc:3060] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.651335  6517 raft_consensus.cc:993] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1: : Instructing follower 31e90d2ac36a47c98a7b4af139bb9ee4 to start an election
I20260709 13:12:34.651902  6517 raft_consensus.cc:1081] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Signalling peer 31e90d2ac36a47c98a7b4af139bb9ee4 to start an election
I20260709 13:12:34.654657  6313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d"
dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:12:34.655292  6313 raft_consensus.cc:493] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:34.655560  6528 raft_consensus.cc:993] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1: : Instructing follower 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:34.655726  6313 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.656046  6517 raft_consensus.cc:1081] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 5 LEADER]: Signalling peer 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:34.656315  6163 raft_consensus.cc:515] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.657915  6165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:57304
I20260709 13:12:34.658460  6165 raft_consensus.cc:493] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:34.658917  6165 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.659080  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9a983b2fc94b55890c843a6311b151" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:34.659701  6237 raft_consensus.cc:3055] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:34.659617  6314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f9a983b2fc94b55890c843a6311b151" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:34.660092  6237 raft_consensus.cc:740] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:34.660447  6314 raft_consensus.cc:3060] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.661012  6237 consensus_queue.cc:260] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.662204  6237 raft_consensus.cc:3060] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.666157  6165 raft_consensus.cc:515] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.668448  6165 leader_election.cc:290] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 6 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:34.669334  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:34.669632  6311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c161ae65b746a8926d7ea53a3206b9" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:34.669914  6240 raft_consensus.cc:3055] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:34.670228  6240 raft_consensus.cc:740] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:34.668104  6314 raft_consensus.cc:2468] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:34.670202  6311 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.671033  6240 consensus_queue.cc:260] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.671875  6130 leader_election.cc:304] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:34.672104  6240 raft_consensus.cc:3060] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.679339  6240 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 6.
I20260709 13:12:34.679515  6311 raft_consensus.cc:2468] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 6.
I20260709 13:12:34.681146  6131 leader_election.cc:304] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 
I20260709 13:12:34.682132  6530 raft_consensus.cc:2804] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:34.660109  6163 leader_election.cc:290] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:34.683224  6313 raft_consensus.cc:515] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.686338  6237 raft_consensus.cc:2468] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:34.688907  6240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:34.689649  6240 raft_consensus.cc:3055] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:34.689993  6240 raft_consensus.cc:740] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:34.691421  6240 consensus_queue.cc:260] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.692721  6240 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.693158  6531 raft_consensus.cc:2804] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:34.695127  6528 raft_consensus.cc:993] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1: : Instructing follower 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:34.696926  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fe14d690ad43168d833eb7e7c60d8d" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:34.697429  6528 raft_consensus.cc:1081] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Signalling peer 0993a7f6a0e845038f017bf489411850 to start an election
I20260709 13:12:34.697455  6163 raft_consensus.cc:3060] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.699463  6165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105"
dest_uuid: "0993a7f6a0e845038f017bf489411850"
 from {username='slave'} at 127.0.0.1:57304
I20260709 13:12:34.700103  6165 raft_consensus.cc:493] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:34.700508  6165 raft_consensus.cc:3060] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.707059  6163 raft_consensus.cc:2468] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 4.
I20260709 13:12:34.708621  6165 raft_consensus.cc:515] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.709195  6278 leader_election.cc:304] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0993a7f6a0e845038f017bf489411850, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:34.710345  6313 leader_election.cc:290] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 4 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:34.710359  6506 raft_consensus.cc:2804] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:34.712693  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:34.713366  6237 raft_consensus.cc:3055] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:34.713722  6237 raft_consensus.cc:740] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:34.714735  6237 consensus_queue.cc:260] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.715943  6237 raft_consensus.cc:3060] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.716353  6240 raft_consensus.cc:2468] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 4.
I20260709 13:12:34.719043  6531 raft_consensus.cc:697] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 6 LEADER]: Becoming Leader. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:34.719696  6506 raft_consensus.cc:697] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 LEADER]: Becoming Leader. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:34.720685  6531 consensus_queue.cc:237] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.721331  6506 consensus_queue.cc:237] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.723697  6237 raft_consensus.cc:2468] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:34.725925  6131 leader_election.cc:304] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 0993a7f6a0e845038f017bf489411850; no voters: 
I20260709 13:12:34.726230  6313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c69dd0a6c240448ea23867b94b5105" candidate_uuid: "0993a7f6a0e845038f017bf489411850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
I20260709 13:12:34.726986  6313 raft_consensus.cc:3060] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:34.727174  6533 raft_consensus.cc:2804] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:34.727325  6530 raft_consensus.cc:697] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Becoming Leader. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:34.727665  6533 raft_consensus.cc:697] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Becoming Leader. State: Replica: 0993a7f6a0e845038f017bf489411850, State: Running, Role: LEADER
I20260709 13:12:34.728536  6530 consensus_queue.cc:237] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.728631  6533 consensus_queue.cc:237] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.724738  6165 leader_election.cc:290] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [CANDIDATE]: Term 2 election: Requested vote from peers 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685), 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131:34845)
I20260709 13:12:34.734578  6313 raft_consensus.cc:2468] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0993a7f6a0e845038f017bf489411850 in term 2.
I20260709 13:12:34.755184  6059 catalog_manager.cc:5697] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 reported cstate change: term changed from 1 to 2, leader changed from 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130) to 0993a7f6a0e845038f017bf489411850 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "0993a7f6a0e845038f017bf489411850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.756409  6529 raft_consensus.cc:993] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1: : Instructing follower 31e90d2ac36a47c98a7b4af139bb9ee4 to start an election
I20260709 13:12:34.754907  6060 catalog_manager.cc:5697] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 reported cstate change: term changed from 3 to 4, leader changed from 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130) to 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131). New cstate: current_term: 4 leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.756891  6528 raft_consensus.cc:1081] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Signalling peer 31e90d2ac36a47c98a7b4af139bb9ee4 to start an election
I20260709 13:12:34.756729  6059 catalog_manager.cc:5697] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 reported cstate change: term changed from 5 to 6, leader changed from 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130) to 0993a7f6a0e845038f017bf489411850 (127.5.227.129). New cstate: current_term: 6 leader_uuid: "0993a7f6a0e845038f017bf489411850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.758720  6313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d03f616cc448403886e32ff890623a14"
dest_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4"
 from {username='slave'} at 127.0.0.1:60470
I20260709 13:12:34.759213  6313 raft_consensus.cc:493] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:34.759518  6313 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.765363  6313 raft_consensus.cc:515] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.767802  6165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0993a7f6a0e845038f017bf489411850"
I20260709 13:12:34.767969  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03f616cc448403886e32ff890623a14" candidate_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "07a287b5d0a24534b4ae9ee9444f59c1"
I20260709 13:12:34.768433  6237 raft_consensus.cc:3055] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:34.768795  6237 raft_consensus.cc:740] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 07a287b5d0a24534b4ae9ee9444f59c1, State: Running, Role: LEADER
I20260709 13:12:34.769598  6237 consensus_queue.cc:260] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.768433  6165 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.772141  6237 raft_consensus.cc:3060] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.779867  6313 leader_election.cc:290] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 4 election: Requested vote from peers 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153), 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685)
I20260709 13:12:34.781932  6237 raft_consensus.cc:2468] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 4.
I20260709 13:12:34.783371  6280 leader_election.cc:304] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a287b5d0a24534b4ae9ee9444f59c1, 31e90d2ac36a47c98a7b4af139bb9ee4; no voters: 
I20260709 13:12:34.784490  6506 raft_consensus.cc:2804] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:34.785012  6506 raft_consensus.cc:697] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 LEADER]: Becoming Leader. State: Replica: 31e90d2ac36a47c98a7b4af139bb9ee4, State: Running, Role: LEADER
I20260709 13:12:34.785836  6506 consensus_queue.cc:237] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } }
I20260709 13:12:34.792927  6165 raft_consensus.cc:2468] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e90d2ac36a47c98a7b4af139bb9ee4 in term 4.
I20260709 13:12:34.801734  6060 catalog_manager.cc:5697] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 reported cstate change: term changed from 3 to 4, leader changed from 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130) to 31e90d2ac36a47c98a7b4af139bb9ee4 (127.5.227.131). New cstate: current_term: 4 leader_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.802389  6059 catalog_manager.cc:5697] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 reported cstate change: term changed from 1 to 2, leader changed from 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130) to 0993a7f6a0e845038f017bf489411850 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "0993a7f6a0e845038f017bf489411850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.194963  6237 raft_consensus.cc:1275] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:35.196393  6531 consensus_queue.cc:1048] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:35.206794  6313 raft_consensus.cc:1275] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:35.210665  6530 consensus_queue.cc:1048] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:35.285619  6165 raft_consensus.cc:1275] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Refusing update from remote peer 31e90d2ac36a47c98a7b4af139bb9ee4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:35.286960  6313 raft_consensus.cc:1275] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:35.287038  6534 consensus_queue.cc:1048] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0993a7f6a0e845038f017bf489411850" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:35.288632  6531 consensus_queue.cc:1048] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:35.290866  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:35.301560  6030 tablet_server.cc:179] TabletServer@127.5.227.129:0 shutting down...
I20260709 13:12:35.303553  6237 raft_consensus.cc:1275] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Refusing update from remote peer 31e90d2ac36a47c98a7b4af139bb9ee4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:12:35.304867  6278 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:35.305970  6506 consensus_queue.cc:1048] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.309019  6311 raft_consensus.cc:1275] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 6 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:35.312927  6530 consensus_queue.cc:1048] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e90d2ac36a47c98a7b4af139bb9ee4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:35.322916  6240 raft_consensus.cc:1275] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 6 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:12:35.326140  6278 consensus_peers.cc:597] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 -> Peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Couldn't send request to peer 0993a7f6a0e845038f017bf489411850. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.326206  6531 consensus_queue.cc:1048] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:12:35.333724  6278 consensus_peers.cc:597] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 -> Peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Couldn't send request to peer 0993a7f6a0e845038f017bf489411850. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.338073  6239 raft_consensus.cc:1275] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Refusing update from remote peer 31e90d2ac36a47c98a7b4af139bb9ee4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:35.340417  6534 consensus_queue.cc:1048] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.349947  6238 raft_consensus.cc:1275] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Refusing update from remote peer 0993a7f6a0e845038f017bf489411850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:35.352214  6531 consensus_queue.cc:1048] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a287b5d0a24534b4ae9ee9444f59c1" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:35.436718  6204 consensus_peers.cc:597] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 -> Peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Couldn't send request to peer 0993a7f6a0e845038f017bf489411850. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.458266  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:35.459403  6030 tablet_replica.cc:333] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850: stopping tablet replica
I20260709 13:12:35.460407  6030 raft_consensus.cc:2243] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.461020  6030 pending_rounds.cc:70] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850: Trying to abort 1 pending ops.
I20260709 13:12:35.461318  6030 pending_rounds.cc:77] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305636883613048832 op_type: NO_OP noop_request { }
I20260709 13:12:35.461767  6030 raft_consensus.cc:2889] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:35.462143  6030 raft_consensus.cc:2272] T d03f616cc448403886e32ff890623a14 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.463804  6278 consensus_peers.cc:597] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 -> Peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Couldn't send request to peer 0993a7f6a0e845038f017bf489411850. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.465905  6030 tablet_replica.cc:333] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850: stopping tablet replica
I20260709 13:12:35.466768  6030 raft_consensus.cc:2243] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.467321  6030 raft_consensus.cc:2272] T b3fe14d690ad43168d833eb7e7c60d8d P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.469699  6030 tablet_replica.cc:333] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850: stopping tablet replica
I20260709 13:12:35.470481  6030 raft_consensus.cc:2243] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.471050  6030 raft_consensus.cc:2272] T d489934293c849a79033ddf7345aa8e2 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.473728  6030 tablet_replica.cc:333] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850: stopping tablet replica
I20260709 13:12:35.474502  6030 raft_consensus.cc:2243] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.475611  6030 raft_consensus.cc:2272] T 30c69dd0a6c240448ea23867b94b5105 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.478410  6030 tablet_replica.cc:333] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850: stopping tablet replica
I20260709 13:12:35.479206  6030 raft_consensus.cc:2243] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.479746  6030 raft_consensus.cc:2272] T f50f534426eb41c4bf42432aff145c02 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.482266  6030 tablet_replica.cc:333] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850: stopping tablet replica
I20260709 13:12:35.483029  6030 raft_consensus.cc:2243] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.484040  6030 raft_consensus.cc:2272] T 37c161ae65b746a8926d7ea53a3206b9 P 0993a7f6a0e845038f017bf489411850 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.486809  6030 tablet_replica.cc:333] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850: stopping tablet replica
I20260709 13:12:35.487614  6030 raft_consensus.cc:2243] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.488720  6030 raft_consensus.cc:2272] T 8f9a983b2fc94b55890c843a6311b151 P 0993a7f6a0e845038f017bf489411850 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.491416  6030 tablet_replica.cc:333] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850: stopping tablet replica
I20260709 13:12:35.492143  6030 raft_consensus.cc:2243] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.492681  6030 raft_consensus.cc:2272] T 1ec2790c669f414cb9c6f234631f9eff P 0993a7f6a0e845038f017bf489411850 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.495095  6030 tablet_replica.cc:333] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850: stopping tablet replica
I20260709 13:12:35.495846  6030 raft_consensus.cc:2243] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.496430  6030 raft_consensus.cc:2272] T 72d55d74fe6e4a84ba7162db97c40a41 P 0993a7f6a0e845038f017bf489411850 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.612455  6030 tablet_server.cc:196] TabletServer@127.5.227.129:0 shutdown complete.
W20260709 13:12:35.624532  6204 consensus_peers.cc:597] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 -> Peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Couldn't send request to peer 0993a7f6a0e845038f017bf489411850. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:37153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.632414  6204 consensus_peers.cc:597] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 -> Peer 0993a7f6a0e845038f017bf489411850 (127.5.227.129:37153): Couldn't send request to peer 0993a7f6a0e845038f017bf489411850. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:37153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.639766  6030 tablet_server.cc:179] TabletServer@127.5.227.130:0 shutting down...
I20260709 13:12:35.673791  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:35.674664  6030 tablet_replica.cc:333] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1: stopping tablet replica
I20260709 13:12:35.675477  6030 raft_consensus.cc:2243] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.676383  6030 raft_consensus.cc:2272] T 72d55d74fe6e4a84ba7162db97c40a41 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.678267  6030 tablet_replica.cc:333] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1: stopping tablet replica
I20260709 13:12:35.678885  6030 raft_consensus.cc:2243] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.679330  6030 raft_consensus.cc:2272] T 30c69dd0a6c240448ea23867b94b5105 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.681592  6030 tablet_replica.cc:333] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1: stopping tablet replica
I20260709 13:12:35.682111  6030 raft_consensus.cc:2243] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.682538  6030 raft_consensus.cc:2272] T 8f9a983b2fc94b55890c843a6311b151 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.684837  6030 tablet_replica.cc:333] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1: stopping tablet replica
I20260709 13:12:35.685446  6030 raft_consensus.cc:2243] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.685990  6030 raft_consensus.cc:2272] T 37c161ae65b746a8926d7ea53a3206b9 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.688367  6030 tablet_replica.cc:333] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1: stopping tablet replica
I20260709 13:12:35.688897  6030 raft_consensus.cc:2243] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.689625  6030 raft_consensus.cc:2272] T 1ec2790c669f414cb9c6f234631f9eff P 07a287b5d0a24534b4ae9ee9444f59c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.691494  6030 tablet_replica.cc:333] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1: stopping tablet replica
I20260709 13:12:35.692014  6030 raft_consensus.cc:2243] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:35.692780  6030 raft_consensus.cc:2272] T f50f534426eb41c4bf42432aff145c02 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.694599  6030 tablet_replica.cc:333] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1: stopping tablet replica
I20260709 13:12:35.695241  6030 raft_consensus.cc:2243] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.695673  6030 raft_consensus.cc:2272] T d489934293c849a79033ddf7345aa8e2 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.697402  6030 tablet_replica.cc:333] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1: stopping tablet replica
I20260709 13:12:35.697885  6030 raft_consensus.cc:2243] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.698324  6030 raft_consensus.cc:2272] T b3fe14d690ad43168d833eb7e7c60d8d P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:35.700564  6030 tablet_replica.cc:333] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1: stopping tablet replica
I20260709 13:12:35.701050  6030 raft_consensus.cc:2243] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:35.701468  6030 raft_consensus.cc:2272] T d03f616cc448403886e32ff890623a14 P 07a287b5d0a24534b4ae9ee9444f59c1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:35.792029  6280 consensus_peers.cc:597] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 -> Peer 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685): Couldn't send request to peer 07a287b5d0a24534b4ae9ee9444f59c1. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:37685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.878497  6280 consensus_peers.cc:597] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 -> Peer 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685): Couldn't send request to peer 07a287b5d0a24534b4ae9ee9444f59c1. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:37685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.898524  6280 consensus_peers.cc:597] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 -> Peer 07a287b5d0a24534b4ae9ee9444f59c1 (127.5.227.130:37685): Couldn't send request to peer 07a287b5d0a24534b4ae9ee9444f59c1. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:37685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:36.349205  6030 tablet_server.cc:196] TabletServer@127.5.227.130:0 shutdown complete.
I20260709 13:12:36.368062  6030 tablet_server.cc:179] TabletServer@127.5.227.131:0 shutting down...
I20260709 13:12:36.392640  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:36.393325  6030 tablet_replica.cc:333] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4: stopping tablet replica
I20260709 13:12:36.393947  6030 raft_consensus.cc:2243] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.394868  6030 raft_consensus.cc:2272] T d03f616cc448403886e32ff890623a14 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.396644  6030 tablet_replica.cc:333] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4: stopping tablet replica
I20260709 13:12:36.397233  6030 raft_consensus.cc:2243] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.397634  6030 raft_consensus.cc:2272] T 30c69dd0a6c240448ea23867b94b5105 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.399320  6030 tablet_replica.cc:333] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4: stopping tablet replica
I20260709 13:12:36.399818  6030 raft_consensus.cc:2243] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.400241  6030 raft_consensus.cc:2272] T 8f9a983b2fc94b55890c843a6311b151 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.402424  6030 tablet_replica.cc:333] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4: stopping tablet replica
I20260709 13:12:36.403003  6030 raft_consensus.cc:2243] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.403466  6030 raft_consensus.cc:2272] T 1ec2790c669f414cb9c6f234631f9eff P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.405041  6030 tablet_replica.cc:333] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4: stopping tablet replica
I20260709 13:12:36.405546  6030 raft_consensus.cc:2243] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.405970  6030 raft_consensus.cc:2272] T 37c161ae65b746a8926d7ea53a3206b9 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.408224  6030 tablet_replica.cc:333] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4: stopping tablet replica
I20260709 13:12:36.408759  6030 raft_consensus.cc:2243] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.409211  6030 raft_consensus.cc:2272] T f50f534426eb41c4bf42432aff145c02 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.410923  6030 tablet_replica.cc:333] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4: stopping tablet replica
I20260709 13:12:36.411396  6030 raft_consensus.cc:2243] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:36.411831  6030 raft_consensus.cc:2272] T 72d55d74fe6e4a84ba7162db97c40a41 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.413357  6030 tablet_replica.cc:333] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4: stopping tablet replica
I20260709 13:12:36.413832  6030 raft_consensus.cc:2243] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.414551  6030 raft_consensus.cc:2272] T d489934293c849a79033ddf7345aa8e2 P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.416343  6030 tablet_replica.cc:333] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4: stopping tablet replica
I20260709 13:12:36.416795  6030 raft_consensus.cc:2243] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.417513  6030 raft_consensus.cc:2272] T b3fe14d690ad43168d833eb7e7c60d8d P 31e90d2ac36a47c98a7b4af139bb9ee4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.444697  6030 tablet_server.cc:196] TabletServer@127.5.227.131:0 shutdown complete.
I20260709 13:12:36.460980  6030 master.cc:562] Master@127.5.227.190:42631 shutting down...
I20260709 13:12:36.635224  6030 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:36.635802  6030 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:36.636119  6030 tablet_replica.cc:333] T 00000000000000000000000000000000 P d7af61d9ccde44978924d3122b0fc037: stopping tablet replica
I20260709 13:12:36.655912  6030 master.cc:584] Master@127.5.227.190:42631 shutdown complete.
07a287b5d0a24534b4ae9ee9444f59c1  4
0993a7f6a0e845038f017bf489411850  4
31e90d2ac36a47c98a7b4af139bb9ee4  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (15514 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:12:36.699509  6030 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.227.190:45471
I20260709 13:12:36.700754  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:36.706751  6564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:36.707243  6567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:36.707290  6565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.708465  6030 server_base.cc:1061] running on GCE node
I20260709 13:12:36.709414  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:36.709594  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:36.709802  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602756709768 us; error 0 us; skew 500 ppm
I20260709 13:12:36.710345  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:36.712951  6030 webserver.cc:533] Webserver started at http://127.5.227.190:40817/ using document root <none> and password file <none>
I20260709 13:12:36.713481  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:36.713686  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:36.713991  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:36.715221  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/master-0-root/instance:
uuid: "20bc5c1ea96d40b798d6540a21620ee6"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-tbwl"
I20260709 13:12:36.719923  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:12:36.723515  6572 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.724279  6030 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:36.724598  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/master-0-root
uuid: "20bc5c1ea96d40b798d6540a21620ee6"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-tbwl"
I20260709 13:12:36.724905  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:36.734928  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:36.736203  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:36.774595  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.190:45471
I20260709 13:12:36.774785  6623 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.190:45471 every 8 connection(s)
I20260709 13:12:36.778719  6624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.788259  6624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6: Bootstrap starting.
I20260709 13:12:36.792971  6624 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.797376  6624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6: No bootstrap required, opened a new log
I20260709 13:12:36.799501  6624 raft_consensus.cc:359] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bc5c1ea96d40b798d6540a21620ee6" member_type: VOTER }
I20260709 13:12:36.799901  6624 raft_consensus.cc:385] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.800076  6624 raft_consensus.cc:740] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20bc5c1ea96d40b798d6540a21620ee6, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.800570  6624 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bc5c1ea96d40b798d6540a21620ee6" member_type: VOTER }
I20260709 13:12:36.800969  6624 raft_consensus.cc:399] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:36.801158  6624 raft_consensus.cc:493] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:36.801375  6624 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.805366  6624 raft_consensus.cc:515] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bc5c1ea96d40b798d6540a21620ee6" member_type: VOTER }
I20260709 13:12:36.805871  6624 leader_election.cc:304] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20bc5c1ea96d40b798d6540a21620ee6; no voters: 
I20260709 13:12:36.807051  6624 leader_election.cc:290] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:36.807421  6627 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.808794  6627 raft_consensus.cc:697] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [term 1 LEADER]: Becoming Leader. State: Replica: 20bc5c1ea96d40b798d6540a21620ee6, State: Running, Role: LEADER
I20260709 13:12:36.809562  6627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bc5c1ea96d40b798d6540a21620ee6" member_type: VOTER }
I20260709 13:12:36.810148  6624 sys_catalog.cc:565] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:36.814105  6629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20bc5c1ea96d40b798d6540a21620ee6. Latest consensus state: current_term: 1 leader_uuid: "20bc5c1ea96d40b798d6540a21620ee6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bc5c1ea96d40b798d6540a21620ee6" member_type: VOTER } }
I20260709 13:12:36.814908  6629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:36.814774  6628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20bc5c1ea96d40b798d6540a21620ee6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20bc5c1ea96d40b798d6540a21620ee6" member_type: VOTER } }
I20260709 13:12:36.815601  6628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:36.817159  6634 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:36.822351  6634 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:36.827706  6030 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:36.831341  6634 catalog_manager.cc:1383] Generated new cluster ID: 3aa74a2c66a34cbb89612fdeac8e5808
I20260709 13:12:36.831672  6634 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:36.846521  6634 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:36.847815  6634 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:36.865334  6634 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6: Generated new TSK 0
I20260709 13:12:36.865993  6634 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:36.894909  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:36.900671  6645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:36.901952  6646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.903944  6030 server_base.cc:1061] running on GCE node
W20260709 13:12:36.903889  6648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.905050  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:36.905292  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:36.905478  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602756905447 us; error 0 us; skew 500 ppm
I20260709 13:12:36.906013  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:36.908367  6030 webserver.cc:533] Webserver started at http://127.5.227.129:37935/ using document root <none> and password file <none>
I20260709 13:12:36.908874  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:36.909070  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:36.909368  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:36.910426  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-0-root/instance:
uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-tbwl"
I20260709 13:12:36.915155  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:12:36.918588  6653 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.919473  6030 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:36.919798  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-0-root
uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-tbwl"
I20260709 13:12:36.920096  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:36.931968  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:36.933319  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:36.934919  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:36.937279  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:36.937481  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.937794  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:36.937973  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:36.978937  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.129:33931
I20260709 13:12:36.979040  6715 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.129:33931 every 8 connection(s)
I20260709 13:12:36.984131  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:36.991606  6720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:36.993597  6721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.996309  6030 server_base.cc:1061] running on GCE node
W20260709 13:12:36.997536  6723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:36.998432  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:36.998716  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:36.998939  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602756998920 us; error 0 us; skew 500 ppm
I20260709 13:12:36.999620  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:37.002256  6716 heartbeater.cc:344] Connected to a master server at 127.5.227.190:45471
I20260709 13:12:37.002673  6716 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:37.002976  6030 webserver.cc:533] Webserver started at http://127.5.227.130:36753/ using document root <none> and password file <none>
I20260709 13:12:37.003487  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:37.003486  6716 heartbeater.cc:507] Master 127.5.227.190:45471 requested a full tablet report, sending...
I20260709 13:12:37.003849  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:37.004164  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:37.005519  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-1-root/instance:
uuid: "9ca3677767cd4244a5584433736614fe"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-tbwl"
I20260709 13:12:37.005960  6589 ts_manager.cc:194] Registered new tserver with Master: 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931)
I20260709 13:12:37.007838  6589 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38146
I20260709 13:12:37.010757  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 13:12:37.014400  6728 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.015218  6030 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:37.015548  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-1-root
uuid: "9ca3677767cd4244a5584433736614fe"
format_stamp: "Formatted at 2026-07-09 13:12:36 on dist-test-slave-tbwl"
I20260709 13:12:37.015888  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:37.034348  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:37.035712  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:37.037233  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:37.039582  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:37.039851  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.040107  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:37.040289  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.081020  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.130:44957
I20260709 13:12:37.081127  6790 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.130:44957 every 8 connection(s)
I20260709 13:12:37.085953  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:37.093508  6794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:37.095813  6795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:37.098611  6797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:37.099416  6791 heartbeater.cc:344] Connected to a master server at 127.5.227.190:45471
I20260709 13:12:37.099575  6030 server_base.cc:1061] running on GCE node
I20260709 13:12:37.099900  6791 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:37.100551  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:37.100823  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:37.100811  6791 heartbeater.cc:507] Master 127.5.227.190:45471 requested a full tablet report, sending...
I20260709 13:12:37.101181  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602757101160 us; error 0 us; skew 500 ppm
I20260709 13:12:37.101922  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:37.103309  6589 ts_manager.cc:194] Registered new tserver with Master: 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:37.104646  6030 webserver.cc:533] Webserver started at http://127.5.227.131:33529/ using document root <none> and password file <none>
I20260709 13:12:37.104979  6589 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38154
I20260709 13:12:37.105166  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:37.105465  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:37.105743  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:37.107342  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-2-root/instance:
uuid: "3385ddbdcf354cb6a3c2afe3170573be"
format_stamp: "Formatted at 2026-07-09 13:12:37 on dist-test-slave-tbwl"
I20260709 13:12:37.112023  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:12:37.115664  6802 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.116726  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:37.117077  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-2-root
uuid: "3385ddbdcf354cb6a3c2afe3170573be"
format_stamp: "Formatted at 2026-07-09 13:12:37 on dist-test-slave-tbwl"
I20260709 13:12:37.117374  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602741015013-6030-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:37.149345  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:37.150571  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:37.152092  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:37.154392  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:37.154628  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.154924  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:37.155102  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:37.194371  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.131:44005
I20260709 13:12:37.194487  6864 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.131:44005 every 8 connection(s)
I20260709 13:12:37.208573  6865 heartbeater.cc:344] Connected to a master server at 127.5.227.190:45471
I20260709 13:12:37.208909  6865 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:37.209620  6865 heartbeater.cc:507] Master 127.5.227.190:45471 requested a full tablet report, sending...
I20260709 13:12:37.211629  6589 ts_manager.cc:194] Registered new tserver with Master: 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:37.212136  6030 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014669958s
I20260709 13:12:37.212973  6589 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38170
I20260709 13:12:37.237591  6589 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38186:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:37.240521  6589 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:37.323784  6680 tablet_service.cc:1511] Processing CreateTablet for tablet ba99fa0116da49c4aec770edf26fe261 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:37.325387  6680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba99fa0116da49c4aec770edf26fe261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.327730  6679 tablet_service.cc:1511] Processing CreateTablet for tablet 63f0c06342474223ae1a8dc48fb848b9 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:37.332441  6677 tablet_service.cc:1511] Processing CreateTablet for tablet b8416fc5086f4da896ff311339e720af (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:37.334343  6756 tablet_service.cc:1511] Processing CreateTablet for tablet b6b00e352e2d45b79b9000b239d2254a (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:37.335062  6750 tablet_service.cc:1511] Processing CreateTablet for tablet a5a8d7fbb5f5438b82da890d340bdc1b (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:37.335757  6756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b00e352e2d45b79b9000b239d2254a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.336397  6750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a8d7fbb5f5438b82da890d340bdc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.337908  6755 tablet_service.cc:1511] Processing CreateTablet for tablet ba99fa0116da49c4aec770edf26fe261 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:37.339874  6754 tablet_service.cc:1511] Processing CreateTablet for tablet 63f0c06342474223ae1a8dc48fb848b9 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:37.341307  6754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f0c06342474223ae1a8dc48fb848b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.343847  6753 tablet_service.cc:1511] Processing CreateTablet for tablet f883b363f15346fea72784b743b14ddc (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:37.345292  6753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f883b363f15346fea72784b743b14ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.346158  6830 tablet_service.cc:1511] Processing CreateTablet for tablet b6b00e352e2d45b79b9000b239d2254a (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:37.347574  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b00e352e2d45b79b9000b239d2254a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.347915  6752 tablet_service.cc:1511] Processing CreateTablet for tablet b8416fc5086f4da896ff311339e720af (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:37.349330  6752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8416fc5086f4da896ff311339e720af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.351219  6747 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef669dcfdf24d80b14089cf5c581591 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:37.351953  6829 tablet_service.cc:1511] Processing CreateTablet for tablet ba99fa0116da49c4aec770edf26fe261 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:37.352768  6747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef669dcfdf24d80b14089cf5c581591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.353454  6829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba99fa0116da49c4aec770edf26fe261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.355861  6828 tablet_service.cc:1511] Processing CreateTablet for tablet 63f0c06342474223ae1a8dc48fb848b9 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:37.355989  6748 tablet_service.cc:1511] Processing CreateTablet for tablet c1f213e0678f42cbb140b6b6c493a75e (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:37.357481  6748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f213e0678f42cbb140b6b6c493a75e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.357326  6828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f0c06342474223ae1a8dc48fb848b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.357316  6749 tablet_service.cc:1511] Processing CreateTablet for tablet 336588db9ad34ddfb8c573e8d0faefc8 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:37.358578  6827 tablet_service.cc:1511] Processing CreateTablet for tablet f883b363f15346fea72784b743b14ddc (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:37.359210  6678 tablet_service.cc:1511] Processing CreateTablet for tablet f883b363f15346fea72784b743b14ddc (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:37.360041  6827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f883b363f15346fea72784b743b14ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.360733  6677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8416fc5086f4da896ff311339e720af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.363958  6826 tablet_service.cc:1511] Processing CreateTablet for tablet b8416fc5086f4da896ff311339e720af (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:37.330107  6681 tablet_service.cc:1511] Processing CreateTablet for tablet b6b00e352e2d45b79b9000b239d2254a (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:37.365501  6826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8416fc5086f4da896ff311339e720af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.367997  6825 tablet_service.cc:1511] Processing CreateTablet for tablet a56bc90e16834fc69797a018889645ff (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:37.369590  6825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a56bc90e16834fc69797a018889645ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.369939  6678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f883b363f15346fea72784b743b14ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.371019  6679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f0c06342474223ae1a8dc48fb848b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.372946  6824 tablet_service.cc:1511] Processing CreateTablet for tablet a5a8d7fbb5f5438b82da890d340bdc1b (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:37.374406  6824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a8d7fbb5f5438b82da890d340bdc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.378700  6822 tablet_service.cc:1511] Processing CreateTablet for tablet c1f213e0678f42cbb140b6b6c493a75e (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:37.380137  6822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f213e0678f42cbb140b6b6c493a75e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.381582  6676 tablet_service.cc:1511] Processing CreateTablet for tablet a56bc90e16834fc69797a018889645ff (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:37.376189  6823 tablet_service.cc:1511] Processing CreateTablet for tablet 336588db9ad34ddfb8c573e8d0faefc8 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:37.383500  6823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 336588db9ad34ddfb8c573e8d0faefc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.383860  6821 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef669dcfdf24d80b14089cf5c581591 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:37.384245  6675 tablet_service.cc:1511] Processing CreateTablet for tablet a5a8d7fbb5f5438b82da890d340bdc1b (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:37.385167  6821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef669dcfdf24d80b14089cf5c581591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.387671  6674 tablet_service.cc:1511] Processing CreateTablet for tablet 336588db9ad34ddfb8c573e8d0faefc8 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:37.379102  6681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b00e352e2d45b79b9000b239d2254a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.407998  6672 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef669dcfdf24d80b14089cf5c581591 (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:37.355974  6751 tablet_service.cc:1511] Processing CreateTablet for tablet a56bc90e16834fc69797a018889645ff (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:37.424461  6673 tablet_service.cc:1511] Processing CreateTablet for tablet c1f213e0678f42cbb140b6b6c493a75e (DEFAULT_TABLE table=test-workload [id=804597e622bd4b71aae2309be1c8c62c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:37.430171  6749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 336588db9ad34ddfb8c573e8d0faefc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.434562  6672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef669dcfdf24d80b14089cf5c581591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.435917  6674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 336588db9ad34ddfb8c573e8d0faefc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.437803  6676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a56bc90e16834fc69797a018889645ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.439162  6755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba99fa0116da49c4aec770edf26fe261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.439913  6751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a56bc90e16834fc69797a018889645ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.447026  6673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1f213e0678f42cbb140b6b6c493a75e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.458376  6881 tablet_bootstrap.cc:492] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be: Bootstrap starting.
I20260709 13:12:37.486866  6675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a8d7fbb5f5438b82da890d340bdc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:37.547260  6881 tablet_bootstrap.cc:654] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.567737  6882 tablet_bootstrap.cc:492] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef: Bootstrap starting.
I20260709 13:12:37.568301  6880 tablet_bootstrap.cc:492] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe: Bootstrap starting.
I20260709 13:12:37.578125  6882 tablet_bootstrap.cc:654] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.578194  6881 tablet_bootstrap.cc:492] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be: No bootstrap required, opened a new log
I20260709 13:12:37.578783  6881 ts_tablet_manager.cc:1403] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.005s
I20260709 13:12:37.582029  6880 tablet_bootstrap.cc:654] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.581831  6881 raft_consensus.cc:359] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.582588  6881 raft_consensus.cc:385] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.582773  6882 tablet_bootstrap.cc:492] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef: No bootstrap required, opened a new log
I20260709 13:12:37.582979  6881 raft_consensus.cc:740] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.583250  6882 ts_tablet_manager.cc:1403] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.006s
I20260709 13:12:37.584005  6881 consensus_queue.cc:260] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.585702  6882 raft_consensus.cc:359] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.586268  6865 heartbeater.cc:499] Master 127.5.227.190:45471 was elected leader, sending a full tablet report...
I20260709 13:12:37.586505  6882 raft_consensus.cc:385] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.586848  6882 raft_consensus.cc:740] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.587224  6881 ts_tablet_manager.cc:1434] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:12:37.587729  6882 consensus_queue.cc:260] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.588521  6881 tablet_bootstrap.cc:492] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be: Bootstrap starting.
I20260709 13:12:37.592840  6716 heartbeater.cc:499] Master 127.5.227.190:45471 was elected leader, sending a full tablet report...
I20260709 13:12:37.594938  6880 tablet_bootstrap.cc:492] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe: No bootstrap required, opened a new log
I20260709 13:12:37.595443  6880 ts_tablet_manager.cc:1403] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.000s
I20260709 13:12:37.596143  6881 tablet_bootstrap.cc:654] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.597733  6882 ts_tablet_manager.cc:1434] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:12:37.598894  6882 tablet_bootstrap.cc:492] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef: Bootstrap starting.
I20260709 13:12:37.606014  6882 tablet_bootstrap.cc:654] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.598482  6880 raft_consensus.cc:359] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.606825  6880 raft_consensus.cc:385] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.607187  6880 raft_consensus.cc:740] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.608048  6880 consensus_queue.cc:260] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.610280  6881 tablet_bootstrap.cc:492] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be: No bootstrap required, opened a new log
I20260709 13:12:37.611079  6881 ts_tablet_manager.cc:1403] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.012s
I20260709 13:12:37.615139  6881 raft_consensus.cc:359] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.616323  6881 raft_consensus.cc:385] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.616817  6881 raft_consensus.cc:740] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.618237  6881 consensus_queue.cc:260] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.621886  6881 ts_tablet_manager.cc:1434] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:12:37.623438  6881 tablet_bootstrap.cc:492] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be: Bootstrap starting.
I20260709 13:12:37.632465  6881 tablet_bootstrap.cc:654] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.648746  6880 ts_tablet_manager.cc:1434] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe: Time spent starting tablet: real 0.053s	user 0.020s	sys 0.024s
I20260709 13:12:37.649263  6791 heartbeater.cc:499] Master 127.5.227.190:45471 was elected leader, sending a full tablet report...
I20260709 13:12:37.650005  6880 tablet_bootstrap.cc:492] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe: Bootstrap starting.
I20260709 13:12:37.650612  6882 tablet_bootstrap.cc:492] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef: No bootstrap required, opened a new log
I20260709 13:12:37.650944  6881 tablet_bootstrap.cc:492] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be: No bootstrap required, opened a new log
I20260709 13:12:37.651196  6882 ts_tablet_manager.cc:1403] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.033s
I20260709 13:12:37.651415  6881 ts_tablet_manager.cc:1403] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.009s
I20260709 13:12:37.654250  6882 raft_consensus.cc:359] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.654490  6881 raft_consensus.cc:359] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.655253  6881 raft_consensus.cc:385] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.655591  6881 raft_consensus.cc:740] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.655148  6882 raft_consensus.cc:385] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.656505  6882 raft_consensus.cc:740] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.656353  6881 consensus_queue.cc:260] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.656901  6880 tablet_bootstrap.cc:654] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.658617  6881 ts_tablet_manager.cc:1434] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:37.659669  6881 tablet_bootstrap.cc:492] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be: Bootstrap starting.
I20260709 13:12:37.659742  6882 consensus_queue.cc:260] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.664290  6882 ts_tablet_manager.cc:1434] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:37.665428  6882 tablet_bootstrap.cc:492] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef: Bootstrap starting.
I20260709 13:12:37.666534  6881 tablet_bootstrap.cc:654] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.668841  6880 tablet_bootstrap.cc:492] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe: No bootstrap required, opened a new log
I20260709 13:12:37.669425  6880 ts_tablet_manager.cc:1403] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:12:37.672361  6880 raft_consensus.cc:359] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.673070  6882 tablet_bootstrap.cc:654] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.673281  6880 raft_consensus.cc:385] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.673719  6880 raft_consensus.cc:740] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.674664  6880 consensus_queue.cc:260] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.677208  6880 ts_tablet_manager.cc:1434] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:37.678289  6880 tablet_bootstrap.cc:492] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe: Bootstrap starting.
I20260709 13:12:37.687139  6880 tablet_bootstrap.cc:654] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.688194  6881 tablet_bootstrap.cc:492] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be: No bootstrap required, opened a new log
I20260709 13:12:37.688999  6881 ts_tablet_manager.cc:1403] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.007s
I20260709 13:12:37.693260  6881 raft_consensus.cc:359] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.694116  6881 raft_consensus.cc:385] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.694482  6881 raft_consensus.cc:740] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.695240  6881 consensus_queue.cc:260] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.696867  6880 tablet_bootstrap.cc:492] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe: No bootstrap required, opened a new log
I20260709 13:12:37.697424  6880 ts_tablet_manager.cc:1403] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:12:37.697628  6881 ts_tablet_manager.cc:1434] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:37.700451  6881 tablet_bootstrap.cc:492] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be: Bootstrap starting.
I20260709 13:12:37.700593  6880 raft_consensus.cc:359] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.701491  6880 raft_consensus.cc:385] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.701876  6880 raft_consensus.cc:740] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.702913  6880 consensus_queue.cc:260] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.704566  6882 tablet_bootstrap.cc:492] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef: No bootstrap required, opened a new log
I20260709 13:12:37.705179  6882 ts_tablet_manager.cc:1403] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent bootstrapping tablet: real 0.040s	user 0.004s	sys 0.025s
I20260709 13:12:37.707702  6881 tablet_bootstrap.cc:654] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.708781  6880 ts_tablet_manager.cc:1434] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:37.710064  6880 tablet_bootstrap.cc:492] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe: Bootstrap starting.
I20260709 13:12:37.709970  6882 raft_consensus.cc:359] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.710908  6882 raft_consensus.cc:385] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.711266  6882 raft_consensus.cc:740] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.712302  6882 consensus_queue.cc:260] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.719848  6880 tablet_bootstrap.cc:654] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.720957  6881 tablet_bootstrap.cc:492] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be: No bootstrap required, opened a new log
I20260709 13:12:37.721495  6881 ts_tablet_manager.cc:1403] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:12:37.723693  6882 ts_tablet_manager.cc:1434] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:37.724783  6880 tablet_bootstrap.cc:492] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe: No bootstrap required, opened a new log
I20260709 13:12:37.724591  6881 raft_consensus.cc:359] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.725255  6880 ts_tablet_manager.cc:1403] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe: Time spent bootstrapping tablet: real 0.015s	user 0.002s	sys 0.008s
I20260709 13:12:37.725399  6881 raft_consensus.cc:385] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.725746  6881 raft_consensus.cc:740] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.726528  6881 consensus_queue.cc:260] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.728098  6880 raft_consensus.cc:359] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.728910  6880 raft_consensus.cc:385] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.729252  6880 raft_consensus.cc:740] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.730505  6881 ts_tablet_manager.cc:1434] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:12:37.730079  6880 consensus_queue.cc:260] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.731575  6881 tablet_bootstrap.cc:492] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be: Bootstrap starting.
I20260709 13:12:37.732478  6882 tablet_bootstrap.cc:492] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef: Bootstrap starting.
I20260709 13:12:37.734489  6880 ts_tablet_manager.cc:1434] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:37.735658  6880 tablet_bootstrap.cc:492] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe: Bootstrap starting.
I20260709 13:12:37.738943  6881 tablet_bootstrap.cc:654] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.739867  6886 raft_consensus.cc:493] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.740391  6886 raft_consensus.cc:515] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.741176  6882 tablet_bootstrap.cc:654] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.742187  6889 raft_consensus.cc:493] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.742672  6889 raft_consensus.cc:515] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.745193  6889 leader_election.cc:290] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:37.748070  6886 leader_election.cc:290] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:37.754405  6880 tablet_bootstrap.cc:654] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.770504  6882 tablet_bootstrap.cc:492] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef: No bootstrap required, opened a new log
I20260709 13:12:37.771222  6882 ts_tablet_manager.cc:1403] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.014s
I20260709 13:12:37.776644  6881 tablet_bootstrap.cc:492] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be: No bootstrap required, opened a new log
I20260709 13:12:37.776785  6880 tablet_bootstrap.cc:492] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe: No bootstrap required, opened a new log
I20260709 13:12:37.777244  6881 ts_tablet_manager.cc:1403] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.008s
I20260709 13:12:37.777319  6880 ts_tablet_manager.cc:1403] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.004s
I20260709 13:12:37.780390  6881 raft_consensus.cc:359] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.781164  6881 raft_consensus.cc:385] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.781461  6881 raft_consensus.cc:740] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.782210  6881 consensus_queue.cc:260] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.784829  6881 ts_tablet_manager.cc:1434] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:37.786194  6880 raft_consensus.cc:359] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.787971  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:37.789415  6880 raft_consensus.cc:385] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.774832  6882 raft_consensus.cc:359] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.791456  6881 tablet_bootstrap.cc:492] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be: Bootstrap starting.
W20260709 13:12:37.791618  6806 leader_election.cc:343] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.789880  6882 raft_consensus.cc:385] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.789773  6880 raft_consensus.cc:740] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.795115  6882 raft_consensus.cc:740] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.795756  6880 consensus_queue.cc:260] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.796092  6882 consensus_queue.cc:260] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.798307  6880 ts_tablet_manager.cc:1434] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 13:12:37.798446  6882 ts_tablet_manager.cc:1434] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:12:37.799605  6882 tablet_bootstrap.cc:492] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef: Bootstrap starting.
I20260709 13:12:37.799747  6880 tablet_bootstrap.cc:492] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe: Bootstrap starting.
I20260709 13:12:37.804951  6881 tablet_bootstrap.cc:654] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.806696  6880 tablet_bootstrap.cc:654] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.809083  6882 tablet_bootstrap.cc:654] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.815986  6886 raft_consensus.cc:493] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.816565  6886 raft_consensus.cc:515] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.817699  6881 tablet_bootstrap.cc:492] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be: No bootstrap required, opened a new log
I20260709 13:12:37.818293  6881 ts_tablet_manager.cc:1403] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.010s
I20260709 13:12:37.818323  6880 tablet_bootstrap.cc:492] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe: No bootstrap required, opened a new log
I20260709 13:12:37.819175  6880 ts_tablet_manager.cc:1403] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:12:37.819723  6882 tablet_bootstrap.cc:492] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef: No bootstrap required, opened a new log
I20260709 13:12:37.820252  6882 ts_tablet_manager.cc:1403] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:12:37.820307  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8416fc5086f4da896ff311339e720af" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:37.821025  6691 raft_consensus.cc:2468] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 0.
I20260709 13:12:37.822048  6880 raft_consensus.cc:359] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
W20260709 13:12:37.822521  6637 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:37.822485  6806 leader_election.cc:304] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 486fb84edbb9421e9b66a14d4bffd6ef; no voters: 
I20260709 13:12:37.822912  6880 raft_consensus.cc:385] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.823395  6880 raft_consensus.cc:740] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.823688  6882 raft_consensus.cc:359] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.824342  6880 consensus_queue.cc:260] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.824904  6882 raft_consensus.cc:385] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.825417  6882 raft_consensus.cc:740] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.827122  6880 ts_tablet_manager.cc:1434] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:37.826654  6882 consensus_queue.cc:260] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.828213  6880 tablet_bootstrap.cc:492] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe: Bootstrap starting.
I20260709 13:12:37.829540  6882 ts_tablet_manager.cc:1434] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:37.829486  6881 raft_consensus.cc:359] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.832190  6881 raft_consensus.cc:385] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.832602  6882 tablet_bootstrap.cc:492] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef: Bootstrap starting.
I20260709 13:12:37.833379  6886 leader_election.cc:290] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:37.833931  6886 raft_consensus.cc:493] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.834369  6886 raft_consensus.cc:515] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.832574  6881 raft_consensus.cc:740] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.842742  6887 raft_consensus.cc:493] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.843432  6887 raft_consensus.cc:515] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.844527  6886 leader_election.cc:290] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:37.834820  6909 raft_consensus.cc:2804] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.835563  6910 raft_consensus.cc:493] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.846388  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be" is_pre_election: true
I20260709 13:12:37.846521  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56bc90e16834fc69797a018889645ff" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:37.846971  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:37.847069  6910 raft_consensus.cc:515] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.847666  6690 raft_consensus.cc:2468] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 0.
I20260709 13:12:37.846391  6766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
W20260709 13:12:37.848286  6806 leader_election.cc:343] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.848574  6766 raft_consensus.cc:2468] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 0.
I20260709 13:12:37.848752  6765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8416fc5086f4da896ff311339e720af" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
I20260709 13:12:37.836162  6880 tablet_bootstrap.cc:654] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.849457  6765 raft_consensus.cc:2468] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 0.
I20260709 13:12:37.850063  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:37.850332  6805 leader_election.cc:304] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:37.850788  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56bc90e16834fc69797a018889645ff" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
I20260709 13:12:37.851483  6764 raft_consensus.cc:2468] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 0.
W20260709 13:12:37.851629  6806 leader_election.cc:343] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.851712  6886 raft_consensus.cc:2804] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.852250  6909 raft_consensus.cc:493] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.852288  6886 raft_consensus.cc:493] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.852376  6882 tablet_bootstrap.cc:654] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.852813  6909 raft_consensus.cc:3060] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.852891  6886 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.857753  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
W20260709 13:12:37.859314  6732 leader_election.cc:343] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.862380  6909 raft_consensus.cc:515] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.864243  6805 leader_election.cc:304] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:37.864714  6909 leader_election.cc:290] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:37.865243  6909 raft_consensus.cc:2804] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.849468  6910 leader_election.cc:290] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:37.864282  6887 leader_election.cc:290] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:37.865808  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8416fc5086f4da896ff311339e720af" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
W20260709 13:12:37.866995  6805 leader_election.cc:343] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.867491  6690 raft_consensus.cc:3060] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.867755  6805 leader_election.cc:304] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be; no voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe
I20260709 13:12:37.869463  6910 raft_consensus.cc:2749] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.870752  6887 raft_consensus.cc:493] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.865586  6909 raft_consensus.cc:493] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.871338  6887 raft_consensus.cc:515] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.871742  6909 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.871932  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8416fc5086f4da896ff311339e720af" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:37.872750  6764 raft_consensus.cc:3060] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.872993  6882 tablet_bootstrap.cc:492] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef: No bootstrap required, opened a new log
I20260709 13:12:37.873488  6882 ts_tablet_manager.cc:1403] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.002s
I20260709 13:12:37.874841  6887 leader_election.cc:290] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:37.874866  6886 raft_consensus.cc:515] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.877055  6882 raft_consensus.cc:359] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.877774  6882 raft_consensus.cc:385] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.878073  6882 raft_consensus.cc:740] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.878986  6764 raft_consensus.cc:2468] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 1.
I20260709 13:12:37.879541  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:37.878610  6886 leader_election.cc:290] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:37.882943  6765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:37.887239  6882 consensus_queue.cc:260] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.887773  6765 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:37.888504  6806 leader_election.cc:343] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.889555  6805 leader_election.cc:304] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:37.890698  6910 raft_consensus.cc:2804] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.891431  6910 raft_consensus.cc:697] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Becoming Leader. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:37.889619  6882 ts_tablet_manager.cc:1434] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:12:37.892361  6910 consensus_queue.cc:237] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.885174  6880 tablet_bootstrap.cc:492] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe: No bootstrap required, opened a new log
I20260709 13:12:37.842237  6881 consensus_queue.cc:260] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.895000  6880 ts_tablet_manager.cc:1403] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.007s
I20260709 13:12:37.896952  6881 ts_tablet_manager.cc:1434] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.002s
I20260709 13:12:37.898015  6881 tablet_bootstrap.cc:492] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be: Bootstrap starting.
I20260709 13:12:37.897771  6909 raft_consensus.cc:515] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.897949  6880 raft_consensus.cc:359] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.899401  6880 raft_consensus.cc:385] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.899766  6880 raft_consensus.cc:740] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.900554  6880 consensus_queue.cc:260] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.900903  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56bc90e16834fc69797a018889645ff" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:37.901610  6691 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.903043  6880 ts_tablet_manager.cc:1434] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:37.903584  6765 raft_consensus.cc:2468] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 1.
I20260709 13:12:37.904865  6805 leader_election.cc:304] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:37.905223  6881 tablet_bootstrap.cc:654] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.907630  6732 leader_election.cc:304] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 3385ddbdcf354cb6a3c2afe3170573be
I20260709 13:12:37.908599  6889 raft_consensus.cc:2804] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.908979  6889 raft_consensus.cc:493] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.909212  6886 raft_consensus.cc:2804] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.909312  6889 raft_consensus.cc:3060] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.909802  6886 raft_consensus.cc:697] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Becoming Leader. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:37.910732  6886 consensus_queue.cc:237] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.912870  6691 raft_consensus.cc:2468] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 1.
I20260709 13:12:37.916980  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b00e352e2d45b79b9000b239d2254a" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
I20260709 13:12:37.917681  6764 raft_consensus.cc:2468] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 0.
I20260709 13:12:37.919715  6882 tablet_bootstrap.cc:492] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef: Bootstrap starting.
I20260709 13:12:37.920118  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f213e0678f42cbb140b6b6c493a75e" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be" is_pre_election: true
I20260709 13:12:37.918352  6889 raft_consensus.cc:515] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.920778  6840 raft_consensus.cc:2468] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 0.
I20260709 13:12:37.922204  6880 tablet_bootstrap.cc:492] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe: Bootstrap starting.
I20260709 13:12:37.922108  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b00e352e2d45b79b9000b239d2254a" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be" is_pre_election: true
I20260709 13:12:37.924168  6657 leader_election.cc:304] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 486fb84edbb9421e9b66a14d4bffd6ef; no voters: 
I20260709 13:12:37.924734  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
W20260709 13:12:37.925109  6657 leader_election.cc:343] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.925848  6887 raft_consensus.cc:2804] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.926208  6887 raft_consensus.cc:493] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:37.926367  6732 leader_election.cc:343] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.927290  6806 leader_election.cc:304] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 486fb84edbb9421e9b66a14d4bffd6ef; no voters: 
I20260709 13:12:37.928355  6911 raft_consensus.cc:2804] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.926559  6887 raft_consensus.cc:3060] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.928267  6889 leader_election.cc:290] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:37.913507  6690 raft_consensus.cc:2468] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 1.
I20260709 13:12:37.926919  6909 leader_election.cc:290] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:37.932667  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56bc90e16834fc69797a018889645ff" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:37.936602  6764 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.938905  6656 leader_election.cc:304] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 3385ddbdcf354cb6a3c2afe3170573be
I20260709 13:12:37.944942  6764 raft_consensus.cc:2468] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 1.
I20260709 13:12:37.931005  6765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f213e0678f42cbb140b6b6c493a75e" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
I20260709 13:12:37.946439  6765 raft_consensus.cc:2468] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 0.
I20260709 13:12:37.945688  6587 catalog_manager.cc:5697] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be reported cstate change: term changed from 0 to 1, leader changed from <none> to 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131). New cstate: current_term: 1 leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:37.946744  6909 raft_consensus.cc:493] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.947121  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:37.947404  6909 raft_consensus.cc:515] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.948890  6880 tablet_bootstrap.cc:654] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.950022  6911 raft_consensus.cc:697] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Becoming Leader. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:37.949667  6690 raft_consensus.cc:3060] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.956033  6911 consensus_queue.cc:237] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.957854  6887 raft_consensus.cc:515] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.959213  6886 raft_consensus.cc:493] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.959867  6886 raft_consensus.cc:515] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.966741  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:37.968115  6886 leader_election.cc:290] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
W20260709 13:12:37.968359  6806 leader_election.cc:343] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.968852  6882 tablet_bootstrap.cc:654] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.968879  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:37.970809  6766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
I20260709 13:12:37.972066  6765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f213e0678f42cbb140b6b6c493a75e" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:37.972301  6889 raft_consensus.cc:493] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.972678  6765 raft_consensus.cc:3060] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:37.974388  6805 leader_election.cc:343] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.975031  6887 leader_election.cc:290] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
W20260709 13:12:37.975392  6806 leader_election.cc:343] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.975653  6887 raft_consensus.cc:2804] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.975817  6806 leader_election.cc:304] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be; no voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe
I20260709 13:12:37.976186  6887 raft_consensus.cc:493] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.976449  6881 tablet_bootstrap.cc:492] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be: No bootstrap required, opened a new log
I20260709 13:12:37.976630  6887 raft_consensus.cc:3060] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.976634  6886 raft_consensus.cc:2749] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.976914  6881 ts_tablet_manager.cc:1403] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.001s
I20260709 13:12:37.977730  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f213e0678f42cbb140b6b6c493a75e" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:37.978319  6839 raft_consensus.cc:3060] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.980075  6881 raft_consensus.cc:359] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.972774  6889 raft_consensus.cc:515] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.980871  6881 raft_consensus.cc:385] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.981266  6881 raft_consensus.cc:740] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.969858  6909 leader_election.cc:290] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:37.982614  6889 leader_election.cc:290] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:37.983230  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
W20260709 13:12:37.986085  6805 leader_election.cc:343] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.986016  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef669dcfdf24d80b14089cf5c581591" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:37.986824  6805 leader_election.cc:304] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be; no voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe
I20260709 13:12:37.987138  6691 raft_consensus.cc:2468] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 0.
I20260709 13:12:37.984267  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef669dcfdf24d80b14089cf5c581591" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be" is_pre_election: true
I20260709 13:12:37.989045  6909 raft_consensus.cc:2749] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:37.989293  6732 leader_election.cc:343] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.990042  6732 leader_election.cc:304] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 3385ddbdcf354cb6a3c2afe3170573be
I20260709 13:12:37.990897  6880 tablet_bootstrap.cc:492] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe: No bootstrap required, opened a new log
I20260709 13:12:37.991346  6880 ts_tablet_manager.cc:1403] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.010s
I20260709 13:12:37.982146  6881 consensus_queue.cc:260] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.992547  6887 raft_consensus.cc:515] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.993883  6881 ts_tablet_manager.cc:1434] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 13:12:37.991214  6889 raft_consensus.cc:2804] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.994885  6889 raft_consensus.cc:493] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.995455  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b00e352e2d45b79b9000b239d2254a" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:37.995697  6887 leader_election.cc:290] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:37.996052  6764 raft_consensus.cc:3060] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.996969  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b00e352e2d45b79b9000b239d2254a" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:37.997524  6840 raft_consensus.cc:3060] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.994220  6880 raft_consensus.cc:359] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:37.974565  6690 raft_consensus.cc:2468] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 1.
I20260709 13:12:37.993917  6839 raft_consensus.cc:2468] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 1.
I20260709 13:12:37.999168  6880 raft_consensus.cc:385] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.994874  6881 tablet_bootstrap.cc:492] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be: Bootstrap starting.
I20260709 13:12:38.000151  6732 leader_election.cc:304] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 3385ddbdcf354cb6a3c2afe3170573be
I20260709 13:12:37.995461  6889 raft_consensus.cc:3060] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.999523  6880 raft_consensus.cc:740] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.001785  6657 leader_election.cc:304] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 486fb84edbb9421e9b66a14d4bffd6ef; no voters: 
I20260709 13:12:38.002035  6880 consensus_queue.cc:260] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.002758  6887 raft_consensus.cc:2804] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.007232  6887 raft_consensus.cc:697] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:38.012001  6887 consensus_queue.cc:237] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.012934  6765 raft_consensus.cc:2468] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 1.
I20260709 13:12:38.022521  6840 raft_consensus.cc:2468] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 1.
I20260709 13:12:38.024847  6657 leader_election.cc:304] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 486fb84edbb9421e9b66a14d4bffd6ef; no voters: 
I20260709 13:12:38.026276  6920 raft_consensus.cc:2804] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.029767  6880 ts_tablet_manager.cc:1434] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.022s
I20260709 13:12:38.035171  6880 tablet_bootstrap.cc:492] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe: Bootstrap starting.
I20260709 13:12:38.037590  6889 raft_consensus.cc:515] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.041831  6889 leader_election.cc:290] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:38.043735  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef669dcfdf24d80b14089cf5c581591" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:38.044618  6690 raft_consensus.cc:3060] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.044745  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef669dcfdf24d80b14089cf5c581591" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
W20260709 13:12:38.046492  6732 leader_election.cc:343] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.055038  6925 raft_consensus.cc:2804] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.056385  6690 raft_consensus.cc:2468] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 1.
I20260709 13:12:38.060209  6925 raft_consensus.cc:697] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Becoming Leader. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:38.061795  6880 tablet_bootstrap.cc:654] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.061535  6925 consensus_queue.cc:237] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.064731  6920 raft_consensus.cc:697] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:38.065769  6920 consensus_queue.cc:237] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.071048  6732 leader_election.cc:304] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 3385ddbdcf354cb6a3c2afe3170573be
I20260709 13:12:38.072395  6889 raft_consensus.cc:2804] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.072894  6889 raft_consensus.cc:697] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Becoming Leader. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:38.073572  6889 consensus_queue.cc:237] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.074108  6881 tablet_bootstrap.cc:654] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.054216  6764 raft_consensus.cc:2468] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 1.
I20260709 13:12:38.084784  6882 tablet_bootstrap.cc:492] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef: No bootstrap required, opened a new log
I20260709 13:12:38.085321  6882 ts_tablet_manager.cc:1403] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent bootstrapping tablet: real 0.166s	user 0.023s	sys 0.019s
I20260709 13:12:38.088423  6882 raft_consensus.cc:359] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.089200  6882 raft_consensus.cc:385] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.089512  6882 raft_consensus.cc:740] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.090282  6882 consensus_queue.cc:260] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.092705  6882 ts_tablet_manager.cc:1434] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:12:38.093719  6882 tablet_bootstrap.cc:492] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef: Bootstrap starting.
I20260709 13:12:38.097519  6586 catalog_manager.cc:5697] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 1 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.107607  6882 tablet_bootstrap.cc:654] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.107707  6587 catalog_manager.cc:5697] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be reported cstate change: term changed from 0 to 1, leader changed from <none> to 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131). New cstate: current_term: 1 leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:38.108817  6881 tablet_bootstrap.cc:492] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be: No bootstrap required, opened a new log
I20260709 13:12:38.109350  6881 ts_tablet_manager.cc:1403] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.009s
I20260709 13:12:38.109958  6587 catalog_manager.cc:5697] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be reported cstate change: term changed from 0 to 1, leader changed from <none> to 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131). New cstate: current_term: 1 leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:38.113456  6880 tablet_bootstrap.cc:492] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe: No bootstrap required, opened a new log
I20260709 13:12:38.113940  6880 ts_tablet_manager.cc:1403] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.008s
I20260709 13:12:38.109340  6588 catalog_manager.cc:5697] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ca3677767cd4244a5584433736614fe (127.5.227.130). New cstate: current_term: 1 leader_uuid: "9ca3677767cd4244a5584433736614fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.116349  6882 tablet_bootstrap.cc:492] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef: No bootstrap required, opened a new log
I20260709 13:12:38.116847  6882 ts_tablet_manager.cc:1403] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:12:38.116008  6588 catalog_manager.cc:5697] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ca3677767cd4244a5584433736614fe (127.5.227.130). New cstate: current_term: 1 leader_uuid: "9ca3677767cd4244a5584433736614fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.119661  6882 raft_consensus.cc:359] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.116958  6880 raft_consensus.cc:359] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.120374  6882 raft_consensus.cc:385] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.120676  6880 raft_consensus.cc:385] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.120711  6882 raft_consensus.cc:740] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.121093  6880 raft_consensus.cc:740] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.121613  6882 consensus_queue.cc:260] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.123579  6882 ts_tablet_manager.cc:1434] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:38.124514  6882 tablet_bootstrap.cc:492] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef: Bootstrap starting.
I20260709 13:12:38.124280  6880 consensus_queue.cc:260] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.126264  6880 ts_tablet_manager.cc:1434] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.004s
I20260709 13:12:38.127185  6880 tablet_bootstrap.cc:492] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe: Bootstrap starting.
I20260709 13:12:38.128786  6586 catalog_manager.cc:5697] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 1 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.130482  6882 tablet_bootstrap.cc:654] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.132911  6880 tablet_bootstrap.cc:654] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.135118  6881 raft_consensus.cc:359] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.135540  6882 tablet_bootstrap.cc:492] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef: No bootstrap required, opened a new log
I20260709 13:12:38.135818  6881 raft_consensus.cc:385] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.136016  6882 ts_tablet_manager.cc:1403] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.006s
I20260709 13:12:38.136106  6881 raft_consensus.cc:740] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.137022  6881 consensus_queue.cc:260] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.139024  6881 ts_tablet_manager.cc:1434] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:12:38.138612  6882 raft_consensus.cc:359] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.139350  6882 raft_consensus.cc:385] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.139601  6882 raft_consensus.cc:740] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.140259  6882 consensus_queue.cc:260] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.142210  6882 ts_tablet_manager.cc:1434] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:12:38.143213  6882 tablet_bootstrap.cc:492] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef: Bootstrap starting.
I20260709 13:12:38.143556  6925 raft_consensus.cc:493] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.144021  6925 raft_consensus.cc:515] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.145004  6881 tablet_bootstrap.cc:492] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be: Bootstrap starting.
I20260709 13:12:38.146265  6925 leader_election.cc:290] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:38.149127  6882 tablet_bootstrap.cc:654] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.150934  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be" is_pre_election: true
I20260709 13:12:38.151252  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:38.151605  6840 raft_consensus.cc:2468] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 0.
I20260709 13:12:38.153043  6732 leader_election.cc:304] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:38.153858  6925 raft_consensus.cc:2804] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.154309  6925 raft_consensus.cc:493] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.154759  6925 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.155272  6882 tablet_bootstrap.cc:492] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef: No bootstrap required, opened a new log
I20260709 13:12:38.155725  6882 ts_tablet_manager.cc:1403] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:12:38.155925  6881 tablet_bootstrap.cc:654] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.152979  6880 tablet_bootstrap.cc:492] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe: No bootstrap required, opened a new log
I20260709 13:12:38.158460  6882 raft_consensus.cc:359] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.158924  6880 ts_tablet_manager.cc:1403] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:12:38.159214  6882 raft_consensus.cc:385] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.159507  6882 raft_consensus.cc:740] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.160328  6882 consensus_queue.cc:260] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
W20260709 13:12:38.161518  6732 leader_election.cc:343] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.161907  6880 raft_consensus.cc:359] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.162274  6882 ts_tablet_manager.cc:1434] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:38.162557  6880 raft_consensus.cc:385] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.162858  6880 raft_consensus.cc:740] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.163034  6925 raft_consensus.cc:515] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.163470  6880 consensus_queue.cc:260] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.165418  6880 ts_tablet_manager.cc:1434] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:12:38.165325  6925 leader_election.cc:290] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:38.166435  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:38.167060  6840 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.168592  6881 tablet_bootstrap.cc:492] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be: No bootstrap required, opened a new log
I20260709 13:12:38.169070  6881 ts_tablet_manager.cc:1403] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 13:12:38.171783  6881 raft_consensus.cc:359] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.172470  6881 raft_consensus.cc:385] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.172760  6881 raft_consensus.cc:740] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.173636  6881 consensus_queue.cc:260] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.174299  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:38.174952  6690 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.175156  6840 raft_consensus.cc:2468] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 1.
I20260709 13:12:38.176343  6732 leader_election.cc:304] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:38.177177  6889 raft_consensus.cc:2804] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.177649  6889 raft_consensus.cc:697] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Becoming Leader. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:38.178831  6881 ts_tablet_manager.cc:1434] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:12:38.178490  6889 consensus_queue.cc:237] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.185876  6690 raft_consensus.cc:2468] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 1.
I20260709 13:12:38.192337  6588 catalog_manager.cc:5697] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ca3677767cd4244a5584433736614fe (127.5.227.130). New cstate: current_term: 1 leader_uuid: "9ca3677767cd4244a5584433736614fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.229444  6909 raft_consensus.cc:493] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.230014  6909 raft_consensus.cc:515] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.231823  6909 leader_election.cc:290] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:38.232787  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:38.232807  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
I20260709 13:12:38.233736  6690 raft_consensus.cc:2393] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3385ddbdcf354cb6a3c2afe3170573be in current term 1: Already voted for candidate 9ca3677767cd4244a5584433736614fe in this term.
I20260709 13:12:38.234748  6806 leader_election.cc:304] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be; no voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe
I20260709 13:12:38.235415  6909 raft_consensus.cc:3060] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.236603  6887 raft_consensus.cc:493] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.237012  6887 raft_consensus.cc:515] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.238873  6887 leader_election.cc:290] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:38.239735  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
I20260709 13:12:38.240389  6764 raft_consensus.cc:2468] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 0.
I20260709 13:12:38.240443  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be" is_pre_election: true
I20260709 13:12:38.241086  6840 raft_consensus.cc:2468] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 0.
I20260709 13:12:38.241670  6656 leader_election.cc:304] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:38.242156  6909 raft_consensus.cc:2749] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.242578  6887 raft_consensus.cc:2804] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.243042  6887 raft_consensus.cc:493] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.243336  6887 raft_consensus.cc:3060] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.247769  6887 raft_consensus.cc:515] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.249401  6887 leader_election.cc:290] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:38.250286  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:38.250897  6764 raft_consensus.cc:3060] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.250972  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:38.251566  6840 raft_consensus.cc:3060] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.255571  6764 raft_consensus.cc:2468] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 1.
I20260709 13:12:38.256202  6840 raft_consensus.cc:2468] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 1.
I20260709 13:12:38.256727  6656 leader_election.cc:304] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:38.257598  6887 raft_consensus.cc:2804] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.258005  6887 raft_consensus.cc:697] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:38.258733  6887 consensus_queue.cc:237] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.266300  6588 catalog_manager.cc:5697] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 1 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.353250  6909 consensus_queue.cc:1048] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.354578  6886 consensus_queue.cc:1048] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.374418  6889 raft_consensus.cc:493] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.375017  6889 raft_consensus.cc:515] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.377259  6889 leader_election.cc:290] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:38.379652  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be" is_pre_election: true
I20260709 13:12:38.380544  6840 raft_consensus.cc:2468] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 0.
I20260709 13:12:38.382694  6732 leader_election.cc:304] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:38.385118  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:38.386015  6917 consensus_queue.cc:1048] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.386032  6690 raft_consensus.cc:2468] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 0.
I20260709 13:12:38.386878  6925 raft_consensus.cc:2804] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.387300  6925 raft_consensus.cc:493] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.387691  6925 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.391845  6887 raft_consensus.cc:493] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.392577  6887 raft_consensus.cc:515] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.398880  6887 leader_election.cc:290] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:38.401145  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be" is_pre_election: true
I20260709 13:12:38.406172  6887 consensus_queue.cc:1048] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:38.415035  6690 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.428184  6925 raft_consensus.cc:515] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.430018  6925 leader_election.cc:290] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:38.430855  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:38.431088  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:38.431535  6691 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.431628  6840 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.433147  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
I20260709 13:12:38.433593  6917 consensus_queue.cc:1048] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.434597  6656 leader_election.cc:304] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef; no voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe
I20260709 13:12:38.435491  6928 raft_consensus.cc:2749] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.435333  6920 consensus_queue.cc:1048] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.440464  6840 raft_consensus.cc:2468] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 1.
I20260709 13:12:38.441743  6732 leader_election.cc:304] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:38.442853  6691 raft_consensus.cc:2468] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 1.
I20260709 13:12:38.445119  6925 raft_consensus.cc:2804] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.445896  6925 raft_consensus.cc:697] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Becoming Leader. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:38.446803  6925 consensus_queue.cc:237] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.457290  6928 consensus_queue.cc:1048] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.463423  6887 consensus_queue.cc:1048] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.487082  6917 raft_consensus.cc:493] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.487603  6917 raft_consensus.cc:515] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.490012  6917 leader_election.cc:290] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:38.491268  6766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef669dcfdf24d80b14089cf5c581591" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca3677767cd4244a5584433736614fe" is_pre_election: true
I20260709 13:12:38.492822  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef669dcfdf24d80b14089cf5c581591" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" is_pre_election: true
I20260709 13:12:38.493691  6690 raft_consensus.cc:2393] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3385ddbdcf354cb6a3c2afe3170573be in current term 1: Already voted for candidate 9ca3677767cd4244a5584433736614fe in this term.
I20260709 13:12:38.494444  6917 consensus_queue.cc:1048] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.497426  6805 leader_election.cc:304] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be; no voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe
I20260709 13:12:38.498826  6917 raft_consensus.cc:3060] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.506538  6917 raft_consensus.cc:2749] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.512884  6886 consensus_queue.cc:1048] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.516018  6586 catalog_manager.cc:5697] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ca3677767cd4244a5584433736614fe (127.5.227.130). New cstate: current_term: 1 leader_uuid: "9ca3677767cd4244a5584433736614fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.573843  6925 consensus_queue.cc:1048] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.585850  6925 consensus_queue.cc:1048] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.595434  6925 consensus_queue.cc:1048] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.607617  6962 consensus_queue.cc:1048] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.652179  6962 consensus_queue.cc:1048] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.664973  6925 consensus_queue.cc:1048] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.769038  6764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
mode: GRACEFUL
new_leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:43728
I20260709 13:12:38.769595  6764 raft_consensus.cc:606] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Received request to transfer leadership to TS 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:38.774830  6764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
mode: GRACEFUL
new_leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:43728
I20260709 13:12:38.775347  6764 raft_consensus.cc:606] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Received request to transfer leadership to TS 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:38.779181  6887 consensus_queue.cc:1048] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.780825  6764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f883b363f15346fea72784b743b14ddc"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
mode: GRACEFUL
new_leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:43728
I20260709 13:12:38.781450  6764 raft_consensus.cc:606] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Received request to transfer leadership to TS 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:38.792308  6920 consensus_queue.cc:1048] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.801079  6840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8416fc5086f4da896ff311339e720af"
dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
mode: GRACEFUL
new_leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:41778
I20260709 13:12:38.801713  6840 raft_consensus.cc:606] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Received request to transfer leadership to TS 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:38.807515  6840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a56bc90e16834fc69797a018889645ff"
dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
mode: GRACEFUL
new_leader_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:41778
I20260709 13:12:38.808284  6840 raft_consensus.cc:606] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Received request to transfer leadership to TS 9ca3677767cd4244a5584433736614fe
I20260709 13:12:38.813899  6840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b"
dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
mode: GRACEFUL
new_leader_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:41778
I20260709 13:12:38.814482  6840 raft_consensus.cc:606] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Received request to transfer leadership to TS 9ca3677767cd4244a5584433736614fe
I20260709 13:12:38.828758  6690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
mode: GRACEFUL
new_leader_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:35984
I20260709 13:12:38.829291  6690 raft_consensus.cc:606] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Received request to transfer leadership to TS 9ca3677767cd4244a5584433736614fe
I20260709 13:12:38.834976  6690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1f213e0678f42cbb140b6b6c493a75e"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
mode: GRACEFUL
new_leader_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:35984
I20260709 13:12:38.835541  6690 raft_consensus.cc:606] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Received request to transfer leadership to TS 9ca3677767cd4244a5584433736614fe
I20260709 13:12:38.841504  6764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ef669dcfdf24d80b14089cf5c581591"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
mode: GRACEFUL
new_leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
 from {username='slave'} at 127.0.0.1:43728
I20260709 13:12:38.842001  6764 raft_consensus.cc:606] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Received request to transfer leadership to TS 3385ddbdcf354cb6a3c2afe3170573be
I20260709 13:12:38.862787  6928 raft_consensus.cc:993] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef: : Instructing follower 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:38.863296  6928 raft_consensus.cc:1081] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Signalling peer 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:38.864905  6764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1f213e0678f42cbb140b6b6c493a75e"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:43716
I20260709 13:12:38.865386  6764 raft_consensus.cc:493] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:38.865690  6764 raft_consensus.cc:3060] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.870322  6764 raft_consensus.cc:515] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.872015  6764 leader_election.cc:290] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 2 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:38.872951  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f213e0678f42cbb140b6b6c493a75e" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:38.873245  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1f213e0678f42cbb140b6b6c493a75e" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:38.873588  6690 raft_consensus.cc:3055] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:38.873780  6840 raft_consensus.cc:3060] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.873953  6690 raft_consensus.cc:740] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:38.874831  6690 consensus_queue.cc:260] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.876078  6690 raft_consensus.cc:3060] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.880759  6840 raft_consensus.cc:2468] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 2.
I20260709 13:12:38.882079  6732 leader_election.cc:304] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:38.882576  6690 raft_consensus.cc:2468] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 2.
I20260709 13:12:38.882822  6925 raft_consensus.cc:2804] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:38.883396  6925 raft_consensus.cc:697] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Becoming Leader. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:38.884142  6925 consensus_queue.cc:237] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.890182  6586 catalog_manager.cc:5697] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe reported cstate change: term changed from 1 to 2, leader changed from 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129) to 9ca3677767cd4244a5584433736614fe (127.5.227.130). New cstate: current_term: 2 leader_uuid: "9ca3677767cd4244a5584433736614fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.902251  6925 consensus_queue.cc:1048] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.909068  6889 raft_consensus.cc:993] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe: : Instructing follower 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:38.909588  6962 raft_consensus.cc:1081] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Signalling peer 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:38.911324  6691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f883b363f15346fea72784b743b14ddc"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:35974
I20260709 13:12:38.912746  6691 raft_consensus.cc:493] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:38.913189  6691 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.916333  6925 consensus_queue.cc:1048] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.919811  6691 raft_consensus.cc:515] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.922214  6691 leader_election.cc:290] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 2 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:38.923125  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:38.923731  6764 raft_consensus.cc:3055] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:38.924069  6764 raft_consensus.cc:740] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:38.924579  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:38.924933  6764 consensus_queue.cc:260] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.926054  6764 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.932745  6764 raft_consensus.cc:2468] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 2.
I20260709 13:12:38.933871  6656 leader_election.cc:304] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 3385ddbdcf354cb6a3c2afe3170573be
I20260709 13:12:38.934813  6928 raft_consensus.cc:2804] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:38.935357  6928 raft_consensus.cc:697] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:38.936198  6928 consensus_queue.cc:237] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:38.942868  6588 catalog_manager.cc:5697] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 1 to 2, leader changed from 9ca3677767cd4244a5584433736614fe (127.5.227.130) to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 2 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.004323  6909 raft_consensus.cc:993] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be: : Instructing follower 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:39.004798  6886 raft_consensus.cc:1081] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Signalling peer 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:39.006289  6764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:43706
I20260709 13:12:39.006827  6764 raft_consensus.cc:493] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.007149  6764 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.011727  6764 raft_consensus.cc:515] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.013672  6764 leader_election.cc:290] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 2 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:39.014487  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:39.014866  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:39.015154  6691 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.015568  6840 raft_consensus.cc:3055] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:39.015892  6840 raft_consensus.cc:740] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:39.016773  6840 consensus_queue.cc:260] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.018003  6840 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.022487  6691 raft_consensus.cc:2468] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 2.
I20260709 13:12:39.024031  6732 leader_election.cc:304] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:39.024890  6925 raft_consensus.cc:2804] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.025081  6840 raft_consensus.cc:2468] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 2.
I20260709 13:12:39.025406  6925 raft_consensus.cc:697] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Becoming Leader. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:39.026357  6925 consensus_queue.cc:237] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.033099  6588 catalog_manager.cc:5697] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe reported cstate change: term changed from 1 to 2, leader changed from 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131) to 9ca3677767cd4244a5584433736614fe (127.5.227.130). New cstate: current_term: 2 leader_uuid: "9ca3677767cd4244a5584433736614fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.062947  6889 raft_consensus.cc:993] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe: : Instructing follower 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:39.063443  6925 raft_consensus.cc:1081] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Signalling peer 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:39.065049  6691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:35974
I20260709 13:12:39.065665  6691 raft_consensus.cc:493] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.066105  6691 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.071822  6909 raft_consensus.cc:993] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be: : Instructing follower 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:39.072309  6911 raft_consensus.cc:1081] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Signalling peer 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:39.073390  6691 raft_consensus.cc:515] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.074227  6764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a56bc90e16834fc69797a018889645ff"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:43706
I20260709 13:12:39.074782  6764 raft_consensus.cc:493] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.075098  6764 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.075371  6691 leader_election.cc:290] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 2 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:39.075999  6766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:39.076575  6766 raft_consensus.cc:3055] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:39.076673  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:39.076965  6766 raft_consensus.cc:740] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:39.077229  6840 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.077792  6766 consensus_queue.cc:260] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.079094  6766 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.080626  6764 raft_consensus.cc:515] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.082443  6764 leader_election.cc:290] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 2 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:39.083923  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56bc90e16834fc69797a018889645ff" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:39.084043  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56bc90e16834fc69797a018889645ff" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:39.084719  6840 raft_consensus.cc:2468] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 2.
I20260709 13:12:39.084697  6691 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.084697  6839 raft_consensus.cc:3055] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:39.085546  6839 raft_consensus.cc:740] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:39.086108  6657 leader_election.cc:304] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 486fb84edbb9421e9b66a14d4bffd6ef; no voters: 
I20260709 13:12:39.086126  6766 raft_consensus.cc:2468] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 2.
I20260709 13:12:39.087055  6928 raft_consensus.cc:2804] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.086470  6839 consensus_queue.cc:260] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.088049  6839 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.088227  6928 raft_consensus.cc:697] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:39.089056  6928 consensus_queue.cc:237] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.092041  6691 raft_consensus.cc:2468] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 2.
I20260709 13:12:39.093361  6732 leader_election.cc:304] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:39.094228  6925 raft_consensus.cc:2804] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.094770  6925 raft_consensus.cc:697] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Becoming Leader. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:39.094939  6839 raft_consensus.cc:2468] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 2.
I20260709 13:12:39.095546  6925 consensus_queue.cc:237] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.096376  6588 catalog_manager.cc:5697] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 1 to 2, leader changed from 9ca3677767cd4244a5584433736614fe (127.5.227.130) to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 2 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.102046  6586 catalog_manager.cc:5697] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe reported cstate change: term changed from 1 to 2, leader changed from 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131) to 9ca3677767cd4244a5584433736614fe (127.5.227.130). New cstate: current_term: 2 leader_uuid: "9ca3677767cd4244a5584433736614fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.212584  6889 raft_consensus.cc:993] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe: : Instructing follower 3385ddbdcf354cb6a3c2afe3170573be to start an election
I20260709 13:12:39.212991  6909 raft_consensus.cc:993] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be: : Instructing follower 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:39.213130  6925 raft_consensus.cc:1081] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Signalling peer 3385ddbdcf354cb6a3c2afe3170573be to start an election
I20260709 13:12:39.213500  6911 raft_consensus.cc:1081] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Signalling peer 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:39.214784  6839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ef669dcfdf24d80b14089cf5c581591"
dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
 from {username='slave'} at 127.0.0.1:41760
I20260709 13:12:39.215015  6691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8416fc5086f4da896ff311339e720af"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:12:39.215281  6839 raft_consensus.cc:493] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.215539  6691 raft_consensus.cc:493] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.215672  6839 raft_consensus.cc:3060] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.216019  6691 raft_consensus.cc:3060] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.221266  6839 raft_consensus.cc:515] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.223232  6691 raft_consensus.cc:515] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.224026  6839 leader_election.cc:290] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 2 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:39.224468  6962 raft_consensus.cc:993] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe: : Instructing follower 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:39.224809  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef669dcfdf24d80b14089cf5c581591" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:39.224924  6962 raft_consensus.cc:1081] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Signalling peer 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:39.225414  6690 raft_consensus.cc:3060] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.225996  6766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8416fc5086f4da896ff311339e720af" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:39.226245  6691 leader_election.cc:290] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 2 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:39.226604  6766 raft_consensus.cc:3060] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.227527  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8416fc5086f4da896ff311339e720af" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:39.228084  6839 raft_consensus.cc:3055] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:39.228410  6839 raft_consensus.cc:740] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:39.229221  6839 consensus_queue.cc:260] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.230321  6691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:35974
I20260709 13:12:39.230399  6839 raft_consensus.cc:3060] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.231086  6691 raft_consensus.cc:493] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.231650  6691 raft_consensus.cc:3060] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.233474  6766 raft_consensus.cc:2468] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 2.
I20260709 13:12:39.234810  6656 leader_election.cc:304] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:39.235646  6928 raft_consensus.cc:2804] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.236110  6928 raft_consensus.cc:697] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:39.237244  6839 raft_consensus.cc:2468] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 2.
I20260709 13:12:39.236953  6928 consensus_queue.cc:237] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.237383  6690 raft_consensus.cc:2468] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 2.
I20260709 13:12:39.238497  6766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef669dcfdf24d80b14089cf5c581591" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:39.238768  6806 leader_election.cc:304] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 486fb84edbb9421e9b66a14d4bffd6ef; no voters: 
I20260709 13:12:39.239151  6766 raft_consensus.cc:3055] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:39.239513  6766 raft_consensus.cc:740] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:39.239666  6911 raft_consensus.cc:2804] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.240180  6911 raft_consensus.cc:697] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 LEADER]: Becoming Leader. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:39.240430  6766 consensus_queue.cc:260] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.241931  6766 raft_consensus.cc:3060] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.241811  6911 consensus_queue.cc:237] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.243402  6691 raft_consensus.cc:515] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.246018  6691 leader_election.cc:290] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 2 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:39.246958  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:39.247571  6764 raft_consensus.cc:3055] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:39.247736  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:39.247920  6764 raft_consensus.cc:740] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:39.248354  6840 raft_consensus.cc:3060] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.249058  6766 raft_consensus.cc:2468] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 2.
I20260709 13:12:39.248790  6764 consensus_queue.cc:260] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.250068  6764 raft_consensus.cc:3060] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.253134  6586 catalog_manager.cc:5697] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 1 to 2, leader changed from 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131) to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 2 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.253679  6588 catalog_manager.cc:5697] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be reported cstate change: term changed from 1 to 2, leader changed from 9ca3677767cd4244a5584433736614fe (127.5.227.130) to 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131). New cstate: current_term: 2 leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.257396  6764 raft_consensus.cc:2468] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 2.
I20260709 13:12:39.258744  6656 leader_election.cc:304] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:39.259583  6928 raft_consensus.cc:2804] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.260017  6840 raft_consensus.cc:2468] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 2.
I20260709 13:12:39.260075  6928 raft_consensus.cc:697] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:39.261246  6928 consensus_queue.cc:237] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.268213  6588 catalog_manager.cc:5697] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 1 to 2, leader changed from 9ca3677767cd4244a5584433736614fe (127.5.227.130) to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 2 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.309128  6920 raft_consensus.cc:993] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef: : Instructing follower 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:39.309628  6928 raft_consensus.cc:1081] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Signalling peer 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:39.311209  6764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:43716
I20260709 13:12:39.311875  6764 raft_consensus.cc:493] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.312307  6764 raft_consensus.cc:3060] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.317181  6764 raft_consensus.cc:515] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.319116  6764 leader_election.cc:290] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 2 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:39.319923  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:39.320101  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:39.320570  6840 raft_consensus.cc:3060] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.320572  6691 raft_consensus.cc:3055] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:39.321118  6691 raft_consensus.cc:740] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:39.322098  6691 consensus_queue.cc:260] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.323359  6691 raft_consensus.cc:3060] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.325151  6839 raft_consensus.cc:1275] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.326432  6962 consensus_queue.cc:1048] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.327996  6840 raft_consensus.cc:2468] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 2.
I20260709 13:12:39.329197  6732 leader_election.cc:304] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:39.329981  6962 raft_consensus.cc:2804] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.330493  6962 raft_consensus.cc:697] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Becoming Leader. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:39.330721  6691 raft_consensus.cc:2468] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 2.
I20260709 13:12:39.331457  6962 consensus_queue.cc:237] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:39.333480  6764 raft_consensus.cc:1275] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.334867  6928 consensus_queue.cc:1048] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.339664  6691 raft_consensus.cc:1275] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.341325  6889 consensus_queue.cc:1048] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.345034  6839 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.341952  6588 catalog_manager.cc:5697] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe reported cstate change: term changed from 1 to 2, leader changed from 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129) to 9ca3677767cd4244a5584433736614fe (127.5.227.130). New cstate: current_term: 2 leader_uuid: "9ca3677767cd4244a5584433736614fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.352542  6839 raft_consensus.cc:1275] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.353991  6887 consensus_queue.cc:1048] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.458565  6691 raft_consensus.cc:1275] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.459908  6925 consensus_queue.cc:1048] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.470788  6839 raft_consensus.cc:1275] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.472355  6925 consensus_queue.cc:1048] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.487330  6691 raft_consensus.cc:1275] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.489077  6925 consensus_queue.cc:1048] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.497310  6839 raft_consensus.cc:1275] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.498822  6889 consensus_queue.cc:1048] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.632676  6839 raft_consensus.cc:1275] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.633961  6887 consensus_queue.cc:1048] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.642704  6764 raft_consensus.cc:1275] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.645020  6928 consensus_queue.cc:1048] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.657987  6764 raft_consensus.cc:1275] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.659279  6928 consensus_queue.cc:1048] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.667295  6764 raft_consensus.cc:1275] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.669584  6980 consensus_queue.cc:1048] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.670862  6839 raft_consensus.cc:1275] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.672421  6928 consensus_queue.cc:1048] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.674494  6691 raft_consensus.cc:1275] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Refusing update from remote peer 3385ddbdcf354cb6a3c2afe3170573be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.676709  6909 consensus_queue.cc:1048] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.694746  6839 raft_consensus.cc:1275] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.696900  6977 consensus_queue.cc:1048] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:39.707818  6764 raft_consensus.cc:1275] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Refusing update from remote peer 3385ddbdcf354cb6a3c2afe3170573be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.710608  6911 consensus_queue.cc:1048] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.827992  6840 raft_consensus.cc:1275] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.829305  6925 consensus_queue.cc:1048] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.838871  6691 raft_consensus.cc:1275] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.840421  6889 consensus_queue.cc:1048] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:41.877660  6030 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:12:41.878854  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:41.898826  6690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
mode: GRACEFUL
new_leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
 from {username='slave'} at 127.0.0.1:35992
I20260709 13:12:41.899572  6690 raft_consensus.cc:606] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Received request to transfer leadership to TS 3385ddbdcf354cb6a3c2afe3170573be
I20260709 13:12:41.902837  6690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f883b363f15346fea72784b743b14ddc"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
mode: GRACEFUL
new_leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
 from {username='slave'} at 127.0.0.1:35992
I20260709 13:12:41.903384  6690 raft_consensus.cc:606] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Received request to transfer leadership to TS 3385ddbdcf354cb6a3c2afe3170573be
I20260709 13:12:41.904655  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:41.905083  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:41.928278  6995 raft_consensus.cc:993] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef: : Instructing follower 3385ddbdcf354cb6a3c2afe3170573be to start an election
I20260709 13:12:41.928889  6977 raft_consensus.cc:1081] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Signalling peer 3385ddbdcf354cb6a3c2afe3170573be to start an election
I20260709 13:12:41.930585  6840 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9"
dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
 from {username='slave'} at 127.0.0.1:41774
I20260709 13:12:41.931114  6840 raft_consensus.cc:493] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:41.931433  6840 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:41.936587  6840 raft_consensus.cc:515] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:41.938428  6840 leader_election.cc:290] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 3 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:41.939821  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:41.939936  6766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:41.940610  6690 raft_consensus.cc:3055] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:41.940659  6766 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:41.940908  6690 raft_consensus.cc:740] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:41.941816  6690 consensus_queue.cc:260] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:41.942945  6690 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:41.946389  6766 raft_consensus.cc:2468] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 3.
I20260709 13:12:41.947927  6805 leader_election.cc:304] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:41.948912  6985 raft_consensus.cc:2804] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:41.949090  6690 raft_consensus.cc:2468] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 3.
I20260709 13:12:41.950073  6985 raft_consensus.cc:697] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Becoming Leader. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:41.951052  6985 consensus_queue.cc:237] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:41.958873  6588 catalog_manager.cc:5697] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be reported cstate change: term changed from 2 to 3, leader changed from 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129) to 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131). New cstate: current_term: 3 leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.171682  6995 raft_consensus.cc:993] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef: : Instructing follower 3385ddbdcf354cb6a3c2afe3170573be to start an election
I20260709 13:12:42.172122  6977 raft_consensus.cc:1081] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Signalling peer 3385ddbdcf354cb6a3c2afe3170573be to start an election
I20260709 13:12:42.173668  6840 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f883b363f15346fea72784b743b14ddc"
dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
 from {username='slave'} at 127.0.0.1:41774
I20260709 13:12:42.174204  6840 raft_consensus.cc:493] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:42.174576  6840 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:42.179384  6840 raft_consensus.cc:515] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:42.181033  6840 leader_election.cc:290] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 3 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:42.181864  6690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:42.182117  6766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:42.182504  6690 raft_consensus.cc:3055] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:42.182724  6766 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:42.182925  6690 raft_consensus.cc:740] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:42.183848  6690 consensus_queue.cc:260] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:42.184916  6690 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:42.187983  6766 raft_consensus.cc:2468] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 3.
I20260709 13:12:42.189076  6805 leader_election.cc:304] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:42.189826  6985 raft_consensus.cc:2804] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:42.190232  6985 raft_consensus.cc:697] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Becoming Leader. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:42.190176  6690 raft_consensus.cc:2468] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 3.
I20260709 13:12:42.191367  6985 consensus_queue.cc:237] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:42.198566  6588 catalog_manager.cc:5697] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be reported cstate change: term changed from 2 to 3, leader changed from 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129) to 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131). New cstate: current_term: 3 leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.343849  6690 raft_consensus.cc:1275] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Refusing update from remote peer 3385ddbdcf354cb6a3c2afe3170573be: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:42.345203  6985 consensus_queue.cc:1048] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.355921  6766 raft_consensus.cc:1275] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Refusing update from remote peer 3385ddbdcf354cb6a3c2afe3170573be: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:42.357440  6996 consensus_queue.cc:1048] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.719061  6690 raft_consensus.cc:1275] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Refusing update from remote peer 3385ddbdcf354cb6a3c2afe3170573be: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:42.720292  6996 consensus_queue.cc:1048] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.729746  6766 raft_consensus.cc:1275] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Refusing update from remote peer 3385ddbdcf354cb6a3c2afe3170573be: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:42.731998  6996 consensus_queue.cc:1048] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:42.905830  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:42.922147  6840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9"
dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
mode: GRACEFUL
new_leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:41778
I20260709 13:12:42.922683  6840 raft_consensus.cc:606] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Received request to transfer leadership to TS 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:42.927354  6840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f883b363f15346fea72784b743b14ddc"
dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
mode: GRACEFUL
new_leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:41778
I20260709 13:12:42.927827  6840 raft_consensus.cc:606] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Received request to transfer leadership to TS 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:42.934891  6766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a56bc90e16834fc69797a018889645ff"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
mode: GRACEFUL
new_leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:43728
I20260709 13:12:42.935382  6766 raft_consensus.cc:606] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Received request to transfer leadership to TS 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:42.940145  6766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
mode: GRACEFUL
new_leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:43728
I20260709 13:12:42.940606  6766 raft_consensus.cc:606] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Received request to transfer leadership to TS 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:42.945052  6766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
mode: GRACEFUL
new_leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:43728
I20260709 13:12:42.945544  6766 raft_consensus.cc:606] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Received request to transfer leadership to TS 486fb84edbb9421e9b66a14d4bffd6ef
I20260709 13:12:43.115286  6925 raft_consensus.cc:993] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe: : Instructing follower 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:43.115742  7011 raft_consensus.cc:1081] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Signalling peer 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:43.117412  6690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:35974
I20260709 13:12:43.117869  6690 raft_consensus.cc:493] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:43.118242  6690 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.123231  6925 raft_consensus.cc:993] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe: : Instructing follower 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:43.123740  7011 raft_consensus.cc:1081] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Signalling peer 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:43.124254  6690 raft_consensus.cc:515] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.125453  6691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a56bc90e16834fc69797a018889645ff"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:35974
I20260709 13:12:43.126032  6691 raft_consensus.cc:493] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:43.126513  6691 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.126773  6690 leader_election.cc:290] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 3 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:43.127535  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:43.128119  6839 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.128309  6766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:43.128923  6766 raft_consensus.cc:3055] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:43.129258  6766 raft_consensus.cc:740] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:43.130086  6766 consensus_queue.cc:260] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.131444  6766 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.133788  6839 raft_consensus.cc:2468] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 3.
I20260709 13:12:43.134544  6691 raft_consensus.cc:515] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.135138  6657 leader_election.cc:304] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 486fb84edbb9421e9b66a14d4bffd6ef; no voters: 
I20260709 13:12:43.135948  6977 raft_consensus.cc:2804] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:43.137876  6691 leader_election.cc:290] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 3 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:43.137955  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56bc90e16834fc69797a018889645ff" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:43.138840  6764 raft_consensus.cc:3055] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:43.138603  6766 raft_consensus.cc:2468] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 3.
I20260709 13:12:43.139271  6764 raft_consensus.cc:740] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:43.139348  6977 raft_consensus.cc:697] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:43.140167  6764 consensus_queue.cc:260] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.140486  6977 consensus_queue.cc:237] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.141477  6764 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.141942  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56bc90e16834fc69797a018889645ff" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:43.142518  6839 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.147578  6839 raft_consensus.cc:2468] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 3.
I20260709 13:12:43.149041  6657 leader_election.cc:304] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 486fb84edbb9421e9b66a14d4bffd6ef; no voters: 
I20260709 13:12:43.149546  6764 raft_consensus.cc:2468] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 3.
I20260709 13:12:43.149770  6977 raft_consensus.cc:2804] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:43.150231  6977 raft_consensus.cc:697] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:43.151145  6977 consensus_queue.cc:237] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.151774  6588 catalog_manager.cc:5697] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 2 to 3, leader changed from 9ca3677767cd4244a5584433736614fe (127.5.227.130) to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 3 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.165890  6588 catalog_manager.cc:5697] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 2 to 3, leader changed from 9ca3677767cd4244a5584433736614fe (127.5.227.130) to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 3 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.193056  6985 raft_consensus.cc:993] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be: : Instructing follower 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:43.193626  7009 raft_consensus.cc:1081] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Signalling peer 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:43.195144  6691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f883b363f15346fea72784b743b14ddc"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:12:43.195662  6691 raft_consensus.cc:493] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:43.195971  6691 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.200635  6691 raft_consensus.cc:515] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.202219  6691 leader_election.cc:290] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 4 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:43.203271  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:43.203271  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f883b363f15346fea72784b743b14ddc" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:43.204062  6764 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.204150  6839 raft_consensus.cc:3055] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:43.204504  6839 raft_consensus.cc:740] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:43.205315  6839 consensus_queue.cc:260] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.206570  6839 raft_consensus.cc:3060] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.210812  6764 raft_consensus.cc:2468] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 4.
I20260709 13:12:43.212214  6656 leader_election.cc:304] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:43.213008  6977 raft_consensus.cc:2804] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:43.213220  6839 raft_consensus.cc:2468] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 4.
I20260709 13:12:43.213541  6977 raft_consensus.cc:697] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:43.214459  6977 consensus_queue.cc:237] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.220999  6588 catalog_manager.cc:5697] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 3 to 4, leader changed from 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131) to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 4 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.330498  6985 raft_consensus.cc:993] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be: : Instructing follower 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:43.331002  6985 raft_consensus.cc:1081] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Signalling peer 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:43.332378  6691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:35972
I20260709 13:12:43.332839  6691 raft_consensus.cc:493] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:43.333115  6691 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.337560  6691 raft_consensus.cc:515] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.339129  6691 leader_election.cc:290] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 4 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:43.340050  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:43.340209  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f0c06342474223ae1a8dc48fb848b9" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:43.340516  6764 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.340803  6839 raft_consensus.cc:3055] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:43.341109  6839 raft_consensus.cc:740] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:43.341739  6839 consensus_queue.cc:260] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.342697  6839 raft_consensus.cc:3060] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.345096  6764 raft_consensus.cc:2468] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 4.
I20260709 13:12:43.346122  6656 leader_election.cc:304] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 486fb84edbb9421e9b66a14d4bffd6ef, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:43.346925  6977 raft_consensus.cc:2804] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:43.347373  6977 raft_consensus.cc:697] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:43.347818  6839 raft_consensus.cc:2468] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 4.
I20260709 13:12:43.348232  6977 consensus_queue.cc:237] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.354185  6588 catalog_manager.cc:5697] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 3 to 4, leader changed from 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131) to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 4 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.390184  6925 raft_consensus.cc:993] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe: : Instructing follower 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:43.390646  7011 raft_consensus.cc:1081] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Signalling peer 486fb84edbb9421e9b66a14d4bffd6ef to start an election
I20260709 13:12:43.392179  6691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
 from {username='slave'} at 127.0.0.1:35974
I20260709 13:12:43.392725  6691 raft_consensus.cc:493] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:43.393006  6691 raft_consensus.cc:3060] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.397388  6691 raft_consensus.cc:515] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.399008  6691 leader_election.cc:290] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 3 election: Requested vote from peers 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:43.399801  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:43.400082  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336588db9ad34ddfb8c573e8d0faefc8" candidate_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:43.400354  6764 raft_consensus.cc:3055] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:43.400583  6839 raft_consensus.cc:3060] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.400682  6764 raft_consensus.cc:740] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:43.401525  6764 consensus_queue.cc:260] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.402807  6764 raft_consensus.cc:3060] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.407713  6839 raft_consensus.cc:2468] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 3.
I20260709 13:12:43.408854  6657 leader_election.cc:304] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 486fb84edbb9421e9b66a14d4bffd6ef; no voters: 
I20260709 13:12:43.409214  6764 raft_consensus.cc:2468] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 486fb84edbb9421e9b66a14d4bffd6ef in term 3.
I20260709 13:12:43.409749  6977 raft_consensus.cc:2804] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:43.410261  6977 raft_consensus.cc:697] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Becoming Leader. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:43.411222  6977 consensus_queue.cc:237] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:43.418237  6588 catalog_manager.cc:5697] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef reported cstate change: term changed from 2 to 3, leader changed from 9ca3677767cd4244a5584433736614fe (127.5.227.130) to 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129). New cstate: current_term: 3 leader_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.625080  6839 raft_consensus.cc:1275] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:43.626345  6977 consensus_queue.cc:1048] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:43.634968  6764 raft_consensus.cc:1275] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:43.636638  6977 consensus_queue.cc:1048] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:43.650498  6839 raft_consensus.cc:1275] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:43.651757  7020 consensus_queue.cc:1048] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:43.660367  6764 raft_consensus.cc:1275] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:43.662055  7012 consensus_queue.cc:1048] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:43.713217  6764 raft_consensus.cc:1275] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:43.714370  7012 consensus_queue.cc:1048] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:43.723568  6839 raft_consensus.cc:1275] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:43.725860  6977 consensus_queue.cc:1048] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:43.756131  6764 raft_consensus.cc:1275] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:43.757648  6977 consensus_queue.cc:1048] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:43.766568  6839 raft_consensus.cc:1275] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:43.768090  7020 consensus_queue.cc:1048] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:43.948251  6764 raft_consensus.cc:1275] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:43.949424  7020 consensus_queue.cc:1048] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:43.959144  6839 raft_consensus.cc:1275] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Refusing update from remote peer 486fb84edbb9421e9b66a14d4bffd6ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:43.960647  7026 consensus_queue.cc:1048] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:45.952265  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:45.960233  6691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a56bc90e16834fc69797a018889645ff"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
mode: GRACEFUL
new_leader_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:35992
I20260709 13:12:45.960760  6691 raft_consensus.cc:606] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Received request to transfer leadership to TS 9ca3677767cd4244a5584433736614fe
I20260709 13:12:45.963032  6691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
mode: GRACEFUL
new_leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
 from {username='slave'} at 127.0.0.1:35992
I20260709 13:12:45.963488  6691 raft_consensus.cc:606] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Received request to transfer leadership to TS 3385ddbdcf354cb6a3c2afe3170573be
I20260709 13:12:45.965523  6691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8416fc5086f4da896ff311339e720af"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
mode: GRACEFUL
new_leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
 from {username='slave'} at 127.0.0.1:35992
I20260709 13:12:45.965939  6691 raft_consensus.cc:606] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Received request to transfer leadership to TS 3385ddbdcf354cb6a3c2afe3170573be
I20260709 13:12:45.967981  6691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261"
dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
mode: GRACEFUL
new_leader_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:35992
I20260709 13:12:45.968405  6691 raft_consensus.cc:606] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Received request to transfer leadership to TS 9ca3677767cd4244a5584433736614fe
I20260709 13:12:45.969373  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:12:45.969832  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:46.015087  7033 raft_consensus.cc:993] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef: : Instructing follower 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:46.015542  7032 raft_consensus.cc:1081] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Signalling peer 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:46.017088  6766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a56bc90e16834fc69797a018889645ff"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:43716
I20260709 13:12:46.017643  6766 raft_consensus.cc:493] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:46.017972  6766 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.023362  6766 raft_consensus.cc:515] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.025068  6766 leader_election.cc:290] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 4 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:46.025996  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56bc90e16834fc69797a018889645ff" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:46.026235  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56bc90e16834fc69797a018889645ff" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:46.026624  6691 raft_consensus.cc:3055] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:46.026763  6839 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.026980  6691 raft_consensus.cc:740] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:46.027750  6691 consensus_queue.cc:260] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.028728  6691 raft_consensus.cc:3060] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.032210  6839 raft_consensus.cc:2468] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 4.
I20260709 13:12:46.033321  6732 leader_election.cc:304] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:46.033840  6691 raft_consensus.cc:2468] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 4.
I20260709 13:12:46.034031  6925 raft_consensus.cc:2804] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:46.035388  6925 raft_consensus.cc:697] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 4 LEADER]: Becoming Leader. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:46.036088  6925 consensus_queue.cc:237] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.042060  6588 catalog_manager.cc:5697] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe reported cstate change: term changed from 3 to 4, leader changed from 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129) to 9ca3677767cd4244a5584433736614fe (127.5.227.130). New cstate: current_term: 4 leader_uuid: "9ca3677767cd4244a5584433736614fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:46.070611  7033 raft_consensus.cc:993] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef: : Instructing follower 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:46.071053  7032 raft_consensus.cc:1081] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Signalling peer 9ca3677767cd4244a5584433736614fe to start an election
I20260709 13:12:46.072425  6766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261"
dest_uuid: "9ca3677767cd4244a5584433736614fe"
 from {username='slave'} at 127.0.0.1:43716
I20260709 13:12:46.072844  6766 raft_consensus.cc:493] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:46.073097  6766 raft_consensus.cc:3060] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.077944  6766 raft_consensus.cc:515] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.079701  6766 leader_election.cc:290] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 3 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131:44005)
I20260709 13:12:46.080451  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:46.080665  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba99fa0116da49c4aec770edf26fe261" candidate_uuid: "9ca3677767cd4244a5584433736614fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
I20260709 13:12:46.081036  6691 raft_consensus.cc:3055] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:46.081107  6839 raft_consensus.cc:3060] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.081401  6691 raft_consensus.cc:740] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:46.082166  6691 consensus_queue.cc:260] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.083290  6691 raft_consensus.cc:3060] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.087649  6839 raft_consensus.cc:2468] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 3.
I20260709 13:12:46.088832  6732 leader_election.cc:304] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:46.089392  6691 raft_consensus.cc:2468] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ca3677767cd4244a5584433736614fe in term 3.
I20260709 13:12:46.089547  6925 raft_consensus.cc:2804] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:46.089963  6925 raft_consensus.cc:697] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 3 LEADER]: Becoming Leader. State: Replica: 9ca3677767cd4244a5584433736614fe, State: Running, Role: LEADER
I20260709 13:12:46.090788  6925 consensus_queue.cc:237] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.097409  6588 catalog_manager.cc:5697] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe reported cstate change: term changed from 2 to 3, leader changed from 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129) to 9ca3677767cd4244a5584433736614fe (127.5.227.130). New cstate: current_term: 3 leader_uuid: "9ca3677767cd4244a5584433736614fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:46.253939  7033 raft_consensus.cc:993] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef: : Instructing follower 3385ddbdcf354cb6a3c2afe3170573be to start an election
I20260709 13:12:46.254447  7032 raft_consensus.cc:1081] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Signalling peer 3385ddbdcf354cb6a3c2afe3170573be to start an election
I20260709 13:12:46.255894  6839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b"
dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
 from {username='slave'} at 127.0.0.1:41774
I20260709 13:12:46.256372  6839 raft_consensus.cc:493] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:46.256675  6839 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.261106  6839 raft_consensus.cc:515] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.262610  6839 leader_election.cc:290] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 4 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:46.263628  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:46.263688  6766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a8d7fbb5f5438b82da890d340bdc1b" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:46.264394  6691 raft_consensus.cc:3055] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:46.264475  6766 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.264699  6691 raft_consensus.cc:740] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:46.265390  6691 consensus_queue.cc:260] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.266263  6691 raft_consensus.cc:3060] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.269944  6766 raft_consensus.cc:2468] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 4.
I20260709 13:12:46.271100  6805 leader_election.cc:304] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:46.271916  6985 raft_consensus.cc:2804] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:46.271924  6691 raft_consensus.cc:2468] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 4.
I20260709 13:12:46.273388  6985 raft_consensus.cc:697] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 4 LEADER]: Becoming Leader. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:46.274268  6985 consensus_queue.cc:237] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.281059  6588 catalog_manager.cc:5697] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be reported cstate change: term changed from 3 to 4, leader changed from 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129) to 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131). New cstate: current_term: 4 leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:46.284900  7033 raft_consensus.cc:993] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef: : Instructing follower 3385ddbdcf354cb6a3c2afe3170573be to start an election
I20260709 13:12:46.285503  7032 raft_consensus.cc:1081] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Signalling peer 3385ddbdcf354cb6a3c2afe3170573be to start an election
I20260709 13:12:46.287207  6839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8416fc5086f4da896ff311339e720af"
dest_uuid: "3385ddbdcf354cb6a3c2afe3170573be"
 from {username='slave'} at 127.0.0.1:41774
I20260709 13:12:46.287752  6839 raft_consensus.cc:493] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:46.288069  6839 raft_consensus.cc:3060] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.293293  6839 raft_consensus.cc:515] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.294878  6839 leader_election.cc:290] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 3 election: Requested vote from peers 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931), 9ca3677767cd4244a5584433736614fe (127.5.227.130:44957)
I20260709 13:12:46.295709  6691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8416fc5086f4da896ff311339e720af" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "486fb84edbb9421e9b66a14d4bffd6ef"
I20260709 13:12:46.295861  6766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8416fc5086f4da896ff311339e720af" candidate_uuid: "3385ddbdcf354cb6a3c2afe3170573be" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ca3677767cd4244a5584433736614fe"
I20260709 13:12:46.296324  6691 raft_consensus.cc:3055] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:46.296394  6766 raft_consensus.cc:3060] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.296592  6691 raft_consensus.cc:740] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 486fb84edbb9421e9b66a14d4bffd6ef, State: Running, Role: LEADER
I20260709 13:12:46.297287  6691 consensus_queue.cc:260] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.298132  6691 raft_consensus.cc:3060] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.301110  6766 raft_consensus.cc:2468] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 3.
I20260709 13:12:46.302217  6805 leader_election.cc:304] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3385ddbdcf354cb6a3c2afe3170573be, 9ca3677767cd4244a5584433736614fe; no voters: 
I20260709 13:12:46.302457  6691 raft_consensus.cc:2468] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3385ddbdcf354cb6a3c2afe3170573be in term 3.
I20260709 13:12:46.303138  6985 raft_consensus.cc:2804] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:46.303655  6985 raft_consensus.cc:697] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Becoming Leader. State: Replica: 3385ddbdcf354cb6a3c2afe3170573be, State: Running, Role: LEADER
I20260709 13:12:46.304538  6985 consensus_queue.cc:237] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } }
I20260709 13:12:46.311147  6588 catalog_manager.cc:5697] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be reported cstate change: term changed from 2 to 3, leader changed from 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129) to 3385ddbdcf354cb6a3c2afe3170573be (127.5.227.131). New cstate: current_term: 3 leader_uuid: "3385ddbdcf354cb6a3c2afe3170573be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:46.503109  6691 raft_consensus.cc:1275] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:46.504384  6925 consensus_queue.cc:1048] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:46.516903  6839 raft_consensus.cc:1275] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:46.518347  6925 consensus_queue.cc:1048] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:46.571550  6839 raft_consensus.cc:1275] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:46.572741  6925 consensus_queue.cc:1048] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3385ddbdcf354cb6a3c2afe3170573be" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:46.581907  6691 raft_consensus.cc:1275] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Refusing update from remote peer 9ca3677767cd4244a5584433736614fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:46.583640  7047 consensus_queue.cc:1048] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:46.713450  6691 raft_consensus.cc:1275] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Refusing update from remote peer 3385ddbdcf354cb6a3c2afe3170573be: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:46.714711  6985 consensus_queue.cc:1048] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:46.723812  6766 raft_consensus.cc:1275] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Refusing update from remote peer 3385ddbdcf354cb6a3c2afe3170573be: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:46.725293  7053 consensus_queue.cc:1048] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:46.795673  6691 raft_consensus.cc:1275] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Refusing update from remote peer 3385ddbdcf354cb6a3c2afe3170573be: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:46.796907  7053 consensus_queue.cc:1048] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "486fb84edbb9421e9b66a14d4bffd6ef" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:46.805915  6766 raft_consensus.cc:1275] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Refusing update from remote peer 3385ddbdcf354cb6a3c2afe3170573be: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:46.807436  6985 consensus_queue.cc:1048] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca3677767cd4244a5584433736614fe" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:46.970729  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:46.976540  6030 tablet_server.cc:179] TabletServer@127.5.227.129:0 shutting down...
I20260709 13:12:47.006819  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:47.007735  6030 tablet_replica.cc:333] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef: stopping tablet replica
I20260709 13:12:47.008546  6030 raft_consensus.cc:2243] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.009531  6030 raft_consensus.cc:2272] T f883b363f15346fea72784b743b14ddc P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.011497  6030 tablet_replica.cc:333] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef: stopping tablet replica
I20260709 13:12:47.012133  6030 raft_consensus.cc:2243] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.012934  6030 raft_consensus.cc:2272] T 336588db9ad34ddfb8c573e8d0faefc8 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.014750  6030 tablet_replica.cc:333] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef: stopping tablet replica
I20260709 13:12:47.015278  6030 raft_consensus.cc:2243] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.015759  6030 raft_consensus.cc:2272] T ba99fa0116da49c4aec770edf26fe261 P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.018213  6030 tablet_replica.cc:333] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef: stopping tablet replica
I20260709 13:12:47.018953  6030 raft_consensus.cc:2243] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.019999  6030 raft_consensus.cc:2272] T 63f0c06342474223ae1a8dc48fb848b9 P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.022771  6030 tablet_replica.cc:333] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef: stopping tablet replica
I20260709 13:12:47.023593  6030 raft_consensus.cc:2243] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.024143  6030 raft_consensus.cc:2272] T a56bc90e16834fc69797a018889645ff P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:47.027469  6732 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 16 similar messages]
I20260709 13:12:47.028626  6030 tablet_replica.cc:333] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef: stopping tablet replica
I20260709 13:12:47.029412  6030 raft_consensus.cc:2243] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.029995  6030 raft_consensus.cc:2272] T 6ef669dcfdf24d80b14089cf5c581591 P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:47.032017  6732 consensus_peers.cc:597] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe -> Peer 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931): Couldn't send request to peer 486fb84edbb9421e9b66a14d4bffd6ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:47.032622  6030 tablet_replica.cc:333] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef: stopping tablet replica
I20260709 13:12:47.033394  6030 raft_consensus.cc:2243] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.033852  6030 raft_consensus.cc:2272] T c1f213e0678f42cbb140b6b6c493a75e P 486fb84edbb9421e9b66a14d4bffd6ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.035658  6030 tablet_replica.cc:333] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef: stopping tablet replica
I20260709 13:12:47.036217  6030 raft_consensus.cc:2243] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.036991  6030 raft_consensus.cc:2272] T b6b00e352e2d45b79b9000b239d2254a P 486fb84edbb9421e9b66a14d4bffd6ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.038738  6030 tablet_replica.cc:333] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef: stopping tablet replica
I20260709 13:12:47.039204  6030 raft_consensus.cc:2243] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.039618  6030 raft_consensus.cc:2272] T a5a8d7fbb5f5438b82da890d340bdc1b P 486fb84edbb9421e9b66a14d4bffd6ef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.041736  6030 tablet_replica.cc:333] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef: stopping tablet replica
I20260709 13:12:47.042403  6030 raft_consensus.cc:2243] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.042856  6030 raft_consensus.cc:2272] T b8416fc5086f4da896ff311339e720af P 486fb84edbb9421e9b66a14d4bffd6ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.072834  6030 tablet_server.cc:196] TabletServer@127.5.227.129:0 shutdown complete.
I20260709 13:12:47.092308  6030 tablet_server.cc:179] TabletServer@127.5.227.130:0 shutting down...
I20260709 13:12:47.118046  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:47.118803  6030 tablet_replica.cc:333] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe: stopping tablet replica
I20260709 13:12:47.119529  6030 raft_consensus.cc:2243] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.120082  6030 raft_consensus.cc:2272] T f883b363f15346fea72784b743b14ddc P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.121994  6030 tablet_replica.cc:333] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe: stopping tablet replica
I20260709 13:12:47.122540  6030 raft_consensus.cc:2243] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.123036  6030 raft_consensus.cc:2272] T b6b00e352e2d45b79b9000b239d2254a P 9ca3677767cd4244a5584433736614fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.124760  6030 tablet_replica.cc:333] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe: stopping tablet replica
I20260709 13:12:47.125293  6030 raft_consensus.cc:2243] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.125735  6030 raft_consensus.cc:2272] T 63f0c06342474223ae1a8dc48fb848b9 P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.127642  6030 tablet_replica.cc:333] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe: stopping tablet replica
I20260709 13:12:47.128147  6030 raft_consensus.cc:2243] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.128885  6030 raft_consensus.cc:2272] T c1f213e0678f42cbb140b6b6c493a75e P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.130566  6030 tablet_replica.cc:333] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe: stopping tablet replica
I20260709 13:12:47.131157  6030 raft_consensus.cc:2243] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.131589  6030 raft_consensus.cc:2272] T 6ef669dcfdf24d80b14089cf5c581591 P 9ca3677767cd4244a5584433736614fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.133241  6030 tablet_replica.cc:333] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe: stopping tablet replica
I20260709 13:12:47.133757  6030 raft_consensus.cc:2243] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.134512  6030 raft_consensus.cc:2272] T a56bc90e16834fc69797a018889645ff P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.136622  6030 tablet_replica.cc:333] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe: stopping tablet replica
I20260709 13:12:47.137147  6030 raft_consensus.cc:2243] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.137580  6030 raft_consensus.cc:2272] T a5a8d7fbb5f5438b82da890d340bdc1b P 9ca3677767cd4244a5584433736614fe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.139834  6030 tablet_replica.cc:333] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe: stopping tablet replica
I20260709 13:12:47.140347  6030 raft_consensus.cc:2243] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.140779  6030 raft_consensus.cc:2272] T b8416fc5086f4da896ff311339e720af P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.143031  6030 tablet_replica.cc:333] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe: stopping tablet replica
I20260709 13:12:47.143509  6030 raft_consensus.cc:2243] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.143910  6030 raft_consensus.cc:2272] T 336588db9ad34ddfb8c573e8d0faefc8 P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.145550  6030 tablet_replica.cc:333] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe: stopping tablet replica
I20260709 13:12:47.146152  6030 raft_consensus.cc:2243] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.147043  6030 raft_consensus.cc:2272] T ba99fa0116da49c4aec770edf26fe261 P 9ca3677767cd4244a5584433736614fe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.168380  6030 tablet_server.cc:196] TabletServer@127.5.227.130:0 shutdown complete.
W20260709 13:12:47.170686  6806 consensus_peers.cc:597] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be -> Peer 486fb84edbb9421e9b66a14d4bffd6ef (127.5.227.129:33931): Couldn't send request to peer 486fb84edbb9421e9b66a14d4bffd6ef. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:33931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:47.187261  6030 tablet_server.cc:179] TabletServer@127.5.227.131:0 shutting down...
I20260709 13:12:47.212198  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:47.212828  6030 tablet_replica.cc:333] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be: stopping tablet replica
I20260709 13:12:47.213328  6030 raft_consensus.cc:2243] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.213811  6030 raft_consensus.cc:2272] T b6b00e352e2d45b79b9000b239d2254a P 3385ddbdcf354cb6a3c2afe3170573be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.215740  6030 tablet_replica.cc:333] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be: stopping tablet replica
I20260709 13:12:47.216343  6030 raft_consensus.cc:2243] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.216730  6030 raft_consensus.cc:2272] T f883b363f15346fea72784b743b14ddc P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.218207  6030 tablet_replica.cc:333] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be: stopping tablet replica
I20260709 13:12:47.218719  6030 raft_consensus.cc:2243] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.219054  6030 raft_consensus.cc:2272] T ba99fa0116da49c4aec770edf26fe261 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.221980  6030 tablet_replica.cc:333] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be: stopping tablet replica
I20260709 13:12:47.222517  6030 raft_consensus.cc:2243] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.223059  6030 raft_consensus.cc:2272] T 336588db9ad34ddfb8c573e8d0faefc8 P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.224690  6030 tablet_replica.cc:333] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be: stopping tablet replica
I20260709 13:12:47.225222  6030 raft_consensus.cc:2243] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.225987  6030 raft_consensus.cc:2272] T a5a8d7fbb5f5438b82da890d340bdc1b P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.228169  6030 tablet_replica.cc:333] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be: stopping tablet replica
I20260709 13:12:47.228654  6030 raft_consensus.cc:2243] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.229358  6030 raft_consensus.cc:2272] T b8416fc5086f4da896ff311339e720af P 3385ddbdcf354cb6a3c2afe3170573be [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.231431  6030 tablet_replica.cc:333] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be: stopping tablet replica
I20260709 13:12:47.231889  6030 raft_consensus.cc:2243] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.232582  6030 raft_consensus.cc:2272] T 6ef669dcfdf24d80b14089cf5c581591 P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.234169  6030 tablet_replica.cc:333] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be: stopping tablet replica
I20260709 13:12:47.234696  6030 raft_consensus.cc:2243] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.235085  6030 raft_consensus.cc:2272] T c1f213e0678f42cbb140b6b6c493a75e P 3385ddbdcf354cb6a3c2afe3170573be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.236697  6030 tablet_replica.cc:333] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be: stopping tablet replica
I20260709 13:12:47.237125  6030 raft_consensus.cc:2243] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.237517  6030 raft_consensus.cc:2272] T a56bc90e16834fc69797a018889645ff P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.239749  6030 tablet_replica.cc:333] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be: stopping tablet replica
I20260709 13:12:47.240172  6030 raft_consensus.cc:2243] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.240540  6030 raft_consensus.cc:2272] T 63f0c06342474223ae1a8dc48fb848b9 P 3385ddbdcf354cb6a3c2afe3170573be [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.260294  6030 tablet_server.cc:196] TabletServer@127.5.227.131:0 shutdown complete.
I20260709 13:12:47.280727  6030 master.cc:562] Master@127.5.227.190:45471 shutting down...
I20260709 13:12:47.302439  6030 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.303076  6030 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.303427  6030 tablet_replica.cc:333] T 00000000000000000000000000000000 P 20bc5c1ea96d40b798d6540a21620ee6: stopping tablet replica
I20260709 13:12:47.324059  6030 master.cc:584] Master@127.5.227.190:45471 shutdown complete.
3385ddbdcf354cb6a3c2afe3170573be  1
486fb84edbb9421e9b66a14d4bffd6ef  5
9ca3677767cd4244a5584433736614fe  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10668 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:12:47.367951  6030 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.227.190:45419
I20260709 13:12:47.369100  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:47.375545  7061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.375625  7060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.375967  7063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:47.376806  6030 server_base.cc:1061] running on GCE node
I20260709 13:12:47.377607  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:47.377784  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:47.377977  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602767377943 us; error 0 us; skew 500 ppm
I20260709 13:12:47.378561  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:47.381389  6030 webserver.cc:533] Webserver started at http://127.5.227.190:42901/ using document root <none> and password file <none>
I20260709 13:12:47.381911  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:47.382115  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:47.382423  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:47.383643  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/master-0-root/instance:
uuid: "50ff9c56d8414bdb8f05f31957b53075"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-tbwl"
I20260709 13:12:47.388123  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:47.391608  7068 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.392421  6030 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:12:47.392745  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/master-0-root
uuid: "50ff9c56d8414bdb8f05f31957b53075"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-tbwl"
I20260709 13:12:47.393085  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:47.409945  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:47.411284  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:47.451750  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.190:45419
I20260709 13:12:47.451855  7119 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.190:45419 every 8 connection(s)
I20260709 13:12:47.455744  7120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.466075  7120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Bootstrap starting.
I20260709 13:12:47.470976  7120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.475605  7120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: No bootstrap required, opened a new log
I20260709 13:12:47.477810  7120 raft_consensus.cc:359] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ff9c56d8414bdb8f05f31957b53075" member_type: VOTER }
I20260709 13:12:47.478266  7120 raft_consensus.cc:385] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.478523  7120 raft_consensus.cc:740] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ff9c56d8414bdb8f05f31957b53075, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.479149  7120 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ff9c56d8414bdb8f05f31957b53075" member_type: VOTER }
I20260709 13:12:47.479619  7120 raft_consensus.cc:399] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:47.479861  7120 raft_consensus.cc:493] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:47.480151  7120 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.484393  7120 raft_consensus.cc:515] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ff9c56d8414bdb8f05f31957b53075" member_type: VOTER }
I20260709 13:12:47.485013  7120 leader_election.cc:304] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50ff9c56d8414bdb8f05f31957b53075; no voters: 
I20260709 13:12:47.486145  7120 leader_election.cc:290] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:47.486490  7123 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:47.487924  7123 raft_consensus.cc:697] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [term 1 LEADER]: Becoming Leader. State: Replica: 50ff9c56d8414bdb8f05f31957b53075, State: Running, Role: LEADER
I20260709 13:12:47.488646  7123 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ff9c56d8414bdb8f05f31957b53075" member_type: VOTER }
I20260709 13:12:47.489359  7120 sys_catalog.cc:565] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:47.494068  7125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50ff9c56d8414bdb8f05f31957b53075. Latest consensus state: current_term: 1 leader_uuid: "50ff9c56d8414bdb8f05f31957b53075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ff9c56d8414bdb8f05f31957b53075" member_type: VOTER } }
I20260709 13:12:47.494850  7125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:47.495311  7124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50ff9c56d8414bdb8f05f31957b53075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ff9c56d8414bdb8f05f31957b53075" member_type: VOTER } }
I20260709 13:12:47.495807  7124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:47.496995  7130 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:47.502164  7130 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:47.506687  6030 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:47.511663  7130 catalog_manager.cc:1383] Generated new cluster ID: c4ad22961873474cbf778aad6aa8b3db
I20260709 13:12:47.511956  7130 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:47.532696  7130 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:47.533936  7130 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:47.546746  7130 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Generated new TSK 0
I20260709 13:12:47.547343  7130 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:47.573249  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:47.579182  7141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.580557  7142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:47.584005  6030 server_base.cc:1061] running on GCE node
W20260709 13:12:47.584041  7144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:47.585731  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:47.585933  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:47.586159  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602767586125 us; error 0 us; skew 500 ppm
I20260709 13:12:47.586812  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:47.589197  6030 webserver.cc:533] Webserver started at http://127.5.227.129:39195/ using document root <none> and password file <none>
I20260709 13:12:47.589694  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:47.589893  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:47.590173  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:47.591410  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/instance:
uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-tbwl"
I20260709 13:12:47.596153  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:12:47.599584  7149 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.600517  6030 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:47.600785  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root
uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-tbwl"
I20260709 13:12:47.601040  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:47.617543  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:47.618893  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:47.620358  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:47.622834  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:47.623031  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.623325  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:47.623513  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.665524  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.129:44171
I20260709 13:12:47.665612  7211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.129:44171 every 8 connection(s)
I20260709 13:12:47.670776  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:47.677299  7216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.678807  7217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.682075  7219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:47.682293  6030 server_base.cc:1061] running on GCE node
I20260709 13:12:47.683323  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:47.683605  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:47.683856  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602767683836 us; error 0 us; skew 500 ppm
I20260709 13:12:47.684546  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:47.687433  7212 heartbeater.cc:344] Connected to a master server at 127.5.227.190:45419
I20260709 13:12:47.687774  6030 webserver.cc:533] Webserver started at http://127.5.227.130:45599/ using document root <none> and password file <none>
I20260709 13:12:47.687839  7212 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:47.688376  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:47.688603  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:47.688719  7212 heartbeater.cc:507] Master 127.5.227.190:45419 requested a full tablet report, sending...
I20260709 13:12:47.688869  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:47.690315  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/instance:
uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-tbwl"
I20260709 13:12:47.691068  7085 ts_manager.cc:194] Registered new tserver with Master: 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
I20260709 13:12:47.693567  7085 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47542
I20260709 13:12:47.696673  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:47.700100  7224 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.701006  6030 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:47.701319  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root
uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-tbwl"
I20260709 13:12:47.701627  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:47.712693  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:47.713817  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:47.715263  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:47.717569  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:47.717799  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.718050  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:47.718254  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.758328  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.130:40351
I20260709 13:12:47.758455  7286 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.130:40351 every 8 connection(s)
I20260709 13:12:47.763316  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:47.771361  7290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.771957  7291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:47.774513  6030 server_base.cc:1061] running on GCE node
W20260709 13:12:47.775429  7293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:47.776599  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:47.776872  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:47.776889  7287 heartbeater.cc:344] Connected to a master server at 127.5.227.190:45419
I20260709 13:12:47.777172  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602767777150 us; error 0 us; skew 500 ppm
I20260709 13:12:47.777469  7287 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:47.777892  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:47.778285  7287 heartbeater.cc:507] Master 127.5.227.190:45419 requested a full tablet report, sending...
I20260709 13:12:47.780864  6030 webserver.cc:533] Webserver started at http://127.5.227.131:36189/ using document root <none> and password file <none>
I20260709 13:12:47.780848  7085 ts_manager.cc:194] Registered new tserver with Master: efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:47.781692  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:47.781968  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:47.782281  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:47.782900  7085 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47554
I20260709 13:12:47.783893  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/instance:
uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-tbwl"
I20260709 13:12:47.788590  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:47.792042  7298 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.792865  6030 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:47.793184  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root
uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-tbwl"
I20260709 13:12:47.793493  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:47.820178  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:47.821453  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:47.823060  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:47.825415  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:47.825608  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.825915  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:47.826083  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.866660  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.131:35093
I20260709 13:12:47.866825  7360 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.131:35093 every 8 connection(s)
I20260709 13:12:47.880951  7361 heartbeater.cc:344] Connected to a master server at 127.5.227.190:45419
I20260709 13:12:47.881330  7361 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:47.882025  7361 heartbeater.cc:507] Master 127.5.227.190:45419 requested a full tablet report, sending...
I20260709 13:12:47.884142  7085 ts_manager.cc:194] Registered new tserver with Master: c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:47.884676  6030 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01469379s
I20260709 13:12:47.885600  7085 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47556
I20260709 13:12:47.912236  7085 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47570:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:47.918893  7085 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:48.121577  7177 tablet_service.cc:1511] Processing CreateTablet for tablet 4039a3dd715849edb6b8786f89e1a1b3 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:48.123231  7177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4039a3dd715849edb6b8786f89e1a1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.128296  7176 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddda14494534865a2d45ddae7f3ec93 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:48.129967  7176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddda14494534865a2d45ddae7f3ec93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.133526  7252 tablet_service.cc:1511] Processing CreateTablet for tablet 4039a3dd715849edb6b8786f89e1a1b3 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:48.135382  7248 tablet_service.cc:1511] Processing CreateTablet for tablet be83b72d4b17414e8521b6707cd8a597 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:48.135943  7251 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddda14494534865a2d45ddae7f3ec93 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:48.136888  7248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be83b72d4b17414e8521b6707cd8a597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.139861  7249 tablet_service.cc:1511] Processing CreateTablet for tablet 4278a1ff7e0c4ce4a86d4e7b748f9557 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:48.140930  7247 tablet_service.cc:1511] Processing CreateTablet for tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:48.138511  7250 tablet_service.cc:1511] Processing CreateTablet for tablet de90ec51ea634c3d8b220c16d71b8cdf (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:48.141343  7249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4278a1ff7e0c4ce4a86d4e7b748f9557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.143275  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4039a3dd715849edb6b8786f89e1a1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.144151  7247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.147012  7251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddda14494534865a2d45ddae7f3ec93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.148945  7246 tablet_service.cc:1511] Processing CreateTablet for tablet cb7edd6d1f1343c1868f27ecb9a9ae9d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:48.149253  7326 tablet_service.cc:1511] Processing CreateTablet for tablet 4039a3dd715849edb6b8786f89e1a1b3 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:48.150408  7246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7edd6d1f1343c1868f27ecb9a9ae9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.151938  7325 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddda14494534865a2d45ddae7f3ec93 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:48.152311  7319 tablet_service.cc:1511] Processing CreateTablet for tablet e247e49279304bdfa2f0146e714dc287 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:48.155833  7323 tablet_service.cc:1511] Processing CreateTablet for tablet 4278a1ff7e0c4ce4a86d4e7b748f9557 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:48.156931  7318 tablet_service.cc:1511] Processing CreateTablet for tablet db390910c47342dc848e258ef7dac1bd (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:48.158245  7320 tablet_service.cc:1511] Processing CreateTablet for tablet cb7edd6d1f1343c1868f27ecb9a9ae9d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:48.160641  7321 tablet_service.cc:1511] Processing CreateTablet for tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:48.160485  7317 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba8ab4b505c46299ab836854622094b (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:48.163300  7322 tablet_service.cc:1511] Processing CreateTablet for tablet be83b72d4b17414e8521b6707cd8a597 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:48.154431  7324 tablet_service.cc:1511] Processing CreateTablet for tablet de90ec51ea634c3d8b220c16d71b8cdf (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:48.165110  7250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de90ec51ea634c3d8b220c16d71b8cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.167459  7326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4039a3dd715849edb6b8786f89e1a1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.169364  7245 tablet_service.cc:1511] Processing CreateTablet for tablet e247e49279304bdfa2f0146e714dc287 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:48.170827  7245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e247e49279304bdfa2f0146e714dc287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.171077  7323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4278a1ff7e0c4ce4a86d4e7b748f9557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.175009  7320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7edd6d1f1343c1868f27ecb9a9ae9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.174806  7244 tablet_service.cc:1511] Processing CreateTablet for tablet db390910c47342dc848e258ef7dac1bd (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:48.177335  7244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db390910c47342dc848e258ef7dac1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.179167  7321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.180055  7324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de90ec51ea634c3d8b220c16d71b8cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.180967  7322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be83b72d4b17414e8521b6707cd8a597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.181921  7318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db390910c47342dc848e258ef7dac1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.183094  7319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e247e49279304bdfa2f0146e714dc287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.183971  7325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddda14494534865a2d45ddae7f3ec93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.185338  7317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba8ab4b505c46299ab836854622094b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.213397  7243 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba8ab4b505c46299ab836854622094b (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:48.213397  7175 tablet_service.cc:1511] Processing CreateTablet for tablet de90ec51ea634c3d8b220c16d71b8cdf (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:48.215107  7174 tablet_service.cc:1511] Processing CreateTablet for tablet 4278a1ff7e0c4ce4a86d4e7b748f9557 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:48.216099  7175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de90ec51ea634c3d8b220c16d71b8cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.217890  7173 tablet_service.cc:1511] Processing CreateTablet for tablet be83b72d4b17414e8521b6707cd8a597 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:48.218886  7243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba8ab4b505c46299ab836854622094b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.219411  7173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be83b72d4b17414e8521b6707cd8a597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.223583  7174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4278a1ff7e0c4ce4a86d4e7b748f9557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.227999  7172 tablet_service.cc:1511] Processing CreateTablet for tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:48.231127  7172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.232434  7171 tablet_service.cc:1511] Processing CreateTablet for tablet cb7edd6d1f1343c1868f27ecb9a9ae9d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:48.234095  7171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7edd6d1f1343c1868f27ecb9a9ae9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.241657  7170 tablet_service.cc:1511] Processing CreateTablet for tablet e247e49279304bdfa2f0146e714dc287 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:48.242527  7169 tablet_service.cc:1511] Processing CreateTablet for tablet db390910c47342dc848e258ef7dac1bd (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:48.243521  7170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e247e49279304bdfa2f0146e714dc287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.246366  7168 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba8ab4b505c46299ab836854622094b (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:48.248016  7168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba8ab4b505c46299ab836854622094b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.251132  7169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db390910c47342dc848e258ef7dac1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.309676  7320 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa9c7bddd6f49acad7c47c33c761358 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:48.320915  7249 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa9c7bddd6f49acad7c47c33c761358 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:48.345582  7176 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa9c7bddd6f49acad7c47c33c761358 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:48.350524  7176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa9c7bddd6f49acad7c47c33c761358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.349092  7318 tablet_service.cc:1511] Processing CreateTablet for tablet f7dc72492fc64c638202c7715a2a72ac (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:48.360059  7250 tablet_service.cc:1511] Processing CreateTablet for tablet f7dc72492fc64c638202c7715a2a72ac (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:48.360091  7252 tablet_service.cc:1511] Processing CreateTablet for tablet c89d6774062049379248eca324d137c6 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:48.361711  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d6774062049379248eca324d137c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.363574  7376 tablet_bootstrap.cc:492] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:48.366389  7378 tablet_bootstrap.cc:492] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:48.367432  7245 tablet_service.cc:1511] Processing CreateTablet for tablet 221fa6fca3154a49b5efa9c28f8c4cd8 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:48.376333  7176 tablet_service.cc:1511] Processing CreateTablet for tablet 221fa6fca3154a49b5efa9c28f8c4cd8 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:48.377869  7176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 221fa6fca3154a49b5efa9c28f8c4cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.386238  7324 tablet_service.cc:1511] Processing CreateTablet for tablet 221fa6fca3154a49b5efa9c28f8c4cd8 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:48.388757  7170 tablet_service.cc:1511] Processing CreateTablet for tablet a4c394fe784e4244b68716ee824f271f (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:48.389851  7323 tablet_service.cc:1511] Processing CreateTablet for tablet a4c394fe784e4244b68716ee824f271f (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:48.390774  7245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 221fa6fca3154a49b5efa9c28f8c4cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.391489  7250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7dc72492fc64c638202c7715a2a72ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.394912  7320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa9c7bddd6f49acad7c47c33c761358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.392078  7177 tablet_service.cc:1511] Processing CreateTablet for tablet c89d6774062049379248eca324d137c6 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:48.396745  7249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa9c7bddd6f49acad7c47c33c761358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.391254  7317 tablet_service.cc:1511] Processing CreateTablet for tablet c89d6774062049379248eca324d137c6 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:48.401566  7319 tablet_service.cc:1511] Processing CreateTablet for tablet 23e0840e609849f8bd379d43569463c8 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:48.400177  7326 tablet_service.cc:1511] Processing CreateTablet for tablet eac161a9db63471dbd87b41a92fe1202 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:48.402387  7325 tablet_service.cc:1511] Processing CreateTablet for tablet 458ab76409d4427f8ab55d4d71ca5799 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:48.409003  7318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7dc72492fc64c638202c7715a2a72ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.411657  7243 tablet_service.cc:1511] Processing CreateTablet for tablet dd122c1cdfa84f8ea52721a14c58c4e2 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:48.413154  7243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd122c1cdfa84f8ea52721a14c58c4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.413691  7317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d6774062049379248eca324d137c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.418677  7173 tablet_service.cc:1511] Processing CreateTablet for tablet f7dc72492fc64c638202c7715a2a72ac (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:48.419152  7252 tablet_service.cc:1511] Processing CreateTablet for tablet eac161a9db63471dbd87b41a92fe1202 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:48.419827  7323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c394fe784e4244b68716ee824f271f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.420436  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac161a9db63471dbd87b41a92fe1202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.411715  7171 tablet_service.cc:1511] Processing CreateTablet for tablet eac161a9db63471dbd87b41a92fe1202 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:48.431288  7324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 221fa6fca3154a49b5efa9c28f8c4cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.436622  7175 tablet_service.cc:1511] Processing CreateTablet for tablet 23e0840e609849f8bd379d43569463c8 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:48.443389  7377 tablet_bootstrap.cc:492] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:48.447582  7252 tablet_service.cc:1511] Processing CreateTablet for tablet 5584200aff994405b2de3e35528fb3cd (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:48.434027  7244 tablet_service.cc:1511] Processing CreateTablet for tablet b2278b8a74ae4c04882dae719a92af7d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:48.448966  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5584200aff994405b2de3e35528fb3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.448271  7248 tablet_service.cc:1511] Processing CreateTablet for tablet a4c394fe784e4244b68716ee824f271f (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:48.449558  7173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7dc72492fc64c638202c7715a2a72ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.450014  7376 tablet_bootstrap.cc:654] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.450544  7248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c394fe784e4244b68716ee824f271f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.451141  7171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac161a9db63471dbd87b41a92fe1202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.451706  7244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2278b8a74ae4c04882dae719a92af7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.454980  7177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d6774062049379248eca324d137c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.455819  7174 tablet_service.cc:1511] Processing CreateTablet for tablet 458ab76409d4427f8ab55d4d71ca5799 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:48.457298  7174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458ab76409d4427f8ab55d4d71ca5799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.459208  7175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e0840e609849f8bd379d43569463c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.459729  7378 tablet_bootstrap.cc:654] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.453440  7326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac161a9db63471dbd87b41a92fe1202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.462210  7325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458ab76409d4427f8ab55d4d71ca5799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.465983  7247 tablet_service.cc:1511] Processing CreateTablet for tablet 23e0840e609849f8bd379d43569463c8 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:48.467825  7247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e0840e609849f8bd379d43569463c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.475219  7170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c394fe784e4244b68716ee824f271f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.479212  7319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e0840e609849f8bd379d43569463c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.484400  7252 tablet_service.cc:1511] Processing CreateTablet for tablet 61f52d3e2071488c9b6c59c9b028e118 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:48.485834  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61f52d3e2071488c9b6c59c9b028e118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.487528  7321 tablet_service.cc:1511] Processing CreateTablet for tablet b2278b8a74ae4c04882dae719a92af7d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:48.488943  7321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2278b8a74ae4c04882dae719a92af7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.489622  7168 tablet_service.cc:1511] Processing CreateTablet for tablet b2278b8a74ae4c04882dae719a92af7d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:48.491868  7246 tablet_service.cc:1511] Processing CreateTablet for tablet 3cb8aa5713ef402a91f009eb4f97885e (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:48.493183  7246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb8aa5713ef402a91f009eb4f97885e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.495206  7251 tablet_service.cc:1511] Processing CreateTablet for tablet 458ab76409d4427f8ab55d4d71ca5799 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:48.496505  7251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458ab76409d4427f8ab55d4d71ca5799. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:48.501778  7133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:48.503516  7168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2278b8a74ae4c04882dae719a92af7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.522943  7252 tablet_service.cc:1511] Processing CreateTablet for tablet 296c0d2843ee4e21a7fdc0240b67a7cc (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:48.524430  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296c0d2843ee4e21a7fdc0240b67a7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.528338  7376 tablet_bootstrap.cc:492] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:48.528884  7376 ts_tablet_manager.cc:1403] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.000s
I20260709 13:12:48.543632  7252 tablet_service.cc:1511] Processing CreateTablet for tablet adaaa8fc7441471b9727128476437ccc (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:48.544991  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adaaa8fc7441471b9727128476437ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.559204  7169 tablet_service.cc:1511] Processing CreateTablet for tablet 5584200aff994405b2de3e35528fb3cd (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:48.560683  7169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5584200aff994405b2de3e35528fb3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.563869  7252 tablet_service.cc:1511] Processing CreateTablet for tablet 8023e86d50f847c7a841c09b7692edeb (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:48.565331  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8023e86d50f847c7a841c09b7692edeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.565620  7322 tablet_service.cc:1511] Processing CreateTablet for tablet 5584200aff994405b2de3e35528fb3cd (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:48.571717  7318 tablet_service.cc:1511] Processing CreateTablet for tablet 61f52d3e2071488c9b6c59c9b028e118 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:48.582564  7252 tablet_service.cc:1511] Processing CreateTablet for tablet 88b1df9cb24b4dc88a4735a646ad8575 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:48.573985  7324 tablet_service.cc:1511] Processing CreateTablet for tablet 3cb8aa5713ef402a91f009eb4f97885e (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:48.574968  7322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5584200aff994405b2de3e35528fb3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.589154  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b1df9cb24b4dc88a4735a646ad8575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.579813  7323 tablet_service.cc:1511] Processing CreateTablet for tablet 296c0d2843ee4e21a7fdc0240b67a7cc (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:48.576213  7377 tablet_bootstrap.cc:654] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.576284  7176 tablet_service.cc:1511] Processing CreateTablet for tablet 61f52d3e2071488c9b6c59c9b028e118 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:48.616366  7324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb8aa5713ef402a91f009eb4f97885e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.617314  7248 tablet_service.cc:1511] Processing CreateTablet for tablet b3393557a6cf4e58b575e336ba525fe9 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:48.618964  7248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3393557a6cf4e58b575e336ba525fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.619107  7317 tablet_service.cc:1511] Processing CreateTablet for tablet dd122c1cdfa84f8ea52721a14c58c4e2 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:48.619604  7172 tablet_service.cc:1511] Processing CreateTablet for tablet 296c0d2843ee4e21a7fdc0240b67a7cc (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:48.630273  7250 tablet_service.cc:1511] Processing CreateTablet for tablet 3106224ab6d746898c7fb52a0788256d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:48.632069  7176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61f52d3e2071488c9b6c59c9b028e118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.640446  7376 raft_consensus.cc:359] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:48.641266  7376 raft_consensus.cc:385] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.641589  7376 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.642343  7376 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:48.645397  7174 tablet_service.cc:1511] Processing CreateTablet for tablet dd122c1cdfa84f8ea52721a14c58c4e2 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:48.646458  7172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296c0d2843ee4e21a7fdc0240b67a7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.645121  7252 tablet_service.cc:1511] Processing CreateTablet for tablet ad4f3c0328924ddaba5d93fe80e78a64 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:48.649322  7174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd122c1cdfa84f8ea52721a14c58c4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.655954  7171 tablet_service.cc:1511] Processing CreateTablet for tablet adaaa8fc7441471b9727128476437ccc (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:48.660076  7171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adaaa8fc7441471b9727128476437ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.664080  7173 tablet_service.cc:1511] Processing CreateTablet for tablet 8023e86d50f847c7a841c09b7692edeb (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:48.665779  7173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8023e86d50f847c7a841c09b7692edeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.674904  7250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3106224ab6d746898c7fb52a0788256d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.675897  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4f3c0328924ddaba5d93fe80e78a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.681000  7170 tablet_service.cc:1511] Processing CreateTablet for tablet 3106224ab6d746898c7fb52a0788256d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:48.682189  7323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296c0d2843ee4e21a7fdc0240b67a7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.682543  7170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3106224ab6d746898c7fb52a0788256d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.683187  7317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd122c1cdfa84f8ea52721a14c58c4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.648380  7175 tablet_service.cc:1511] Processing CreateTablet for tablet 3cb8aa5713ef402a91f009eb4f97885e (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:48.688057  7175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb8aa5713ef402a91f009eb4f97885e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.680969  7174 tablet_service.cc:1511] Processing CreateTablet for tablet 88b1df9cb24b4dc88a4735a646ad8575 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:48.689782  7174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b1df9cb24b4dc88a4735a646ad8575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.696763  7212 heartbeater.cc:499] Master 127.5.227.190:45419 was elected leader, sending a full tablet report...
W20260709 13:12:48.702870  7072 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54036.3us
W20260709 13:12:48.706708  7071 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49977.2us
I20260709 13:12:48.707325  7318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61f52d3e2071488c9b6c59c9b028e118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.720676  7378 tablet_bootstrap.cc:492] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:48.720602  7246 tablet_service.cc:1511] Processing CreateTablet for tablet d735c64b62484486814db631ca028bdb (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:48.721228  7378 ts_tablet_manager.cc:1403] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.355s	user 0.010s	sys 0.019s
I20260709 13:12:48.722009  7246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d735c64b62484486814db631ca028bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.722661  7321 tablet_service.cc:1511] Processing CreateTablet for tablet adaaa8fc7441471b9727128476437ccc (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:48.724280  7378 raft_consensus.cc:359] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:48.725069  7378 raft_consensus.cc:385] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.725374  7378 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.735615  7251 tablet_service.cc:1511] Processing CreateTablet for tablet 2486da35b1ff416a9879e8c0588f1db9 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:48.737010  7251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2486da35b1ff416a9879e8c0588f1db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.740285  7325 tablet_service.cc:1511] Processing CreateTablet for tablet 8023e86d50f847c7a841c09b7692edeb (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:48.741804  7325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8023e86d50f847c7a841c09b7692edeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.746444  7321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adaaa8fc7441471b9727128476437ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.748765  7177 tablet_service.cc:1511] Processing CreateTablet for tablet ad4f3c0328924ddaba5d93fe80e78a64 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:48.749444  7320 tablet_service.cc:1511] Processing CreateTablet for tablet 88b1df9cb24b4dc88a4735a646ad8575 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:48.750162  7177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4f3c0328924ddaba5d93fe80e78a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.726280  7378 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:48.752004  7326 tablet_service.cc:1511] Processing CreateTablet for tablet 3106224ab6d746898c7fb52a0788256d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:48.757205  7245 tablet_service.cc:1511] Processing CreateTablet for tablet 50a190f80864482f8c9dfc9a627c1d6d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:48.757937  7170 tablet_service.cc:1511] Processing CreateTablet for tablet d735c64b62484486814db631ca028bdb (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:48.758608  7245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a190f80864482f8c9dfc9a627c1d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.759270  7170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d735c64b62484486814db631ca028bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.762705  7319 tablet_service.cc:1511] Processing CreateTablet for tablet ad4f3c0328924ddaba5d93fe80e78a64 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:48.770833  7320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b1df9cb24b4dc88a4735a646ad8575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.780917  7326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3106224ab6d746898c7fb52a0788256d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.786823  7287 heartbeater.cc:499] Master 127.5.227.190:45419 was elected leader, sending a full tablet report...
I20260709 13:12:48.789316  7249 tablet_service.cc:1511] Processing CreateTablet for tablet b0eff9774a9c435d955814f903cb2401 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:48.790730  7249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0eff9774a9c435d955814f903cb2401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.795696  7378 ts_tablet_manager.cc:1434] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.074s	user 0.000s	sys 0.011s
I20260709 13:12:48.795524  7168 tablet_service.cc:1511] Processing CreateTablet for tablet 2486da35b1ff416a9879e8c0588f1db9 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:48.796809  7378 tablet_bootstrap.cc:492] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:48.796979  7168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2486da35b1ff416a9879e8c0588f1db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.800688  7244 tablet_service.cc:1511] Processing CreateTablet for tablet 06475a21ebc249129fc41345c177538a (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:48.802131  7244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06475a21ebc249129fc41345c177538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.804364  7174 tablet_service.cc:1511] Processing CreateTablet for tablet 50a190f80864482f8c9dfc9a627c1d6d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:48.805800  7174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a190f80864482f8c9dfc9a627c1d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.806809  7252 tablet_service.cc:1511] Processing CreateTablet for tablet 5626b16aa2aa438290520c1b9b979802 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:48.808053  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5626b16aa2aa438290520c1b9b979802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.817641  7243 tablet_service.cc:1511] Processing CreateTablet for tablet 5920bb7e53034c2688b18dfe352590c8 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:48.819118  7243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5920bb7e53034c2688b18dfe352590c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.819891  7169 tablet_service.cc:1511] Processing CreateTablet for tablet 5626b16aa2aa438290520c1b9b979802 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:48.821250  7169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5626b16aa2aa438290520c1b9b979802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.823107  7322 tablet_service.cc:1511] Processing CreateTablet for tablet d735c64b62484486814db631ca028bdb (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:48.826669  7318 tablet_service.cc:1511] Processing CreateTablet for tablet 2486da35b1ff416a9879e8c0588f1db9 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:48.830021  7247 tablet_service.cc:1511] Processing CreateTablet for tablet cb3d8971d9be4ed09286c9b433d050b2 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:48.831446  7247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3d8971d9be4ed09286c9b433d050b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.835027  7171 tablet_service.cc:1511] Processing CreateTablet for tablet b3393557a6cf4e58b575e336ba525fe9 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:48.836359  7171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3393557a6cf4e58b575e336ba525fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.838599  7319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4f3c0328924ddaba5d93fe80e78a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.840499  7322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d735c64b62484486814db631ca028bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.842290  7318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2486da35b1ff416a9879e8c0588f1db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.873411  7376 ts_tablet_manager.cc:1434] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.344s	user 0.007s	sys 0.013s
I20260709 13:12:48.883703  7317 tablet_service.cc:1511] Processing CreateTablet for tablet b3393557a6cf4e58b575e336ba525fe9 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:48.885704  7317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3393557a6cf4e58b575e336ba525fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.888477  7361 heartbeater.cc:499] Master 127.5.227.190:45419 was elected leader, sending a full tablet report...
I20260709 13:12:48.897306  7173 tablet_service.cc:1511] Processing CreateTablet for tablet b0eff9774a9c435d955814f903cb2401 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:48.911269  7377 tablet_bootstrap.cc:492] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:48.911819  7377 ts_tablet_manager.cc:1403] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.469s	user 0.017s	sys 0.014s
I20260709 13:12:48.915165  7376 tablet_bootstrap.cc:492] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:48.917802  7378 tablet_bootstrap.cc:654] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.858161  7250 tablet_service.cc:1511] Processing CreateTablet for tablet 788b854112d74649a8e966f1fe824f3f (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:48.931641  7250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788b854112d74649a8e966f1fe824f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.933414  7319 tablet_service.cc:1511] Processing CreateTablet for tablet 50a190f80864482f8c9dfc9a627c1d6d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:48.939358  7173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0eff9774a9c435d955814f903cb2401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.942812  7175 tablet_service.cc:1511] Processing CreateTablet for tablet 5920bb7e53034c2688b18dfe352590c8 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:48.944274  7175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5920bb7e53034c2688b18dfe352590c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.933521  7172 tablet_service.cc:1511] Processing CreateTablet for tablet 06475a21ebc249129fc41345c177538a (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:48.949482  7172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06475a21ebc249129fc41345c177538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.882603  7246 tablet_service.cc:1511] Processing CreateTablet for tablet ab82ab5b0c4442cd8a05ee133017c2e0 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:48.951766  7319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a190f80864482f8c9dfc9a627c1d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.952346  7246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab82ab5b0c4442cd8a05ee133017c2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.957808  7322 tablet_service.cc:1511] Processing CreateTablet for tablet b0eff9774a9c435d955814f903cb2401 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:48.963652  7174 tablet_service.cc:1511] Processing CreateTablet for tablet cb3d8971d9be4ed09286c9b433d050b2 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:48.947291  7323 tablet_service.cc:1511] Processing CreateTablet for tablet 5626b16aa2aa438290520c1b9b979802 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:48.965267  7174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3d8971d9be4ed09286c9b433d050b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.965710  7323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5626b16aa2aa438290520c1b9b979802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.969161  7322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0eff9774a9c435d955814f903cb2401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.968573  7377 raft_consensus.cc:359] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:48.982416  7377 raft_consensus.cc:385] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.984586  7377 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.985558  7377 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:48.983040  7378 tablet_bootstrap.cc:492] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:48.983901  7318 tablet_service.cc:1511] Processing CreateTablet for tablet 5920bb7e53034c2688b18dfe352590c8 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:48.988711  7378 ts_tablet_manager.cc:1403] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.192s	user 0.015s	sys 0.011s
I20260709 13:12:48.993413  7247 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9487fc89de4e68b395c4a70193c3b6 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:48.994525  7318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5920bb7e53034c2688b18dfe352590c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.995471  7378 raft_consensus.cc:359] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.003001  7378 raft_consensus.cc:385] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.003427  7378 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.996269  7247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9487fc89de4e68b395c4a70193c3b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.005348  7169 tablet_service.cc:1511] Processing CreateTablet for tablet 788b854112d74649a8e966f1fe824f3f (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:49.006332  7378 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.007952  7377 ts_tablet_manager.cc:1434] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260709 13:12:49.015695  7377 tablet_bootstrap.cc:492] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:49.015591  7324 tablet_service.cc:1511] Processing CreateTablet for tablet 06475a21ebc249129fc41345c177538a (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:49.040853  7324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06475a21ebc249129fc41345c177538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.046167  7377 tablet_bootstrap.cc:654] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.016732  7323 tablet_service.cc:1511] Processing CreateTablet for tablet 788b854112d74649a8e966f1fe824f3f (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:49.048110  7323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788b854112d74649a8e966f1fe824f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.047848  7176 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9487fc89de4e68b395c4a70193c3b6 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:49.049065  7169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788b854112d74649a8e966f1fe824f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.022797  7319 tablet_service.cc:1511] Processing CreateTablet for tablet ab82ab5b0c4442cd8a05ee133017c2e0 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:49.052021  7319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab82ab5b0c4442cd8a05ee133017c2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.018330  7376 tablet_bootstrap.cc:654] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.002429  7321 tablet_service.cc:1511] Processing CreateTablet for tablet cb3d8971d9be4ed09286c9b433d050b2 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:49.059911  7321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3d8971d9be4ed09286c9b433d050b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.033562  7249 tablet_service.cc:1511] Processing CreateTablet for tablet 5044ec7fc5dd45979aa778b49eba1ead (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:49.064143  7249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5044ec7fc5dd45979aa778b49eba1ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.017441  7378 ts_tablet_manager.cc:1434] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:12:49.071770  7378 tablet_bootstrap.cc:492] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:49.074924  7377 tablet_bootstrap.cc:492] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:49.038928  7252 tablet_service.cc:1511] Processing CreateTablet for tablet 4637971bd855417fac5632325ab8f119 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:49.034261  7322 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9487fc89de4e68b395c4a70193c3b6 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:49.076023  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4637971bd855417fac5632325ab8f119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.076535  7322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9487fc89de4e68b395c4a70193c3b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.039450  7318 tablet_service.cc:1511] Processing CreateTablet for tablet 5044ec7fc5dd45979aa778b49eba1ead (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:49.084239  7318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5044ec7fc5dd45979aa778b49eba1ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.085028  7377 ts_tablet_manager.cc:1403] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.006s
I20260709 13:12:49.086055  7378 tablet_bootstrap.cc:654] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.087636  7324 tablet_service.cc:1511] Processing CreateTablet for tablet 4637971bd855417fac5632325ab8f119 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:49.089177  7324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4637971bd855417fac5632325ab8f119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.027990  7177 tablet_service.cc:1511] Processing CreateTablet for tablet ab82ab5b0c4442cd8a05ee133017c2e0 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:49.090463  7177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab82ab5b0c4442cd8a05ee133017c2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.096233  7377 raft_consensus.cc:359] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.103390  7377 raft_consensus.cc:385] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.111326  7381 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.111806  7381 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.112684  7173 tablet_service.cc:1511] Processing CreateTablet for tablet 5044ec7fc5dd45979aa778b49eba1ead (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:49.113802  7171 tablet_service.cc:1511] Processing CreateTablet for tablet 4637971bd855417fac5632325ab8f119 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:49.110742  7377 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.129081  7378 tablet_bootstrap.cc:492] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:49.117198  7381 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:49.131472  7176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9487fc89de4e68b395c4a70193c3b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.140946  7168 tablet_service.cc:1511] Processing CreateTablet for tablet 8ffda2d3bf0b4684a675dae01ebe1c35 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:49.146132  7252 tablet_service.cc:1511] Processing CreateTablet for tablet 8ffda2d3bf0b4684a675dae01ebe1c35 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:49.147293  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ffda2d3bf0b4684a675dae01ebe1c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.141606  7378 ts_tablet_manager.cc:1403] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.003s
I20260709 13:12:49.168802  7383 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.169340  7383 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.172722  7378 raft_consensus.cc:359] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.173839  7378 raft_consensus.cc:385] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.188297  7376 tablet_bootstrap.cc:492] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:49.192404  7383 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:49.193168  7383 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.193759  7383 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.184542  7168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ffda2d3bf0b4684a675dae01ebe1c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.196811  7319 tablet_service.cc:1511] Processing CreateTablet for tablet 8ffda2d3bf0b4684a675dae01ebe1c35 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:49.198153  7319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ffda2d3bf0b4684a675dae01ebe1c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.198848  7175 tablet_service.cc:1511] Processing CreateTablet for tablet 50bbf75da7f04c6cb95c0f589775820b (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:49.200073  7175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bbf75da7f04c6cb95c0f589775820b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.201719  7173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5044ec7fc5dd45979aa778b49eba1ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.201565  7322 tablet_service.cc:1511] Processing CreateTablet for tablet 50bbf75da7f04c6cb95c0f589775820b (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:49.202848  7322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bbf75da7f04c6cb95c0f589775820b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.210003  7169 tablet_service.cc:1511] Processing CreateTablet for tablet 71d8ccd854bc453397ebc79aefe1c520 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:49.211445  7169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71d8ccd854bc453397ebc79aefe1c520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.215752  7323 tablet_service.cc:1511] Processing CreateTablet for tablet 71d8ccd854bc453397ebc79aefe1c520 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:49.175387  7377 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.217375  7323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71d8ccd854bc453397ebc79aefe1c520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.174263  7378 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.219138  7377 ts_tablet_manager.cc:1434] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.133s	user 0.008s	sys 0.000s
I20260709 13:12:49.227012  7171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4637971bd855417fac5632325ab8f119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.191293  7376 ts_tablet_manager.cc:1403] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.316s	user 0.018s	sys 0.017s
I20260709 13:12:49.246945  7172 tablet_service.cc:1511] Processing CreateTablet for tablet 90c9778e4f484bb7ab035094ae2c24c9 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:49.247650  7383 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:49.248422  7172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c9778e4f484bb7ab035094ae2c24c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.259578  7171 tablet_service.cc:1511] Processing CreateTablet for tablet cb0912958bd849238a8f104a7916c427 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:49.261646  7171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb0912958bd849238a8f104a7916c427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.224711  7378 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.281128  7378 ts_tablet_manager.cc:1434] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.000s
I20260709 13:12:49.289729  7177 tablet_service.cc:1511] Processing CreateTablet for tablet d8d111efe5ab4e9cad378e4ebfdeb996 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:49.291359  7177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d111efe5ab4e9cad378e4ebfdeb996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.295001  7377 tablet_bootstrap.cc:492] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:49.314815  7252 tablet_service.cc:1511] Processing CreateTablet for tablet 71d8ccd854bc453397ebc79aefe1c520 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:49.315304  7246 tablet_service.cc:1511] Processing CreateTablet for tablet 90c9778e4f484bb7ab035094ae2c24c9 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:49.316066  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71d8ccd854bc453397ebc79aefe1c520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.315855  7249 tablet_service.cc:1511] Processing CreateTablet for tablet 50bbf75da7f04c6cb95c0f589775820b (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:49.317414  7250 tablet_service.cc:1511] Processing CreateTablet for tablet cb0912958bd849238a8f104a7916c427 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:49.318702  7250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb0912958bd849238a8f104a7916c427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.319514  7247 tablet_service.cc:1511] Processing CreateTablet for tablet d8d111efe5ab4e9cad378e4ebfdeb996 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:49.320748  7247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d111efe5ab4e9cad378e4ebfdeb996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.322963  7246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c9778e4f484bb7ab035094ae2c24c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.326411  7249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bbf75da7f04c6cb95c0f589775820b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.327072  7171 tablet_service.cc:1511] Processing CreateTablet for tablet 8df49b022aa74a6481683d10c4fcc035 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:49.330307  7324 tablet_service.cc:1511] Processing CreateTablet for tablet cb0912958bd849238a8f104a7916c427 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:49.332195  7245 tablet_service.cc:1511] Processing CreateTablet for tablet 8df49b022aa74a6481683d10c4fcc035 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:49.338475  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:49.339529  7245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df49b022aa74a6481683d10c4fcc035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.332736  7321 tablet_service.cc:1511] Processing CreateTablet for tablet d8d111efe5ab4e9cad378e4ebfdeb996 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:49.338421  7171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df49b022aa74a6481683d10c4fcc035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.339571  7318 tablet_service.cc:1511] Processing CreateTablet for tablet 8df49b022aa74a6481683d10c4fcc035 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:49.344714  7174 tablet_service.cc:1511] Processing CreateTablet for tablet 39cd4b2ac236480091e1c72b42541e94 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:49.345750  7318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df49b022aa74a6481683d10c4fcc035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.346616  7251 tablet_service.cc:1511] Processing CreateTablet for tablet 39cd4b2ac236480091e1c72b42541e94 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:49.347656  7174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cd4b2ac236480091e1c72b42541e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.348021  7251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cd4b2ac236480091e1c72b42541e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.323210  7378 tablet_bootstrap.cc:492] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
W20260709 13:12:49.350805  7150 leader_election.cc:343] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.353039  7319 tablet_service.cc:1511] Processing CreateTablet for tablet 39cd4b2ac236480091e1c72b42541e94 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:49.356240  7170 tablet_service.cc:1511] Processing CreateTablet for tablet edb4d64ffd0f4bed80982e942f1033c3 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:49.358361  7321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d111efe5ab4e9cad378e4ebfdeb996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.361864  7319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cd4b2ac236480091e1c72b42541e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.362308  7243 tablet_service.cc:1511] Processing CreateTablet for tablet edb4d64ffd0f4bed80982e942f1033c3 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:49.363821  7170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb4d64ffd0f4bed80982e942f1033c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.367033  7324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb0912958bd849238a8f104a7916c427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.371001  7243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb4d64ffd0f4bed80982e942f1033c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.378782  7376 raft_consensus.cc:359] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.379645  7376 raft_consensus.cc:385] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.379961  7376 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.380764  7376 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.384315  7376 ts_tablet_manager.cc:1434] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.147s	user 0.005s	sys 0.002s
I20260709 13:12:49.386914  7376 tablet_bootstrap.cc:492] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:49.387145  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:12:49.389624  7152 leader_election.cc:343] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.390153  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:49.353041  7322 tablet_service.cc:1511] Processing CreateTablet for tablet 90c9778e4f484bb7ab035094ae2c24c9 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:49.391484  7381 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.391757  7322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c9778e4f484bb7ab035094ae2c24c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.393581  7376 tablet_bootstrap.cc:654] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.395900  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:49.397123  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:49.398916  7225 leader_election.cc:343] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:49.399628  7225 leader_election.cc:343] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.405395  7378 tablet_bootstrap.cc:654] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.420742  7377 tablet_bootstrap.cc:654] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.445029  7174 tablet_service.cc:1511] Processing CreateTablet for tablet 75c50740d1144c09a074230835085663 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:49.447255  7174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c50740d1144c09a074230835085663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.452873  7247 tablet_service.cc:1511] Processing CreateTablet for tablet 75c50740d1144c09a074230835085663 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:49.459018  7376 tablet_bootstrap.cc:492] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:49.459578  7376 ts_tablet_manager.cc:1403] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.024s
I20260709 13:12:49.462718  7376 raft_consensus.cc:359] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.463920  7385 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.464417  7385 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.467013  7247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c50740d1144c09a074230835085663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.463454  7376 raft_consensus.cc:385] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.475549  7376 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.479663  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:49.479367  7376 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.480842  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:49.481231  7172 tablet_service.cc:1511] Processing CreateTablet for tablet 242a63190870450082200759c7f513ab (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:12:49.481861  7228 leader_election.cc:343] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.485518  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:12:49.486915  7228 leader_election.cc:343] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.487351  7228 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:49.488368  7394 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.489296  7394 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.490206  7319 tablet_service.cc:1511] Processing CreateTablet for tablet 75c50740d1144c09a074230835085663 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:49.490236  7381 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.491565  7319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c50740d1144c09a074230835085663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.491353  7381 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.495805  7252 tablet_service.cc:1511] Processing CreateTablet for tablet 242a63190870450082200759c7f513ab (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:49.496759  7252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a63190870450082200759c7f513ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.469245  7385 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:49.504451  7172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a63190870450082200759c7f513ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.508066  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:49.508687  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:49.510172  7150 leader_election.cc:343] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.510017  7326 tablet_service.cc:1511] Processing CreateTablet for tablet 242a63190870450082200759c7f513ab (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:49.511375  7326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a63190870450082200759c7f513ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.511116  7324 tablet_service.cc:1511] Processing CreateTablet for tablet edb4d64ffd0f4bed80982e942f1033c3 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:49.512392  7324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb4d64ffd0f4bed80982e942f1033c3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:49.512413  7133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:12:49.512979  7152 leader_election.cc:343] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.513449  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:49.500164  7381 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:49.524977  7245 tablet_service.cc:1511] Processing CreateTablet for tablet 984a0b52728d43fb97379422fa55491d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:49.526278  7378 tablet_bootstrap.cc:492] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:49.526705  7381 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.536043  7245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984a0b52728d43fb97379422fa55491d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.536701  7378 ts_tablet_manager.cc:1403] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.230s	user 0.027s	sys 0.004s
I20260709 13:12:49.514183  7177 tablet_service.cc:1511] Processing CreateTablet for tablet 984a0b52728d43fb97379422fa55491d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:49.538864  7177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984a0b52728d43fb97379422fa55491d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.543419  7376 ts_tablet_manager.cc:1434] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.001s
I20260709 13:12:49.556349  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:49.560192  7302 leader_election.cc:343] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.557178  7378 raft_consensus.cc:359] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.560861  7378 raft_consensus.cc:385] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.561909  7378 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.562783  7378 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.565497  7378 ts_tablet_manager.cc:1434] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:12:49.567238  7376 tablet_bootstrap.cc:492] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:49.572777  7377 tablet_bootstrap.cc:492] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:49.573297  7377 ts_tablet_manager.cc:1403] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.279s	user 0.012s	sys 0.005s
I20260709 13:12:49.579720  7377 raft_consensus.cc:359] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.580442  7377 raft_consensus.cc:385] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.580773  7377 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.583103  7376 tablet_bootstrap.cc:654] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.586488  7318 tablet_service.cc:1511] Processing CreateTablet for tablet 984a0b52728d43fb97379422fa55491d (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:49.587846  7318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984a0b52728d43fb97379422fa55491d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.596380  7246 tablet_service.cc:1511] Processing CreateTablet for tablet a893449156a24240bd4ed83fc67f85f6 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:49.587706  7177 tablet_service.cc:1511] Processing CreateTablet for tablet a893449156a24240bd4ed83fc67f85f6 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:49.605203  7246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a893449156a24240bd4ed83fc67f85f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.605561  7177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a893449156a24240bd4ed83fc67f85f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.606305  7385 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.606835  7385 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.609046  7385 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:49.610950  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:49.612498  7302 leader_election.cc:343] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.613517  7324 tablet_service.cc:1511] Processing CreateTablet for tablet a893449156a24240bd4ed83fc67f85f6 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:49.614965  7324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a893449156a24240bd4ed83fc67f85f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:49.603158  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 90218us
I20260709 13:12:49.618814  7171 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6277156300462b934adab718a32e44 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:49.620263  7171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6277156300462b934adab718a32e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.621464  7378 tablet_bootstrap.cc:492] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:49.623937  7403 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.624500  7403 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.625041  7245 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6277156300462b934adab718a32e44 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:49.629492  7319 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6277156300462b934adab718a32e44 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:49.630764  7319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6277156300462b934adab718a32e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.634138  7245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6277156300462b934adab718a32e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.584321  7377 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.634449  7172 tablet_service.cc:1511] Processing CreateTablet for tablet d6f19c97414f4b0c9f9e2ed509ee22d1 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:49.635746  7172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f19c97414f4b0c9f9e2ed509ee22d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.639823  7377 ts_tablet_manager.cc:1434] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:12:49.640288  7324 tablet_service.cc:1511] Processing CreateTablet for tablet d6f19c97414f4b0c9f9e2ed509ee22d1 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:49.641532  7324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f19c97414f4b0c9f9e2ed509ee22d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.649003  7174 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4a2f06cbc44402ae7754d23798eaff (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:49.649176  7249 tablet_service.cc:1511] Processing CreateTablet for tablet d6f19c97414f4b0c9f9e2ed509ee22d1 (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:49.650220  7174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4a2f06cbc44402ae7754d23798eaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.650429  7249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f19c97414f4b0c9f9e2ed509ee22d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.650908  7377 tablet_bootstrap.cc:492] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:49.651501  7318 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4a2f06cbc44402ae7754d23798eaff (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:49.663477  7378 tablet_bootstrap.cc:654] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.663702  7318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4a2f06cbc44402ae7754d23798eaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.672442  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:49.652179  7403 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:49.673873  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:49.652348  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:49.674799  7376 tablet_bootstrap.cc:492] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:49.652493  7247 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4a2f06cbc44402ae7754d23798eaff (DEFAULT_TABLE table=test-workload [id=786759ba1b154200b9567dfd8516ad68]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:49.675348  7376 ts_tablet_manager.cc:1403] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.000s
I20260709 13:12:49.676030  7247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4a2f06cbc44402ae7754d23798eaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.676934  7377 tablet_bootstrap.cc:654] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.653256  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:49.678435  7376 raft_consensus.cc:359] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.679185  7376 raft_consensus.cc:385] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.679500  7376 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
W20260709 13:12:49.679750  7152 leader_election.cc:343] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:49.680706  7150 leader_election.cc:343] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.681173  7150 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:12:49.681777  7301 leader_election.cc:343] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.681991  7403 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.680364  7376 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.682237  7301 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:12:49.684149  7301 leader_election.cc:343] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.684571  7301 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:49.685532  7385 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.686156  7385 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.693946  7376 ts_tablet_manager.cc:1434] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:49.703061  7378 tablet_bootstrap.cc:492] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:49.703706  7378 ts_tablet_manager.cc:1403] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.002s
I20260709 13:12:49.704260  7376 tablet_bootstrap.cc:492] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:49.703809  7377 tablet_bootstrap.cc:492] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:49.707000  7378 raft_consensus.cc:359] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.707778  7377 ts_tablet_manager.cc:1403] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.000s
I20260709 13:12:49.707939  7378 raft_consensus.cc:385] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.708418  7378 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.709197  7378 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.711239  7378 ts_tablet_manager.cc:1434] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:49.710898  7377 raft_consensus.cc:359] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.711647  7377 raft_consensus.cc:385] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.711978  7377 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.712342  7378 tablet_bootstrap.cc:492] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:49.712749  7377 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.715013  7377 ts_tablet_manager.cc:1434] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:12:49.716967  7376 tablet_bootstrap.cc:654] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.719063  7383 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.719887  7378 tablet_bootstrap.cc:654] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.719570  7383 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.721805  7383 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:49.723659  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:49.725792  7228 leader_election.cc:343] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.728098  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:49.729022  7336 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:49.731004  7225 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:49.732638  7377 tablet_bootstrap.cc:492] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:49.732728  7383 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.735194  7383 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.735735  7383 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.742835  7377 tablet_bootstrap.cc:654] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.753396  7383 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.754878  7377 tablet_bootstrap.cc:492] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:49.755018  7376 tablet_bootstrap.cc:492] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:49.755541  7377 ts_tablet_manager.cc:1403] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.011s
I20260709 13:12:49.755721  7376 ts_tablet_manager.cc:1403] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.022s
I20260709 13:12:49.756624  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:12:49.758114  7228 leader_election.cc:343] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.759442  7376 raft_consensus.cc:359] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.760095  7378 tablet_bootstrap.cc:492] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:49.760253  7376 raft_consensus.cc:385] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.760334  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:49.760007  7377 raft_consensus.cc:359] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.760783  7376 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.760944  7378 ts_tablet_manager.cc:1403] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.031s
I20260709 13:12:49.761018  7336 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.760811  7383 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:49.761032  7377 raft_consensus.cc:385] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.761628  7376 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.762223  7377 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.764065  7376 ts_tablet_manager.cc:1434] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:49.764787  7378 raft_consensus.cc:359] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.765259  7376 tablet_bootstrap.cc:492] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:49.765698  7378 raft_consensus.cc:385] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.766100  7378 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.766924  7378 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.769536  7378 ts_tablet_manager.cc:1434] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:49.769443  7336 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:49.770815  7378 tablet_bootstrap.cc:492] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:49.771020  7225 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:49.772509  7394 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.773001  7394 raft_consensus.cc:697] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:49.773864  7394 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.776466  7376 tablet_bootstrap.cc:654] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.777946  7378 tablet_bootstrap.cc:654] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.777563  7377 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.780187  7377 ts_tablet_manager.cc:1434] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:12:49.784188  7377 tablet_bootstrap.cc:492] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:49.805078  7377 tablet_bootstrap.cc:654] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.810899  7378 tablet_bootstrap.cc:492] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:49.811437  7378 ts_tablet_manager.cc:1403] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.019s
I20260709 13:12:49.814150  7378 raft_consensus.cc:359] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.814757  7378 raft_consensus.cc:385] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.814908  7377 tablet_bootstrap.cc:492] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:49.815047  7378 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.815480  7377 ts_tablet_manager.cc:1403] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.000s
I20260709 13:12:49.815877  7378 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.817701  7378 ts_tablet_manager.cc:1434] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:12:49.818548  7378 tablet_bootstrap.cc:492] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:49.818569  7377 raft_consensus.cc:359] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.819589  7377 raft_consensus.cc:385] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.818557  7084 catalog_manager.cc:5697] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.819948  7377 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.820835  7377 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.821292  7376 tablet_bootstrap.cc:492] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:49.823071  7376 ts_tablet_manager.cc:1403] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.058s	user 0.029s	sys 0.011s
I20260709 13:12:49.825748  7378 tablet_bootstrap.cc:654] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.827040  7376 raft_consensus.cc:359] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.827965  7376 raft_consensus.cc:385] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.828339  7376 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.829739  7377 ts_tablet_manager.cc:1434] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:12:49.830825  7377 tablet_bootstrap.cc:492] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:49.838003  7376 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.840358  7406 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.840795  7376 ts_tablet_manager.cc:1434] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:12:49.841499  7377 tablet_bootstrap.cc:654] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.840876  7406 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.844901  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:49.845306  7376 tablet_bootstrap.cc:492] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:49.845772  7187 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:49.847628  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:49.848871  7385 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.849334  7385 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.849769  7385 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.852694  7421 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.853237  7421 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.853895  7406 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:49.859797  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:49.860509  7260 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:49.861835  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:49.862709  7406 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.863122  7406 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.863505  7406 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.864125  7385 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.867107  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:49.867762  7186 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.868115  7378 tablet_bootstrap.cc:492] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:49.868674  7378 ts_tablet_manager.cc:1403] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.035s
I20260709 13:12:49.870411  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:49.855381  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:49.871572  7378 raft_consensus.cc:359] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.858103  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:49.872370  7378 raft_consensus.cc:385] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.872723  7378 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
W20260709 13:12:49.873400  7302 leader_election.cc:343] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.871481  7385 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:49.871043  7260 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.873550  7378 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.874928  7186 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:49.876052  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:49.876868  7385 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.878858  7378 ts_tablet_manager.cc:1434] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:12:49.879833  7378 tablet_bootstrap.cc:492] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:49.881644  7260 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:49.858295  7377 tablet_bootstrap.cc:492] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:49.883121  7377 ts_tablet_manager.cc:1403] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.003s
I20260709 13:12:49.858606  7421 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:49.886931  7378 tablet_bootstrap.cc:654] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.887598  7421 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.888074  7421 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.890609  7421 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:49.855247  7376 tablet_bootstrap.cc:654] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.892098  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:49.892764  7385 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:49.892922  7262 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:49.892185  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:49.870164  7406 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.894411  7378 tablet_bootstrap.cc:492] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:49.894891  7378 ts_tablet_manager.cc:1403] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 13:12:49.894170  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:49.895824  7406 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:12:49.896030  7302 leader_election.cc:343] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.896446  7406 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.896766  7406 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.897118  7406 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.897257  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:49.897480  7378 raft_consensus.cc:359] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.897907  7260 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.898159  7378 raft_consensus.cc:385] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.898135  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:49.898715  7378 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
W20260709 13:12:49.899737  7302 leader_election.cc:343] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.899524  7378 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.886152  7377 raft_consensus.cc:359] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.900790  7377 raft_consensus.cc:385] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.901106  7377 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.901870  7378 ts_tablet_manager.cc:1434] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:49.901794  7377 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.903621  7378 tablet_bootstrap.cc:492] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:49.893699  7385 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.904245  7377 ts_tablet_manager.cc:1434] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:12:49.906016  7377 tablet_bootstrap.cc:492] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:49.911224  7378 tablet_bootstrap.cc:654] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.913724  7377 tablet_bootstrap.cc:654] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.916805  7376 tablet_bootstrap.cc:492] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:49.917332  7376 ts_tablet_manager.cc:1403] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.001s
I20260709 13:12:49.920393  7376 raft_consensus.cc:359] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.921175  7376 raft_consensus.cc:385] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.921478  7376 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.922256  7376 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.923120  7378 tablet_bootstrap.cc:492] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:49.923656  7378 ts_tablet_manager.cc:1403] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
I20260709 13:12:49.923414  7406 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.926456  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:49.927475  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:12:49.927860  7302 leader_election.cc:343] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.928079  7262 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.929620  7378 raft_consensus.cc:359] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.929181  7085 catalog_manager.cc:5697] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.930580  7378 raft_consensus.cc:385] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.930886  7378 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.931643  7378 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.932617  7260 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:49.935887  7394 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.936324  7394 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.938133  7394 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:49.939303  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:49.939668  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:49.940240  7186 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
W20260709 13:12:49.940531  7225 leader_election.cc:343] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.934090  7378 ts_tablet_manager.cc:1434] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:49.940639  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:49.941742  7378 tablet_bootstrap.cc:492] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:49.941509  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:49.942646  7394 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.943013  7394 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.943338  7394 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.945529  7262 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:49.947492  7378 tablet_bootstrap.cc:654] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.949020  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:49.949895  7406 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:49.950742  7376 ts_tablet_manager.cc:1434] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:12:49.950947  7406 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.951553  7406 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:49.952407  7406 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.958653  7377 tablet_bootstrap.cc:492] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:49.959257  7377 ts_tablet_manager.cc:1403] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.002s
I20260709 13:12:49.960040  7394 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.958352  7423 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.961323  7423 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:49.962457  7423 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.963970  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:49.964811  7186 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.967234  7385 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.967842  7385 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.971896  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:49.972805  7187 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:49.974639  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:49.976046  7422 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.976544  7422 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.976954  7422 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.966939  7377 raft_consensus.cc:359] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.978703  7377 raft_consensus.cc:385] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.979048  7377 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.981750  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:49.982705  7262 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:49.984404  7403 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.984509  7385 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:49.984949  7403 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.985729  7377 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:49.987211  7403 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:49.988225  7377 ts_tablet_manager.cc:1434] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:12:49.989240  7377 tablet_bootstrap.cc:492] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:49.989508  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:49.990584  7336 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:12:49.990391  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:49.992697  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:49.993989  7403 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.995982  7376 tablet_bootstrap.cc:492] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:50.000006  7383 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.000531  7383 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.000555  7403 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.000756  7186 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:50.002696  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:50.002174  7084 catalog_manager.cc:5697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.002947  7383 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.003685  7383 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.004118  7383 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:50.004815  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:50.004930  7383 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.005502  7336 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:50.006714  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:50.010900  7377 tablet_bootstrap.cc:654] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.022478  7433 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.023145  7433 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.023620  7433 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.026389  7377 tablet_bootstrap.cc:492] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:50.027204  7377 ts_tablet_manager.cc:1403] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.007s
I20260709 13:12:50.002044  7422 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.030129  7403 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.030743  7422 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:50.030683  7403 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.032267  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:50.032719  7394 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.033349  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:50.033941  7186 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.034891  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:50.032857  7403 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:12:50.036509  7225 leader_election.cc:343] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.038389  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:50.039076  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:50.039714  7152 leader_election.cc:343] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.039942  7335 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:50.041815  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:50.043105  7403 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.043501  7403 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.043855  7403 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.043901  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.045447  7378 tablet_bootstrap.cc:492] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
W20260709 13:12:50.045635  7228 leader_election.cc:343] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.046116  7378 ts_tablet_manager.cc:1403] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.105s	user 0.035s	sys 0.026s
I20260709 13:12:50.032871  7262 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.051148  7403 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.051771  7376 tablet_bootstrap.cc:654] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.054250  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:50.054401  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:50.055132  7335 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:50.055878  7152 leader_election.cc:343] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.058606  7186 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:50.060681  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:50.057737  7262 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:50.061486  7422 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.062038  7422 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:50.033943  7377 raft_consensus.cc:359] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.063179  7377 raft_consensus.cc:385] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.062808  7422 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.063689  7377 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.063302  7084 catalog_manager.cc:5697] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.064103  7378 raft_consensus.cc:359] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.064796  7378 raft_consensus.cc:385] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.065135  7378 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.064630  7377 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.065762  7378 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.067474  7377 ts_tablet_manager.cc:1434] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260709 13:12:50.068502  7377 tablet_bootstrap.cc:492] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:50.074409  7433 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.076133  7376 tablet_bootstrap.cc:492] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:50.076615  7376 ts_tablet_manager.cc:1403] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.000s
I20260709 13:12:50.076676  7433 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.077591  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:12:50.079098  7228 leader_election.cc:343] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.077754  7083 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.080116  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:50.080649  7336 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.082672  7335 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:50.083484  7403 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.084060  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:50.085304  7403 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.086992  7403 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:50.088297  7336 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:50.087877  7403 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.080672  7377 tablet_bootstrap.cc:654] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.091329  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:50.092162  7433 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.093124  7378 ts_tablet_manager.cc:1434] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.003s
I20260709 13:12:50.093286  7433 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:50.094153  7378 tablet_bootstrap.cc:492] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:50.095011  7433 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.095973  7376 raft_consensus.cc:359] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.096628  7376 raft_consensus.cc:385] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.096990  7376 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.100493  7084 catalog_manager.cc:5697] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.103169  7378 tablet_bootstrap.cc:654] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.105844  7083 catalog_manager.cc:5697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.106837  7376 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.109660  7376 ts_tablet_manager.cc:1434] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:12:50.110881  7376 tablet_bootstrap.cc:492] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:50.114965  7377 tablet_bootstrap.cc:492] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:50.116101  7377 ts_tablet_manager.cc:1403] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.003s
I20260709 13:12:50.116780  7376 tablet_bootstrap.cc:654] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.119072  7377 raft_consensus.cc:359] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.119866  7377 raft_consensus.cc:385] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.120198  7377 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.121199  7378 tablet_bootstrap.cc:492] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:50.121002  7377 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.121841  7378 ts_tablet_manager.cc:1403] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:12:50.125762  7378 raft_consensus.cc:359] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.126528  7377 ts_tablet_manager.cc:1434] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:50.126791  7378 raft_consensus.cc:385] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.127206  7378 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.128032  7377 tablet_bootstrap.cc:492] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:50.128336  7378 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.131103  7378 ts_tablet_manager.cc:1434] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:12:50.132005  7378 tablet_bootstrap.cc:492] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:50.134795  7377 tablet_bootstrap.cc:654] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.138185  7422 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.139171  7378 tablet_bootstrap.cc:654] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.138844  7422 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.141112  7422 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:50.142911  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.145066  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:50.144593  7084 catalog_manager.cc:5697] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.145663  7262 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
W20260709 13:12:50.146917  7302 leader_election.cc:343] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.149083  7433 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.149552  7433 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.150789  7378 tablet_bootstrap.cc:492] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:50.150578  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:50.151214  7378 ts_tablet_manager.cc:1403] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.003s
I20260709 13:12:50.151698  7433 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.152063  7422 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.152486  7422 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.152881  7422 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.153674  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.153837  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:50.153947  7378 raft_consensus.cc:359] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.154330  7186 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:50.154584  7376 tablet_bootstrap.cc:492] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:50.154687  7378 raft_consensus.cc:385] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.155107  7378 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.155186  7376 ts_tablet_manager.cc:1403] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.020s
I20260709 13:12:50.155843  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:50.155843  7378 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.157085  7433 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.157449  7433 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.157815  7433 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.157967  7378 ts_tablet_manager.cc:1434] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:50.159029  7378 tablet_bootstrap.cc:492] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:50.164006  7422 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.164729  7378 tablet_bootstrap.cc:654] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.164983  7433 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.168030  7376 raft_consensus.cc:359] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.168094  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:50.168802  7376 raft_consensus.cc:385] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.169126  7376 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.154501  7336 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:50.169956  7376 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:50.170382  7302 leader_election.cc:343] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.174506  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:50.175213  7262 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.176760  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:50.177383  7336 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.177829  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:50.178814  7186 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.184026  7262 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:50.184481  7336 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:50.185388  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:50.185643  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:50.186331  7423 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.186906  7433 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.186960  7423 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:50.174808  7376 ts_tablet_manager.cc:1434] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:12:50.188202  7376 tablet_bootstrap.cc:492] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:50.187850  7423 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.186364  7383 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.190951  7383 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:50.191871  7383 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.195218  7376 tablet_bootstrap.cc:654] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.174521  7422 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:50.199462  7186 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:50.207625  7377 tablet_bootstrap.cc:492] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:50.208464  7377 ts_tablet_manager.cc:1403] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.008s
I20260709 13:12:50.211455  7376 tablet_bootstrap.cc:492] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:50.211948  7376 ts_tablet_manager.cc:1403] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.007s
I20260709 13:12:50.212736  7377 raft_consensus.cc:359] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.213773  7377 raft_consensus.cc:385] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.214217  7377 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.214718  7376 raft_consensus.cc:359] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.215569  7376 raft_consensus.cc:385] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.215916  7376 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.216048  7377 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.217017  7376 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.219740  7377 ts_tablet_manager.cc:1434] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:50.221426  7377 tablet_bootstrap.cc:492] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:50.224390  7376 ts_tablet_manager.cc:1434] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:50.225430  7376 tablet_bootstrap.cc:492] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:50.229960  7377 tablet_bootstrap.cc:654] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.232546  7433 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.233114  7433 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.234519  7376 tablet_bootstrap.cc:654] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.235394  7433 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.236642  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.236935  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:50.238457  7225 leader_election.cc:343] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:50.239096  7228 leader_election.cc:343] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.239538  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:50.240927  7433 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.247906  7377 tablet_bootstrap.cc:492] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:50.248747  7377 ts_tablet_manager.cc:1403] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.003s
I20260709 13:12:50.248260  7084 catalog_manager.cc:5697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.252853  7377 raft_consensus.cc:359] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.255497  7377 raft_consensus.cc:385] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.258308  7377 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.259268  7377 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.260805  7378 tablet_bootstrap.cc:492] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:50.257884  7376 tablet_bootstrap.cc:492] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:50.261286  7378 ts_tablet_manager.cc:1403] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.102s	user 0.063s	sys 0.036s
I20260709 13:12:50.261364  7376 ts_tablet_manager.cc:1403] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.005s
I20260709 13:12:50.263247  7085 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.264053  7376 raft_consensus.cc:359] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.264722  7376 raft_consensus.cc:385] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.264361  7378 raft_consensus.cc:359] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.265017  7376 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.265172  7378 raft_consensus.cc:385] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.265597  7378 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.266054  7377 ts_tablet_manager.cc:1434] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:12:50.266357  7378 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.267037  7377 tablet_bootstrap.cc:492] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:50.268669  7378 ts_tablet_manager.cc:1434] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:50.269461  7378 tablet_bootstrap.cc:492] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:50.273689  7377 tablet_bootstrap.cc:654] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.275098  7378 tablet_bootstrap.cc:654] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.274927  7376 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.280234  7376 ts_tablet_manager.cc:1434] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:12:50.281235  7376 tablet_bootstrap.cc:492] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:50.287855  7376 tablet_bootstrap.cc:654] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.291718  7378 tablet_bootstrap.cc:492] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:50.292258  7378 ts_tablet_manager.cc:1403] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260709 13:12:50.294044  7423 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.295553  7378 raft_consensus.cc:359] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.296522  7378 raft_consensus.cc:385] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.296859  7378 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.297749  7378 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.299463  7423 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.300108  7433 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.299964  7423 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.300688  7378 ts_tablet_manager.cc:1434] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:12:50.300573  7433 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.301311  7376 tablet_bootstrap.cc:492] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:50.301612  7378 tablet_bootstrap.cc:492] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:50.302392  7376 ts_tablet_manager.cc:1403] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 13:12:50.302984  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:50.304868  7302 leader_election.cc:343] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.305317  7376 raft_consensus.cc:359] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.305819  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.306025  7376 raft_consensus.cc:385] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.306423  7376 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
W20260709 13:12:50.307281  7228 leader_election.cc:343] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.307158  7376 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.308858  7378 tablet_bootstrap.cc:654] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.309072  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:50.309312  7376 ts_tablet_manager.cc:1434] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:50.307654  7423 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:50.312054  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:50.310612  7301 leader_election.cc:343] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.313081  7301 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:50.311013  7433 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.313902  7423 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.310493  7376 tablet_bootstrap.cc:492] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
W20260709 13:12:50.317710  7225 leader_election.cc:343] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.318218  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:50.318812  7403 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.319475  7403 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.323437  7383 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.323686  7433 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.324131  7433 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.324369  7377 tablet_bootstrap.cc:492] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:50.325050  7377 ts_tablet_manager.cc:1403] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.004s
I20260709 13:12:50.325978  7433 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.328843  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:50.329360  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:50.331678  7376 tablet_bootstrap.cc:654] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:50.337208  7150 leader_election.cc:343] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.337962  7378 tablet_bootstrap.cc:492] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:50.338465  7378 ts_tablet_manager.cc:1403] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.018s
I20260709 13:12:50.339095  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:50.340909  7228 leader_election.cc:343] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.341125  7378 raft_consensus.cc:359] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.341771  7378 raft_consensus.cc:385] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:50.341756  7225 leader_election.cc:343] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.342180  7378 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.342281  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:50.342892  7378 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.343082  7433 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.344600  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:50.345216  7378 ts_tablet_manager.cc:1434] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:50.346096  7403 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.348906  7377 raft_consensus.cc:359] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.350438  7377 raft_consensus.cc:385] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.350828  7377 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.346309  7378 tablet_bootstrap.cc:492] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
W20260709 13:12:50.346410  7152 leader_election.cc:343] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.351882  7377 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.352342  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:50.353993  7403 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.356943  7406 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.357703  7406 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.362118  7378 tablet_bootstrap.cc:654] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.362251  7433 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.366709  7433 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.370738  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.374691  7383 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.375427  7383 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.365542  7377 ts_tablet_manager.cc:1434] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:12:50.381699  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:50.383633  7383 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:12:50.385075  7225 leader_election.cc:343] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.383543  7377 tablet_bootstrap.cc:492] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:50.387055  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:50.389791  7228 leader_election.cc:343] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.390424  7228 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:50.391325  7421 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.393366  7383 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.395603  7423 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.396250  7376 tablet_bootstrap.cc:492] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:50.396703  7376 ts_tablet_manager.cc:1403] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.086s	user 0.040s	sys 0.022s
I20260709 13:12:50.364379  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:50.398734  7433 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.399242  7406 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:50.399174  7423 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.399436  7376 raft_consensus.cc:359] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.400064  7376 raft_consensus.cc:385] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.400797  7376 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.401443  7376 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.365257  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.403469  7376 ts_tablet_manager.cc:1434] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:50.404772  7376 tablet_bootstrap.cc:492] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:50.412542  7376 tablet_bootstrap.cc:654] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.412560  7377 tablet_bootstrap.cc:654] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.413712  7186 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 1: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:12:50.414703  7336 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.418196  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:50.427425  7187 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.447834  7302 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:50.450811  7383 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.453131  7432 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.475258  7403 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.476668  7335 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 1: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:12:50.476828  7403 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.483100  7378 tablet_bootstrap.cc:492] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:50.483588  7378 ts_tablet_manager.cc:1403] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.137s	user 0.027s	sys 0.048s
I20260709 13:12:50.485090  7225 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:50.485910  7432 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.485709  7433 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.487406  7403 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.488624  7422 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.489105  7422 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.490654  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:50.491437  7262 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:12:50.491693  7422 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:50.493251  7406 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.494172  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:50.494386  7433 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:12:50.499182  7301 leader_election.cc:343] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.498010  7421 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.501149  7421 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:50.494920  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47237us
I20260709 13:12:50.516713  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.516906  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.517521  7185 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
W20260709 13:12:50.521322  7302 leader_election.cc:343] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.522342  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:50.523483  7433 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.530673  7421 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:50.531623  7406 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.532040  7406 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.532400  7406 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.535689  7377 tablet_bootstrap.cc:492] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:50.536101  7377 ts_tablet_manager.cc:1403] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.153s	user 0.009s	sys 0.007s
I20260709 13:12:50.535080  7432 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.543752  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:50.545260  7378 raft_consensus.cc:359] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.545922  7378 raft_consensus.cc:385] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.546201  7378 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.546514  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:50.550906  7150 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:50.538707  7433 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.556030  7403 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.556270  7433 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.553768  7378 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.565742  7377 raft_consensus.cc:359] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.566591  7377 raft_consensus.cc:385] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.566896  7377 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.567651  7377 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.569357  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.564472  7423 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:12:50.571142  7228 leader_election.cc:343] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:50.571461  7301 leader_election.cc:343] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.572935  7378 ts_tablet_manager.cc:1434] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
I20260709 13:12:50.573939  7378 tablet_bootstrap.cc:492] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:50.574007  7377 ts_tablet_manager.cc:1434] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.004s
I20260709 13:12:50.574910  7377 tablet_bootstrap.cc:492] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:50.575862  7423 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.578483  7187 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:50.580658  7133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:50.572116  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:50.563562  7433 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.745012  7376 tablet_bootstrap.cc:492] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:50.747731  7376 ts_tablet_manager.cc:1403] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.343s	user 0.033s	sys 0.005s
I20260709 13:12:50.703791  7383 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
W20260709 13:12:50.616279  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65536.1us
I20260709 13:12:50.750222  7433 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:50.682953  7438 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:50.651701  7466 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:50.754964  7183 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.748344  7473 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.642048  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:50.674885  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 103412us
I20260709 13:12:50.589085  7406 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.770530  7432 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.753516  7438 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:50.787005  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56177.8us
I20260709 13:12:50.821455  7376 raft_consensus.cc:359] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.822204  7376 raft_consensus.cc:385] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.822482  7378 tablet_bootstrap.cc:654] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.822496  7376 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.824618  7376 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.832873  7377 tablet_bootstrap.cc:654] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.765211  7473 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.787493  7383 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:12:50.789026  7432 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.860917  7376 ts_tablet_manager.cc:1434] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.113s	user 0.012s	sys 0.020s
I20260709 13:12:50.861670  7376 tablet_bootstrap.cc:492] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:50.860734  7438 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.875401  7423 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:50.874701  7225 leader_election.cc:343] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.882349  7403 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:50.886843  7470 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.068s	user 0.002s	sys 0.001s
I20260709 13:12:50.894115  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:12:50.879796  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 308345us
W20260709 13:12:50.944761  7468 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 13:12:50.950383  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:50.951161  7182 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.894431  7406 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:50.962399  7481 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.965468  7376 tablet_bootstrap.cc:654] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.970589  7476 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:12:50.971217  7476 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.973855  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:50.975973  7150 leader_election.cc:343] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.976894  7473 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:50.936089  7480 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.082s
I20260709 13:12:50.977823  7385 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.979147  7385 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.983635  7378 tablet_bootstrap.cc:492] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:50.984167  7378 ts_tablet_manager.cc:1403] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.410s	user 0.021s	sys 0.042s
W20260709 13:12:50.967531  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 92884.9us
I20260709 13:12:50.986819  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:50.987181  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:50.988471  7385 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:50.989408  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.990700  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:50.991779  7472 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:50.993332  7301 leader_election.cc:343] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.993451  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:50.994148  7260 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
W20260709 13:12:50.994817  7228 leader_election.cc:343] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.995463  7423 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.997779  7475 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.999831  7378 raft_consensus.cc:359] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.000548  7378 raft_consensus.cc:385] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.000336  7475 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.000849  7378 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.001593  7301 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:51.001598  7378 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:50.993286  7472 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 13:12:51.006779  7377 tablet_bootstrap.cc:492] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:51.164626  7377 ts_tablet_manager.cc:1403] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.590s	user 0.066s	sys 0.100s
W20260709 13:12:51.157433  7486 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:12:51.003666  7302 leader_election.cc:343] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.175958  7377 raft_consensus.cc:359] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.007548  7423 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.067102  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:51.103756  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:51.044610  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:51.157397  7473 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.179613  7378 ts_tablet_manager.cc:1434] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.195s	user 0.034s	sys 0.067s
I20260709 13:12:51.080253  7476 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.049086  7432 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.181612  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:51.067895  7475 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.178501  7377 raft_consensus.cc:385] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.190202  7473 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.198257  7377 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.199275  7377 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.175196  7383 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.201519  7377 ts_tablet_manager.cc:1434] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:12:51.182773  7423 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.205534  7182 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:51.211110  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:51.209147  7423 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.217828  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:51.222177  7378 tablet_bootstrap.cc:492] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:51.225484  7473 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.227934  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:51.228591  7332 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:51.223250  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:51.203236  7383 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.246459  7376 tablet_bootstrap.cc:492] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:51.247159  7376 ts_tablet_manager.cc:1403] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.386s	user 0.012s	sys 0.009s
W20260709 13:12:51.251583  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 249854us
I20260709 13:12:51.253466  7472 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:51.243389  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:51.260919  7476 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.261456  7476 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.261875  7476 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.271260  7383 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.275362  7476 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.278331  7476 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.298765  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:51.308750  7491 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:12:51.310376  7376 raft_consensus.cc:359] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.311126  7376 raft_consensus.cc:385] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.310993  7423 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:51.311374  7228 leader_election.cc:343] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:51.297665  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 71388.5us
I20260709 13:12:51.311401  7376 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.314174  7376 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.316511  7376 ts_tablet_manager.cc:1434] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:12:51.317440  7376 tablet_bootstrap.cc:492] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:51.306596  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:51.318435  7378 tablet_bootstrap.cc:654] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:51.320967  7225 leader_election.cc:343] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.321568  7225 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:51.322440  7383 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.321116  7472 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.323226  7472 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:51.323285  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:51.302831  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:51.325228  7472 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.327545  7476 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:51.329555  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:51.340056  7377 tablet_bootstrap.cc:492] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:51.331847  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:51.335631  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:51.335842  7421 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.335409  7332 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.336386  7423 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:51.355872  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:51.341854  7421 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.359125  7421 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:51.353379  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:51.343580  7260 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.352283  7476 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:51.359977  7335 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:51.394075  7376 tablet_bootstrap.cc:654] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.437500  7152 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:12:51.440155  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 54081.5us
W20260709 13:12:51.442272  7152 leader_election.cc:343] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.443203  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:51.442821  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:12:51.446141  7152 leader_election.cc:343] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.448464  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:51.458709  7475 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.462385  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:51.463663  7257 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:51.479074  7481 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.479643  7481 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.480091  7481 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.504858  7476 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:51.506304  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 166334us
I20260709 13:12:51.509824  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:51.511586  7421 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.512220  7421 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.512734  7421 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.520035  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:51.522576  7475 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.523520  7475 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:51.513988  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 68117.3us
I20260709 13:12:51.551262  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:51.555898  7473 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:51.556085  7150 leader_election.cc:343] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.565322  7376 tablet_bootstrap.cc:492] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:51.565989  7376 ts_tablet_manager.cc:1403] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.249s	user 0.015s	sys 0.001s
I20260709 13:12:51.560220  7377 tablet_bootstrap.cc:654] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.570884  7260 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:51.572775  7301 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:51.546058  7475 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.575141  7378 tablet_bootstrap.cc:492] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
W20260709 13:12:51.576391  7302 leader_election.cc:343] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.581359  7332 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
W20260709 13:12:51.582842  7302 leader_election.cc:343] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.584740  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:51.585238  7472 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.585644  7378 ts_tablet_manager.cc:1403] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.364s	user 0.025s	sys 0.010s
W20260709 13:12:51.597190  7152 leader_election.cc:343] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:51.598234  7152 leader_election.cc:343] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.598740  7378 raft_consensus.cc:359] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.599552  7378 raft_consensus.cc:385] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.599859  7378 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
W20260709 13:12:51.601408  7505 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.102s	user 0.005s	sys 0.000s
I20260709 13:12:51.606832  7472 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:51.601600  7481 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.608934  7378 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.608436  7472 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.612077  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:51.612406  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:51.612969  7334 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.613402  7473 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.618594  7482 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.619591  7482 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.624670  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:51.626916  7473 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.627475  7473 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:51.628031  7421 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.628557  7473 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:51.635386  7133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:51.634312  7481 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.660583  7378 ts_tablet_manager.cc:1434] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.002s
I20260709 13:12:51.661414  7334 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:51.663239  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:51.664417  7481 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.665159  7482 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.666461  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:51.668043  7225 leader_election.cc:343] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.660102  7376 raft_consensus.cc:359] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.662554  7378 tablet_bootstrap.cc:492] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:51.669132  7376 raft_consensus.cc:385] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.669902  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:51.670223  7421 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:51.669474  7376 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.671597  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:51.673604  7376 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.668865  7481 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:51.676378  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:12:51.676558  7228 leader_election.cc:343] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.677042  7183 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:51.677704  7228 leader_election.cc:343] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.678208  7228 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:51.680773  7482 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.682382  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:51.682204  7481 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.683033  7259 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.685557  7183 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:51.688228  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:51.689015  7377 tablet_bootstrap.cc:492] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:51.689157  7472 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.690080  7472 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:51.690347  7377 ts_tablet_manager.cc:1403] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.350s	user 0.020s	sys 0.014s
I20260709 13:12:51.696269  7081 catalog_manager.cc:5697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.691088  7472 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.698047  7259 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:51.702168  7376 ts_tablet_manager.cc:1434] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.136s	user 0.016s	sys 0.000s
I20260709 13:12:51.704522  7376 tablet_bootstrap.cc:492] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:51.706200  7377 raft_consensus.cc:359] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.706982  7377 raft_consensus.cc:385] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.707269  7377 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.707967  7377 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.711010  7378 tablet_bootstrap.cc:654] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.734042  7378 tablet_bootstrap.cc:492] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:51.734700  7378 ts_tablet_manager.cc:1403] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.001s
I20260709 13:12:51.736044  7377 ts_tablet_manager.cc:1434] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:12:51.747363  7376 tablet_bootstrap.cc:654] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.738341  7378 raft_consensus.cc:359] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.737718  7084 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.747852  7378 raft_consensus.cc:385] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.748123  7377 tablet_bootstrap.cc:492] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:51.748157  7378 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.749058  7378 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.751261  7378 ts_tablet_manager.cc:1434] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:12:51.753496  7378 tablet_bootstrap.cc:492] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:51.760672  7377 tablet_bootstrap.cc:654] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.766449  7378 tablet_bootstrap.cc:654] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.777833  7378 tablet_bootstrap.cc:492] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:51.778396  7378 ts_tablet_manager.cc:1403] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.003s
I20260709 13:12:51.779284  7085 catalog_manager.cc:5697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.781826  7378 raft_consensus.cc:359] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.782588  7378 raft_consensus.cc:385] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.782900  7378 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.783631  7378 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.787348  7378 ts_tablet_manager.cc:1434] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:51.788488  7378 tablet_bootstrap.cc:492] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:51.792783  7376 tablet_bootstrap.cc:492] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:51.793305  7376 ts_tablet_manager.cc:1403] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.005s
I20260709 13:12:51.797235  7376 raft_consensus.cc:359] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.798010  7376 raft_consensus.cc:385] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.798326  7376 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.799103  7376 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.802332  7377 tablet_bootstrap.cc:492] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:51.802881  7377 ts_tablet_manager.cc:1403] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.006s
I20260709 13:12:51.803599  7084 catalog_manager.cc:5697] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.805708  7377 raft_consensus.cc:359] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.806450  7377 raft_consensus.cc:385] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.806756  7377 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.806680  7084 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.807615  7377 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.809976  7376 ts_tablet_manager.cc:1434] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:12:51.810467  7377 ts_tablet_manager.cc:1434] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:51.823733  7377 tablet_bootstrap.cc:492] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:51.824045  7376 tablet_bootstrap.cc:492] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:51.828341  7378 tablet_bootstrap.cc:654] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.838239  7377 tablet_bootstrap.cc:654] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.844269  7377 tablet_bootstrap.cc:492] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:51.844666  7378 tablet_bootstrap.cc:492] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:51.844781  7376 tablet_bootstrap.cc:654] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.845284  7378 ts_tablet_manager.cc:1403] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.000s
I20260709 13:12:51.844764  7377 ts_tablet_manager.cc:1403] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:12:51.848585  7377 raft_consensus.cc:359] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.848436  7378 raft_consensus.cc:359] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.849468  7377 raft_consensus.cc:385] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.849579  7378 raft_consensus.cc:385] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.849849  7377 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.850157  7378 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.850893  7377 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.851271  7378 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.854722  7378 ts_tablet_manager.cc:1434] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:51.856283  7378 tablet_bootstrap.cc:492] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:51.863701  7377 ts_tablet_manager.cc:1434] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:12:51.863767  7378 tablet_bootstrap.cc:654] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.865047  7377 tablet_bootstrap.cc:492] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:51.871763  7377 tablet_bootstrap.cc:654] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.885222  7376 tablet_bootstrap.cc:492] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:51.885871  7376 ts_tablet_manager.cc:1403] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.018s
I20260709 13:12:51.887192  7472 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:51.889532  7376 raft_consensus.cc:359] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.890424  7376 raft_consensus.cc:385] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.890641  7378 tablet_bootstrap.cc:492] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:51.890781  7376 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.891152  7378 ts_tablet_manager.cc:1403] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.000s
I20260709 13:12:51.891853  7376 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.895520  7376 ts_tablet_manager.cc:1434] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:51.897022  7376 tablet_bootstrap.cc:492] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:51.896751  7378 raft_consensus.cc:359] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.897509  7378 raft_consensus.cc:385] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.897809  7378 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.901983  7378 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.903264  7377 tablet_bootstrap.cc:492] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:51.903817  7377 ts_tablet_manager.cc:1403] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.004s
I20260709 13:12:51.905962  7376 tablet_bootstrap.cc:654] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.906862  7377 raft_consensus.cc:359] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.907578  7377 raft_consensus.cc:385] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.907964  7377 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.908722  7377 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.911290  7377 ts_tablet_manager.cc:1434] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:51.912297  7377 tablet_bootstrap.cc:492] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:51.916038  7378 ts_tablet_manager.cc:1434] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:12:51.918272  7377 tablet_bootstrap.cc:654] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.918226  7482 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.918825  7482 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.921159  7482 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.924046  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:51.924343  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:51.925685  7228 leader_election.cc:343] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.926193  7472 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.926836  7472 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.927389  7378 tablet_bootstrap.cc:492] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
W20260709 13:12:51.926249  7225 leader_election.cc:343] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.929798  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:51.931289  7472 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:12:51.931425  7302 leader_election.cc:343] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.929771  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:51.934504  7376 tablet_bootstrap.cc:492] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:51.934362  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:51.935216  7376 ts_tablet_manager.cc:1403] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.008s
W20260709 13:12:51.936519  7301 leader_election.cc:343] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.937170  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:51.937552  7378 tablet_bootstrap.cc:654] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.937898  7481 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.938459  7472 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.938570  7481 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.939188  7481 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.942306  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:51.942572  7481 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.944516  7376 raft_consensus.cc:359] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.945308  7376 raft_consensus.cc:385] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.945243  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:51.945773  7376 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.946952  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:51.946594  7376 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.948092  7482 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.949378  7376 ts_tablet_manager.cc:1434] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:12:51.951125  7376 tablet_bootstrap.cc:492] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:51.951311  7482 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.951807  7482 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.954888  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:51.955631  7182 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:51.957024  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:51.957918  7481 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.958319  7481 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.958694  7481 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.959036  7376 tablet_bootstrap.cc:654] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.962129  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:51.962909  7334 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:51.963397  7259 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.965183  7482 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.968340  7481 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.972033  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:51.972949  7183 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.984172  7482 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.984659  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:51.984715  7482 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:51.985357  7334 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.986989  7482 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:51.990967  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:51.993124  7225 leader_election.cc:343] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.994362  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:51.996392  7228 leader_election.cc:343] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.996991  7228 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:51.998373  7482 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.006346  7334 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:52.012696  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:52.013159  7378 tablet_bootstrap.cc:492] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:52.007093  7481 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.013669  7482 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.982446  7183 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:52.014180  7482 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:52.013644  7378 ts_tablet_manager.cc:1403] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.023s
I20260709 13:12:52.015173  7482 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.018782  7481 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.019392  7481 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.022110  7481 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.018182  7378 raft_consensus.cc:359] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.022840  7378 raft_consensus.cc:385] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.023129  7378 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.023304  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:52.024497  7378 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.025626  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:52.026456  7334 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 1: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:12:52.027179  7378 ts_tablet_manager.cc:1434] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:52.027927  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:52.029881  7376 tablet_bootstrap.cc:492] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:52.030110  7472 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.030982  7481 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.030546  7376 ts_tablet_manager.cc:1403] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.018s
I20260709 13:12:52.041181  7376 raft_consensus.cc:359] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.041898  7376 raft_consensus.cc:385] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.042187  7376 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.042822  7376 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.043850  7378 tablet_bootstrap.cc:492] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
W20260709 13:12:52.046286  7302 consensus_peers.cc:597] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:52.050436  7376 ts_tablet_manager.cc:1434] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:12:52.051404  7376 tablet_bootstrap.cc:492] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:52.055680  7376 tablet_bootstrap.cc:654] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.055605  7481 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.058246  7475 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.058811  7475 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.061378  7475 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.063465  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:52.064141  7334 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:52.065568  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:52.066418  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:52.067190  7259 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:52.067412  7475 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.067799  7475 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.068166  7475 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.070873  7378 tablet_bootstrap.cc:654] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.074818  7377 tablet_bootstrap.cc:492] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:52.075277  7377 ts_tablet_manager.cc:1403] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.163s	user 0.084s	sys 0.058s
I20260709 13:12:52.077842  7376 tablet_bootstrap.cc:492] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:52.078369  7376 ts_tablet_manager.cc:1403] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.006s
I20260709 13:12:52.077993  7377 raft_consensus.cc:359] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.078766  7377 raft_consensus.cc:385] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.079053  7377 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.080230  7377 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.080399  7081 catalog_manager.cc:5697] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.081221  7376 raft_consensus.cc:359] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.081869  7376 raft_consensus.cc:385] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.082129  7376 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.082309  7377 ts_tablet_manager.cc:1434] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:52.083321  7377 tablet_bootstrap.cc:492] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:52.089166  7377 tablet_bootstrap.cc:654] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.088490  7376 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.094854  7376 ts_tablet_manager.cc:1434] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:12:52.096086  7376 tablet_bootstrap.cc:492] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:52.097388  7378 tablet_bootstrap.cc:492] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:52.097862  7378 ts_tablet_manager.cc:1403] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.070s	user 0.006s	sys 0.017s
I20260709 13:12:52.101280  7378 raft_consensus.cc:359] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.101945  7378 raft_consensus.cc:385] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.102208  7378 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.102829  7376 tablet_bootstrap.cc:654] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.102955  7378 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.105082  7378 ts_tablet_manager.cc:1434] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:12:52.106249  7378 tablet_bootstrap.cc:492] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:52.111989  7476 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.114478  7378 tablet_bootstrap.cc:654] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.119148  7506 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.120895  7376 tablet_bootstrap.cc:492] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:52.120967  7476 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.121241  7378 tablet_bootstrap.cc:492] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:52.121465  7376 ts_tablet_manager.cc:1403] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.015s
I20260709 13:12:52.121861  7378 ts_tablet_manager.cc:1403] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:12:52.121536  7476 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.124295  7376 raft_consensus.cc:359] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.124459  7378 raft_consensus.cc:359] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.125345  7378 raft_consensus.cc:385] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.125708  7378 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.125913  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:52.126430  7378 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.127059  7334 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:12:52.129274  7378 ts_tablet_manager.cc:1434] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:12:52.130438  7378 tablet_bootstrap.cc:492] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:52.135488  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:52.136468  7378 tablet_bootstrap.cc:654] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.137575  7152 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:52.138440  7473 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.125013  7376 raft_consensus.cc:385] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.142874  7376 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.143832  7376 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.154331  7472 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.155133  7472 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.159088  7472 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:52.161913  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:52.162930  7257 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:52.165441  7475 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.168335  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:52.169328  7182 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:52.172427  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:52.170310  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:52.173852  7334 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.174118  7506 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.174530  7506 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.174894  7506 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.175614  7432 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.184324  7377 tablet_bootstrap.cc:492] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:52.184819  7377 ts_tablet_manager.cc:1403] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.102s	user 0.035s	sys 0.036s
I20260709 13:12:52.188046  7377 raft_consensus.cc:359] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.188961  7377 raft_consensus.cc:385] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.189306  7377 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.192004  7503 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:52.194000  7473 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.182382  7506 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.191160  7476 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.202519  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:52.203359  7257 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.208511  7377 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.170001  7475 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.222222  7376 ts_tablet_manager.cc:1434] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.024s
I20260709 13:12:52.223766  7376 tablet_bootstrap.cc:492] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:52.225514  7432 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.239423  7503 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.240200  7503 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.244704  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:52.255260  7302 leader_election.cc:343] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.255831  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:52.256513  7262 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:52.256902  7506 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:52.258314  7377 ts_tablet_manager.cc:1434] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.001s
I20260709 13:12:52.258733  7503 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:52.212616  7472 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:12:52.260558  7377 tablet_bootstrap.cc:492] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:52.267760  7301 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:52.268209  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:52.268814  7260 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.269484  7506 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.269881  7506 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.293696  7376 tablet_bootstrap.cc:654] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.284415  7506 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.297365  7475 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.305902  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:52.325681  7506 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.305400  7475 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.334301  7187 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.337796  7334 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:52.338479  7538 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.341918  7473 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.348321  7538 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.353576  7378 tablet_bootstrap.cc:492] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:52.354077  7378 ts_tablet_manager.cc:1403] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.224s	user 0.051s	sys 0.071s
I20260709 13:12:52.354372  7538 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.354810  7546 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:52.355270  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:52.356268  7473 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:52.358237  7228 leader_election.cc:343] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.358664  7475 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.359112  7473 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.362600  7378 raft_consensus.cc:359] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.363375  7378 raft_consensus.cc:385] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.363662  7378 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.364343  7378 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.365461  7187 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:52.366552  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:52.366730  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:52.367177  7257 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:52.367698  7503 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.368235  7503 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:52.372514  7378 ts_tablet_manager.cc:1434] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:52.374715  7378 tablet_bootstrap.cc:492] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:52.374661  7503 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.378880  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:52.379333  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:52.380115  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:12:52.380333  7302 leader_election.cc:343] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.380889  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:52.381201  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:12:52.380928  7225 leader_election.cc:343] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.371191  7260 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:52.383507  7473 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.383328  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:52.391673  7473 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:52.392100  7538 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.392633  7473 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.384552  7257 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.401093  7508 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.382381  7506 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:52.383870  7262 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:52.404897  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:52.405609  7332 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:52.410480  7085 catalog_manager.cc:5697] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.411818  7475 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.420286  7475 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.410962  7508 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.422267  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:52.443904  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:52.447129  7152 leader_election.cc:343] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.447866  7476 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.448275  7476 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.448621  7476 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.450194  7376 tablet_bootstrap.cc:492] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:52.450708  7376 ts_tablet_manager.cc:1403] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.227s	user 0.020s	sys 0.023s
I20260709 13:12:52.453192  7475 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.454385  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:12:52.456360  7301 leader_election.cc:343] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.456287  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:52.454443  7508 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:52.457284  7187 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:52.457804  7378 tablet_bootstrap.cc:654] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.458606  7302 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:12:52.459120  7550 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:52.459823  7538 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:52.460426  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:52.461097  7261 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:52.463439  7508 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.463855  7508 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.464186  7508 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.466863  7152 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:52.467694  7475 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.468560  7475 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.468914  7475 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.470024  7377 tablet_bootstrap.cc:654] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:52.468210  7150 leader_election.cc:343] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.472357  7150 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:52.474685  7546 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.476696  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:52.478950  7150 leader_election.cc:343] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.485998  7376 raft_consensus.cc:359] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.486937  7376 raft_consensus.cc:385] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.487303  7376 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.492206  7376 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.480525  7257 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:52.493621  7508 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.494302  7476 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.495640  7301 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:52.498728  7385 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.499241  7385 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:52.500181  7385 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.504081  7376 ts_tablet_manager.cc:1434] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:12:52.516245  7376 tablet_bootstrap.cc:492] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:52.519163  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:52.519814  7257 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.520638  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:52.521268  7184 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.524145  7475 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.533134  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:52.534617  7378 tablet_bootstrap.cc:492] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:52.533980  7261 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.535161  7378 ts_tablet_manager.cc:1403] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.161s	user 0.013s	sys 0.005s
I20260709 13:12:52.517982  7473 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.537799  7508 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:52.543042  7376 tablet_bootstrap.cc:654] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.542795  7378 raft_consensus.cc:359] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.544250  7378 raft_consensus.cc:385] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.544544  7378 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.545099  7378 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.528595  7476 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.550619  7084 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.552775  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:52.553323  7334 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.558035  7475 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.540352  7473 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.564175  7473 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.564927  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:52.565598  7260 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.568907  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:52.570441  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:52.571498  7183 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.574834  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:52.579548  7377 tablet_bootstrap.cc:492] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:52.580351  7377 ts_tablet_manager.cc:1403] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.320s	user 0.014s	sys 0.012s
I20260709 13:12:52.584677  7378 ts_tablet_manager.cc:1434] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
W20260709 13:12:52.585688  7150 leader_election.cc:343] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.587303  7482 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:12:52.598591  7378 tablet_bootstrap.cc:492] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:52.592105  7261 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:52.607630  7334 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:52.607998  7152 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:52.611135  7476 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.611790  7476 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:52.611543  7085 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.612962  7476 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.615324  7184 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:52.620596  7377 raft_consensus.cc:359] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.621529  7377 raft_consensus.cc:385] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.621768  7377 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.628959  7377 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.617347  7257 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:52.608199  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:52.625203  7302 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:52.632323  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:52.633329  7473 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.633997  7473 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:52.634516  7377 ts_tablet_manager.cc:1434] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 13:12:52.635594  7377 tablet_bootstrap.cc:492] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:52.636898  7473 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.627940  7260 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:52.639211  7506 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.639916  7506 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:52.644608  7546 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.641004  7506 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.679545  7508 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.680079  7508 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.683252  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:52.686877  7302 leader_election.cc:343] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.705821  7378 tablet_bootstrap.cc:654] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.706393  7377 tablet_bootstrap.cc:654] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.702823  7508 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:52.707599  7432 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.708206  7432 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.709125  7376 tablet_bootstrap.cc:492] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:52.709568  7376 ts_tablet_manager.cc:1403] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.195s	user 0.012s	sys 0.004s
I20260709 13:12:52.712206  7376 raft_consensus.cc:359] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.712864  7376 raft_consensus.cc:385] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.713140  7376 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.713327  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:52.715063  7085 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:52.716262  7228 leader_election.cc:343] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.717460  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:52.717921  7376 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:52.719614  7225 leader_election.cc:343] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.720000  7432 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.720402  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:52.721268  7432 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:52.702337  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48035.3us
W20260709 13:12:52.722806  7133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:52.725564  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:52.726491  7260 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:52.732224  7376 ts_tablet_manager.cc:1434] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:12:52.733881  7376 tablet_bootstrap.cc:492] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:52.733583  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:52.745208  7508 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.745764  7508 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.746235  7508 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.754164  7377 tablet_bootstrap.cc:492] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:52.754699  7377 ts_tablet_manager.cc:1403] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.119s	user 0.018s	sys 0.012s
I20260709 13:12:52.755970  7376 tablet_bootstrap.cc:654] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.757663  7377 raft_consensus.cc:359] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.760908  7377 raft_consensus.cc:385] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.761186  7377 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.762413  7378 tablet_bootstrap.cc:492] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:52.762883  7378 ts_tablet_manager.cc:1403] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.174s	user 0.039s	sys 0.016s
I20260709 13:12:52.767293  7377 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.771164  7377 ts_tablet_manager.cc:1434] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:12:52.772677  7377 tablet_bootstrap.cc:492] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:52.766371  7378 raft_consensus.cc:359] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.775527  7378 raft_consensus.cc:385] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.775939  7378 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.776973  7378 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.779902  7378 ts_tablet_manager.cc:1434] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:12:52.785506  7378 tablet_bootstrap.cc:492] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:52.775064  7508 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.789932  7508 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:52.784464  7377 tablet_bootstrap.cc:654] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.791085  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:52.791723  7260 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.791795  7473 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.791853  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:52.792375  7473 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.794819  7378 tablet_bootstrap.cc:654] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.795253  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:52.797024  7187 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.804347  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:52.805222  7332 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:12:52.807288  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:52.810271  7546 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:52.813524  7506 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:52.814648  7473 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.817188  7187 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:52.817759  7476 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.808749  7260 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:52.820573  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:52.821475  7560 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.821975  7560 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:52.822849  7560 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.829945  7085 catalog_manager.cc:5697] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.831754  7376 tablet_bootstrap.cc:492] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:52.832331  7376 ts_tablet_manager.cc:1403] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.099s	user 0.017s	sys 0.015s
I20260709 13:12:52.847793  7472 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:52.854048  7546 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.859220  7376 raft_consensus.cc:359] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.859926  7376 raft_consensus.cc:385] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.860191  7376 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.861665  7376 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.873531  7376 ts_tablet_manager.cc:1434] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:12:52.873574  7473 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.874275  7377 tablet_bootstrap.cc:492] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:52.874765  7377 ts_tablet_manager.cc:1403] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.019s
I20260709 13:12:52.874140  7473 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.878381  7376 tablet_bootstrap.cc:492] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:52.872440  7081 catalog_manager.cc:5697] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.881142  7377 raft_consensus.cc:359] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.881320  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:52.881908  7377 raft_consensus.cc:385] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.882205  7377 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.882050  7257 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:52.883291  7377 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.883709  7152 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:52.884596  7546 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.885071  7546 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.885329  7473 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.885421  7546 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.887938  7377 ts_tablet_manager.cc:1434] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:12:52.887959  7378 tablet_bootstrap.cc:492] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:52.888710  7378 ts_tablet_manager.cc:1403] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.030s
I20260709 13:12:52.889140  7377 tablet_bootstrap.cc:492] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:52.891392  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:52.891960  7378 raft_consensus.cc:359] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.892679  7378 raft_consensus.cc:385] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:52.892910  7150 leader_election.cc:343] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.892956  7378 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.893895  7378 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.897702  7546 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.903455  7378 ts_tablet_manager.cc:1434] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:52.904274  7378 tablet_bootstrap.cc:492] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:52.898445  7376 tablet_bootstrap.cc:654] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.904835  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:52.905460  7257 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.910235  7378 tablet_bootstrap.cc:654] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.911569  7546 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.912206  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:52.912591  7377 tablet_bootstrap.cc:654] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:52.913908  7150 leader_election.cc:343] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.917099  7257 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:52.918954  7152 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:52.920573  7546 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.921239  7546 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:52.922385  7546 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.950591  7082 catalog_manager.cc:5697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.952059  7377 tablet_bootstrap.cc:492] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:52.952557  7377 ts_tablet_manager.cc:1403] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.017s
I20260709 13:12:52.953687  7378 tablet_bootstrap.cc:492] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:52.955183  7376 tablet_bootstrap.cc:492] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:52.955622  7378 ts_tablet_manager.cc:1403] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.030s
I20260709 13:12:52.955641  7376 ts_tablet_manager.cc:1403] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.001s
I20260709 13:12:52.956844  7377 raft_consensus.cc:359] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.957547  7377 raft_consensus.cc:385] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.957794  7377 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.958443  7377 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.960564  7377 ts_tablet_manager.cc:1434] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:52.960312  7376 raft_consensus.cc:359] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.961054  7376 raft_consensus.cc:385] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.961339  7376 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.961650  7377 tablet_bootstrap.cc:492] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:52.962010  7376 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.964480  7376 ts_tablet_manager.cc:1434] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:52.964340  7084 catalog_manager.cc:5697] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.969712  7376 tablet_bootstrap.cc:492] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:52.969640  7378 raft_consensus.cc:359] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.970553  7378 raft_consensus.cc:385] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.970882  7378 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.971535  7378 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.973598  7378 ts_tablet_manager.cc:1434] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:12:52.975610  7377 tablet_bootstrap.cc:654] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.977749  7546 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.977943  7385 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.978798  7481 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.978464  7385 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.979162  7378 tablet_bootstrap.cc:492] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:52.979290  7481 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.980717  7385 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:52.981323  7481 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.983306  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:52.983635  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:52.983901  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:52.984586  7257 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:52.984606  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:52.985831  7378 tablet_bootstrap.cc:654] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.986446  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:52.978310  7546 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.992674  7546 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.993028  7473 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.993669  7473 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:52.994134  7184 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:52.983985  7332 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:52.996270  7473 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:52.997484  7508 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.997987  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:52.999476  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:53.005692  7334 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:53.006915  7508 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.007135  7481 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.007339  7508 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.007522  7481 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.007913  7481 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.011148  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.013273  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:53.015019  7481 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.015322  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:53.016243  7257 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:12:53.018673  7421 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:53.020524  7150 leader_election.cc:343] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.021895  7546 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.022419  7546 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.022891  7546 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.027987  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.028891  7261 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:53.031224  7152 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:53.032922  7376 tablet_bootstrap.cc:654] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.033141  7475 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.033676  7475 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.034101  7475 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.036958  7481 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.039065  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:53.040953  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:53.056671  7508 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.057226  7546 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.057717  7334 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 1: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:12:53.058751  7184 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 1: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:12:53.058983  7481 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.059451  7481 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.060125  7473 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.061462  7481 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.061519  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:53.062263  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.062345  7334 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:12:53.063081  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:53.063393  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:53.064352  7432 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:12:53.064604  7225 leader_election.cc:343] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.043356  7377 tablet_bootstrap.cc:492] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:53.045670  7378 tablet_bootstrap.cc:492] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:53.048071  7376 tablet_bootstrap.cc:492] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:53.048228  7475 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.066699  7378 ts_tablet_manager.cc:1403] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.026s
W20260709 13:12:53.048841  7302 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:53.066042  7377 ts_tablet_manager.cc:1403] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.105s	user 0.028s	sys 0.011s
I20260709 13:12:53.066272  7376 ts_tablet_manager.cc:1403] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.004s
I20260709 13:12:53.067075  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:53.068971  7184 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:53.070945  7378 raft_consensus.cc:359] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.072153  7378 raft_consensus.cc:385] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.072434  7378 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.073838  7376 raft_consensus.cc:359] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.074438  7376 raft_consensus.cc:385] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.074680  7376 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.075579  7376 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.075588  7378 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.065538  7546 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.079864  7378 ts_tablet_manager.cc:1434] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:53.080596  7376 ts_tablet_manager.cc:1434] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:53.079483  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:53.083070  7257 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:12:53.087795  7432 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.088248  7432 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.088585  7432 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.089126  7475 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.090233  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:53.090715  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:12:53.091823  7150 leader_election.cc:343] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.091884  7475 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.093235  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:53.093868  7257 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.097123  7508 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:53.098256  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:53.099116  7260 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 1: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:12:53.087916  7377 raft_consensus.cc:359] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.100075  7377 raft_consensus.cc:385] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.100358  7377 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.102022  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:53.102785  7184 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 1: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:12:53.103413  7378 tablet_bootstrap.cc:492] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:53.104734  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:53.105257  7432 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:53.106231  7150 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:53.106303  7475 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.108572  7475 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.109159  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:53.109923  7184 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.101052  7377 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.111828  7503 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.112106  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:53.113031  7377 ts_tablet_manager.cc:1434] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.004s
I20260709 13:12:53.110750  7475 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:12:53.113543  7150 leader_election.cc:343] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.114766  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.115422  7260 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:53.119328  7378 tablet_bootstrap.cc:654] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.120304  7184 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:53.117281  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:53.121533  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:12:53.122815  7225 leader_election.cc:343] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.123122  7475 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.123533  7475 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.123883  7475 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.126571  7503 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.127372  7503 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.117777  7377 tablet_bootstrap.cc:492] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:53.117621  7376 tablet_bootstrap.cc:492] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:53.131377  7503 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:53.132510  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:53.132733  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.133414  7260 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:53.133610  7481 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.134516  7481 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:53.134771  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:53.135641  7481 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.137286  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.137699  7377 tablet_bootstrap.cc:654] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:53.140313  7302 leader_election.cc:343] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.142076  7257 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:53.142490  7475 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.145797  7475 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.145537  7152 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:53.146977  7546 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.147543  7546 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:53.148415  7546 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.135774  7503 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.151235  7503 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.151643  7503 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.153972  7377 tablet_bootstrap.cc:492] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:53.154503  7377 ts_tablet_manager.cc:1403] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.005s
I20260709 13:12:53.157259  7377 raft_consensus.cc:359] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.158107  7377 raft_consensus.cc:385] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.158401  7377 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.163506  7377 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.165733  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:53.167702  7377 ts_tablet_manager.cc:1434] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:53.115161  7432 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.171068  7377 tablet_bootstrap.cc:492] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:53.166489  7334 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.176729  7475 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.177434  7376 tablet_bootstrap.cc:654] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.177742  7378 tablet_bootstrap.cc:492] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:53.178767  7378 ts_tablet_manager.cc:1403] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.076s	user 0.007s	sys 0.028s
I20260709 13:12:53.181406  7378 raft_consensus.cc:359] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.182101  7378 raft_consensus.cc:385] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.182377  7378 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.188275  7378 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.189376  7376 tablet_bootstrap.cc:492] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:53.190055  7376 ts_tablet_manager.cc:1403] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.005s
I20260709 13:12:53.196391  7508 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.197088  7590 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.197615  7590 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.198822  7085 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.201782  7377 tablet_bootstrap.cc:654] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.193763  7376 raft_consensus.cc:359] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.203989  7376 raft_consensus.cc:385] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.204357  7376 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.207306  7376 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.210348  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:53.215139  7260 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.219208  7376 ts_tablet_manager.cc:1434] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:12:53.223480  7508 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.224216  7508 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.227939  7260 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:53.230814  7508 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:53.215999  7503 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.249298  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.250038  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:53.250911  7257 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.257295  7378 ts_tablet_manager.cc:1434] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.078s	user 0.027s	sys 0.017s
I20260709 13:12:53.251528  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.260865  7376 tablet_bootstrap.cc:492] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:53.249577  7503 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:53.263445  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.263777  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:12:53.265281  7228 leader_election.cc:343] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:53.273732  7301 leader_election.cc:343] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:53.275512  7302 leader_election.cc:343] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.276001  7302 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:53.276160  7385 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:53.277176  7302 leader_election.cc:343] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.277570  7385 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:53.269568  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 68404.7us
I20260709 13:12:53.282852  7590 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.286160  7378 tablet_bootstrap.cc:492] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:53.289635  7334 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:53.295939  7377 tablet_bootstrap.cc:492] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:53.296446  7377 ts_tablet_manager.cc:1403] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.005s
I20260709 13:12:53.298161  7376 tablet_bootstrap.cc:654] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.298738  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:53.300554  7257 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:53.303041  7546 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.303611  7546 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:53.305922  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:53.306655  7503 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.306303  7546 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.307255  7503 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:53.308413  7503 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.308525  7084 catalog_manager.cc:5697] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.321156  7598 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.321906  7377 raft_consensus.cc:359] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.322610  7377 raft_consensus.cc:385] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.322988  7377 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.321730  7598 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.325228  7598 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.326248  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.327306  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:53.327759  7228 leader_election.cc:343] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.327975  7332 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:53.331807  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:53.333163  7598 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.333518  7598 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.333868  7598 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.333767  7476 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.336009  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:53.337744  7225 leader_election.cc:343] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.338265  7225 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:53.339466  7481 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.341995  7377 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.367300  7378 tablet_bootstrap.cc:654] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.368963  7377 ts_tablet_manager.cc:1434] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.003s
I20260709 13:12:53.369551  7598 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.370056  7377 tablet_bootstrap.cc:492] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:53.365011  7508 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:53.365231  7085 catalog_manager.cc:5697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.359426  7376 tablet_bootstrap.cc:492] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:53.374475  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:53.374858  7376 ts_tablet_manager.cc:1403] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.116s	user 0.027s	sys 0.027s
I20260709 13:12:53.383927  7377 tablet_bootstrap.cc:654] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.376389  7598 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:12:53.386546  7228 leader_election.cc:343] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.365576  7084 catalog_manager.cc:5697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.375610  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:53.392347  7376 raft_consensus.cc:359] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.393049  7376 raft_consensus.cc:385] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.393337  7376 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.391155  7332 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.394135  7376 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.398187  7476 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.404062  7376 ts_tablet_manager.cc:1434] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:12:53.409356  7376 tablet_bootstrap.cc:492] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:53.424043  7378 tablet_bootstrap.cc:492] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:53.424643  7378 ts_tablet_manager.cc:1403] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.163s	user 0.017s	sys 0.011s
I20260709 13:12:53.431200  7376 tablet_bootstrap.cc:654] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.431412  7472 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:53.433163  7377 tablet_bootstrap.cc:492] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:53.433650  7377 ts_tablet_manager.cc:1403] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.006s
I20260709 13:12:53.434242  7332 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:53.435642  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:53.436779  7598 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.439198  7598 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:53.440053  7598 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.447300  7378 raft_consensus.cc:359] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.448020  7378 raft_consensus.cc:385] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.448275  7378 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.454896  7378 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.454260  7377 raft_consensus.cc:359] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.456710  7377 raft_consensus.cc:385] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:53.460175  7150 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:53.460516  7377 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.465247  7378 ts_tablet_manager.cc:1434] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.002s
I20260709 13:12:53.466830  7481 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.467319  7481 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.469220  7473 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.469689  7473 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.470183  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.471797  7473 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:12:53.472642  7228 leader_election.cc:343] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.473449  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:53.474965  7150 leader_election.cc:343] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.475936  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:53.477489  7225 leader_election.cc:343] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.477960  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:53.478876  7590 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.481662  7376 tablet_bootstrap.cc:492] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:53.481573  7481 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.482261  7376 ts_tablet_manager.cc:1403] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.009s
I20260709 13:12:53.485335  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.485595  7376 raft_consensus.cc:359] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.486399  7376 raft_consensus.cc:385] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:53.486935  7152 leader_election.cc:343] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.487087  7376 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.487511  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:53.487882  7376 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.488293  7546 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.489784  7376 ts_tablet_manager.cc:1434] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:12:53.490566  7481 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.491067  7481 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.490929  7377 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.493049  7481 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.493873  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.494261  7376 tablet_bootstrap.cc:492] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
W20260709 13:12:53.495455  7228 leader_election.cc:343] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.497582  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:12:53.499248  7225 leader_election.cc:343] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.499822  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:53.499208  7085 catalog_manager.cc:5697] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.500939  7481 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.501586  7376 tablet_bootstrap.cc:654] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.502926  7377 ts_tablet_manager.cc:1434] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.004s
I20260709 13:12:53.503989  7377 tablet_bootstrap.cc:492] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:53.502067  7378 tablet_bootstrap.cc:492] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:53.506698  7376 tablet_bootstrap.cc:492] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:53.507229  7376 ts_tablet_manager.cc:1403] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.009s
I20260709 13:12:53.509950  7376 raft_consensus.cc:359] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.510785  7376 raft_consensus.cc:385] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.511145  7376 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.511839  7376 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.512688  7378 tablet_bootstrap.cc:654] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.514122  7376 ts_tablet_manager.cc:1434] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:12:53.515156  7376 tablet_bootstrap.cc:492] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:53.521685  7376 tablet_bootstrap.cc:654] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.523638  7481 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:53.529983  7377 tablet_bootstrap.cc:654] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.569125  7378 tablet_bootstrap.cc:492] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:53.569772  7378 ts_tablet_manager.cc:1403] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.000s
I20260709 13:12:53.571990  7376 tablet_bootstrap.cc:492] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:53.572402  7378 raft_consensus.cc:359] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.573176  7376 ts_tablet_manager.cc:1403] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.058s	user 0.031s	sys 0.024s
I20260709 13:12:53.575197  7377 tablet_bootstrap.cc:492] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:53.575678  7377 ts_tablet_manager.cc:1403] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.000s
I20260709 13:12:53.576653  7376 raft_consensus.cc:359] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.577564  7376 raft_consensus.cc:385] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.577876  7376 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
W20260709 13:12:53.578816  7225 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:53.578228  7377 raft_consensus.cc:359] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.578958  7376 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.579582  7377 raft_consensus.cc:385] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.579825  7378 raft_consensus.cc:385] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.580065  7377 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.580178  7378 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.580806  7377 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.581004  7378 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.581797  7376 ts_tablet_manager.cc:1434] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:12:53.583316  7377 ts_tablet_manager.cc:1434] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:53.583452  7378 ts_tablet_manager.cc:1434] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:53.584190  7376 tablet_bootstrap.cc:492] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:53.585011  7377 tablet_bootstrap.cc:492] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:53.586300  7546 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.591346  7376 tablet_bootstrap.cc:654] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.591382  7377 tablet_bootstrap.cc:654] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.595533  7546 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.596261  7546 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.600394  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.601421  7257 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:12:53.604373  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:53.603461  7546 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.607933  7150 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:53.609912  7546 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.623304  7378 tablet_bootstrap.cc:492] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:53.640594  7546 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.656942  7473 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.657176  7378 tablet_bootstrap.cc:654] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.657608  7473 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.659855  7473 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.661777  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.664067  7503 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.664592  7503 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.665663  7376 tablet_bootstrap.cc:492] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:53.664875  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:53.670415  7378 tablet_bootstrap.cc:492] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:53.670890  7378 ts_tablet_manager.cc:1403] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.006s
I20260709 13:12:53.667589  7503 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:53.667786  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.671579  7376 ts_tablet_manager.cc:1403] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.089s	user 0.021s	sys 0.049s
I20260709 13:12:53.668560  7377 tablet_bootstrap.cc:492] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:53.672724  7377 ts_tablet_manager.cc:1403] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.088s	user 0.029s	sys 0.048s
I20260709 13:12:53.675218  7377 raft_consensus.cc:359] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.675800  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:53.676010  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.674158  7376 raft_consensus.cc:359] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.677834  7301 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:53.678386  7378 raft_consensus.cc:359] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.676996  7376 raft_consensus.cc:385] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.678963  7503 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.679023  7378 raft_consensus.cc:385] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.679590  7378 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
W20260709 13:12:53.679632  7150 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:53.679119  7376 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.678970  7476 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.680747  7376 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.682791  7376 ts_tablet_manager.cc:1434] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:12:53.683852  7376 tablet_bootstrap.cc:492] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:53.680320  7378 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.675840  7377 raft_consensus.cc:385] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.685719  7377 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.686381  7377 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.686796  7378 ts_tablet_manager.cc:1434] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:53.688488  7377 ts_tablet_manager.cc:1434] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:12:53.690166  7378 tablet_bootstrap.cc:492] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:53.691391  7377 tablet_bootstrap.cc:492] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:53.697126  7377 tablet_bootstrap.cc:654] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.701177  7378 tablet_bootstrap.cc:654] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.703915  7376 tablet_bootstrap.cc:654] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.712572  7332 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.714934  7503 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.715461  7503 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.719022  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.719700  7257 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:53.720219  7476 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.720685  7476 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.723490  7476 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.722258  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:53.726032  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:53.726301  7508 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.726725  7508 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.727054  7508 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.733331  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.734030  7257 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:53.735668  7152 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:53.736603  7473 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.739504  7473 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.739974  7473 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:53.740238  7150 leader_election.cc:343] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.745754  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.746748  7183 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:53.737504  7503 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:53.754772  7476 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:53.763446  7377 tablet_bootstrap.cc:492] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:53.766947  7377 ts_tablet_manager.cc:1403] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.076s	user 0.029s	sys 0.005s
I20260709 13:12:53.774221  7560 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.774955  7560 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.777734  7560 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:53.777930  7508 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.779685  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:53.781390  7376 tablet_bootstrap.cc:492] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
W20260709 13:12:53.781539  7301 leader_election.cc:343] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.782083  7376 ts_tablet_manager.cc:1403] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.098s	user 0.026s	sys 0.041s
I20260709 13:12:53.783134  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.785036  7183 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:53.791492  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:53.791628  7377 raft_consensus.cc:359] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.792526  7377 raft_consensus.cc:385] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.792680  7503 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.792863  7377 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.793119  7503 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.793516  7503 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.793917  7377 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.795567  7376 raft_consensus.cc:359] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.796018  7376 raft_consensus.cc:385] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.796188  7376 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.796676  7376 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.798532  7546 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:53.799467  7376 ts_tablet_manager.cc:1434] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:12:53.800494  7376 tablet_bootstrap.cc:492] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:53.808161  7503 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.810725  7377 ts_tablet_manager.cc:1434] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:12:53.812912  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:53.813565  7183 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.814343  7376 tablet_bootstrap.cc:654] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.819231  7598 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.819768  7598 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.821928  7598 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.823159  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.824445  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:12:53.824760  7228 leader_election.cc:343] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.825139  7261 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.825572  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:53.826980  7182 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.837096  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:53.837814  7182 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:53.837741  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:53.839200  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:12:53.839578  7225 leader_election.cc:343] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.822672  7508 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:53.840021  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:53.840586  7508 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:53.840889  7301 leader_election.cc:343] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.841078  7598 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.835419  7503 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:53.845136  7508 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:53.846017  7378 tablet_bootstrap.cc:492] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:53.846549  7378 ts_tablet_manager.cc:1403] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.157s	user 0.022s	sys 0.016s
I20260709 13:12:53.846299  7508 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.852049  7598 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.852626  7598 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.854409  7183 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:53.856000  7302 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:53.856875  7378 raft_consensus.cc:359] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.857432  7503 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.857582  7378 raft_consensus.cc:385] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.857929  7378 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.858605  7378 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.857997  7503 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:53.826460  7473 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.861032  7503 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.862672  7598 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.863436  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:53.863983  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.864230  7262 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.864642  7183 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:53.866720  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:53.867687  7481 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.867931  7261 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:53.868217  7481 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.868719  7481 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.869405  7377 tablet_bootstrap.cc:492] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:53.870048  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:53.870705  7332 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:53.873833  7378 ts_tablet_manager.cc:1434] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
W20260709 13:12:53.874401  7133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:53.875025  7378 tablet_bootstrap.cc:492] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
W20260709 13:12:53.868726  7228 consensus_peers.cc:597] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:53.916682  7472 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.920017  7473 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:53.948240  7262 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:53.951589  7481 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.952541  7152 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:53.953703  7475 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.954187  7475 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:53.977882  7475 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.978982  7508 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.979554  7333 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.979494  7508 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:53.983131  7182 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:53.988118  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 105245us
I20260709 13:12:53.991662  7508 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:53.996291  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:53.993795  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:12:54.001991  7150 leader_election.cc:343] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.998431  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:54.003479  7376 tablet_bootstrap.cc:492] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:54.003971  7376 ts_tablet_manager.cc:1403] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.204s	user 0.008s	sys 0.019s
I20260709 13:12:54.004413  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:53.999027  7187 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:54.009366  7084 catalog_manager.cc:5697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:54.017964  7301 leader_election.cc:343] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.028613  7506 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.010988  7184 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.033962  7378 tablet_bootstrap.cc:654] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:54.039889  7213 tablet.cc:2406] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:54.035980  7376 raft_consensus.cc:359] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.037639  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:54.042336  7376 raft_consensus.cc:385] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.042865  7376 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.044965  7376 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.054952  7506 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.055410  7506 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.055773  7506 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.065095  7506 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.065440  7629 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:54.084517  7376 ts_tablet_manager.cc:1434] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:12:54.088444  7377 tablet_bootstrap.cc:654] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.120491  7376 tablet_bootstrap.cc:492] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
W20260709 13:12:54.128054  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 89772.1us
I20260709 13:12:54.141345  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:54.142093  7335 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.146515  7506 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:54.139086  7481 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:54.157409  7184 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:54.152987  7335 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
W20260709 13:12:54.135288  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 113067us
I20260709 13:12:54.165964  7378 tablet_bootstrap.cc:492] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:54.167796  7378 ts_tablet_manager.cc:1403] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.292s	user 0.019s	sys 0.016s
I20260709 13:12:54.172318  7378 raft_consensus.cc:359] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.173297  7378 raft_consensus.cc:385] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.173651  7378 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.176815  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:54.187547  7376 tablet_bootstrap.cc:654] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.187088  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:54.194700  7633 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.195291  7633 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:54.196143  7633 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.199049  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:54.199719  7183 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.206367  7084 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.176254  7378 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.216091  7378 ts_tablet_manager.cc:1434] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:12:54.217320  7378 tablet_bootstrap.cc:492] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:54.215611  7261 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.221019  7377 tablet_bootstrap.cc:492] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:54.221578  7377 ts_tablet_manager.cc:1403] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.352s	user 0.026s	sys 0.036s
I20260709 13:12:54.226043  7261 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:54.240056  7377 raft_consensus.cc:359] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.243057  7377 raft_consensus.cc:385] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.243435  7377 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.244164  7377 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.246438  7377 ts_tablet_manager.cc:1434] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:12:54.247520  7377 tablet_bootstrap.cc:492] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:54.253939  7085 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.253000  7183 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:54.258594  7182 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.262002  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:54.263566  7635 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.264633  7635 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:54.266161  7635 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.273697  7378 tablet_bootstrap.cc:654] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.276952  7376 tablet_bootstrap.cc:492] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:54.277551  7376 ts_tablet_manager.cc:1403] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.009s
I20260709 13:12:54.278918  7377 tablet_bootstrap.cc:654] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.282809  7081 catalog_manager.cc:5697] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.297789  7376 raft_consensus.cc:359] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.304431  7376 raft_consensus.cc:385] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.304834  7376 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.305482  7376 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.307711  7377 tablet_bootstrap.cc:492] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:54.308203  7377 ts_tablet_manager.cc:1403] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.006s
I20260709 13:12:54.311100  7378 tablet_bootstrap.cc:492] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:54.311565  7378 ts_tablet_manager.cc:1403] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.094s	user 0.005s	sys 0.007s
I20260709 13:12:54.307724  7376 ts_tablet_manager.cc:1434] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:12:54.314035  7635 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.314723  7376 tablet_bootstrap.cc:492] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:54.314582  7635 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.316783  7635 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:54.317310  7635 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.319940  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:54.320528  7260 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:54.321702  7376 tablet_bootstrap.cc:654] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.321672  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:54.323159  7503 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.323549  7503 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.323886  7503 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.327106  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:54.327692  7377 raft_consensus.cc:359] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.328342  7377 raft_consensus.cc:385] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.328612  7377 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.329104  7376 tablet_bootstrap.cc:492] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:54.329599  7376 ts_tablet_manager.cc:1403] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 13:12:54.329223  7377 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:54.332185  7302 leader_election.cc:343] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.332652  7376 raft_consensus.cc:359] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.333361  7376 raft_consensus.cc:385] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.334410  7590 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.334833  7635 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.334957  7590 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.337071  7590 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:54.338146  7377 ts_tablet_manager.cc:1434] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.003s
I20260709 13:12:54.339247  7377 tablet_bootstrap.cc:492] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:54.339699  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:54.341462  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:54.343052  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:54.344255  7260 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.345002  7081 catalog_manager.cc:5697] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.346225  7376 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.346691  7377 tablet_bootstrap.cc:654] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.346964  7376 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.349046  7376 ts_tablet_manager.cc:1434] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:12:54.351779  7376 tablet_bootstrap.cc:492] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:54.358019  7376 tablet_bootstrap.cc:654] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.360802  7473 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.361336  7473 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.364841  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:54.369239  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:54.370246  7261 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
W20260709 13:12:54.372201  7150 leader_election.cc:343] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.373317  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:54.374379  7476 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.374902  7476 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.375347  7476 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.387995  7481 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.392393  7473 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:54.394790  7560 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.403985  7377 tablet_bootstrap.cc:492] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:54.404558  7377 ts_tablet_manager.cc:1403] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.038s
I20260709 13:12:54.405443  7560 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.407294  7377 raft_consensus.cc:359] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.408118  7377 raft_consensus.cc:385] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.408447  7377 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.409240  7377 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.412236  7503 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.415398  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:54.416023  7262 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.405205  7378 raft_consensus.cc:359] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.416617  7378 raft_consensus.cc:385] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.416893  7378 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.411465  7377 ts_tablet_manager.cc:1434] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:54.421801  7377 tablet_bootstrap.cc:492] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:54.421407  7378 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.423440  7378 ts_tablet_manager.cc:1434] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260709 13:12:54.424419  7378 tablet_bootstrap.cc:492] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:54.428344  7377 tablet_bootstrap.cc:654] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.433967  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:12:54.435864  7302 leader_election.cc:343] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.437233  7262 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:54.439867  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:54.440869  7635 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.441512  7635 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:54.442525  7635 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.455399  7334 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.466234  7473 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:54.471434  7377 tablet_bootstrap.cc:492] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:54.471887  7377 ts_tablet_manager.cc:1403] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.021s
I20260709 13:12:54.474726  7377 raft_consensus.cc:359] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.475399  7377 raft_consensus.cc:385] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.475670  7377 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.476867  7377 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.478845  7503 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:54.479465  7377 ts_tablet_manager.cc:1434] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:54.401495  7476 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.480652  7377 tablet_bootstrap.cc:492] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:54.483333  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:12:54.486274  7150 leader_election.cc:343] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.487409  7377 tablet_bootstrap.cc:654] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.492825  7377 tablet_bootstrap.cc:492] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:54.492897  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:54.493549  7377 ts_tablet_manager.cc:1403] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 13:12:54.493573  7262 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.497154  7377 raft_consensus.cc:359] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.497992  7377 raft_consensus.cc:385] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.498369  7377 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.499217  7377 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.501251  7377 ts_tablet_manager.cc:1434] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:54.501243  7262 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:54.502318  7635 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.502923  7377 tablet_bootstrap.cc:492] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:54.502978  7635 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.506687  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:54.507545  7187 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:54.509047  7302 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:54.509516  7377 tablet_bootstrap.cc:654] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.510151  7472 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.510663  7472 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.511108  7472 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.520347  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:54.521327  7262 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:54.523443  7635 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:54.529196  7472 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.530854  7476 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:54.532251  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:54.533768  7476 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.534641  7476 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:54.535766  7476 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.547638  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:54.548550  7187 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.568292  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:54.569136  7262 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.574323  7473 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:54.574784  7472 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:54.576539  7187 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:54.578117  7302 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:54.579788  7503 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.581732  7503 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:54.582886  7503 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.592187  7377 tablet_bootstrap.cc:492] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:54.592778  7377 ts_tablet_manager.cc:1403] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.090s	user 0.028s	sys 0.056s
I20260709 13:12:54.594857  7590 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:54.595513  7377 raft_consensus.cc:359] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.596321  7377 raft_consensus.cc:385] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.596657  7377 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.597466  7377 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.599781  7377 ts_tablet_manager.cc:1434] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:54.601203  7377 tablet_bootstrap.cc:492] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:54.605111  7262 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:54.605767  7481 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.607661  7377 tablet_bootstrap.cc:654] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.629469  7472 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.630203  7472 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.635388  7472 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:54.635825  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:54.636587  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:54.638870  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:54.640512  7472 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.654475  7081 catalog_manager.cc:5697] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.662103  7376 tablet_bootstrap.cc:492] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:54.662882  7376 ts_tablet_manager.cc:1403] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.311s	user 0.049s	sys 0.093s
I20260709 13:12:54.674607  7378 tablet_bootstrap.cc:654] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.675081  7376 raft_consensus.cc:359] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.675817  7376 raft_consensus.cc:385] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.676141  7376 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.676962  7376 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.679255  7376 ts_tablet_manager.cc:1434] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:54.680131  7376 tablet_bootstrap.cc:492] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:54.685837  7376 tablet_bootstrap.cc:654] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.692444  7332 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.725123  7081 catalog_manager.cc:5697] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.734071  7377 tablet_bootstrap.cc:492] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:54.734802  7377 ts_tablet_manager.cc:1403] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.134s	user 0.048s	sys 0.044s
I20260709 13:12:54.737829  7377 raft_consensus.cc:359] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.738541  7377 raft_consensus.cc:385] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.738834  7377 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.739487  7377 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.756094  7377 ts_tablet_manager.cc:1434] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:12:54.757135  7377 tablet_bootstrap.cc:492] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:54.757716  7335 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.762493  7085 catalog_manager.cc:5697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.765075  7503 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.765589  7503 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.766892  7472 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.767689  7503 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:54.768679  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:54.770102  7302 leader_election.cc:343] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.772303  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:12:54.774180  7301 leader_election.cc:343] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.774952  7301 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:54.776047  7506 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.782161  7377 tablet_bootstrap.cc:654] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.794047  7506 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:54.832728  7378 tablet_bootstrap.cc:492] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:54.846089  7378 ts_tablet_manager.cc:1403] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.422s	user 0.016s	sys 0.000s
I20260709 13:12:54.856355  7506 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.856916  7506 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.859932  7506 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:54.860737  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:54.861495  7182 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:54.861810  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:54.862389  7260 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:54.862769  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:54.863359  7377 tablet_bootstrap.cc:492] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:54.863706  7506 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:54.863826  7377 ts_tablet_manager.cc:1403] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.107s	user 0.037s	sys 0.032s
I20260709 13:12:54.864136  7506 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.864514  7506 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.871608  7506 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.874428  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:54.875043  7187 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.880159  7376 tablet_bootstrap.cc:492] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:54.880762  7376 ts_tablet_manager.cc:1403] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.201s	user 0.043s	sys 0.084s
I20260709 13:12:54.881204  7378 raft_consensus.cc:359] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.881981  7378 raft_consensus.cc:385] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.882273  7378 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.883177  7376 raft_consensus.cc:359] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.883885  7376 raft_consensus.cc:385] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.883703  7377 raft_consensus.cc:359] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.884205  7376 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.884440  7377 raft_consensus.cc:385] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.884761  7377 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.885007  7376 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.885422  7377 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.886679  7506 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:54.887262  7376 ts_tablet_manager.cc:1434] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:54.893112  7376 tablet_bootstrap.cc:492] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:54.893656  7377 ts_tablet_manager.cc:1434] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.001s
I20260709 13:12:54.887771  7187 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:12:54.888578  7598 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.889114  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:54.894704  7377 tablet_bootstrap.cc:492] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:54.894907  7260 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.894259  7598 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.901942  7598 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:54.904181  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:54.904911  7332 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:54.906368  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:54.906690  7376 tablet_bootstrap.cc:654] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:54.906965  7133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:54.907027  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:54.907312  7598 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.907816  7598 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.908252  7598 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.910583  7377 tablet_bootstrap.cc:654] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.910784  7260 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:12:54.912007  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:12:54.912396  7228 leader_election.cc:343] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.912846  7506 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:54.913364  7506 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:54.914208  7506 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.914924  7598 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.891239  7378 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.917644  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:12:54.919422  7228 leader_election.cc:343] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.925462  7377 tablet_bootstrap.cc:492] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:54.925973  7377 ts_tablet_manager.cc:1403] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.003s
I20260709 13:12:54.925827  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:54.926462  7332 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.929034  7376 tablet_bootstrap.cc:492] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:54.928946  7377 raft_consensus.cc:359] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.929723  7377 raft_consensus.cc:385] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.929598  7376 ts_tablet_manager.cc:1403] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.037s	user 0.004s	sys 0.007s
I20260709 13:12:54.930022  7377 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.930932  7377 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.922495  7598 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:54.933037  7378 ts_tablet_manager.cc:1434] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.084s	user 0.004s	sys 0.002s
I20260709 13:12:54.933501  7377 ts_tablet_manager.cc:1434] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:54.934022  7378 tablet_bootstrap.cc:492] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:54.933614  7376 raft_consensus.cc:359] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.934474  7376 raft_consensus.cc:385] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.934752  7377 tablet_bootstrap.cc:492] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:54.934832  7376 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.935643  7376 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.937862  7376 ts_tablet_manager.cc:1434] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:54.939258  7376 tablet_bootstrap.cc:492] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:54.943789  7377 tablet_bootstrap.cc:654] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.944437  7503 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.945483  7376 tablet_bootstrap.cc:654] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.963662  7332 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:54.967641  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:54.968812  7481 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.969388  7481 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:54.970340  7481 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:54.972187  7378 tablet_bootstrap.cc:654] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:54.975881  7150 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:54.978116  7081 catalog_manager.cc:5697] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 2, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.002673  7377 tablet_bootstrap.cc:492] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:55.003206  7377 ts_tablet_manager.cc:1403] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.016s
I20260709 13:12:55.005833  7377 raft_consensus.cc:359] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.006500  7377 raft_consensus.cc:385] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.008915  7377 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.008929  7473 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.009577  7473 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.009752  7377 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.011783  7473 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.011894  7377 ts_tablet_manager.cc:1434] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:55.013547  7377 tablet_bootstrap.cc:492] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:55.013741  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:55.018347  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:55.019536  7377 tablet_bootstrap.cc:654] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.024509  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:55.029168  7473 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.040807  7182 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.056720  7481 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.057451  7481 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.061275  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:55.061944  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:55.062453  7376 tablet_bootstrap.cc:492] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:55.062597  7182 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
W20260709 13:12:55.062847  7225 leader_election.cc:343] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.063181  7376 ts_tablet_manager.cc:1403] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.124s	user 0.043s	sys 0.068s
I20260709 13:12:55.063827  7228 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:55.064023  7560 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.064749  7598 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.065122  7598 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.065475  7598 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.063854  7481 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.072623  7378 tablet_bootstrap.cc:492] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:55.073076  7378 ts_tablet_manager.cc:1403] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.139s	user 0.010s	sys 0.003s
I20260709 13:12:55.073596  7598 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.076390  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:55.076987  7183 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.078790  7378 raft_consensus.cc:359] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.079457  7378 raft_consensus.cc:385] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.079704  7378 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.080037  7376 raft_consensus.cc:359] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.080679  7376 raft_consensus.cc:385] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.080328  7378 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.082387  7378 ts_tablet_manager.cc:1434] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:12:55.080931  7376 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.088483  7183 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:55.093219  7378 tablet_bootstrap.cc:492] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:55.088410  7085 catalog_manager.cc:5697] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.094290  7376 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.094954  7228 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:55.095443  7377 tablet_bootstrap.cc:492] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:55.095809  7590 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.096047  7377 ts_tablet_manager.cc:1403] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.083s	user 0.039s	sys 0.024s
I20260709 13:12:55.096297  7590 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:55.097168  7590 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.099895  7377 raft_consensus.cc:359] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.100962  7377 raft_consensus.cc:385] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.101310  7377 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.105858  7473 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.110121  7378 tablet_bootstrap.cc:654] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.114004  7377 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.117220  7377 ts_tablet_manager.cc:1434] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:12:55.118696  7377 tablet_bootstrap.cc:492] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:55.089855  7598 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.090147  7508 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.091464  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:55.126123  7377 tablet_bootstrap.cc:654] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:55.126480  7225 leader_election.cc:343] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:55.128603  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56592.4us
I20260709 13:12:55.139881  7377 tablet_bootstrap.cc:492] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:55.140529  7377 ts_tablet_manager.cc:1403] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.008s
I20260709 13:12:55.144078  7377 raft_consensus.cc:359] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.145072  7377 raft_consensus.cc:385] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.145411  7377 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.146410  7081 catalog_manager.cc:5697] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.149039  7508 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.146109  7377 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.156790  7377 ts_tablet_manager.cc:1434] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:55.157852  7377 tablet_bootstrap.cc:492] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:55.181581  7377 tablet_bootstrap.cc:654] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.186918  7560 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.187475  7560 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:55.188199  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 94671.6us
I20260709 13:12:55.190320  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:55.188681  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 85413.8us
I20260709 13:12:55.191669  7183 raft_consensus.cc:2393] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 1: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:12:55.191565  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:55.194096  7301 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:55.194885  7503 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.196105  7377 tablet_bootstrap.cc:492] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:55.198606  7377 ts_tablet_manager.cc:1403] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.001s
I20260709 13:12:55.202581  7472 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.190349  7560 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:55.203317  7472 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.206472  7472 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:55.207978  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:55.203179  7503 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.209388  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:55.210122  7377 raft_consensus.cc:359] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.210840  7377 raft_consensus.cc:385] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.211113  7377 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
W20260709 13:12:55.211159  7302 leader_election.cc:343] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:55.212049  7301 leader_election.cc:343] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.211825  7377 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.212422  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:55.213773  7472 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.213967  7377 ts_tablet_manager.cc:1434] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:12:55.222882  7377 tablet_bootstrap.cc:492] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
W20260709 13:12:55.208530  7686 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:12:55.230451  7472 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.231120  7472 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.232455  7376 ts_tablet_manager.cc:1434] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.169s	user 0.042s	sys 0.040s
I20260709 13:12:55.233590  7376 tablet_bootstrap.cc:492] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:55.234117  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:55.235801  7503 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.236322  7503 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.238070  7503 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:55.239002  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:55.239290  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:12:55.240495  7302 leader_election.cc:343] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.240983  7378 tablet_bootstrap.cc:492] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:55.241477  7378 ts_tablet_manager.cc:1403] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.149s	user 0.032s	sys 0.022s
I20260709 13:12:55.239012  7472 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:55.244287  7378 raft_consensus.cc:359] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.245046  7378 raft_consensus.cc:385] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.245308  7378 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.249125  7377 tablet_bootstrap.cc:654] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.251236  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:12:55.247167  7301 leader_election.cc:343] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.254976  7301 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:55.255702  7508 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.256855  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:55.257870  7508 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.265426  7378 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.269622  7378 ts_tablet_manager.cc:1434] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.000s
I20260709 13:12:55.270176  7560 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.270587  7378 tablet_bootstrap.cc:492] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:55.270720  7560 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.272809  7560 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:55.266973  7376 tablet_bootstrap.cc:654] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.274612  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:55.276026  7302 leader_election.cc:343] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.279923  7376 tablet_bootstrap.cc:492] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:55.280643  7376 ts_tablet_manager.cc:1403] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.005s
I20260709 13:12:55.281282  7378 tablet_bootstrap.cc:654] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.283457  7376 raft_consensus.cc:359] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.284386  7376 raft_consensus.cc:385] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.284832  7376 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.285501  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:55.285899  7376 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.290526  7376 ts_tablet_manager.cc:1434] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
W20260709 13:12:55.291524  7301 leader_election.cc:343] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.294142  7301 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:55.292768  7377 tablet_bootstrap.cc:492] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:55.294893  7376 tablet_bootstrap.cc:492] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:55.294932  7377 ts_tablet_manager.cc:1403] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.000s
I20260709 13:12:55.297406  7560 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.293358  7378 tablet_bootstrap.cc:492] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:55.300841  7378 ts_tablet_manager.cc:1403] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 13:12:55.301687  7376 tablet_bootstrap.cc:654] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.304668  7377 raft_consensus.cc:359] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.305609  7377 raft_consensus.cc:385] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.305954  7377 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.306913  7377 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.309970  7377 ts_tablet_manager.cc:1434] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:12:55.312721  7378 raft_consensus.cc:359] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.313350  7378 raft_consensus.cc:385] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.313645  7378 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.314240  7560 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.315053  7376 tablet_bootstrap.cc:492] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:55.314795  7560 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.315636  7376 ts_tablet_manager.cc:1403] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.007s
I20260709 13:12:55.315820  7377 tablet_bootstrap.cc:492] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:55.314553  7378 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.317514  7378 ts_tablet_manager.cc:1434] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:12:55.318581  7378 tablet_bootstrap.cc:492] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:55.322517  7377 tablet_bootstrap.cc:654] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.321382  7376 raft_consensus.cc:359] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.329069  7376 raft_consensus.cc:385] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.329581  7376 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.331482  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:55.333289  7183 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:55.333763  7377 tablet_bootstrap.cc:492] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:55.334218  7377 ts_tablet_manager.cc:1403] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:12:55.334676  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:55.335530  7472 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.335908  7472 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.336282  7472 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.336046  7376 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.337013  7377 raft_consensus.cc:359] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.337659  7377 raft_consensus.cc:385] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.337913  7377 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.338615  7376 ts_tablet_manager.cc:1434] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:12:55.338811  7377 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.332731  7378 tablet_bootstrap.cc:654] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.341156  7377 ts_tablet_manager.cc:1434] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:55.341287  7476 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.341719  7476 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.342110  7377 tablet_bootstrap.cc:492] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:55.344318  7560 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:55.345414  7476 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.346849  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:55.347512  7332 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:55.348555  7376 tablet_bootstrap.cc:492] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:55.350975  7150 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:55.351881  7684 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.352231  7684 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.352586  7684 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.354913  7508 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.355444  7508 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.357824  7508 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:55.348918  7377 tablet_bootstrap.cc:654] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.361797  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:55.362488  7182 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:55.364475  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:55.365329  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:55.365980  7260 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:55.365322  7560 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.367956  7560 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.368291  7560 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.368377  7378 tablet_bootstrap.cc:492] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:55.369014  7378 ts_tablet_manager.cc:1403] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.001s
I20260709 13:12:55.369469  7684 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.370744  7377 tablet_bootstrap.cc:492] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:55.370807  7629 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.371273  7377 ts_tablet_manager.cc:1403] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.010s
I20260709 13:12:55.371487  7376 tablet_bootstrap.cc:654] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.371341  7629 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.373454  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:55.373594  7629 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.373982  7377 raft_consensus.cc:359] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.374686  7377 raft_consensus.cc:385] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.374984  7377 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
W20260709 13:12:55.375722  7301 leader_election.cc:343] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.375840  7377 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.376797  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:55.377614  7187 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 1: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:12:55.378515  7377 ts_tablet_manager.cc:1434] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:55.378995  7332 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.382436  7260 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:55.384436  7508 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.384886  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:55.385578  7335 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:55.387303  7377 tablet_bootstrap.cc:492] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:55.387492  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:55.387863  7376 tablet_bootstrap.cc:492] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:55.388080  7260 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:55.388521  7376 ts_tablet_manager.cc:1403] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.008s
I20260709 13:12:55.392199  7376 raft_consensus.cc:359] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.392964  7682 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.393388  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:55.391153  7472 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.393536  7682 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.398833  7377 tablet_bootstrap.cc:654] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.394810  7629 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.397044  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:55.399217  7629 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.399667  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:55.399827  7183 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.400355  7335 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:55.392957  7376 raft_consensus.cc:385] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.375744  7378 raft_consensus.cc:359] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.399819  7629 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.397994  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:55.401160  7376 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.400315  7682 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.402153  7376 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.401183  7378 raft_consensus.cc:385] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.405244  7378 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.404963  7376 ts_tablet_manager.cc:1434] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:12:55.405987  7378 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.406575  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:55.406976  7257 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:55.407570  7682 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.407995  7682 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.408862  7376 tablet_bootstrap.cc:492] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:55.397071  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:55.408538  7629 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.408497  7682 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:55.414873  7301 leader_election.cc:343] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.415968  7629 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.410318  7560 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.419102  7183 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:55.408484  7378 ts_tablet_manager.cc:1434] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:12:55.420759  7378 tablet_bootstrap.cc:492] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:55.418282  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:55.421406  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:55.421110  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:55.421929  7187 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 1: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:12:55.422061  7335 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.422212  7503 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.422680  7503 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:55.423460  7503 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.418382  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:55.426826  7260 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:12:55.398146  7472 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:55.435580  7335 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:55.435791  7682 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.436404  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:55.438961  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:55.444092  7684 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.444530  7183 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.445482  7260 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.438237  7560 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:55.443323  7378 tablet_bootstrap.cc:654] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.451843  7682 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.456966  7183 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:55.459676  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:55.461689  7506 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.461855  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:55.462225  7506 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:55.462445  7334 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.463136  7506 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.461220  7183 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:55.472190  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:55.472561  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:55.473862  7629 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.473930  7262 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.474560  7629 raft_consensus.cc:697] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:55.460845  7260 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:55.489619  7376 tablet_bootstrap.cc:654] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.519615  7503 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:12:55.525816  7081 catalog_manager.cc:5697] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.509204  7629 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.528052  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:55.542361  7377 tablet_bootstrap.cc:492] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:55.543131  7377 ts_tablet_manager.cc:1403] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.156s	user 0.012s	sys 0.005s
I20260709 13:12:55.533248  7334 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:55.560737  7377 raft_consensus.cc:359] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.561338  7377 raft_consensus.cc:385] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.561579  7377 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.562081  7377 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.558606  7262 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:55.568136  7152 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:55.569025  7682 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.569500  7682 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:55.570322  7682 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.577978  7377 ts_tablet_manager.cc:1434] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:12:55.578383  7598 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.574653  7335 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:12:55.579562  7377 tablet_bootstrap.cc:492] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:55.582500  7150 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:55.586354  7473 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.596714  7378 tablet_bootstrap.cc:492] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:55.597221  7378 ts_tablet_manager.cc:1403] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.177s	user 0.013s	sys 0.037s
I20260709 13:12:55.599829  7378 raft_consensus.cc:359] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.600533  7378 raft_consensus.cc:385] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.600873  7378 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.601495  7378 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:55.601987  7228 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.603618  7378 ts_tablet_manager.cc:1434] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:12:55.604866  7378 tablet_bootstrap.cc:492] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:55.605798  7598 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.606329  7598 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.612311  7081 catalog_manager.cc:5697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.666304  7378 tablet_bootstrap.cc:654] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.678212  7503 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.678910  7503 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.689479  7706 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.689834  7503 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:55.686043  7598 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.613533  7590 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.081s
I20260709 13:12:55.690222  7706 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.725739  7706 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:55.731503  7376 tablet_bootstrap.cc:492] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:55.732214  7376 ts_tablet_manager.cc:1403] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.324s	user 0.025s	sys 0.023s
I20260709 13:12:55.734079  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:55.735257  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:55.737833  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:55.738554  7332 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:55.739197  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:12:55.739465  7301 leader_election.cc:343] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.742873  7376 raft_consensus.cc:359] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.743597  7376 raft_consensus.cc:385] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.743871  7376 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.747085  7376 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.749271  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:55.755767  7376 ts_tablet_manager.cc:1434] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.002s
W20260709 13:12:55.765571  7301 leader_election.cc:343] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.765661  7629 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.767092  7590 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.772917  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:55.769658  7629 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.776813  7629 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.766287  7598 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:12:55.776453  7085 catalog_manager.cc:5697] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.780654  7377 tablet_bootstrap.cc:654] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.783215  7376 tablet_bootstrap.cc:492] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:55.775183  7590 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.788215  7590 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.793622  7378 tablet_bootstrap.cc:492] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:55.794129  7378 ts_tablet_manager.cc:1403] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.015s
I20260709 13:12:55.784003  7508 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:55.831388  7302 leader_election.cc:343] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.805280  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:55.856196  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:55.804134  7508 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:55.897956  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 66600.9us
I20260709 13:12:55.900980  7472 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.913064  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:55.923753  7715 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:12:55.923187  7082 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.957549  7684 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.958339  7684 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.961112  7684 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.955111  7629 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:55.969291  7629 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:55.969871  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:55.970798  7508 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:12:55.974972  7152 leader_election.cc:343] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.004400  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:56.005859  7376 tablet_bootstrap.cc:654] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.023072  7378 raft_consensus.cc:359] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.023813  7378 raft_consensus.cc:385] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.024085  7378 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.024691  7378 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:56.025851  7302 leader_election.cc:343] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.034906  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:56.005136  7331 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.040081  7378 ts_tablet_manager.cc:1434] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.246s	user 0.004s	sys 0.012s
I20260709 13:12:56.042606  7378 tablet_bootstrap.cc:492] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:56.033321  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:56.045940  7508 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.047820  7184 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 1: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:12:56.067997  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:56.081542  7682 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.083566  7682 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.085613  7682 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:56.087461  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:56.088057  7184 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:56.097733  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:56.098517  7330 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:56.102021  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:56.108217  7377 tablet_bootstrap.cc:492] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:56.108907  7377 ts_tablet_manager.cc:1403] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.530s	user 0.020s	sys 0.024s
I20260709 13:12:56.102823  7332 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:56.108330  7261 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.118139  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:56.121956  7377 raft_consensus.cc:359] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.123425  7377 raft_consensus.cc:385] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.123737  7377 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.124326  7377 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:56.128046  7301 leader_election.cc:343] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.132894  7481 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.134693  7377 ts_tablet_manager.cc:1434] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:12:56.131273  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:56.143543  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:56.154749  7378 tablet_bootstrap.cc:654] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:56.136693  7228 leader_election.cc:343] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.160985  7377 tablet_bootstrap.cc:492] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:56.161842  7683 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.167626  7376 tablet_bootstrap.cc:492] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:56.168385  7376 ts_tablet_manager.cc:1403] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.386s	user 0.018s	sys 0.023s
I20260709 13:12:56.162278  7683 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.172878  7683 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.179118  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:56.191237  7725 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.191776  7725 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.192149  7725 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.207279  7302 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:12:56.240363  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61386.4us
I20260709 13:12:56.240700  7598 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.258219  7376 raft_consensus.cc:359] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.259956  7376 raft_consensus.cc:385] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.258828  7720 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:56.260246  7376 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.260731  7683 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.259102  7710 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:56.263455  7331 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:56.265589  7725 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:56.268003  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 60807.7us
I20260709 13:12:56.268357  7722 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.268759  7722 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.270898  7722 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.270135  7376 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.273831  7725 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:56.275393  7683 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:56.275974  7376 ts_tablet_manager.cc:1434] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.107s	user 0.014s	sys 0.004s
I20260709 13:12:56.276976  7376 tablet_bootstrap.cc:492] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:56.278982  7722 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.280786  7378 tablet_bootstrap.cc:492] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:56.281227  7378 ts_tablet_manager.cc:1403] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.239s	user 0.014s	sys 0.005s
I20260709 13:12:56.283274  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:56.283747  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:56.283888  7180 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.284577  7334 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:12:56.285548  7718 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:56.291394  7378 raft_consensus.cc:359] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.292320  7378 raft_consensus.cc:385] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.292588  7378 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.293241  7378 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.295491  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:56.254704  7377 tablet_bootstrap.cc:654] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.296115  7258 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.299130  7378 ts_tablet_manager.cc:1434] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:12:56.300101  7378 tablet_bootstrap.cc:492] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:56.304642  7376 tablet_bootstrap.cc:654] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:56.323324  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54027.6us
I20260709 13:12:56.332513  7378 tablet_bootstrap.cc:654] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.337030  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:12:56.337785  7152 leader_election.cc:343] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.323913  7476 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:12:56.346972  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:56.339033  7722 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:56.340364  7508 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.353574  7508 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:56.354235  7152 leader_election.cc:343] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.355849  7508 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:56.357470  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:56.358112  7328 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.347003  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:12:56.365811  7133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:56.367331  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:56.352699  7732 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.371451  7473 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.370692  7732 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:56.370247  7258 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:56.375587  7732 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.386473  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:56.391853  7722 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.369522  7684 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:12:56.385519  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:56.393580  7377 tablet_bootstrap.cc:492] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:56.385804  7735 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.059s
I20260709 13:12:56.401158  7377 ts_tablet_manager.cc:1403] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.240s	user 0.032s	sys 0.030s
I20260709 13:12:56.393150  7722 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:56.412842  7722 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.414323  7180 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:56.420733  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:56.490785  7182 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 1: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:12:56.578944  7328 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:56.609748  7376 tablet_bootstrap.cc:492] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:56.610291  7376 ts_tablet_manager.cc:1403] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.334s	user 0.028s	sys 0.016s
I20260709 13:12:56.612550  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:56.625263  7378 tablet_bootstrap.cc:492] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:56.625994  7378 ts_tablet_manager.cc:1403] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.326s	user 0.005s	sys 0.017s
I20260709 13:12:56.627718  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:56.630966  7684 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.631481  7684 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:56.632332  7684 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.633344  7376 raft_consensus.cc:359] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:56.634383  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 108065us
W20260709 13:12:56.635170  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 186046us
I20260709 13:12:56.643021  7376 raft_consensus.cc:385] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.643406  7376 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
W20260709 13:12:56.645334  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 191360us
W20260709 13:12:56.648075  7301 leader_election.cc:343] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.644074  7376 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.642784  7377 raft_consensus.cc:359] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.657285  7377 raft_consensus.cc:385] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.658456  7376 ts_tablet_manager.cc:1434] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.003s
I20260709 13:12:56.660516  7377 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.669858  7377 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.667953  7378 raft_consensus.cc:359] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.661139  7376 tablet_bootstrap.cc:492] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:56.691803  7719 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.692333  7719 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.693907  7377 ts_tablet_manager.cc:1434] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.290s	user 0.021s	sys 0.020s
I20260709 13:12:56.694414  7719 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:56.695230  7378 raft_consensus.cc:385] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.700335  7378 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.698858  7376 tablet_bootstrap.cc:654] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:56.696868  7302 leader_election.cc:343] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.701064  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:56.703322  7378 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.708446  7378 ts_tablet_manager.cc:1434] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 13:12:56.706655  7377 tablet_bootstrap.cc:492] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:56.709841  7378 tablet_bootstrap.cc:492] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:56.704269  7085 catalog_manager.cc:5697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:56.711673  7722 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.712180  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:56.731200  7377 tablet_bootstrap.cc:654] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.717312  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:56.720194  7472 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.731097  7335 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:56.736785  7225 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:56.737529  7732 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.737901  7732 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.738266  7732 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:56.744509  7228 leader_election.cc:343] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.748651  7378 tablet_bootstrap.cc:654] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.749153  7732 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.758177  7732 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:56.758745  7376 tablet_bootstrap.cc:492] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:56.759284  7376 ts_tablet_manager.cc:1403] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.006s
I20260709 13:12:56.759281  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:56.760151  7335 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.764183  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:56.766042  7376 raft_consensus.cc:359] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.767015  7335 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:56.767102  7376 raft_consensus.cc:385] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.767553  7376 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
W20260709 13:12:56.767911  7228 leader_election.cc:343] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.768313  7376 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.771124  7376 ts_tablet_manager.cc:1434] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:56.771602  7225 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:56.772145  7376 tablet_bootstrap.cc:492] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:56.772387  7732 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.772927  7732 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:56.773756  7732 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.785065  7376 tablet_bootstrap.cc:654] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.789499  7377 tablet_bootstrap.cc:492] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:56.792459  7377 ts_tablet_manager.cc:1403] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.004s
I20260709 13:12:56.795185  7377 raft_consensus.cc:359] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.796180  7377 raft_consensus.cc:385] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.796516  7377 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.789760  7378 tablet_bootstrap.cc:492] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:56.797797  7378 ts_tablet_manager.cc:1403] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.088s	user 0.022s	sys 0.009s
I20260709 13:12:56.801018  7378 raft_consensus.cc:359] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.801735  7378 raft_consensus.cc:385] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.801996  7378 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.809860  7377 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.805147  7082 catalog_manager.cc:5697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.812323  7377 ts_tablet_manager.cc:1434] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:12:56.813407  7377 tablet_bootstrap.cc:492] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:56.802618  7378 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.815487  7378 ts_tablet_manager.cc:1434] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:12:56.816428  7378 tablet_bootstrap.cc:492] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:56.831390  7081 catalog_manager.cc:5697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.839437  7376 tablet_bootstrap.cc:492] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:56.840049  7376 ts_tablet_manager.cc:1403] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.000s
I20260709 13:12:56.844980  7376 raft_consensus.cc:359] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.845763  7376 raft_consensus.cc:385] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.846033  7376 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.849237  7378 tablet_bootstrap.cc:654] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.832515  7719 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:56.855010  7376 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.857761  7376 ts_tablet_manager.cc:1434] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:56.859256  7376 tablet_bootstrap.cc:492] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:56.860749  7706 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.875123  7719 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.875715  7719 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.878615  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:56.880036  7228 leader_election.cc:343] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.883265  7377 tablet_bootstrap.cc:654] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.884526  7376 tablet_bootstrap.cc:654] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.899070  7719 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:56.904815  7732 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:56.906117  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:56.904874  7082 catalog_manager.cc:5697] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.915769  7725 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.916692  7725 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.920363  7725 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:56.921906  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:56.922129  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:56.922616  7336 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:56.923920  7150 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:56.924719  7683 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.925074  7683 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.925411  7683 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.926810  7378 tablet_bootstrap.cc:492] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:56.927475  7378 ts_tablet_manager.cc:1403] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.111s	user 0.034s	sys 0.021s
W20260709 13:12:56.928200  7152 leader_election.cc:343] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.912463  7335 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:56.953241  7225 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:56.965970  7378 raft_consensus.cc:359] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.967011  7378 raft_consensus.cc:385] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.967344  7378 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.973925  7378 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.984120  7732 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.984539  7732 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.984860  7732 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.991987  7683 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.992766  7732 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:56.997095  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:56.997603  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:56.998339  7336 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.000000  7683 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:12:57.001060  7152 leader_election.cc:343] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.001155  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:57.003456  7378 ts_tablet_manager.cc:1434] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.076s	user 0.012s	sys 0.000s
I20260709 13:12:57.004504  7378 tablet_bootstrap.cc:492] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:57.007174  7732 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.009080  7376 tablet_bootstrap.cc:492] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:57.009554  7377 tablet_bootstrap.cc:492] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:57.009861  7376 ts_tablet_manager.cc:1403] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.151s	user 0.036s	sys 0.036s
I20260709 13:12:57.009959  7377 ts_tablet_manager.cc:1403] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.197s	user 0.011s	sys 0.004s
I20260709 13:12:57.013330  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:57.013970  7334 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.017867  7683 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.018479  7683 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.020511  7683 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.022046  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:57.023118  7335 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 0.
I20260709 13:12:57.023588  7377 raft_consensus.cc:359] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.024241  7377 raft_consensus.cc:385] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.024534  7377 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.025147  7377 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:57.026955  7228 leader_election.cc:343] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.028076  7150 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:57.021891  7334 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:57.028589  7722 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.029567  7473 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.029983  7473 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.030303  7473 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.022290  7376 raft_consensus.cc:359] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.031620  7376 raft_consensus.cc:385] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.031930  7376 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.032546  7376 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.034614  7376 ts_tablet_manager.cc:1434] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.002s
I20260709 13:12:57.036306  7376 tablet_bootstrap.cc:492] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:57.037137  7225 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:57.039844  7473 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.040648  7732 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.042711  7722 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.046525  7336 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:57.046399  7722 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.046830  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:57.047434  7261 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.044108  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:57.048688  7732 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:57.048883  7722 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:57.049643  7732 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.053948  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:12:57.056143  7301 leader_election.cc:343] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.057542  7377 ts_tablet_manager.cc:1434] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.004s
I20260709 13:12:57.060142  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:57.060865  7185 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:57.061935  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:57.062949  7722 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.063395  7722 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.063468  7377 tablet_bootstrap.cc:492] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:57.066381  7150 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:57.068300  7684 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.063810  7722 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.089108  7473 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.088232  7684 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:57.096416  7684 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.087967  7261 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:57.125447  7722 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.144292  7378 tablet_bootstrap.cc:654] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.173870  7473 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:57.177387  7376 tablet_bootstrap.cc:654] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.175218  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:57.209602  7722 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:57.210484  7719 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:57.205050  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46102us
I20260709 13:12:57.224296  7081 catalog_manager.cc:5697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.233287  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:57.234441  7473 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.235036  7473 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:57.206317  7336 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.235745  7473 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.219691  7710 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.247991  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:57.256207  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:57.254004  7710 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.287246  7719 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.287948  7719 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.290318  7183 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.301106  7377 tablet_bootstrap.cc:654] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:57.303794  7766 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.101s	user 0.001s	sys 0.001s
I20260709 13:12:57.303267  7082 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.282279  7180 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:57.314149  7228 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:57.343130  7710 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:57.348945  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:57.351229  7376 tablet_bootstrap.cc:492] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:57.351764  7376 ts_tablet_manager.cc:1403] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.316s	user 0.014s	sys 0.013s
W20260709 13:12:57.354497  7302 leader_election.cc:343] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.361790  7336 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:57.374310  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:57.375861  7378 tablet_bootstrap.cc:492] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:57.376376  7378 ts_tablet_manager.cc:1403] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.372s	user 0.026s	sys 0.031s
I20260709 13:12:57.396456  7719 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.391045  7256 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.398495  7376 raft_consensus.cc:359] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.402469  7376 raft_consensus.cc:385] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.403554  7376 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.411196  7376 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:57.419673  7301 leader_election.cc:343] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.421871  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:57.425937  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:57.429001  7376 ts_tablet_manager.cc:1434] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 13:12:57.439946  7376 tablet_bootstrap.cc:492] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:57.451623  7180 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:57.456465  7378 raft_consensus.cc:359] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.457204  7378 raft_consensus.cc:385] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.457475  7378 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.458087  7378 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.460134  7378 ts_tablet_manager.cc:1434] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.001s
I20260709 13:12:57.467434  7378 tablet_bootstrap.cc:492] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:57.463276  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:57.468986  7723 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.470197  7723 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:57.471097  7723 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.471889  7768 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.469733  7376 tablet_bootstrap.cc:654] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.473173  7719 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:57.460505  7179 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:57.480705  7133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:57.501189  7377 tablet_bootstrap.cc:492] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:57.505858  7377 ts_tablet_manager.cc:1403] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.443s	user 0.014s	sys 0.028s
I20260709 13:12:57.490504  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:57.504467  7725 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:12:57.523343  7725 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:57.524264  7301 leader_election.cc:343] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.524726  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:57.527088  7735 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:57.532037  7085 catalog_manager.cc:5697] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.540163  7376 tablet_bootstrap.cc:492] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:57.540732  7376 ts_tablet_manager.cc:1403] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.009s
I20260709 13:12:57.542761  7683 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.546146  7778 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.546496  7683 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.555896  7725 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.557546  7378 tablet_bootstrap.cc:654] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.559993  7473 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.560986  7777 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:57.562891  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:57.562290  7683 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.564060  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:57.568137  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:57.570878  7377 raft_consensus.cc:359] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.571600  7377 raft_consensus.cc:385] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.571863  7377 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.575258  7376 raft_consensus.cc:359] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.575949  7376 raft_consensus.cc:385] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.576221  7376 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.576907  7376 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.579519  7376 ts_tablet_manager.cc:1434] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:12:57.580574  7376 tablet_bootstrap.cc:492] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:57.582674  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:57.584563  7725 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:57.584961  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:57.585875  7333 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:12:57.572479  7377 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.595312  7377 ts_tablet_manager.cc:1434] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.001s
I20260709 13:12:57.596652  7377 tablet_bootstrap.cc:492] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:57.598121  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:57.599313  7683 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.600476  7683 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:12:57.600957  7683 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.605072  7376 tablet_bootstrap.cc:654] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.606173  7378 tablet_bootstrap.cc:492] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:57.606712  7378 ts_tablet_manager.cc:1403] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.139s	user 0.013s	sys 0.003s
I20260709 13:12:57.609936  7378 raft_consensus.cc:359] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.610639  7378 raft_consensus.cc:385] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.610915  7378 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.611594  7378 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.612089  7082 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.613772  7378 ts_tablet_manager.cc:1434] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:57.616290  7257 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.618598  7377 tablet_bootstrap.cc:654] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.625489  7473 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.626998  7378 tablet_bootstrap.cc:492] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:57.637709  7377 tablet_bootstrap.cc:492] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:57.638264  7377 ts_tablet_manager.cc:1403] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.001s
I20260709 13:12:57.641326  7377 raft_consensus.cc:359] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.641971  7377 raft_consensus.cc:385] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.642253  7377 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.643244  7378 tablet_bootstrap.cc:654] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.642987  7377 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.645164  7377 ts_tablet_manager.cc:1434] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:57.646137  7377 tablet_bootstrap.cc:492] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:57.669623  7378 tablet_bootstrap.cc:492] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:57.671257  7378 ts_tablet_manager.cc:1403] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.022s
I20260709 13:12:57.673403  7377 tablet_bootstrap.cc:654] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.677165  7378 raft_consensus.cc:359] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.677871  7378 raft_consensus.cc:385] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.678174  7378 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.678925  7378 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.680450  7378 ts_tablet_manager.cc:1434] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:12:57.681443  7378 tablet_bootstrap.cc:492] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:57.688365  7378 tablet_bootstrap.cc:654] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.699309  7377 tablet_bootstrap.cc:492] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:57.700165  7378 tablet_bootstrap.cc:492] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:57.700640  7378 ts_tablet_manager.cc:1403] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.002s
I20260709 13:12:57.703508  7378 raft_consensus.cc:359] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.704206  7378 raft_consensus.cc:385] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.704481  7378 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.705087  7378 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.699954  7377 ts_tablet_manager.cc:1403] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.000s
I20260709 13:12:57.708020  7378 ts_tablet_manager.cc:1434] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:12:57.710451  7378 tablet_bootstrap.cc:492] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:57.714927  7377 raft_consensus.cc:359] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.715907  7377 raft_consensus.cc:385] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.716248  7377 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.716866  7377 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.719156  7378 tablet_bootstrap.cc:654] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.719914  7778 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.720445  7778 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.723551  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:57.725005  7228 leader_election.cc:343] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.728204  7778 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.732328  7378 tablet_bootstrap.cc:492] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:57.732928  7378 ts_tablet_manager.cc:1403] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.002s
I20260709 13:12:57.733035  7473 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.735736  7378 raft_consensus.cc:359] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.736461  7378 raft_consensus.cc:385] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.736680  7719 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.736730  7378 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.737311  7719 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.738448  7378 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.740764  7719 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.740995  7377 ts_tablet_manager.cc:1434] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.004s
I20260709 13:12:57.741479  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:57.742444  7377 tablet_bootstrap.cc:492] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
W20260709 13:12:57.743229  7228 leader_election.cc:343] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.744510  7378 ts_tablet_manager.cc:1434] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:57.745723  7378 tablet_bootstrap.cc:492] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:57.751062  7377 tablet_bootstrap.cc:654] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.755072  7378 tablet_bootstrap.cc:654] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.750008  7683 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.837328  7183 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:57.840059  7378 tablet_bootstrap.cc:492] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:57.840550  7378 ts_tablet_manager.cc:1403] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.095s	user 0.030s	sys 0.028s
I20260709 13:12:57.842022  7720 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.842517  7720 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.844534  7720 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:12:57.845723  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63485.3us
I20260709 13:12:57.847672  7377 tablet_bootstrap.cc:492] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:57.848155  7377 ts_tablet_manager.cc:1403] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.014s
I20260709 13:12:57.850940  7377 raft_consensus.cc:359] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.851617  7377 raft_consensus.cc:385] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.851891  7377 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.852497  7377 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.841982  7683 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.855535  7377 ts_tablet_manager.cc:1434] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:57.856594  7377 tablet_bootstrap.cc:492] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:57.862579  7377 tablet_bootstrap.cc:654] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.864451  7376 tablet_bootstrap.cc:492] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:57.864986  7376 ts_tablet_manager.cc:1403] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.285s	user 0.037s	sys 0.053s
I20260709 13:12:57.868052  7376 raft_consensus.cc:359] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.868844  7376 raft_consensus.cc:385] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.869144  7376 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.871846  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:57.872527  7183 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:57.878021  7302 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:57.878430  7377 tablet_bootstrap.cc:492] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:57.878932  7720 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.879304  7720 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.879657  7720 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.880998  7719 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.883814  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:57.884459  7255 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:57.880874  7378 raft_consensus.cc:359] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.886613  7378 raft_consensus.cc:385] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.886423  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:57.887023  7378 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.887701  7378 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.888659  7377 ts_tablet_manager.cc:1403] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.004s
I20260709 13:12:57.889268  7378 ts_tablet_manager.cc:1434] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.048s	user 0.001s	sys 0.004s
I20260709 13:12:57.890194  7378 tablet_bootstrap.cc:492] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:57.891695  7719 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:57.892058  7719 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:57.892851  7719 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.893981  7719 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.888162  7720 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.895642  7683 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.898401  7377 raft_consensus.cc:359] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.899123  7377 raft_consensus.cc:385] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.899394  7377 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.900030  7377 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.903097  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:57.903728  7183 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.909320  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:57.909631  7183 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:57.909968  7257 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.911044  7302 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:57.912602  7723 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.913089  7723 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:57.913898  7723 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.914753  7720 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:57.869774  7376 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.919842  7377 ts_tablet_manager.cc:1434] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 13:12:57.920432  7376 ts_tablet_manager.cc:1434] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:12:57.920928  7377 tablet_bootstrap.cc:492] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Bootstrap starting.
I20260709 13:12:57.920804  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:57.921464  7376 tablet_bootstrap.cc:492] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:57.921597  7336 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:57.922888  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:57.923374  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:57.924023  7336 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:57.929037  7377 tablet_bootstrap.cc:654] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.930990  7376 tablet_bootstrap.cc:654] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.933064  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:57.942914  7590 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.943337  7590 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.943670  7590 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.947183  7257 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:57.948029  7378 tablet_bootstrap.cc:654] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.961862  7719 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.962406  7719 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.965206  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:57.965423  7261 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:12:57.965937  7183 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 1: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:12:57.967661  7719 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.968164  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:57.969020  7719 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.969429  7719 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.969849  7719 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.969990  7590 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.972100  7376 tablet_bootstrap.cc:492] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:57.974583  7376 ts_tablet_manager.cc:1403] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.004s
I20260709 13:12:57.976766  7719 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.980582  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:57.984131  7719 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.988327  7774 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.989033  7774 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.991273  7774 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:57.994022  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:12:57.995452  7228 leader_election.cc:343] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.978178  7376 raft_consensus.cc:359] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:57.996441  7376 raft_consensus.cc:385] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.996857  7376 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.003033  7590 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:58.003636  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:58.008637  7179 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.009212  7378 tablet_bootstrap.cc:492] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:58.010818  7378 ts_tablet_manager.cc:1403] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.023s
I20260709 13:12:58.013686  7378 raft_consensus.cc:359] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.015272  7378 raft_consensus.cc:385] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.015662  7378 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.010833  7376 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.016307  7183 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.017992  7376 ts_tablet_manager.cc:1434] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:12:58.017922  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:58.019263  7376 tablet_bootstrap.cc:492] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:58.020311  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:58.020759  7256 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.020951  7335 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.022718  7183 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:58.024557  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:58.025666  7378 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.027524  7335 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:58.028085  7590 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.028653  7590 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:58.029559  7590 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.030314  7378 ts_tablet_manager.cc:1434] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:12:58.030802  7376 tablet_bootstrap.cc:654] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.032356  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:58.033155  7723 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.033439  7473 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:58.033639  7723 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.034121  7473 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:12:58.035164  7473 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.037796  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:58.039139  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:58.037838  7179 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:58.040854  7720 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.041055  7228 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:58.042021  7774 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.042470  7774 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:58.043296  7774 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:12:58.045189  7302 leader_election.cc:343] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.045796  7723 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:58.047045  7378 tablet_bootstrap.cc:492] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:58.047349  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:58.050863  7261 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:58.052209  7301 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:58.054078  7225 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:58.054960  7377 tablet_bootstrap.cc:492] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: No bootstrap required, opened a new log
I20260709 13:12:58.055415  7377 ts_tablet_manager.cc:1403] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Time spent bootstrapping tablet: real 0.135s	user 0.027s	sys 0.042s
I20260709 13:12:58.055757  7378 tablet_bootstrap.cc:654] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.058848  7335 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 0.
I20260709 13:12:58.059585  7723 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.060583  7723 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.060954  7723 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.068209  7723 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.071117  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:58.077204  7376 tablet_bootstrap.cc:492] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:58.077754  7376 ts_tablet_manager.cc:1403] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.009s
W20260709 13:12:58.077859  7302 leader_election.cc:343] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.083122  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:12:58.083910  7590 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.084282  7590 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.084602  7723 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:58.085014  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:58.086011  7377 raft_consensus.cc:359] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.086719  7377 raft_consensus.cc:385] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.087664  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:58.088245  7336 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.088444  7376 raft_consensus.cc:359] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.084628  7590 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.081666  7378 tablet_bootstrap.cc:492] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:58.091334  7378 ts_tablet_manager.cc:1403] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.008s
I20260709 13:12:58.089181  7376 raft_consensus.cc:385] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.095973  7376 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.096622  7376 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.097826  7560 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.098721  7376 ts_tablet_manager.cc:1434] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:12:58.099718  7376 tablet_bootstrap.cc:492] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:58.086969  7377 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.100284  7336 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:58.106760  7376 tablet_bootstrap.cc:654] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.108947  7590 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.110553  7261 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 1: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:12:58.101192  7378 raft_consensus.cc:359] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.111231  7378 raft_consensus.cc:385] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.111522  7378 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.112150  7378 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.114328  7378 ts_tablet_manager.cc:1434] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 13:12:58.115394  7378 tablet_bootstrap.cc:492] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Bootstrap starting.
I20260709 13:12:58.116729  7301 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:58.118294  7472 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.123608  7378 tablet_bootstrap.cc:654] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.124153  7590 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:58.104303  7377 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.127228  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:58.128494  7377 ts_tablet_manager.cc:1434] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.000s
W20260709 13:12:58.128736  7228 leader_election.cc:343] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.142369  7376 tablet_bootstrap.cc:492] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:58.143188  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:58.144162  7336 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 1: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:12:58.145193  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:12:58.146265  7774 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.147853  7376 ts_tablet_manager.cc:1403] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.022s
I20260709 13:12:58.151516  7778 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.157370  7378 tablet_bootstrap.cc:492] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: No bootstrap required, opened a new log
I20260709 13:12:58.157959  7378 ts_tablet_manager.cc:1403] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.001s
I20260709 13:12:58.164781  7378 raft_consensus.cc:359] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.165447  7378 raft_consensus.cc:385] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.165714  7378 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.166353  7378 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.168584  7378 ts_tablet_manager.cc:1434] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:58.161787  7376 raft_consensus.cc:359] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.169330  7376 raft_consensus.cc:385] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.169620  7376 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.170282  7376 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.171877  7376 ts_tablet_manager.cc:1434] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:12:58.172942  7376 tablet_bootstrap.cc:492] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:58.178579  7376 tablet_bootstrap.cc:654] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.196013  7082 catalog_manager.cc:5697] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.227438  7376 tablet_bootstrap.cc:492] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:58.227921  7376 ts_tablet_manager.cc:1403] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.029s
I20260709 13:12:58.230008  7376 raft_consensus.cc:359] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.230566  7376 raft_consensus.cc:385] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.230912  7376 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.231648  7376 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.234057  7376 ts_tablet_manager.cc:1434] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:58.235010  7376 tablet_bootstrap.cc:492] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:58.237792  7085 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.239732  7376 tablet_bootstrap.cc:654] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.241746  7720 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.242255  7720 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.242842  7085 catalog_manager.cc:5697] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.244408  7720 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:58.245097  7376 tablet_bootstrap.cc:492] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:58.245141  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:58.245934  7376 ts_tablet_manager.cc:1403] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.002s
I20260709 13:12:58.245918  7180 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:58.246273  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:58.247033  7256 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:58.247382  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:58.249135  7720 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.249038  7376 raft_consensus.cc:359] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.249586  7720 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.249982  7376 raft_consensus.cc:385] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.250020  7720 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.250357  7376 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.251245  7376 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.254755  7376 ts_tablet_manager.cc:1434] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:12:58.255825  7376 tablet_bootstrap.cc:492] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Bootstrap starting.
I20260709 13:12:58.259759  7720 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.261286  7376 tablet_bootstrap.cc:654] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.261951  7720 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:58.262692  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:58.263326  7180 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.263571  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:58.264149  7256 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.270648  7180 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:58.270042  7081 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 2, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.277136  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:58.279250  7723 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.279774  7723 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:58.280580  7723 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.283574  7256 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:58.284670  7706 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.285845  7179 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.286305  7706 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.289000  7376 tablet_bootstrap.cc:492] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: No bootstrap required, opened a new log
I20260709 13:12:58.289460  7376 ts_tablet_manager.cc:1403] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.016s
I20260709 13:12:58.289593  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:58.290251  7256 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:58.291620  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:58.292357  7720 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.292269  7376 raft_consensus.cc:359] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.293259  7720 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.293468  7376 raft_consensus.cc:385] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.293655  7720 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.293895  7376 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.294663  7376 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.302332  7706 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:58.301685  7720 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.303081  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:58.303668  7183 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:58.305298  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:58.305840  7183 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.305357  7084 catalog_manager.cc:5697] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.307453  7376 ts_tablet_manager.cc:1434] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:12:58.309284  7720 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:58.310587  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:58.311220  7256 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.319375  7183 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:58.320763  7302 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:12:58.322059  7723 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.322461  7256 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:58.322515  7723 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:58.324082  7723 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.344671  7084 catalog_manager.cc:5697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.354605  7720 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.363696  7720 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.365334  7710 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.364193  7720 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.370395  7720 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:58.371477  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:58.372124  7261 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:58.372566  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:58.373139  7183 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 0.
I20260709 13:12:58.373245  7301 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:58.374332  7720 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.374708  7720 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.375020  7720 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.381783  7720 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.383821  7720 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:12:58.386189  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:12:58.387178  7255 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.386485  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:58.389572  7180 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.392891  7684 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.393589  7684 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.395109  7255 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:58.396297  7180 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:12:58.396476  7301 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:58.396649  7684 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:58.397260  7723 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.397452  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:12:58.397780  7723 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:12:58.398371  7261 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:12:58.398801  7723 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:58.401422  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:58.402293  7336 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 1: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:12:58.403939  7150 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:12:58.404678  7684 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.410526  7684 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.413667  7081 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 0 to 1, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.448642  7774 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.462702  7590 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:58.529348  7133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:58.592926  7778 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.606138  7719 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.617959  7333 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.634196  7333 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:58.636758  7768 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.646670  7255 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:58.650444  7801 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:58.749261  7720 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.750068  7723 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.787163  7723 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.808792  7723 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.924242  7720 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.935139  7710 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:59.562830  7133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:59.716064  7777 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.716629  7777 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:59.718758  7777 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:59.719446  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:12:59.719636  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:12:59.720160  7179 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:59.720180  7336 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:12:59.721517  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:59.722136  7719 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:59.722463  7719 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.722800  7719 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.727828  7719 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:59.730369  7719 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:12:59.730486  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:12:59.731201  7179 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.731287  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:12:59.731860  7336 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.735958  7336 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:12:59.736089  7179 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:12:59.737134  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:12:59.737888  7719 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.738413  7719 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:12:59.739212  7719 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:12:59.749822  7085 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 0 to 2, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 2 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.134692  7336 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:00.135969  7719 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.150403  7183 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:00.152736  7719 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.341672  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:00.368865  7851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:00.372347  7850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:00.377593  7853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:00.378935  6030 server_base.cc:1061] running on GCE node
I20260709 13:13:00.381515  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:00.381827  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:00.382054  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783602780382034 us; error 0 us; skew 500 ppm
I20260709 13:13:00.382822  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:00.386466  6030 webserver.cc:533] Webserver started at http://127.5.227.132:37329/ using document root <none> and password file <none>
I20260709 13:13:00.387048  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:00.387233  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:00.387485  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:00.388788  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-3-root/instance:
uuid: "9a54ecc9fb4541df915f9f8c01e19429"
format_stamp: "Formatted at 2026-07-09 13:13:00 on dist-test-slave-tbwl"
I20260709 13:13:00.393705  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:13:00.398070  7858 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:00.399034  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:00.399310  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-3-root
uuid: "9a54ecc9fb4541df915f9f8c01e19429"
format_stamp: "Formatted at 2026-07-09 13:13:00 on dist-test-slave-tbwl"
I20260709 13:13:00.399573  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:00.415661  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:00.417522  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:00.419574  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:00.422272  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:00.422463  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:00.422740  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:00.422905  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:00.488539  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.132:39125
I20260709 13:13:00.488706  7920 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.132:39125 every 8 connection(s)
I20260709 13:13:00.493683  6030 auto_leader_rebalancer-test.cc:384] add a tserver: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:00.510042  7921 heartbeater.cc:344] Connected to a master server at 127.5.227.190:45419
I20260709 13:13:00.510509  7921 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:00.511440  7921 heartbeater.cc:507] Master 127.5.227.190:45419 requested a full tablet report, sending...
I20260709 13:13:00.513674  7084 ts_manager.cc:194] Registered new tserver with Master: 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:00.515394  7084 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60766
I20260709 13:13:00.645679  7336 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:00.654209  7256 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:00.655685  7849 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.657569  7179 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:00.659197  7849 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.669963  7706 raft_consensus.cc:2955] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.672039  7255 raft_consensus.cc:2955] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
W20260709 13:13:00.679256  7299 consensus_peers.cc:597] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5626b16aa2aa438290520c1b9b979802. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.701535  7084 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.713181  7180 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:00.711990  7179 raft_consensus.cc:2955] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.730842  7255 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:00.736816  7683 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.746440  7336 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:00.749500  7801 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.761314  7801 raft_consensus.cc:2955] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.763258  7261 raft_consensus.cc:2955] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
W20260709 13:13:00.768383  7150 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5044ec7fc5dd45979aa778b49eba1ead. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.771070  7336 raft_consensus.cc:2955] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.786218  7085 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.816206  7255 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:00.827378  7180 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:00.829367  7946 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:00.830188  7336 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:00.835300  7932 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:00.845356  7225 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de90ec51ea634c3d8b220c16d71b8cdf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.851580  7946 raft_consensus.cc:2955] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.853717  7180 raft_consensus.cc:2955] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.856038  7336 raft_consensus.cc:2955] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.869648  7081 catalog_manager.cc:5697] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.879455  7336 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:00.893011  7183 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:00.894575  7849 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.895282  7255 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:13:00.896445  7299 consensus_peers.cc:597] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4278a1ff7e0c4ce4a86d4e7b748f9557. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.897171  7849 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.910759  7706 raft_consensus.cc:2955] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.912534  7183 raft_consensus.cc:2955] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.917711  7255 raft_consensus.cc:2955] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:00.936885  7085 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.098855  7953 ts_tablet_manager.cc:933] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:01.101087  7953 tablet_copy_client.cc:323] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
I20260709 13:13:01.115573  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet 5626b16aa2aa438290520c1b9b979802 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
I20260709 13:13:01.116281  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet 5626b16aa2aa438290520c1b9b979802 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-5626b16aa2aa438290520c1b9b979802
I20260709 13:13:01.123381  7346 tablet_copy_source_session.cc:215] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:01.127048  7953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5626b16aa2aa438290520c1b9b979802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:01.144842  7953 tablet_copy_client.cc:806] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:01.145618  7953 tablet_copy_client.cc:670] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:01.152956  7953 tablet_copy_client.cc:538] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:01.162358  7953 tablet_bootstrap.cc:492] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:01.194285  7953 tablet_bootstrap.cc:492] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.195307  7953 tablet_bootstrap.cc:492] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:01.195967  7953 ts_tablet_manager.cc:1403] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.004s
I20260709 13:13:01.198961  7953 raft_consensus.cc:359] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:01.199837  7953 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:01.200479  7953 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:01.203313  7921 heartbeater.cc:499] Master 127.5.227.190:45419 was elected leader, sending a full tablet report...
I20260709 13:13:01.203776  7953 ts_tablet_manager.cc:1434] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:01.208894  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-5626b16aa2aa438290520c1b9b979802 received from {username='slave'} at 127.0.0.1:44980
I20260709 13:13:01.209436  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-5626b16aa2aa438290520c1b9b979802 on tablet 5626b16aa2aa438290520c1b9b979802 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:01.317080  7953 ts_tablet_manager.cc:933] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
I20260709 13:13:01.318782  7953 tablet_copy_client.cc:323] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.129:44171
I20260709 13:13:01.330283  7197 tablet_copy_service.cc:140] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Received BeginTabletCopySession request for tablet 5044ec7fc5dd45979aa778b49eba1ead from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:54396)
I20260709 13:13:01.330947  7197 tablet_copy_service.cc:161] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Beginning new tablet copy session on tablet 5044ec7fc5dd45979aa778b49eba1ead from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:54396: session id = 9a54ecc9fb4541df915f9f8c01e19429-5044ec7fc5dd45979aa778b49eba1ead
I20260709 13:13:01.340804  7197 tablet_copy_source_session.cc:215] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:01.344043  7953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5044ec7fc5dd45979aa778b49eba1ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:01.360395  7953 tablet_copy_client.cc:806] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:01.360994  7953 tablet_copy_client.cc:670] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:01.366261  7953 tablet_copy_client.cc:538] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:01.377182  7953 tablet_bootstrap.cc:492] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:01.393180  7960 ts_tablet_manager.cc:933] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:01.396054  7960 tablet_copy_client.cc:323] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.130:40351
I20260709 13:13:01.407081  7953 tablet_bootstrap.cc:492] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.410884  7953 tablet_bootstrap.cc:492] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:01.411624  7953 ts_tablet_manager.cc:1403] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.000s
I20260709 13:13:01.421231  7953 raft_consensus.cc:359] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:01.422154  7953 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:01.422899  7953 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:01.429224  7953 ts_tablet_manager.cc:1434] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:13:01.431737  7197 tablet_copy_service.cc:342] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-5044ec7fc5dd45979aa778b49eba1ead received from {username='slave'} at 127.0.0.1:54396
I20260709 13:13:01.432217  7197 tablet_copy_service.cc:434] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-5044ec7fc5dd45979aa778b49eba1ead on tablet 5044ec7fc5dd45979aa778b49eba1ead with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:01.435002  7953 ts_tablet_manager.cc:933] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:01.469112  7272 tablet_copy_service.cc:140] P efc9ee9e1d86480790fa83f6ad0c295c: Received BeginTabletCopySession request for tablet de90ec51ea634c3d8b220c16d71b8cdf from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:57560)
I20260709 13:13:01.469758  7272 tablet_copy_service.cc:161] P efc9ee9e1d86480790fa83f6ad0c295c: Beginning new tablet copy session on tablet de90ec51ea634c3d8b220c16d71b8cdf from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:57560: session id = 9a54ecc9fb4541df915f9f8c01e19429-de90ec51ea634c3d8b220c16d71b8cdf
I20260709 13:13:01.475093  7953 tablet_copy_client.cc:323] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
I20260709 13:13:01.478441  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet 4278a1ff7e0c4ce4a86d4e7b748f9557 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
I20260709 13:13:01.479123  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet 4278a1ff7e0c4ce4a86d4e7b748f9557 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-4278a1ff7e0c4ce4a86d4e7b748f9557
I20260709 13:13:01.483783  7272 tablet_copy_source_session.cc:215] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:01.486243  7346 tablet_copy_source_session.cc:215] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:01.487761  7960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de90ec51ea634c3d8b220c16d71b8cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:01.496424  7953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4278a1ff7e0c4ce4a86d4e7b748f9557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:01.508028  7960 tablet_copy_client.cc:806] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:01.508659  7960 tablet_copy_client.cc:670] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:01.512687  7896 raft_consensus.cc:1217] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:01.516604  7953 tablet_copy_client.cc:806] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:01.520551  7953 tablet_copy_client.cc:670] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:01.521940  7960 tablet_copy_client.cc:538] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:01.530603  7953 tablet_copy_client.cc:538] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:01.533912  7960 tablet_bootstrap.cc:492] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:01.539254  7953 tablet_bootstrap.cc:492] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:01.563050  7960 tablet_bootstrap.cc:492] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.563968  7960 tablet_bootstrap.cc:492] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:01.564605  7960 ts_tablet_manager.cc:1403] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.007s
I20260709 13:13:01.568435  7960 raft_consensus.cc:359] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:01.569255  7960 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:01.569906  7960 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:01.577749  7960 ts_tablet_manager.cc:1434] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 13:13:01.582472  7272 tablet_copy_service.cc:342] P efc9ee9e1d86480790fa83f6ad0c295c: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-de90ec51ea634c3d8b220c16d71b8cdf received from {username='slave'} at 127.0.0.1:57560
I20260709 13:13:01.582979  7272 tablet_copy_service.cc:434] P efc9ee9e1d86480790fa83f6ad0c295c: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-de90ec51ea634c3d8b220c16d71b8cdf on tablet de90ec51ea634c3d8b220c16d71b8cdf with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:01.589306  7953 tablet_bootstrap.cc:492] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.590283  7953 tablet_bootstrap.cc:492] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:01.590938  7953 ts_tablet_manager.cc:1403] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.052s	user 0.033s	sys 0.012s
I20260709 13:13:01.593158  7953 raft_consensus.cc:359] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:01.594002  7953 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:01.594552  7953 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:01.596175  7953 ts_tablet_manager.cc:1434] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:01.651492  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-4278a1ff7e0c4ce4a86d4e7b748f9557 received from {username='slave'} at 127.0.0.1:44980
I20260709 13:13:01.652733  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-4278a1ff7e0c4ce4a86d4e7b748f9557 on tablet 4278a1ff7e0c4ce4a86d4e7b748f9557 with peer 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:01.804236  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 94988.3us
I20260709 13:13:01.839490  7896 raft_consensus.cc:1217] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:13:01.992041  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 47049.3us
I20260709 13:13:02.010692  7896 raft_consensus.cc:1217] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:02.049326  7896 raft_consensus.cc:1217] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:02.125671  7971 raft_consensus.cc:1064] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:02.128480  7971 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:02.137046  7896 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.139478  7180 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.139206  7978 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:02.140571  7255 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.141974  7978 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:02.144682  7971 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:02.152910  7849 raft_consensus.cc:2955] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.156141  7257 raft_consensus.cc:2955] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.167716  7896 raft_consensus.cc:2955] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.167937  7180 raft_consensus.cc:2955] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.180347  7081 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:02.220912  7333 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:02.229138  7896 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:02.230326  7257 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:02.231841  7849 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:02.233093  7978 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:02.239740  7978 raft_consensus.cc:2955] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.241627  7896 raft_consensus.cc:2955] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.243328  7257 raft_consensus.cc:2955] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.250471  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5626b16aa2aa438290520c1b9b979802 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:02.258730  7085 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:02.283659  7172 tablet_service.cc:1558] Processing DeleteTablet for tablet 5626b16aa2aa438290520c1b9b979802 with delete_type TABLET_DATA_TOMBSTONED (TS 2ecdd7dc4a144f5aa0f2f91c7b94434d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50448
I20260709 13:13:02.334189  7943 raft_consensus.cc:1064] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:02.336896  7943 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:02.346359  7989 tablet_replica.cc:333] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:13:02.351610  7335 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.353219  7896 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.355670  7972 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:02.356990  7980 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:02.364202  7257 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.381840  7970 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:13:02.401407  7990 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:02.406188  7972 raft_consensus.cc:2955] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.407619  7989 raft_consensus.cc:2243] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.409003  7989 raft_consensus.cc:2272] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.412957  7989 ts_tablet_manager.cc:1916] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:02.412133  7333 raft_consensus.cc:2955] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.412164  7896 raft_consensus.cc:2955] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.423183  7255 raft_consensus.cc:2955] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.440165  7085 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:02.464442  7178 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:02.476094  7335 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:02.479707  7895 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:02.479288  7980 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:13:02.483553  7972 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:02.488503  7989 ts_tablet_manager.cc:1929] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:02.489157  7989 log.cc:1199] T 5626b16aa2aa438290520c1b9b979802 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/wals/5626b16aa2aa438290520c1b9b979802
I20260709 13:13:02.494145  7072 catalog_manager.cc:5028] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): tablet 5626b16aa2aa438290520c1b9b979802 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:02.498245  7972 raft_consensus.cc:2955] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.500689  7896 raft_consensus.cc:2955] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.501382  7335 raft_consensus.cc:2955] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.510250  7072 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5044ec7fc5dd45979aa778b49eba1ead with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:02.519068  7084 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.529805  7245 tablet_service.cc:1558] Processing DeleteTablet for tablet 5044ec7fc5dd45979aa778b49eba1ead with delete_type TABLET_DATA_TOMBSTONED (TS efc9ee9e1d86480790fa83f6ad0c295c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55484
I20260709 13:13:02.533470  7994 tablet_replica.cc:333] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:13:02.534373  7994 raft_consensus.cc:2243] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.535108  7994 raft_consensus.cc:2272] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.538715  7994 ts_tablet_manager.cc:1916] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:02.552073  7994 ts_tablet_manager.cc:1929] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:02.552595  7994 log.cc:1199] T 5044ec7fc5dd45979aa778b49eba1ead P efc9ee9e1d86480790fa83f6ad0c295c: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/wals/5044ec7fc5dd45979aa778b49eba1ead
I20260709 13:13:02.554791  7071 catalog_manager.cc:5028] TS efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): tablet 5044ec7fc5dd45979aa778b49eba1ead (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:02.584657  7946 raft_consensus.cc:1064] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:02.586980  7946 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:02.594466  7178 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.594595  7896 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.595062  7335 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.596464  7932 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:02.597506  7973 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:02.598546  7846 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:02.612591  7846 raft_consensus.cc:2955] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.615422  7178 raft_consensus.cc:2955] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.632624  7335 raft_consensus.cc:2955] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.636118  7896 raft_consensus.cc:2955] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.639696  7082 catalog_manager.cc:5697] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.681067  7978 raft_consensus.cc:1064] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:02.683827  7978 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:02.709694  7262 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:02.715507  7896 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:02.715505  7178 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:02.718429  7946 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:02.719619  7932 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:02.728663  7896 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.730298  7180 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.730218  7978 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:02.732903  7255 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:02.732582  7932 raft_consensus.cc:2955] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.735942  7849 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:02.739732  7976 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:02.761641  7180 raft_consensus.cc:2955] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.776551  7896 raft_consensus.cc:2955] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.782007  7978 raft_consensus.cc:2955] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.792412  7262 raft_consensus.cc:2955] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.797602  7084 catalog_manager.cc:5697] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:02.875478  7324 tablet_service.cc:1558] Processing DeleteTablet for tablet de90ec51ea634c3d8b220c16d71b8cdf with delete_type TABLET_DATA_TOMBSTONED (TS c85cf49c63cc4e66b4747d8c4fa14022 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33680
W20260709 13:13:02.931897  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 108042us
I20260709 13:13:02.936620  8010 tablet_replica.cc:333] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:13:02.937839  8010 raft_consensus.cc:2243] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.943835  7084 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:13:02.952225  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 103139us
I20260709 13:13:02.960460  8010 raft_consensus.cc:2272] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.049204  8010 ts_tablet_manager.cc:1916] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:03.060437  7071 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet de90ec51ea634c3d8b220c16d71b8cdf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:13:03.084621  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 70470.4us
I20260709 13:13:03.099354  7895 raft_consensus.cc:2955] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:13:03.102408  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63418.1us
I20260709 13:13:03.117857  7180 raft_consensus.cc:2955] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:13:03.124761  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 215978us
I20260709 13:13:03.162119  8010 ts_tablet_manager.cc:1929] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:03.162599  8010 log.cc:1199] T de90ec51ea634c3d8b220c16d71b8cdf P c85cf49c63cc4e66b4747d8c4fa14022: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/wals/de90ec51ea634c3d8b220c16d71b8cdf
I20260709 13:13:03.171165  7069 catalog_manager.cc:5028] TS c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): tablet de90ec51ea634c3d8b220c16d71b8cdf (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:03.182338  7333 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:03.188895  7895 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:03.190685  7971 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:03.199786  7706 raft_consensus.cc:2955] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:03.211138  7895 raft_consensus.cc:2955] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:03.217684  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4278a1ff7e0c4ce4a86d4e7b748f9557 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:03.219688  7255 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:03.221812  7976 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:03.226307  7255 raft_consensus.cc:2955] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:03.227315  7082 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.289108  7172 tablet_service.cc:1558] Processing DeleteTablet for tablet 4278a1ff7e0c4ce4a86d4e7b748f9557 with delete_type TABLET_DATA_TOMBSTONED (TS 2ecdd7dc4a144f5aa0f2f91c7b94434d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50448
I20260709 13:13:03.293488  8017 tablet_replica.cc:333] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:13:03.294713  8017 raft_consensus.cc:2243] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:03.296465  8017 raft_consensus.cc:2272] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:03.302340  8017 ts_tablet_manager.cc:1916] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:03.322441  8017 ts_tablet_manager.cc:1929] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:03.322924  8017 log.cc:1199] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/wals/4278a1ff7e0c4ce4a86d4e7b748f9557
I20260709 13:13:03.324575  7072 catalog_manager.cc:5028] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): tablet 4278a1ff7e0c4ce4a86d4e7b748f9557 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:04.359287  7335 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:04.365739  7257 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:13:04.365777  7299 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50bbf75da7f04c6cb95c0f589775820b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:04.366238  7178 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:04.367240  7971 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.370981  7971 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:04.376892  8015 raft_consensus.cc:2955] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.378584  7255 raft_consensus.cc:2955] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.385695  7178 raft_consensus.cc:2955] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.392391  7180 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:04.397866  7081 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.404084  7333 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:13:04.406996  7150 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd122c1cdfa84f8ea52721a14c58c4e2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:04.409240  8016 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:04.409741  7257 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:04.414077  8016 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.423758  7943 raft_consensus.cc:2955] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.438426  7255 raft_consensus.cc:2955] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.439575  7333 raft_consensus.cc:2955] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.460429  7082 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.460695  7257 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:13:04.473237  7225 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db390910c47342dc848e258ef7dac1bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:04.478986  7178 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:04.479435  7333 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:04.480958  8008 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.481863  8004 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:04.511349  8034 raft_consensus.cc:2955] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.513688  7180 raft_consensus.cc:2955] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.515785  7333 raft_consensus.cc:2955] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.534629  7082 catalog_manager.cc:5697] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.535181  7333 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:04.544046  7178 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:04.544201  7255 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:04.545634  8036 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.546461  7971 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:04.547454  7299 consensus_peers.cc:597] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79fac6ca4a1b42d1b629b7a5b1e5e6ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:04.557401  8036 raft_consensus.cc:2955] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.560241  7178 raft_consensus.cc:2955] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.565536  7255 raft_consensus.cc:2955] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.581884  7084 catalog_manager.cc:5697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:04.873181  8041 ts_tablet_manager.cc:933] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
I20260709 13:13:04.876963  8041 tablet_copy_client.cc:323] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.129:44171
I20260709 13:13:04.877025  8043 ts_tablet_manager.cc:933] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:04.879405  7197 tablet_copy_service.cc:140] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Received BeginTabletCopySession request for tablet dd122c1cdfa84f8ea52721a14c58c4e2 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:54396)
I20260709 13:13:04.879983  7197 tablet_copy_service.cc:161] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Beginning new tablet copy session on tablet dd122c1cdfa84f8ea52721a14c58c4e2 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:54396: session id = 9a54ecc9fb4541df915f9f8c01e19429-dd122c1cdfa84f8ea52721a14c58c4e2
I20260709 13:13:04.883092  8043 tablet_copy_client.cc:323] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
I20260709 13:13:04.884812  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet 50bbf75da7f04c6cb95c0f589775820b from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
I20260709 13:13:04.885298  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet 50bbf75da7f04c6cb95c0f589775820b from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-50bbf75da7f04c6cb95c0f589775820b
I20260709 13:13:04.893538  7197 tablet_copy_source_session.cc:215] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:04.897398  8041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd122c1cdfa84f8ea52721a14c58c4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.899333  7346 tablet_copy_source_session.cc:215] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:04.902415  8043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bbf75da7f04c6cb95c0f589775820b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:04.914345  8041 tablet_copy_client.cc:806] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:04.915016  8041 tablet_copy_client.cc:670] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:04.919117  8041 tablet_copy_client.cc:538] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:04.928133  8043 tablet_copy_client.cc:806] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:04.929108  8043 tablet_copy_client.cc:670] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:04.930032  8041 tablet_bootstrap.cc:492] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:04.933159  8043 tablet_copy_client.cc:538] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:04.942343  8043 tablet_bootstrap.cc:492] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:04.953375  8041 tablet_bootstrap.cc:492] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.954515  8041 tablet_bootstrap.cc:492] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:04.955305  8041 ts_tablet_manager.cc:1403] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 13:13:04.959044  8041 raft_consensus.cc:359] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:04.959969  8041 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:04.960714  8041 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:04.975517  8043 tablet_bootstrap.cc:492] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.976734  8043 tablet_bootstrap.cc:492] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:04.977490  8043 ts_tablet_manager.cc:1403] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.035s	user 0.026s	sys 0.010s
I20260709 13:13:04.977857  8041 ts_tablet_manager.cc:1434] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.013s
I20260709 13:13:04.979720  7197 tablet_copy_service.cc:342] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-dd122c1cdfa84f8ea52721a14c58c4e2 received from {username='slave'} at 127.0.0.1:54396
I20260709 13:13:04.980168  7197 tablet_copy_service.cc:434] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-dd122c1cdfa84f8ea52721a14c58c4e2 on tablet dd122c1cdfa84f8ea52721a14c58c4e2 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:04.981649  8043 raft_consensus.cc:359] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:04.982694  8043 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:04.983415  8043 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:04.985839  8043 ts_tablet_manager.cc:1434] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:04.988577  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-50bbf75da7f04c6cb95c0f589775820b received from {username='slave'} at 127.0.0.1:44980
I20260709 13:13:04.989014  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-50bbf75da7f04c6cb95c0f589775820b on tablet 50bbf75da7f04c6cb95c0f589775820b with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:05.055346  8043 ts_tablet_manager.cc:933] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:05.056965  8043 tablet_copy_client.cc:323] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
I20260709 13:13:05.058514  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
I20260709 13:13:05.059031  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-79fac6ca4a1b42d1b629b7a5b1e5e6ee
I20260709 13:13:05.064446  8041 ts_tablet_manager.cc:933] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:05.064836  7346 tablet_copy_source_session.cc:215] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:05.067828  8041 tablet_copy_client.cc:323] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.130:40351
I20260709 13:13:05.068161  8043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:05.069898  7272 tablet_copy_service.cc:140] P efc9ee9e1d86480790fa83f6ad0c295c: Received BeginTabletCopySession request for tablet db390910c47342dc848e258ef7dac1bd from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:57560)
I20260709 13:13:05.070454  7272 tablet_copy_service.cc:161] P efc9ee9e1d86480790fa83f6ad0c295c: Beginning new tablet copy session on tablet db390910c47342dc848e258ef7dac1bd from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:57560: session id = 9a54ecc9fb4541df915f9f8c01e19429-db390910c47342dc848e258ef7dac1bd
I20260709 13:13:05.082894  7272 tablet_copy_source_session.cc:215] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:05.084123  8043 tablet_copy_client.cc:806] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:05.084738  8043 tablet_copy_client.cc:670] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:05.086694  8041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db390910c47342dc848e258ef7dac1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:05.090332  8043 tablet_copy_client.cc:538] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:05.099825  8043 tablet_bootstrap.cc:492] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:05.107839  8041 tablet_copy_client.cc:806] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:05.108443  8041 tablet_copy_client.cc:670] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:05.112423  8041 tablet_copy_client.cc:538] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:05.119941  8043 tablet_bootstrap.cc:492] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:05.120939  8043 tablet_bootstrap.cc:492] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:05.121598  8043 ts_tablet_manager.cc:1403] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:13:05.122978  8041 tablet_bootstrap.cc:492] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:05.124681  8043 raft_consensus.cc:359] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:05.125545  8043 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:05.126782  8043 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:05.145983  8043 ts_tablet_manager.cc:1434] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:13:05.154146  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-79fac6ca4a1b42d1b629b7a5b1e5e6ee received from {username='slave'} at 127.0.0.1:44980
I20260709 13:13:05.154592  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-79fac6ca4a1b42d1b629b7a5b1e5e6ee on tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:05.162801  8041 tablet_bootstrap.cc:492] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:05.163615  8041 tablet_bootstrap.cc:492] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:05.164187  8041 ts_tablet_manager.cc:1403] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.007s
I20260709 13:13:05.166333  8041 raft_consensus.cc:359] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:05.167018  8041 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:05.167527  8041 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:05.169445  8041 ts_tablet_manager.cc:1434] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:05.171149  7272 tablet_copy_service.cc:342] P efc9ee9e1d86480790fa83f6ad0c295c: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-db390910c47342dc848e258ef7dac1bd received from {username='slave'} at 127.0.0.1:57560
I20260709 13:13:05.171592  7272 tablet_copy_service.cc:434] P efc9ee9e1d86480790fa83f6ad0c295c: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-db390910c47342dc848e258ef7dac1bd on tablet db390910c47342dc848e258ef7dac1bd with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:05.252699  7895 raft_consensus.cc:1217] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:05.374213  7895 raft_consensus.cc:1217] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:05.480263  7895 raft_consensus.cc:1217] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:05.539582  7895 raft_consensus.cc:1217] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:05.634325  8018 raft_consensus.cc:1064] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:05.636807  8018 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:05.643262  7895 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:05.644797  7971 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:05.645510  7178 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:05.647210  7971 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:05.647974  7255 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:05.649412  7971 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:05.675571  8015 raft_consensus.cc:2955] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.677238  7178 raft_consensus.cc:2955] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.689839  7255 raft_consensus.cc:2955] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.696254  7895 raft_consensus.cc:2955] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.700022  7081 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.742990  7333 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:05.749006  7895 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:05.751441  7178 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:05.751367  7971 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:05.753876  8053 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:05.760703  8053 raft_consensus.cc:2955] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.764104  7895 raft_consensus.cc:2955] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.771662  7178 raft_consensus.cc:2955] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.786252  7084 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.791894  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 50bbf75da7f04c6cb95c0f589775820b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:05.801381  7245 tablet_service.cc:1558] Processing DeleteTablet for tablet 50bbf75da7f04c6cb95c0f589775820b with delete_type TABLET_DATA_TOMBSTONED (TS efc9ee9e1d86480790fa83f6ad0c295c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55484
I20260709 13:13:05.803351  8061 tablet_replica.cc:333] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:13:05.804697  8061 raft_consensus.cc:2243] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.805786  8061 raft_consensus.cc:2272] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.813737  8061 ts_tablet_manager.cc:1916] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:05.829723  8061 ts_tablet_manager.cc:1929] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:05.830183  8061 log.cc:1199] T 50bbf75da7f04c6cb95c0f589775820b P efc9ee9e1d86480790fa83f6ad0c295c: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/wals/50bbf75da7f04c6cb95c0f589775820b
I20260709 13:13:05.832067  7071 catalog_manager.cc:5028] TS efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): tablet 50bbf75da7f04c6cb95c0f589775820b (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:05.858095  7943 raft_consensus.cc:1064] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:05.860512  7943 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:05.867880  7333 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:05.869277  7895 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:05.869760  8028 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:05.870697  7255 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:05.871206  7943 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:05.872217  8029 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:05.897135  8028 raft_consensus.cc:2955] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.900072  7255 raft_consensus.cc:2955] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.904785  7895 raft_consensus.cc:2955] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.914366  7333 raft_consensus.cc:2955] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.920563  7084 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:05.937803  7178 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:05.945287  7895 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:05.946817  7255 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:05.947216  8029 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:05.949896  8029 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:05.957468  8028 raft_consensus.cc:2955] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.958513  7257 raft_consensus.cc:2955] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.965343  7072 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd122c1cdfa84f8ea52721a14c58c4e2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:05.964360  7896 raft_consensus.cc:2955] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.968972  8018 raft_consensus.cc:1064] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:05.971897  8018 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:05.988045  7085 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:05.993556  8004 raft_consensus.cc:1064] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:05.996978  8004 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:06.010841  7896 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:06.012290  7333 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:06.014297  7178 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:06.015736  8008 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:06.017150  8033 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:06.019080  8033 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:06.029649  7324 tablet_service.cc:1558] Processing DeleteTablet for tablet dd122c1cdfa84f8ea52721a14c58c4e2 with delete_type TABLET_DATA_TOMBSTONED (TS c85cf49c63cc4e66b4747d8c4fa14022 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33680
I20260709 13:13:06.035516  8070 tablet_replica.cc:333] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:13:06.036588  8070 raft_consensus.cc:2243] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.038422  8070 raft_consensus.cc:2272] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.044045  8070 ts_tablet_manager.cc:1916] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:06.093403  7896 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:06.095096  8015 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:06.095757  8033 raft_consensus.cc:2955] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.098309  7336 raft_consensus.cc:2955] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.102670  7178 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:06.105362  8018 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:06.108670  7178 raft_consensus.cc:2955] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.111356  7255 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:06.114471  7081 catalog_manager.cc:5697] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:06.129132  7971 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:06.159852  8018 raft_consensus.cc:2955] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.161665  7895 raft_consensus.cc:2955] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.164028  7894 raft_consensus.cc:2955] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.175077  7179 raft_consensus.cc:2955] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.192034  7257 raft_consensus.cc:2955] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.194970  7085 catalog_manager.cc:5697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.190868  7255 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:06.207934  7179 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:06.209372  8008 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:06.210448  8070 ts_tablet_manager.cc:1929] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:06.211102  8070 log.cc:1199] T dd122c1cdfa84f8ea52721a14c58c4e2 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/wals/dd122c1cdfa84f8ea52721a14c58c4e2
I20260709 13:13:06.215283  7069 catalog_manager.cc:5028] TS c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): tablet dd122c1cdfa84f8ea52721a14c58c4e2 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:06.215950  8004 raft_consensus.cc:2955] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.217444  7179 raft_consensus.cc:2955] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.212918  7894 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:06.220464  8033 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:06.227305  7071 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet db390910c47342dc848e258ef7dac1bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:06.236953  7894 raft_consensus.cc:2955] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.253575  7333 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:06.256409  7084 catalog_manager.cc:5697] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:06.265506  7895 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:06.267823  8053 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:06.273087  7257 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:06.277747  7971 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:06.277251  8053 raft_consensus.cc:2955] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.281880  7257 raft_consensus.cc:2955] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.288002  7324 tablet_service.cc:1558] Processing DeleteTablet for tablet db390910c47342dc848e258ef7dac1bd with delete_type TABLET_DATA_TOMBSTONED (TS c85cf49c63cc4e66b4747d8c4fa14022 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33680
I20260709 13:13:06.288998  8070 tablet_replica.cc:333] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:13:06.290118  8070 raft_consensus.cc:2243] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.290902  8070 raft_consensus.cc:2272] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.293826  7895 raft_consensus.cc:2955] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.295964  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:06.299664  8070 ts_tablet_manager.cc:1916] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:06.319742  8070 ts_tablet_manager.cc:1929] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:06.320299  8070 log.cc:1199] T db390910c47342dc848e258ef7dac1bd P c85cf49c63cc4e66b4747d8c4fa14022: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/wals/db390910c47342dc848e258ef7dac1bd
I20260709 13:13:06.318982  7082 catalog_manager.cc:5697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:06.322010  7069 catalog_manager.cc:5028] TS c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): tablet db390910c47342dc848e258ef7dac1bd (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:06.334385  7172 tablet_service.cc:1558] Processing DeleteTablet for tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee with delete_type TABLET_DATA_TOMBSTONED (TS 2ecdd7dc4a144f5aa0f2f91c7b94434d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50448
I20260709 13:13:06.337661  8076 tablet_replica.cc:333] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:13:06.338888  8076 raft_consensus.cc:2243] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.339637  8076 raft_consensus.cc:2272] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.343284  8076 ts_tablet_manager.cc:1916] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:06.355947  8076 ts_tablet_manager.cc:1929] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:06.356387  8076 log.cc:1199] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/wals/79fac6ca4a1b42d1b629b7a5b1e5e6ee
I20260709 13:13:06.357928  7072 catalog_manager.cc:5028] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): tablet 79fac6ca4a1b42d1b629b7a5b1e5e6ee (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:07.399610  7179 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:07.407219  7262 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:07.407219  7333 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:13:07.408211  7150 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88b1df9cb24b4dc88a4735a646ad8575. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:07.411180  8079 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.413919  7943 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.420607  8029 raft_consensus.cc:2955] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.422287  7333 raft_consensus.cc:2955] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.425153  7257 raft_consensus.cc:2955] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.448768  7336 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:07.449172  7081 catalog_manager.cc:5697] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.457669  7257 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:07.459591  8015 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:07.461891  7299 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a4a2f06cbc44402ae7754d23798eaff. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:07.463611  7179 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:07.465595  8053 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:07.478047  8053 raft_consensus.cc:2955] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.481984  7262 raft_consensus.cc:2955] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.489140  7179 raft_consensus.cc:2955] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.495620  7178 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:07.517457  7262 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:07.517680  7336 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:13:07.518692  7150 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7dc72492fc64c638202c7715a2a72ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:07.519495  8029 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.523649  8079 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.529372  8079 raft_consensus.cc:2955] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.536015  7336 raft_consensus.cc:2955] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.539670  7082 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.547014  7333 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:07.555924  7257 raft_consensus.cc:2955] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.577491  7262 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:07.579322  8015 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:07.582528  7299 consensus_peers.cc:597] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad4f3c0328924ddaba5d93fe80e78a64. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:07.582880  7178 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:07.583794  7082 catalog_manager.cc:5697] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.584980  8053 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.594282  8088 raft_consensus.cc:2955] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.605350  7257 raft_consensus.cc:2955] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.616779  7178 raft_consensus.cc:2955] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:07.618602  7081 catalog_manager.cc:5697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.874576  8097 ts_tablet_manager.cc:933] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:07.876940  8097 tablet_copy_client.cc:323] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
I20260709 13:13:07.878557  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet 3a4a2f06cbc44402ae7754d23798eaff from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
I20260709 13:13:07.879215  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet 3a4a2f06cbc44402ae7754d23798eaff from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-3a4a2f06cbc44402ae7754d23798eaff
I20260709 13:13:07.884819  7346 tablet_copy_source_session.cc:215] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:07.888904  8097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4a2f06cbc44402ae7754d23798eaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.907228  8097 tablet_copy_client.cc:806] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:07.907843  8097 tablet_copy_client.cc:670] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:07.911947  8097 tablet_copy_client.cc:538] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:07.919809  8097 tablet_bootstrap.cc:492] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:07.944669  8100 ts_tablet_manager.cc:933] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
I20260709 13:13:07.945598  8097 tablet_bootstrap.cc:492] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.946666  8097 tablet_bootstrap.cc:492] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:07.947023  8100 tablet_copy_client.cc:323] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.129:44171
I20260709 13:13:07.947408  8097 ts_tablet_manager.cc:1403] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.003s
I20260709 13:13:07.948588  7197 tablet_copy_service.cc:140] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Received BeginTabletCopySession request for tablet 88b1df9cb24b4dc88a4735a646ad8575 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:54396)
I20260709 13:13:07.949064  7197 tablet_copy_service.cc:161] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Beginning new tablet copy session on tablet 88b1df9cb24b4dc88a4735a646ad8575 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:54396: session id = 9a54ecc9fb4541df915f9f8c01e19429-88b1df9cb24b4dc88a4735a646ad8575
I20260709 13:13:07.950912  8097 raft_consensus.cc:359] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:07.951817  8097 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:07.952502  8097 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:07.956831  7197 tablet_copy_source_session.cc:215] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:07.960165  8097 ts_tablet_manager.cc:1434] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 13:13:07.960424  8100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b1df9cb24b4dc88a4735a646ad8575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.963948  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-3a4a2f06cbc44402ae7754d23798eaff received from {username='slave'} at 127.0.0.1:44980
I20260709 13:13:07.964425  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-3a4a2f06cbc44402ae7754d23798eaff on tablet 3a4a2f06cbc44402ae7754d23798eaff with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:07.981405  8100 tablet_copy_client.cc:806] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:07.982050  8100 tablet_copy_client.cc:670] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:07.990350  8100 tablet_copy_client.cc:538] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:07.998154  8100 tablet_bootstrap.cc:492] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:08.004906  8097 ts_tablet_manager.cc:933] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
I20260709 13:13:08.025627  8097 tablet_copy_client.cc:323] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.129:44171
I20260709 13:13:08.027520  7197 tablet_copy_service.cc:140] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Received BeginTabletCopySession request for tablet f7dc72492fc64c638202c7715a2a72ac from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:54396)
I20260709 13:13:08.028065  7197 tablet_copy_service.cc:161] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Beginning new tablet copy session on tablet f7dc72492fc64c638202c7715a2a72ac from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:54396: session id = 9a54ecc9fb4541df915f9f8c01e19429-f7dc72492fc64c638202c7715a2a72ac
I20260709 13:13:08.029021  8104 ts_tablet_manager.cc:933] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:08.044473  7197 tablet_copy_source_session.cc:215] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:08.056610  8097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7dc72492fc64c638202c7715a2a72ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.080780  8100 tablet_bootstrap.cc:492] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.082592  8100 tablet_bootstrap.cc:492] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:08.083801  8100 ts_tablet_manager.cc:1403] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.085s	user 0.039s	sys 0.031s
I20260709 13:13:08.085245  8104 tablet_copy_client.cc:323] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
I20260709 13:13:08.087381  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet ad4f3c0328924ddaba5d93fe80e78a64 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
I20260709 13:13:08.087914  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet ad4f3c0328924ddaba5d93fe80e78a64 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-ad4f3c0328924ddaba5d93fe80e78a64
I20260709 13:13:08.091154  8097 tablet_copy_client.cc:806] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:08.092067  8097 tablet_copy_client.cc:670] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:08.100992  8097 tablet_copy_client.cc:538] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:08.101814  7346 tablet_copy_source_session.cc:215] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:08.105599  8100 raft_consensus.cc:359] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:08.106583  8100 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:08.107304  8100 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:08.110111  8100 ts_tablet_manager.cc:1434] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:13:08.111822  7197 tablet_copy_service.cc:342] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-88b1df9cb24b4dc88a4735a646ad8575 received from {username='slave'} at 127.0.0.1:54396
I20260709 13:13:08.112301  7197 tablet_copy_service.cc:434] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-88b1df9cb24b4dc88a4735a646ad8575 on tablet 88b1df9cb24b4dc88a4735a646ad8575 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:08.110562  8104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4f3c0328924ddaba5d93fe80e78a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.128760  8097 tablet_bootstrap.cc:492] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:08.147578  8104 tablet_copy_client.cc:806] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:08.148219  8104 tablet_copy_client.cc:670] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:08.152192  8104 tablet_copy_client.cc:538] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:08.159911  8104 tablet_bootstrap.cc:492] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:08.161981  8097 tablet_bootstrap.cc:492] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.163024  8097 tablet_bootstrap.cc:492] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:08.163756  8097 ts_tablet_manager.cc:1403] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.012s
I20260709 13:13:08.167285  8097 raft_consensus.cc:359] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:08.168157  8097 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:08.168812  8097 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:08.173678  8097 ts_tablet_manager.cc:1434] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:08.176746  7197 tablet_copy_service.cc:342] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-f7dc72492fc64c638202c7715a2a72ac received from {username='slave'} at 127.0.0.1:54396
I20260709 13:13:08.177165  7197 tablet_copy_service.cc:434] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-f7dc72492fc64c638202c7715a2a72ac on tablet f7dc72492fc64c638202c7715a2a72ac with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:08.200068  8104 tablet_bootstrap.cc:492] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.201197  8104 tablet_bootstrap.cc:492] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:08.201964  8104 ts_tablet_manager.cc:1403] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.003s
I20260709 13:13:08.205091  8104 raft_consensus.cc:359] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:08.205996  8104 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:08.206696  8104 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:08.209198  8104 ts_tablet_manager.cc:1434] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:13:08.210989  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-ad4f3c0328924ddaba5d93fe80e78a64 received from {username='slave'} at 127.0.0.1:44980
I20260709 13:13:08.211416  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-ad4f3c0328924ddaba5d93fe80e78a64 on tablet ad4f3c0328924ddaba5d93fe80e78a64 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:08.322795  7894 raft_consensus.cc:1217] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:08.332621  7894 raft_consensus.cc:1217] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:08.586509  7894 raft_consensus.cc:1217] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:08.595942  7894 raft_consensus.cc:1217] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:08.802892  8077 raft_consensus.cc:1064] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:08.805401  8077 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:08.811734  7894 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:08.811704  7257 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:08.813524  8015 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:08.815369  7179 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:08.816262  8077 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:08.833544  8110 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:08.850239  8053 raft_consensus.cc:2955] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:08.852152  7257 raft_consensus.cc:2955] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:08.860782  7894 raft_consensus.cc:2955] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:08.875545  7081 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:08.882879  7179 raft_consensus.cc:2955] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:08.889272  8029 raft_consensus.cc:1064] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:08.892063  8029 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:08.913296  7333 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:08.914685  7262 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:08.916383  7894 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:08.917312  8079 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:08.919325  8079 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:08.924784  8082 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:08.956804  8029 raft_consensus.cc:2955] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:08.967360  7255 raft_consensus.cc:2955] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:08.969724  7894 raft_consensus.cc:2955] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:08.968468  7333 raft_consensus.cc:2955] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:08.991303  7333 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:08.993369  7081 catalog_manager.cc:5697] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.002859  7894 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:09.005374  8053 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:09.009068  7179 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:09.010974  8110 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:09.017285  8077 raft_consensus.cc:2955] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.023900  7894 raft_consensus.cc:2955] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.042135  7179 raft_consensus.cc:2955] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.045233  7178 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:09.055809  7333 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:09.056810  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3a4a2f06cbc44402ae7754d23798eaff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:09.057804  8079 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:09.056017  7895 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:09.060974  8029 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:09.066521  7085 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:09.074687  8029 raft_consensus.cc:2955] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.085274  7245 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a4a2f06cbc44402ae7754d23798eaff with delete_type TABLET_DATA_TOMBSTONED (TS efc9ee9e1d86480790fa83f6ad0c295c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55484
I20260709 13:13:09.089247  7333 raft_consensus.cc:2955] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.092229  8124 tablet_replica.cc:333] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:13:09.093360  8124 raft_consensus.cc:2243] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.094240  8124 raft_consensus.cc:2272] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.098948  8124 ts_tablet_manager.cc:1916] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:09.103778  7072 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88b1df9cb24b4dc88a4735a646ad8575 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:09.110543  7894 raft_consensus.cc:2955] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.123347  7083 catalog_manager.cc:5697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:09.125082  8029 raft_consensus.cc:1064] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:09.130486  8124 ts_tablet_manager.cc:1929] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:09.130960  8029 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:09.131000  8124 log.cc:1199] T 3a4a2f06cbc44402ae7754d23798eaff P efc9ee9e1d86480790fa83f6ad0c295c: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/wals/3a4a2f06cbc44402ae7754d23798eaff
I20260709 13:13:09.137377  7071 catalog_manager.cc:5028] TS efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): tablet 3a4a2f06cbc44402ae7754d23798eaff (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:09.140993  7245 tablet_service.cc:1558] Processing DeleteTablet for tablet 88b1df9cb24b4dc88a4735a646ad8575 with delete_type TABLET_DATA_TOMBSTONED (TS efc9ee9e1d86480790fa83f6ad0c295c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55484
I20260709 13:13:09.143592  7894 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:09.144244  7255 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:09.141880  7333 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:09.147873  8124 tablet_replica.cc:333] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:13:09.148913  8124 raft_consensus.cc:2243] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.149658  8124 raft_consensus.cc:2272] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.152292  8079 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:09.154112  8079 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:09.156126  8082 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:09.174392  8124 ts_tablet_manager.cc:1916] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:09.185376  8077 raft_consensus.cc:1064] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:09.188366  8077 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:09.230767  8082 raft_consensus.cc:2955] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.242686  7894 raft_consensus.cc:2955] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.248291  8124 ts_tablet_manager.cc:1929] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:09.252269  8124 log.cc:1199] T 88b1df9cb24b4dc88a4735a646ad8575 P efc9ee9e1d86480790fa83f6ad0c295c: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/wals/88b1df9cb24b4dc88a4735a646ad8575
I20260709 13:13:09.253327  7896 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:09.254733  7071 catalog_manager.cc:5028] TS efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): tablet 88b1df9cb24b4dc88a4735a646ad8575 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:09.254959  8077 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:09.254055  7333 raft_consensus.cc:2955] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.256978  7257 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:09.259939  7179 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:09.262661  8053 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:09.268229  7262 raft_consensus.cc:2955] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.270689  8110 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:09.294667  7085 catalog_manager.cc:5697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:09.326556  7180 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:09.351478  7894 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:09.353724  8029 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:13:09.384743  8125 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.054s	user 0.005s	sys 0.004s
W20260709 13:13:09.387334  8117 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:13:09.390748  8082 raft_consensus.cc:2955] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.400018  7255 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:09.408773  8111 raft_consensus.cc:2955] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.410320  7072 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7dc72492fc64c638202c7715a2a72ac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:09.413491  7894 raft_consensus.cc:2955] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.419929  7896 raft_consensus.cc:2955] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.423097  7262 raft_consensus.cc:2955] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.427824  8029 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:09.433038  7255 raft_consensus.cc:2955] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.435806  7085 catalog_manager.cc:5697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:09.438705  7180 raft_consensus.cc:2955] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.441481  7082 catalog_manager.cc:5697] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.466604  7324 tablet_service.cc:1558] Processing DeleteTablet for tablet f7dc72492fc64c638202c7715a2a72ac with delete_type TABLET_DATA_TOMBSTONED (TS c85cf49c63cc4e66b4747d8c4fa14022 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33680
I20260709 13:13:09.495199  7333 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:09.503609  7894 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:09.504355  7262 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:09.505093  8137 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:09.506592  8053 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:09.512275  8138 raft_consensus.cc:2955] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.482542  8140 tablet_replica.cc:333] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:13:09.521381  7261 raft_consensus.cc:2955] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.522449  7894 raft_consensus.cc:2955] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.533751  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ad4f3c0328924ddaba5d93fe80e78a64 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:09.536489  8140 raft_consensus.cc:2243] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.537343  8140 raft_consensus.cc:2272] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.536998  7082 catalog_manager.cc:5697] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:09.541759  8140 ts_tablet_manager.cc:1916] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:09.551390  7172 tablet_service.cc:1558] Processing DeleteTablet for tablet ad4f3c0328924ddaba5d93fe80e78a64 with delete_type TABLET_DATA_TOMBSTONED (TS 2ecdd7dc4a144f5aa0f2f91c7b94434d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50448
I20260709 13:13:09.563423  8141 tablet_replica.cc:333] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:13:09.564314  8141 raft_consensus.cc:2243] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.565104  8141 raft_consensus.cc:2272] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.568603  8141 ts_tablet_manager.cc:1916] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:09.570477  8140 ts_tablet_manager.cc:1929] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:09.570964  8140 log.cc:1199] T f7dc72492fc64c638202c7715a2a72ac P c85cf49c63cc4e66b4747d8c4fa14022: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/wals/f7dc72492fc64c638202c7715a2a72ac
I20260709 13:13:09.572459  7069 catalog_manager.cc:5028] TS c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): tablet f7dc72492fc64c638202c7715a2a72ac (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:09.580359  8141 ts_tablet_manager.cc:1929] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:09.580708  8141 log.cc:1199] T ad4f3c0328924ddaba5d93fe80e78a64 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/wals/ad4f3c0328924ddaba5d93fe80e78a64
I20260709 13:13:09.582056  7072 catalog_manager.cc:5028] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): tablet ad4f3c0328924ddaba5d93fe80e78a64 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:10.633219  7180 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:10.645164  7255 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:13:10.647097  7150 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adaaa8fc7441471b9727128476437ccc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:10.648018  7328 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:10.648175  8139 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.650578  8120 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.658150  8120 raft_consensus.cc:2955] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.659938  7255 raft_consensus.cc:2955] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.668165  7331 raft_consensus.cc:2955] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.672447  7261 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:10.675941  7081 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.682520  7179 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:10.686050  8033 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:10.687252  7225 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 788b854112d74649a8e966f1fe824f3f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:10.692417  7331 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:10.694126  8142 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:10.707103  8033 raft_consensus.cc:2955] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.712177  7179 raft_consensus.cc:2955] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.716169  7328 raft_consensus.cc:2955] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.740267  7261 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:10.752264  7328 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:13:10.753051  7225 consensus_peers.cc:597] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d735c64b62484486814db631ca028bdb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:10.753211  7179 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:10.754158  8127 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.755149  8142 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.757519  7082 catalog_manager.cc:5697] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.783571  8127 raft_consensus.cc:2955] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.789134  7331 raft_consensus.cc:2955] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.797150  7179 raft_consensus.cc:2955] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.807839  7081 catalog_manager.cc:5697] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.811450  7331 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:13:10.821137  7299 consensus_peers.cc:597] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d6f19c97414f4b0c9f9e2ed509ee22d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:10.821936  7261 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:10.826325  8138 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.827666  7183 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:10.829635  8138 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.846050  8053 raft_consensus.cc:2955] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.848101  7261 raft_consensus.cc:2955] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.848342  7180 raft_consensus.cc:2955] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:10.867022  7085 catalog_manager.cc:5697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:11.085202  8160 ts_tablet_manager.cc:933] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
I20260709 13:13:11.087502  8160 tablet_copy_client.cc:323] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.129:44171
I20260709 13:13:11.089160  7197 tablet_copy_service.cc:140] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Received BeginTabletCopySession request for tablet adaaa8fc7441471b9727128476437ccc from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:54396)
I20260709 13:13:11.089618  7197 tablet_copy_service.cc:161] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Beginning new tablet copy session on tablet adaaa8fc7441471b9727128476437ccc from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:54396: session id = 9a54ecc9fb4541df915f9f8c01e19429-adaaa8fc7441471b9727128476437ccc
I20260709 13:13:11.096504  7197 tablet_copy_source_session.cc:215] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:11.099757  8160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adaaa8fc7441471b9727128476437ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.117520  8160 tablet_copy_client.cc:806] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:11.118230  8160 tablet_copy_client.cc:670] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:11.122367  8160 tablet_copy_client.cc:538] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:11.129941  8160 tablet_bootstrap.cc:492] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:11.158179  8160 tablet_bootstrap.cc:492] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.159157  8160 tablet_bootstrap.cc:492] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:11.159837  8160 ts_tablet_manager.cc:1403] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.030s	user 0.023s	sys 0.004s
I20260709 13:13:11.162989  8160 raft_consensus.cc:359] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:11.163803  8160 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:11.164426  8160 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:11.167477  8160 ts_tablet_manager.cc:1434] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:13:11.169641  7197 tablet_copy_service.cc:342] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-adaaa8fc7441471b9727128476437ccc received from {username='slave'} at 127.0.0.1:54396
I20260709 13:13:11.170077  7197 tablet_copy_service.cc:434] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-adaaa8fc7441471b9727128476437ccc on tablet adaaa8fc7441471b9727128476437ccc with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:11.270218  8160 ts_tablet_manager.cc:933] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:11.272994  8160 tablet_copy_client.cc:323] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.130:40351
I20260709 13:13:11.275074  7272 tablet_copy_service.cc:140] P efc9ee9e1d86480790fa83f6ad0c295c: Received BeginTabletCopySession request for tablet 788b854112d74649a8e966f1fe824f3f from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:57560)
I20260709 13:13:11.275552  7272 tablet_copy_service.cc:161] P efc9ee9e1d86480790fa83f6ad0c295c: Beginning new tablet copy session on tablet 788b854112d74649a8e966f1fe824f3f from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:57560: session id = 9a54ecc9fb4541df915f9f8c01e19429-788b854112d74649a8e966f1fe824f3f
I20260709 13:13:11.281811  7272 tablet_copy_source_session.cc:215] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:11.282559  8165 ts_tablet_manager.cc:933] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:11.286154  8160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788b854112d74649a8e966f1fe824f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.288239  8165 tablet_copy_client.cc:323] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.130:40351
I20260709 13:13:11.289875  7272 tablet_copy_service.cc:140] P efc9ee9e1d86480790fa83f6ad0c295c: Received BeginTabletCopySession request for tablet d735c64b62484486814db631ca028bdb from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:57560)
I20260709 13:13:11.290344  7272 tablet_copy_service.cc:161] P efc9ee9e1d86480790fa83f6ad0c295c: Beginning new tablet copy session on tablet d735c64b62484486814db631ca028bdb from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:57560: session id = 9a54ecc9fb4541df915f9f8c01e19429-d735c64b62484486814db631ca028bdb
I20260709 13:13:11.301141  7272 tablet_copy_source_session.cc:215] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:11.303295  8160 tablet_copy_client.cc:806] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:11.304206  8160 tablet_copy_client.cc:670] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:11.304263  8165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d735c64b62484486814db631ca028bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.308887  8160 tablet_copy_client.cc:538] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:11.315531  8160 tablet_bootstrap.cc:492] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:11.321491  8165 tablet_copy_client.cc:806] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:11.322126  8165 tablet_copy_client.cc:670] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:11.326182  8165 tablet_copy_client.cc:538] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:11.337111  8165 tablet_bootstrap.cc:492] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:11.339241  8160 tablet_bootstrap.cc:492] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.340202  8160 tablet_bootstrap.cc:492] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:11.340898  8160 ts_tablet_manager.cc:1403] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.002s
I20260709 13:13:11.345757  8160 raft_consensus.cc:359] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:11.346953  8160 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:11.347708  8160 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:11.349946  8160 ts_tablet_manager.cc:1434] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:13:11.351742  7272 tablet_copy_service.cc:342] P efc9ee9e1d86480790fa83f6ad0c295c: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-788b854112d74649a8e966f1fe824f3f received from {username='slave'} at 127.0.0.1:57560
I20260709 13:13:11.352166  7272 tablet_copy_service.cc:434] P efc9ee9e1d86480790fa83f6ad0c295c: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-788b854112d74649a8e966f1fe824f3f on tablet 788b854112d74649a8e966f1fe824f3f with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:11.361446  8165 tablet_bootstrap.cc:492] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.362486  8165 tablet_bootstrap.cc:492] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:11.363633  8165 ts_tablet_manager.cc:1403] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.008s
I20260709 13:13:11.366211  8165 raft_consensus.cc:359] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:11.366889  8165 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:11.367391  8165 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:11.369971  8165 ts_tablet_manager.cc:1434] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:13:11.371587  7272 tablet_copy_service.cc:342] P efc9ee9e1d86480790fa83f6ad0c295c: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-d735c64b62484486814db631ca028bdb received from {username='slave'} at 127.0.0.1:57560
I20260709 13:13:11.372052  7272 tablet_copy_service.cc:434] P efc9ee9e1d86480790fa83f6ad0c295c: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-d735c64b62484486814db631ca028bdb on tablet d735c64b62484486814db631ca028bdb with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:11.404528  8165 ts_tablet_manager.cc:933] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:11.426868  8165 tablet_copy_client.cc:323] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
I20260709 13:13:11.428455  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet d6f19c97414f4b0c9f9e2ed509ee22d1 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
I20260709 13:13:11.428936  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet d6f19c97414f4b0c9f9e2ed509ee22d1 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-d6f19c97414f4b0c9f9e2ed509ee22d1
I20260709 13:13:11.434667  7346 tablet_copy_source_session.cc:215] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:11.437428  8165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f19c97414f4b0c9f9e2ed509ee22d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:11.451503  8165 tablet_copy_client.cc:806] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:11.452040  8165 tablet_copy_client.cc:670] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:11.455502  8165 tablet_copy_client.cc:538] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:11.461997  8165 tablet_bootstrap.cc:492] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:11.480360  8165 tablet_bootstrap.cc:492] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:11.481093  8165 tablet_bootstrap.cc:492] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:11.481670  8165 ts_tablet_manager.cc:1403] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.002s
I20260709 13:13:11.483870  8165 raft_consensus.cc:359] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:11.484699  8165 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:11.485317  8165 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:11.488052  8165 ts_tablet_manager.cc:1434] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.005s
I20260709 13:13:11.493059  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-d6f19c97414f4b0c9f9e2ed509ee22d1 received from {username='slave'} at 127.0.0.1:44980
I20260709 13:13:11.493527  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-d6f19c97414f4b0c9f9e2ed509ee22d1 on tablet d6f19c97414f4b0c9f9e2ed509ee22d1 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:11.532668  7894 raft_consensus.cc:1217] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:11.797209  7894 raft_consensus.cc:1217] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:11.904140  7894 raft_consensus.cc:1217] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:11.935696  7894 raft_consensus.cc:1217] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:12.131251  8144 raft_consensus.cc:1064] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:12.134649  8144 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:12.146922  7333 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.148463  8177 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.149953  7894 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.152588  7255 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.152403  8176 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.154206  8172 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.178524  8144 raft_consensus.cc:2955] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.207984  7333 raft_consensus.cc:2955] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.222499  7255 raft_consensus.cc:2955] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.240775  7085 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.243688  7896 raft_consensus.cc:2955] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.250934  8033 raft_consensus.cc:1064] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:12.253614  8033 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:12.301877  7894 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.303659  8142 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.313197  7331 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.314901  8127 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.315368  7179 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.316681  8142 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:12.325402  8142 raft_consensus.cc:1064] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:12.332319  8033 raft_consensus.cc:2955] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.333474  7331 raft_consensus.cc:2955] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.331877  8142 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:12.354300  7179 raft_consensus.cc:2955] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.358825  7894 raft_consensus.cc:2955] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.365901  7896 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.365898  7331 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.364223  7183 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.373040  8033 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:12.374009  8127 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:12.377151  8175 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.418936  8175 raft_consensus.cc:2955] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.425666  7331 raft_consensus.cc:2955] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.428757  7894 raft_consensus.cc:2955] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.441016  7179 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:12.447250  7082 catalog_manager.cc:5697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.450398  7180 raft_consensus.cc:2955] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.456822  7331 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:12.458303  8177 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:12.459311  7896 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:12.468791  8144 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:12.471377  8176 raft_consensus.cc:2955] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.474087  7333 raft_consensus.cc:2955] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.487967  7896 raft_consensus.cc:2955] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.488972  7255 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:12.496495  7085 catalog_manager.cc:5697] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.500161  7894 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:12.502385  8174 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:12.512619  7333 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:12.513991  7072 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet adaaa8fc7441471b9727128476437ccc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:12.519497  8174 raft_consensus.cc:2955] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.524242  7895 raft_consensus.cc:2955] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.542897  8142 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:12.545397  7071 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d735c64b62484486814db631ca028bdb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:12.549959  7333 raft_consensus.cc:2955] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.553684  8110 raft_consensus.cc:1064] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:12.562677  8110 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:12.576787  7083 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.580024  7255 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:12.589926  7896 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.590754  7179 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.591230  7261 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:12.592823  8171 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.594244  8053 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:12.594537  7085 catalog_manager.cc:5697] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.598531  7896 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:12.599195  7179 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:12.598534  8053 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:12.603405  8175 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:12.604501  8174 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:12.606765  7245 tablet_service.cc:1558] Processing DeleteTablet for tablet adaaa8fc7441471b9727128476437ccc with delete_type TABLET_DATA_TOMBSTONED (TS efc9ee9e1d86480790fa83f6ad0c295c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55484
I20260709 13:13:12.663168  8174 raft_consensus.cc:2955] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.736739  8198 tablet_replica.cc:333] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:13:12.742484  8198 raft_consensus.cc:2243] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.751806  8198 raft_consensus.cc:2272] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.757894  8198 ts_tablet_manager.cc:1916] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:12.760609  7071 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 788b854112d74649a8e966f1fe824f3f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:12.761439  7172 tablet_service.cc:1558] Processing DeleteTablet for tablet d735c64b62484486814db631ca028bdb with delete_type TABLET_DATA_TOMBSTONED (TS 2ecdd7dc4a144f5aa0f2f91c7b94434d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50448
I20260709 13:13:12.773612  7894 raft_consensus.cc:2955] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.792490  8203 tablet_replica.cc:333] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:13:12.797153  8203 raft_consensus.cc:2243] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.799676  8198 ts_tablet_manager.cc:1929] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:12.803290  8203 raft_consensus.cc:2272] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.803704  8198 log.cc:1199] T adaaa8fc7441471b9727128476437ccc P efc9ee9e1d86480790fa83f6ad0c295c: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/wals/adaaa8fc7441471b9727128476437ccc
W20260709 13:13:12.763986  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 113793us
I20260709 13:13:12.812826  7071 catalog_manager.cc:5028] TS efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): tablet adaaa8fc7441471b9727128476437ccc (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:12.817430  8203 ts_tablet_manager.cc:1916] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:12.824572  8110 raft_consensus.cc:2955] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.831074  7262 raft_consensus.cc:2955] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.817430  7083 catalog_manager.cc:5697] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.843374  7179 raft_consensus.cc:2955] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.859130  8203 ts_tablet_manager.cc:1929] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:12.859756  8203 log.cc:1199] T d735c64b62484486814db631ca028bdb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/wals/d735c64b62484486814db631ca028bdb
I20260709 13:13:12.862320  7894 raft_consensus.cc:2955] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.863881  7072 catalog_manager.cc:5028] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): tablet d735c64b62484486814db631ca028bdb (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:12.864315  7324 tablet_service.cc:1558] Processing DeleteTablet for tablet 788b854112d74649a8e966f1fe824f3f with delete_type TABLET_DATA_TOMBSTONED (TS c85cf49c63cc4e66b4747d8c4fa14022 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33680
I20260709 13:13:12.872748  7083 catalog_manager.cc:5697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.892838  8204 tablet_replica.cc:333] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:13:12.894104  8204 raft_consensus.cc:2243] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.895107  8204 raft_consensus.cc:2272] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.904358  8204 ts_tablet_manager.cc:1916] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:12.907295  7179 raft_consensus.cc:2955] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.920501  7336 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:12.922298  8204 ts_tablet_manager.cc:1929] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:12.922783  8204 log.cc:1199] T 788b854112d74649a8e966f1fe824f3f P c85cf49c63cc4e66b4747d8c4fa14022: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/wals/788b854112d74649a8e966f1fe824f3f
I20260709 13:13:12.927841  7069 catalog_manager.cc:5028] TS c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): tablet 788b854112d74649a8e966f1fe824f3f (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:12.931358  7894 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:12.933913  8053 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:12.935434  7262 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:12.939074  8171 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:12.945856  8178 raft_consensus.cc:2955] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.948902  7894 raft_consensus.cc:2955] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.951320  7262 raft_consensus.cc:2955] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:12.957643  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d6f19c97414f4b0c9f9e2ed509ee22d1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:12.965544  7085 catalog_manager.cc:5697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.981997  7172 tablet_service.cc:1558] Processing DeleteTablet for tablet d6f19c97414f4b0c9f9e2ed509ee22d1 with delete_type TABLET_DATA_TOMBSTONED (TS 2ecdd7dc4a144f5aa0f2f91c7b94434d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50448
I20260709 13:13:12.982985  8203 tablet_replica.cc:333] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:13:12.983923  8203 raft_consensus.cc:2243] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.984659  8203 raft_consensus.cc:2272] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.988257  8203 ts_tablet_manager.cc:1916] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:13.011010  8203 ts_tablet_manager.cc:1929] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:13.011358  8203 log.cc:1199] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/wals/d6f19c97414f4b0c9f9e2ed509ee22d1
I20260709 13:13:13.012957  7072 catalog_manager.cc:5028] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): tablet d6f19c97414f4b0c9f9e2ed509ee22d1 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:14.055706  7255 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.061954  7336 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:13:14.065534  7225 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8df49b022aa74a6481683d10c4fcc035. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.066470  8175 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.067512  7182 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:14.068905  8175 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.077477  8206 raft_consensus.cc:2955] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.079141  7336 raft_consensus.cc:2955] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.083998  7179 raft_consensus.cc:2955] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.100692  7179 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.097890  7083 catalog_manager.cc:5697] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.110663  7261 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:14.111384  7336 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:13:14.113009  7150 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb7edd6d1f1343c1868f27ecb9a9ae9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.113306  8211 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:14.114419  8176 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.126916  8144 raft_consensus.cc:2955] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.130481  7255 raft_consensus.cc:2955] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.135855  7336 raft_consensus.cc:2955] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.155225  7336 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.165913  7179 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:13:14.170054  7299 consensus_peers.cc:597] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06475a21ebc249129fc41345c177538a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.175997  8110 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.165400  7255 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:14.179137  8110 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.173252  7082 catalog_manager.cc:5697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.190893  8171 raft_consensus.cc:2955] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.211550  7179 raft_consensus.cc:2955] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.224454  7182 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.235204  7255 raft_consensus.cc:2955] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.237188  7082 catalog_manager.cc:5697] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.252532  7336 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:13:14.255843  7150 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: edb4d64ffd0f4bed80982e942f1033c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.255957  8211 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:14.257613  7255 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:14.259617  8211 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:14.278489  8144 raft_consensus.cc:2955] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.280222  7336 raft_consensus.cc:2955] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.280705  7261 raft_consensus.cc:2955] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.296630  7082 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index -1 to 3, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:14.484125  8225 ts_tablet_manager.cc:933] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:14.486133  8225 tablet_copy_client.cc:323] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.130:40351
I20260709 13:13:14.488119  7272 tablet_copy_service.cc:140] P efc9ee9e1d86480790fa83f6ad0c295c: Received BeginTabletCopySession request for tablet 8df49b022aa74a6481683d10c4fcc035 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:57560)
I20260709 13:13:14.488705  7272 tablet_copy_service.cc:161] P efc9ee9e1d86480790fa83f6ad0c295c: Beginning new tablet copy session on tablet 8df49b022aa74a6481683d10c4fcc035 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:57560: session id = 9a54ecc9fb4541df915f9f8c01e19429-8df49b022aa74a6481683d10c4fcc035
I20260709 13:13:14.500142  7272 tablet_copy_source_session.cc:215] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:14.504108  8225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8df49b022aa74a6481683d10c4fcc035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.521668  8225 tablet_copy_client.cc:806] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:14.522372  8225 tablet_copy_client.cc:670] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:14.527581  8225 tablet_copy_client.cc:538] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:14.538084  8225 tablet_bootstrap.cc:492] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:14.549701  8227 ts_tablet_manager.cc:933] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
I20260709 13:13:14.552126  8227 tablet_copy_client.cc:323] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.129:44171
I20260709 13:13:14.554083  7197 tablet_copy_service.cc:140] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Received BeginTabletCopySession request for tablet cb7edd6d1f1343c1868f27ecb9a9ae9d from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:54396)
I20260709 13:13:14.554733  7197 tablet_copy_service.cc:161] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Beginning new tablet copy session on tablet cb7edd6d1f1343c1868f27ecb9a9ae9d from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:54396: session id = 9a54ecc9fb4541df915f9f8c01e19429-cb7edd6d1f1343c1868f27ecb9a9ae9d
I20260709 13:13:14.561307  8225 tablet_bootstrap.cc:492] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:14.562397  8225 tablet_bootstrap.cc:492] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:14.562737  7197 tablet_copy_source_session.cc:215] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:14.563256  8225 ts_tablet_manager.cc:1403] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.012s
I20260709 13:13:14.566955  8227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7edd6d1f1343c1868f27ecb9a9ae9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.567405  8225 raft_consensus.cc:359] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.568351  8225 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:14.569088  8225 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.579108  8225 ts_tablet_manager.cc:1434] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:13:14.585093  7272 tablet_copy_service.cc:342] P efc9ee9e1d86480790fa83f6ad0c295c: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-8df49b022aa74a6481683d10c4fcc035 received from {username='slave'} at 127.0.0.1:57560
I20260709 13:13:14.585597  7272 tablet_copy_service.cc:434] P efc9ee9e1d86480790fa83f6ad0c295c: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-8df49b022aa74a6481683d10c4fcc035 on tablet 8df49b022aa74a6481683d10c4fcc035 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:14.597769  8227 tablet_copy_client.cc:806] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:14.598387  8227 tablet_copy_client.cc:670] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:14.603650  8227 tablet_copy_client.cc:538] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:14.612205  8227 tablet_bootstrap.cc:492] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:14.630390  8227 tablet_bootstrap.cc:492] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:14.631152  8227 tablet_bootstrap.cc:492] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:14.631709  8227 ts_tablet_manager.cc:1403] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:13:14.633839  8227 raft_consensus.cc:359] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.634588  8227 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:14.635243  8227 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.639227  8227 ts_tablet_manager.cc:1434] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:13:14.641016  7197 tablet_copy_service.cc:342] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-cb7edd6d1f1343c1868f27ecb9a9ae9d received from {username='slave'} at 127.0.0.1:54396
I20260709 13:13:14.641469  7197 tablet_copy_service.cc:434] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-cb7edd6d1f1343c1868f27ecb9a9ae9d on tablet cb7edd6d1f1343c1868f27ecb9a9ae9d with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:14.772641  8227 ts_tablet_manager.cc:933] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:14.774313  8227 tablet_copy_client.cc:323] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
I20260709 13:13:14.776254  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet 06475a21ebc249129fc41345c177538a from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
I20260709 13:13:14.776834  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet 06475a21ebc249129fc41345c177538a from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-06475a21ebc249129fc41345c177538a
I20260709 13:13:14.786139  7346 tablet_copy_source_session.cc:215] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:14.789319  8227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06475a21ebc249129fc41345c177538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.804608  8227 tablet_copy_client.cc:806] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:14.805214  8227 tablet_copy_client.cc:670] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:14.808642  8227 tablet_copy_client.cc:538] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:14.817265  8227 tablet_bootstrap.cc:492] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:14.834147  8227 tablet_bootstrap.cc:492] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:14.835119  8227 tablet_bootstrap.cc:492] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:14.835871  8227 ts_tablet_manager.cc:1403] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.019s	user 0.020s	sys 0.000s
I20260709 13:13:14.838752  8227 raft_consensus.cc:359] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.839388  8227 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:14.839905  8227 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.842082  8227 ts_tablet_manager.cc:1434] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:13:14.844800  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-06475a21ebc249129fc41345c177538a received from {username='slave'} at 127.0.0.1:44980
I20260709 13:13:14.845242  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-06475a21ebc249129fc41345c177538a on tablet 06475a21ebc249129fc41345c177538a with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:14.861235  8227 ts_tablet_manager.cc:933] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
I20260709 13:13:14.862779  8227 tablet_copy_client.cc:323] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.129:44171
I20260709 13:13:14.864219  7197 tablet_copy_service.cc:140] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Received BeginTabletCopySession request for tablet edb4d64ffd0f4bed80982e942f1033c3 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:54396)
I20260709 13:13:14.864665  7197 tablet_copy_service.cc:161] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Beginning new tablet copy session on tablet edb4d64ffd0f4bed80982e942f1033c3 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:54396: session id = 9a54ecc9fb4541df915f9f8c01e19429-edb4d64ffd0f4bed80982e942f1033c3
I20260709 13:13:14.871253  7197 tablet_copy_source_session.cc:215] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:14.874018  8227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb4d64ffd0f4bed80982e942f1033c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.886979  8227 tablet_copy_client.cc:806] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:14.887554  8227 tablet_copy_client.cc:670] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:14.891379  8227 tablet_copy_client.cc:538] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:14.898545  8227 tablet_bootstrap.cc:492] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:14.916098  8227 tablet_bootstrap.cc:492] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:14.916910  8227 tablet_bootstrap.cc:492] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:14.917538  8227 ts_tablet_manager.cc:1403] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 13:13:14.919804  8227 raft_consensus.cc:359] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.920356  8227 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:14.920835  8227 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:14.922781  8227 ts_tablet_manager.cc:1434] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:14.925050  7197 tablet_copy_service.cc:342] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-edb4d64ffd0f4bed80982e942f1033c3 received from {username='slave'} at 127.0.0.1:54396
I20260709 13:13:14.925467  7197 tablet_copy_service.cc:434] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-edb4d64ffd0f4bed80982e942f1033c3 on tablet edb4d64ffd0f4bed80982e942f1033c3 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:15.052670  7894 raft_consensus.cc:1217] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:15.092308  7894 raft_consensus.cc:1217] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:15.352018  7896 raft_consensus.cc:1217] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:13:15.392233  7896 raft_consensus.cc:1217] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:15.597088  8176 raft_consensus.cc:1064] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:15.599694  8176 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:15.609866  7333 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:15.611159  7896 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:15.612023  8238 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:15.616111  8237 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:15.625326  7255 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:15.628974  8238 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:15.630949  8176 raft_consensus.cc:2955] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.644539  7896 raft_consensus.cc:2955] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.659096  7085 catalog_manager.cc:5697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.661154  7261 raft_consensus.cc:2955] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.665412  7333 raft_consensus.cc:2955] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.703261  8200 raft_consensus.cc:1064] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:15.705078  8200 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:15.723431  7896 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:15.724647  7179 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:15.724717  7333 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:15.724661  8200 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:15.726315  8206 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:15.730871  8200 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:15.746783  7180 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:15.750638  8206 raft_consensus.cc:2955] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.755303  7896 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:15.756680  8237 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:15.756996  7333 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:15.753319  7179 raft_consensus.cc:2955] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.759238  8237 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:15.773303  8176 raft_consensus.cc:2955] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.782382  7896 raft_consensus.cc:2955] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.803505  7333 raft_consensus.cc:2955] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.804363  7083 catalog_manager.cc:5697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.819792  7331 raft_consensus.cc:2955] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.822558  7072 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb7edd6d1f1343c1868f27ecb9a9ae9d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:15.832187  7245 tablet_service.cc:1558] Processing DeleteTablet for tablet cb7edd6d1f1343c1868f27ecb9a9ae9d with delete_type TABLET_DATA_TOMBSTONED (TS efc9ee9e1d86480790fa83f6ad0c295c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55484
I20260709 13:13:15.835738  7081 catalog_manager.cc:5697] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.846797  7896 raft_consensus.cc:2955] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.851703  8217 raft_consensus.cc:1064] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:15.853395  8258 tablet_replica.cc:333] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:13:15.858071  8217 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:15.878931  7255 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:15.886662  7894 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:15.888058  7895 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:15.889032  7179 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:15.890260  8110 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:15.890832  7261 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:15.892119  8200 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:15.898594  8110 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:15.908833  8110 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:15.908545  8200 raft_consensus.cc:2955] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.916193  7896 raft_consensus.cc:2955] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.933050  7179 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:15.933153  7083 catalog_manager.cc:5697] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.920361  7071 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8df49b022aa74a6481683d10c4fcc035 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:15.922492  8258 raft_consensus.cc:2243] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.962738  8200 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:15.962440  8258 raft_consensus.cc:2272] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.968130  7324 tablet_service.cc:1558] Processing DeleteTablet for tablet 8df49b022aa74a6481683d10c4fcc035 with delete_type TABLET_DATA_TOMBSTONED (TS c85cf49c63cc4e66b4747d8c4fa14022 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33680
I20260709 13:13:15.970932  7180 raft_consensus.cc:2955] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.984982  8217 raft_consensus.cc:2955] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:15.986733  8176 raft_consensus.cc:1064] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:15.989952  8176 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:16.011049  7895 raft_consensus.cc:2955] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.024406  7083 catalog_manager.cc:5697] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.967731  8258 ts_tablet_manager.cc:1916] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:16.058084  8263 tablet_replica.cc:333] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:13:16.069715  8263 raft_consensus.cc:2243] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.075568  7180 raft_consensus.cc:2955] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.078562  8263 raft_consensus.cc:2272] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.082304  7333 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:16.083945  8255 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:16.083719  7255 raft_consensus.cc:2955] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.085517  8263 ts_tablet_manager.cc:1916] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:16.101399  7262 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:16.104158  8254 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:16.116933  7896 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEARNER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:16.118860  8258 ts_tablet_manager.cc:1929] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:16.119427  8258 log.cc:1199] T cb7edd6d1f1343c1868f27ecb9a9ae9d P efc9ee9e1d86480790fa83f6ad0c295c: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/wals/cb7edd6d1f1343c1868f27ecb9a9ae9d
I20260709 13:13:16.119813  8176 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:16.120790  7331 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:16.123852  8263 ts_tablet_manager.cc:1929] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:16.124421  8263 log.cc:1199] T 8df49b022aa74a6481683d10c4fcc035 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/wals/8df49b022aa74a6481683d10c4fcc035
I20260709 13:13:16.121276  7071 catalog_manager.cc:5028] TS efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): tablet cb7edd6d1f1343c1868f27ecb9a9ae9d (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:16.126187  7069 catalog_manager.cc:5028] TS c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): tablet 8df49b022aa74a6481683d10c4fcc035 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:16.133702  7255 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:16.135254  8217 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:16.135958  7895 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:16.142810  8217 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:16.149783  8239 raft_consensus.cc:2955] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.155949  7261 raft_consensus.cc:2955] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.160339  7895 raft_consensus.cc:2955] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.164590  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 06475a21ebc249129fc41345c177538a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:16.153173  8176 raft_consensus.cc:2955] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.173538  7896 raft_consensus.cc:2955] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.162483  7255 raft_consensus.cc:2955] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.173544  7085 catalog_manager.cc:5697] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.195508  7172 tablet_service.cc:1558] Processing DeleteTablet for tablet 06475a21ebc249129fc41345c177538a with delete_type TABLET_DATA_TOMBSTONED (TS 2ecdd7dc4a144f5aa0f2f91c7b94434d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50448
I20260709 13:13:16.200012  7331 raft_consensus.cc:2955] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.218313  8268 tablet_replica.cc:333] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:13:16.219502  8268 raft_consensus.cc:2243] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.220300  8268 raft_consensus.cc:2272] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.222435  7082 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 3 to 4, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.227479  8268 ts_tablet_manager.cc:1916] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:16.241297  7180 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:16.247112  8268 ts_tablet_manager.cc:1929] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:16.247542  8268 log.cc:1199] T 06475a21ebc249129fc41345c177538a P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/wals/06475a21ebc249129fc41345c177538a
I20260709 13:13:16.250242  7072 catalog_manager.cc:5028] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): tablet 06475a21ebc249129fc41345c177538a (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:16.251214  7255 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:16.251446  7895 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:16.253123  8176 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:16.258088  8176 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:16.259574  8254 raft_consensus.cc:2955] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.267109  7895 raft_consensus.cc:2955] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.270504  7255 raft_consensus.cc:2955] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:16.271668  7072 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet edb4d64ffd0f4bed80982e942f1033c3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:16.281919  7081 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 4 to 5, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.299484  7324 tablet_service.cc:1558] Processing DeleteTablet for tablet edb4d64ffd0f4bed80982e942f1033c3 with delete_type TABLET_DATA_TOMBSTONED (TS c85cf49c63cc4e66b4747d8c4fa14022 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33680
I20260709 13:13:16.300443  8263 tablet_replica.cc:333] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:13:16.301537  8263 raft_consensus.cc:2243] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:16.302210  8263 raft_consensus.cc:2272] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:16.304802  8263 ts_tablet_manager.cc:1916] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:16.323521  8263 ts_tablet_manager.cc:1929] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:13:16.323961  8263 log.cc:1199] T edb4d64ffd0f4bed80982e942f1033c3 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/wals/edb4d64ffd0f4bed80982e942f1033c3
I20260709 13:13:16.327720  7069 catalog_manager.cc:5028] TS c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): tablet edb4d64ffd0f4bed80982e942f1033c3 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:17.368526  7331 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:13:17.374526  7299 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61f52d3e2071488c9b6c59c9b028e118. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.375517  7255 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:17.376813  7179 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:17.376904  8217 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:17.378178  8171 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:17.385878  8217 raft_consensus.cc:2955] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.387513  7255 raft_consensus.cc:2955] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.388913  7179 raft_consensus.cc:2955] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.401028  7182 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:17.407829  7085 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.412891  7331 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:17.413802  7255 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:17.414469  8176 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:17.415518  7150 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8023e86d50f847c7a841c09b7692edeb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.415642  8254 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:17.425813  8254 raft_consensus.cc:2955] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.428067  7255 raft_consensus.cc:2955] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.444046  7255 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:17.444203  7331 raft_consensus.cc:2955] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.460757  7081 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.483768  7182 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:17.485896  7333 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:17.487598  8248 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:17.489609  7225 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7ddda14494534865a2d45ddae7f3ec93. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.489734  8281 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:17.507169  8200 raft_consensus.cc:2955] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.512120  7336 raft_consensus.cc:2955] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.527823  7179 raft_consensus.cc:2955] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.532096  7333 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:17.529282  7085 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:17.541419  7299 consensus_peers.cc:597] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 984a0b52728d43fb97379422fa55491d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.545601  7255 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:17.544783  7179 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:17.547518  8217 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:17.550179  8217 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:17.574064  8171 raft_consensus.cc:2955] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.575534  7182 raft_consensus.cc:2955] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.590834  7081 catalog_manager.cc:5697] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.591984  7255 raft_consensus.cc:2955] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:17.803442  8289 ts_tablet_manager.cc:933] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:17.805379  8289 tablet_copy_client.cc:323] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
I20260709 13:13:17.807798  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet 61f52d3e2071488c9b6c59c9b028e118 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
I20260709 13:13:17.808391  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet 61f52d3e2071488c9b6c59c9b028e118 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-61f52d3e2071488c9b6c59c9b028e118
I20260709 13:13:17.815858  7346 tablet_copy_source_session.cc:215] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:17.819188  8289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61f52d3e2071488c9b6c59c9b028e118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.838863  8289 tablet_copy_client.cc:806] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:17.839529  8289 tablet_copy_client.cc:670] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:17.843360  8289 tablet_copy_client.cc:538] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:17.852440  8289 tablet_bootstrap.cc:492] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:17.874270  8289 tablet_bootstrap.cc:492] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:17.876338  8289 tablet_bootstrap.cc:492] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:17.877022  8289 ts_tablet_manager.cc:1403] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.012s
I20260709 13:13:17.879978  8289 raft_consensus.cc:359] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:17.880816  8289 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:17.881479  8289 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:17.884366  8289 ts_tablet_manager.cc:1434] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:17.886431  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-61f52d3e2071488c9b6c59c9b028e118 received from {username='slave'} at 127.0.0.1:44980
I20260709 13:13:17.886832  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-61f52d3e2071488c9b6c59c9b028e118 on tablet 61f52d3e2071488c9b6c59c9b028e118 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:17.927260  8289 ts_tablet_manager.cc:933] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
I20260709 13:13:17.929227  8289 tablet_copy_client.cc:323] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.129:44171
I20260709 13:13:17.930788  7197 tablet_copy_service.cc:140] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Received BeginTabletCopySession request for tablet 8023e86d50f847c7a841c09b7692edeb from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:54396)
I20260709 13:13:17.931360  7197 tablet_copy_service.cc:161] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Beginning new tablet copy session on tablet 8023e86d50f847c7a841c09b7692edeb from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:54396: session id = 9a54ecc9fb4541df915f9f8c01e19429-8023e86d50f847c7a841c09b7692edeb
I20260709 13:13:17.937450  7197 tablet_copy_source_session.cc:215] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:17.940439  8289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8023e86d50f847c7a841c09b7692edeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.953521  8289 tablet_copy_client.cc:806] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:17.954131  8289 tablet_copy_client.cc:670] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:17.957527  8289 tablet_copy_client.cc:538] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:17.965874  8289 tablet_bootstrap.cc:492] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:17.982893  8289 tablet_bootstrap.cc:492] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:17.983889  8289 tablet_bootstrap.cc:492] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:17.984601  8289 ts_tablet_manager.cc:1403] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.004s
I20260709 13:13:17.987529  8289 raft_consensus.cc:359] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:17.988432  8289 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:17.989154  8289 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:17.994585  8289 ts_tablet_manager.cc:1434] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:17.996512  7197 tablet_copy_service.cc:342] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-8023e86d50f847c7a841c09b7692edeb received from {username='slave'} at 127.0.0.1:54396
I20260709 13:13:17.996973  7197 tablet_copy_service.cc:434] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-8023e86d50f847c7a841c09b7692edeb on tablet 8023e86d50f847c7a841c09b7692edeb with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:18.000054  8289 ts_tablet_manager.cc:933] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:18.010795  8289 tablet_copy_client.cc:323] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
I20260709 13:13:18.012998  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet 984a0b52728d43fb97379422fa55491d from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
I20260709 13:13:18.013569  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet 984a0b52728d43fb97379422fa55491d from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-984a0b52728d43fb97379422fa55491d
I20260709 13:13:18.023419  7346 tablet_copy_source_session.cc:215] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:18.026510  8289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984a0b52728d43fb97379422fa55491d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.040675  8289 tablet_copy_client.cc:806] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:18.041251  8289 tablet_copy_client.cc:670] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:18.046195  8289 tablet_copy_client.cc:538] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:18.052716  8289 tablet_bootstrap.cc:492] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:18.067796  8289 tablet_bootstrap.cc:492] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:18.068692  8289 tablet_bootstrap.cc:492] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:18.069335  8289 ts_tablet_manager.cc:1403] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.017s	user 0.017s	sys 0.000s
I20260709 13:13:18.071625  8289 raft_consensus.cc:359] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:18.072204  8289 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:18.072680  8289 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:18.074291  8289 ts_tablet_manager.cc:1434] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:13:18.076005  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-984a0b52728d43fb97379422fa55491d received from {username='slave'} at 127.0.0.1:44980
I20260709 13:13:18.076431  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-984a0b52728d43fb97379422fa55491d on tablet 984a0b52728d43fb97379422fa55491d with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:18.101939  8289 ts_tablet_manager.cc:933] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:18.104571  8289 tablet_copy_client.cc:323] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.130:40351
I20260709 13:13:18.106079  7272 tablet_copy_service.cc:140] P efc9ee9e1d86480790fa83f6ad0c295c: Received BeginTabletCopySession request for tablet 7ddda14494534865a2d45ddae7f3ec93 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:57560)
I20260709 13:13:18.106652  7272 tablet_copy_service.cc:161] P efc9ee9e1d86480790fa83f6ad0c295c: Beginning new tablet copy session on tablet 7ddda14494534865a2d45ddae7f3ec93 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:57560: session id = 9a54ecc9fb4541df915f9f8c01e19429-7ddda14494534865a2d45ddae7f3ec93
I20260709 13:13:18.118808  7272 tablet_copy_source_session.cc:215] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:18.121904  8289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddda14494534865a2d45ddae7f3ec93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:18.134439  8289 tablet_copy_client.cc:806] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:18.135051  8289 tablet_copy_client.cc:670] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:18.138754  8289 tablet_copy_client.cc:538] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:18.146234  8289 tablet_bootstrap.cc:492] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:18.162614  8289 tablet_bootstrap.cc:492] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:18.163522  8289 tablet_bootstrap.cc:492] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:18.164119  8289 ts_tablet_manager.cc:1403] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.005s
I20260709 13:13:18.169301  8289 raft_consensus.cc:359] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:18.170373  8289 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:18.174587  8289 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:18.178972  8289 ts_tablet_manager.cc:1434] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:13:18.185041  7272 tablet_copy_service.cc:342] P efc9ee9e1d86480790fa83f6ad0c295c: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-7ddda14494534865a2d45ddae7f3ec93 received from {username='slave'} at 127.0.0.1:57560
I20260709 13:13:18.185552  7272 tablet_copy_service.cc:434] P efc9ee9e1d86480790fa83f6ad0c295c: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-7ddda14494534865a2d45ddae7f3ec93 on tablet 7ddda14494534865a2d45ddae7f3ec93 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:18.241859  7896 raft_consensus.cc:1217] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:18.413808  7896 raft_consensus.cc:1217] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:18.477203  7896 raft_consensus.cc:1217] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:18.655030  7896 raft_consensus.cc:1217] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:18.727843  8300 raft_consensus.cc:1064] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:18.732369  8300 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:18.740640  7896 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:18.742717  8287 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:13:18.757243  7255 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:18.757748  7179 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:18.758805  8300 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:18.760119  8304 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:18.775501  8288 raft_consensus.cc:2955] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:18.778723  7261 raft_consensus.cc:2955] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:18.788558  7896 raft_consensus.cc:2955] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:18.795091  7182 raft_consensus.cc:2955] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:18.822458  7081 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:18.866125  7336 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:18.874853  7182 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:18.875255  7895 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:18.876206  8304 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:18.877202  8308 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:18.883985  8304 raft_consensus.cc:2955] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:18.885501  7895 raft_consensus.cc:2955] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:18.894479  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 61f52d3e2071488c9b6c59c9b028e118 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:18.898021  7182 raft_consensus.cc:2955] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:18.904016  7082 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:18.921463  7245 tablet_service.cc:1558] Processing DeleteTablet for tablet 61f52d3e2071488c9b6c59c9b028e118 with delete_type TABLET_DATA_TOMBSTONED (TS efc9ee9e1d86480790fa83f6ad0c295c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55484
I20260709 13:13:18.923516  8313 tablet_replica.cc:333] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:13:18.925081  8313 raft_consensus.cc:2243] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.930847  8313 raft_consensus.cc:2272] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.933815  8313 ts_tablet_manager.cc:1916] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:18.947345  8304 raft_consensus.cc:1064] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:18.950599  8313 ts_tablet_manager.cc:1929] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:18.951139  8313 log.cc:1199] T 61f52d3e2071488c9b6c59c9b028e118 P efc9ee9e1d86480790fa83f6ad0c295c: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/wals/61f52d3e2071488c9b6c59c9b028e118
I20260709 13:13:18.952808  7071 catalog_manager.cc:5028] TS efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): tablet 61f52d3e2071488c9b6c59c9b028e118 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:18.953511  8304 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:18.961272  7896 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:18.961272  7261 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:18.962674  7182 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:18.963430  8287 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:18.964380  8308 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:18.965277  8304 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:18.987913  7255 raft_consensus.cc:2955] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:18.987329  8288 raft_consensus.cc:2955] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.009214  7082 catalog_manager.cc:5697] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.017624  8301 raft_consensus.cc:1064] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:19.020792  8301 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:19.030203  7182 raft_consensus.cc:2955] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.057217  7896 raft_consensus.cc:2955] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.104597  7333 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:19.111661  7893 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:19.114707  8304 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:19.121635  8248 raft_consensus.cc:1064] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:19.124439  8248 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:19.125324  8288 raft_consensus.cc:2955] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.128209  7893 raft_consensus.cc:2955] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.128551  7255 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:19.136005  8300 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:19.146301  7255 raft_consensus.cc:2955] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.156714  7333 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:19.159253  7896 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:19.161779  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 984a0b52728d43fb97379422fa55491d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:19.167675  7254 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:19.170826  7893 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:19.166779  8176 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:13:19.170564  7082 catalog_manager.cc:5697] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 1 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.172978  8200 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:19.174765  8301 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:19.175864  8319 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.183233  7179 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:19.186507  8248 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.207396  7336 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:19.224217  8302 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.248040  8301 raft_consensus.cc:2955] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.250352  8200 raft_consensus.cc:2955] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.253597  7333 raft_consensus.cc:2955] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.262410  7896 raft_consensus.cc:2955] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.265122  7172 tablet_service.cc:1558] Processing DeleteTablet for tablet 984a0b52728d43fb97379422fa55491d with delete_type TABLET_DATA_TOMBSTONED (TS 2ecdd7dc4a144f5aa0f2f91c7b94434d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50448
I20260709 13:13:19.268244  7179 raft_consensus.cc:2955] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.274978  7083 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:13:19.293807  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 44017us
I20260709 13:13:19.288496  8328 tablet_replica.cc:333] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:13:19.298339  7896 raft_consensus.cc:2955] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.306491  8328 raft_consensus.cc:2243] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.307291  8328 raft_consensus.cc:2272] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.313264  8328 ts_tablet_manager.cc:1916] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:19.325156  7333 raft_consensus.cc:2955] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.327190  7083 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.337347  7179 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:19.338798  7254 raft_consensus.cc:2955] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.345569  7336 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:19.348306  8319 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:19.349184  8328 ts_tablet_manager.cc:1929] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:19.349611  8328 log.cc:1199] T 984a0b52728d43fb97379422fa55491d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/wals/984a0b52728d43fb97379422fa55491d
I20260709 13:13:19.351218  7896 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:19.351428  7072 catalog_manager.cc:5028] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): tablet 984a0b52728d43fb97379422fa55491d (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:19.354861  8254 raft_consensus.cc:2955] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.358742  8176 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:19.367357  7072 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8023e86d50f847c7a841c09b7692edeb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:19.365454  7896 raft_consensus.cc:2955] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.364746  7331 raft_consensus.cc:2955] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.391184  7254 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:19.401906  7893 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:19.403134  7179 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:19.403586  8200 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:19.405299  8200 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:19.413892  7083 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.420131  8248 raft_consensus.cc:2955] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.429958  7245 tablet_service.cc:1558] Processing DeleteTablet for tablet 8023e86d50f847c7a841c09b7692edeb with delete_type TABLET_DATA_TOMBSTONED (TS efc9ee9e1d86480790fa83f6ad0c295c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55484
I20260709 13:13:19.428879  7893 raft_consensus.cc:2955] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.431002  8313 tablet_replica.cc:333] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:13:19.432058  8313 raft_consensus.cc:2243] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.432731  8313 raft_consensus.cc:2272] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.421613  7179 raft_consensus.cc:2955] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:19.441352  8313 ts_tablet_manager.cc:1916] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:19.458563  7071 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7ddda14494534865a2d45ddae7f3ec93 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:19.462616  8313 ts_tablet_manager.cc:1929] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:19.463195  8313 log.cc:1199] T 8023e86d50f847c7a841c09b7692edeb P efc9ee9e1d86480790fa83f6ad0c295c: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/wals/8023e86d50f847c7a841c09b7692edeb
I20260709 13:13:19.464740  7071 catalog_manager.cc:5028] TS efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): tablet 8023e86d50f847c7a841c09b7692edeb (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:19.466856  7085 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.477839  7324 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ddda14494534865a2d45ddae7f3ec93 with delete_type TABLET_DATA_TOMBSTONED (TS c85cf49c63cc4e66b4747d8c4fa14022 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33680
I20260709 13:13:19.480036  8329 tablet_replica.cc:333] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:13:19.480873  8329 raft_consensus.cc:2243] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.481436  8329 raft_consensus.cc:2272] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.485515  8329 ts_tablet_manager.cc:1916] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:19.499792  8329 ts_tablet_manager.cc:1929] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:19.500146  8329 log.cc:1199] T 7ddda14494534865a2d45ddae7f3ec93 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/wals/7ddda14494534865a2d45ddae7f3ec93
I20260709 13:13:19.501967  7069 catalog_manager.cc:5028] TS c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): tablet 7ddda14494534865a2d45ddae7f3ec93 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:20.495167  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:20.555934  7254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:35332
I20260709 13:13:20.556655  7254 raft_consensus.cc:606] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:20.574288  7254 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:20.577152  7333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:20.577684  7333 raft_consensus.cc:606] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:20.580590  7333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:20.581125  7333 raft_consensus.cc:606] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:20.582289  7331 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:20.584070  7331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
W20260709 13:13:20.584362  7225 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4637971bd855417fac5632325ab8f119. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.584425  7182 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:20.585111  8248 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.586381  8200 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.584578  7331 raft_consensus.cc:606] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:20.591773  7331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:20.592504  7331 raft_consensus.cc:606] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:20.596349  7331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c89d6774062049379248eca324d137c6"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:20.597021  7331 raft_consensus.cc:606] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:20.596835  8248 raft_consensus.cc:2955] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:20.598356  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:20.600064  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:20.603404  8288 raft_consensus.cc:993] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower efc9ee9e1d86480790fa83f6ad0c295c to start an election
I20260709 13:13:20.603965  8288 raft_consensus.cc:1081] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer efc9ee9e1d86480790fa83f6ad0c295c to start an election
I20260709 13:13:20.607123  7254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:55506
I20260709 13:13:20.607913  7254 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.608299  7254 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.610919  7179 raft_consensus.cc:2955] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:20.611483  7182 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:20.616520  7254 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.622869  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:20.623517  7187 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.635350  7333 raft_consensus.cc:2955] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:20.630477  7082 catalog_manager.cc:5697] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:20.638520  7187 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:20.643685  7254 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:20.644609  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:20.645426  8339 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.645898  8339 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:20.646759  8339 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.647450  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:20.647987  7333 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.648262  7333 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:20.649397  7333 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.653574  7333 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.662706  7333 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:20.664160  7331 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:13:20.666332  7150 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3393557a6cf4e58b575e336ba525fe9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.667136  8319 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.668560  7254 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:20.669889  8319 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.677218  8288 raft_consensus.cc:993] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:20.677822  8288 raft_consensus.cc:1081] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:20.681823  7182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:13:20.682562  7182 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.683017  7182 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.692090  8330 raft_consensus.cc:2955] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:20.694584  7331 raft_consensus.cc:2955] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:20.701660  7083 catalog_manager.cc:5697] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 1 to 2, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 2 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.706488  7254 raft_consensus.cc:2955] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:20.710325  7182 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.714030  7182 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:20.715303  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:20.715935  7333 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.716228  7333 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:20.716970  7333 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.718230  7333 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.718869  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:20.727140  7261 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.722124  7085 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:20.734902  7261 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:20.738142  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:20.740017  7333 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:20.742453  8319 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.743117  8319 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:20.743698  8288 raft_consensus.cc:993] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:20.744143  8304 raft_consensus.cc:1081] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:20.746258  7893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:33196
I20260709 13:13:20.746825  7893 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.747176  7893 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.754827  8319 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.755461  7893 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:20.754757  7261 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:20.768632  8288 raft_consensus.cc:993] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:20.769105  8288 raft_consensus.cc:1081] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:20.770905  7180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c89d6774062049379248eca324d137c6"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:13:20.771456  7180 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.771791  7180 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.775034  8248 raft_consensus.cc:993] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: : Instructing follower 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:20.775480  8248 raft_consensus.cc:1081] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Signalling peer 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:20.775763  7333 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:20.776479  7893 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:20.777546  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:20.777699  7179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:50456
I20260709 13:13:20.778133  7331 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.778658  7331 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:20.778084  7085 catalog_manager.cc:5697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 2, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.779282  8335 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.779361  7331 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:20.780459  7331 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:20.782505  7225 consensus_peers.cc:597] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4c394fe784e4244b68716ee824f271f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.778184  7179 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.783339  7179 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.784150  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:20.784724  7187 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.791421  7180 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.793545  7180 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:20.794368  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:20.794986  7255 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.799234  7182 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:20.800945  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:20.801537  7336 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.801836  7336 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:20.802546  7336 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.802850  8248 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.803789  7336 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.798570  7179 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.810192  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:20.810809  7261 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.811245  7261 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:20.810858  7336 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:20.812624  7261 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.813226  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:20.813709  7261 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.814136  8319 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.814649  8319 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:20.815275  7179 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:20.815579  8319 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.821297  7187 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:20.818849  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:20.823818  7336 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.848448  7255 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:20.849011  7261 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:20.852065  7336 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:20.853085  7331 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:20.863752  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:20.868453  8339 raft_consensus.cc:2955] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
W20260709 13:13:20.870718  8354 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:13:20.869114  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:20.875826  8349 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.876322  8349 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:20.877130  8349 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.878309  8356 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.887511  7331 raft_consensus.cc:2955] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:20.893273  7085 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 2, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.900579  7083 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.909077  7187 raft_consensus.cc:2955] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:20.908078  8356 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:20.919377  8356 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:20.929437  7255 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:20.937700  8287 raft_consensus.cc:993] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:20.949198  8287 raft_consensus.cc:1081] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:20.959988  7331 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.960521  7187 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:20.961174  7225 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a893449156a24240bd4ed83fc67f85f6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.961790  8338 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.962796  8248 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.963392  7187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:13:20.964579  7187 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.964977  7187 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.969480  7083 catalog_manager.cc:5697] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 2, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.972488  7187 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.973522  7082 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 1 to 2, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:20.975737  7187 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:20.976733  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:20.977356  7336 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.977674  7336 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:20.978377  7336 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:20.979550  7336 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.985203  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:20.985814  7255 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.986778  7336 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:20.991380  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:20.999524  8349 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:21.000070  8349 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:21.001142  7255 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:21.000213  8338 raft_consensus.cc:2955] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:21.001034  8349 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:21.006343  7331 raft_consensus.cc:2955] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:21.048636  7085 catalog_manager.cc:5697] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 2, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.052021  7180 raft_consensus.cc:2955] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:21.055883  7082 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 2 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.108544  8367 ts_tablet_manager.cc:933] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
I20260709 13:13:21.110291  8367 tablet_copy_client.cc:323] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.129:44171
I20260709 13:13:21.111943  7197 tablet_copy_service.cc:140] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Received BeginTabletCopySession request for tablet b3393557a6cf4e58b575e336ba525fe9 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:54396)
I20260709 13:13:21.112555  7197 tablet_copy_service.cc:161] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Beginning new tablet copy session on tablet b3393557a6cf4e58b575e336ba525fe9 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:54396: session id = 9a54ecc9fb4541df915f9f8c01e19429-b3393557a6cf4e58b575e336ba525fe9
I20260709 13:13:21.120504  7197 tablet_copy_source_session.cc:215] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:21.123795  8367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3393557a6cf4e58b575e336ba525fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.141341  8367 tablet_copy_client.cc:806] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:21.142041  8367 tablet_copy_client.cc:670] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:21.154004  8369 ts_tablet_manager.cc:933] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:21.154459  8367 tablet_copy_client.cc:538] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:21.154803  8370 ts_tablet_manager.cc:933] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:21.163903  8370 tablet_copy_client.cc:323] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.130:40351
I20260709 13:13:21.165822  7272 tablet_copy_service.cc:140] P efc9ee9e1d86480790fa83f6ad0c295c: Received BeginTabletCopySession request for tablet a4c394fe784e4244b68716ee824f271f from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:57560)
I20260709 13:13:21.166375  7272 tablet_copy_service.cc:161] P efc9ee9e1d86480790fa83f6ad0c295c: Beginning new tablet copy session on tablet a4c394fe784e4244b68716ee824f271f from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:57560: session id = 9a54ecc9fb4541df915f9f8c01e19429-a4c394fe784e4244b68716ee824f271f
I20260709 13:13:21.167763  8369 tablet_copy_client.cc:323] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.130:40351
I20260709 13:13:21.172628  8367 tablet_bootstrap.cc:492] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:21.172781  7271 tablet_copy_service.cc:140] P efc9ee9e1d86480790fa83f6ad0c295c: Received BeginTabletCopySession request for tablet 4637971bd855417fac5632325ab8f119 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:57560)
I20260709 13:13:21.173416  7271 tablet_copy_service.cc:161] P efc9ee9e1d86480790fa83f6ad0c295c: Beginning new tablet copy session on tablet 4637971bd855417fac5632325ab8f119 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:57560: session id = 9a54ecc9fb4541df915f9f8c01e19429-4637971bd855417fac5632325ab8f119
I20260709 13:13:21.179883  7272 tablet_copy_source_session.cc:215] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:21.182065  7271 tablet_copy_source_session.cc:215] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:21.184211  8370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c394fe784e4244b68716ee824f271f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.184923  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4637971bd855417fac5632325ab8f119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:21.210934  8369 tablet_copy_client.cc:806] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:21.211934  8369 tablet_copy_client.cc:670] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:21.216519  8369 tablet_copy_client.cc:538] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:21.221314  8370 tablet_copy_client.cc:806] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:21.224757  8370 tablet_copy_client.cc:670] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:21.229099  8369 tablet_bootstrap.cc:492] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:21.231587  7331 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.233381  8339 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:21.234127  8367 tablet_bootstrap.cc:492] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:21.235167  8367 tablet_bootstrap.cc:492] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:21.235900  8367 ts_tablet_manager.cc:1403] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.064s	user 0.033s	sys 0.004s
I20260709 13:13:21.239043  8367 raft_consensus.cc:359] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:21.239952  8367 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:21.240917  8370 tablet_copy_client.cc:538] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:21.244931  8367 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:21.249768  8367 ts_tablet_manager.cc:1434] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:13:21.251624  7197 tablet_copy_service.cc:342] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-b3393557a6cf4e58b575e336ba525fe9 received from {username='slave'} at 127.0.0.1:54396
I20260709 13:13:21.252091  7197 tablet_copy_service.cc:434] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-b3393557a6cf4e58b575e336ba525fe9 on tablet b3393557a6cf4e58b575e336ba525fe9 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:21.256497  7180 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.258123  8248 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:21.275563  7257 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.277416  8370 tablet_bootstrap.cc:492] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:21.292182  8369 tablet_bootstrap.cc:492] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:21.293119  8369 tablet_bootstrap.cc:492] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:21.293848  8369 ts_tablet_manager.cc:1403] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.013s
I20260709 13:13:21.296247  8349 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:21.310483  7261 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.352767  7261 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.354900  8349 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:21.365075  8349 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:13:21.376672  7333 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:21.416553  7333 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.381951  8356 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:13:21.419371  7331 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.447784  8350 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:21.446376  8348 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:13:21.494480  7179 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:21.437134  8369 raft_consensus.cc:359] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:21.496731  8357 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:21.497161  8369 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:21.535207  8369 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:13:21.553469  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 121378us
I20260709 13:13:21.553144  8369 ts_tablet_manager.cc:1434] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.259s	user 0.007s	sys 0.006s
I20260709 13:13:21.556531  7331 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:21.578101  8388 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:13:21.574688  8370 tablet_bootstrap.cc:492] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:21.624637  7896 raft_consensus.cc:1217] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:21.643131  8367 ts_tablet_manager.cc:933] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:21.642324  8370 tablet_bootstrap.cc:492] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:21.641196  7271 tablet_copy_service.cc:342] P efc9ee9e1d86480790fa83f6ad0c295c: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-4637971bd855417fac5632325ab8f119 received from {username='slave'} at 127.0.0.1:57560
I20260709 13:13:21.603005  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:21.681834  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52056.7us
I20260709 13:13:21.679008  7271 tablet_copy_service.cc:434] P efc9ee9e1d86480790fa83f6ad0c295c: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-4637971bd855417fac5632325ab8f119 on tablet 4637971bd855417fac5632325ab8f119 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:21.686793  8370 ts_tablet_manager.cc:1403] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.412s	user 0.031s	sys 0.010s
I20260709 13:13:21.761693  7895 raft_consensus.cc:1217] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:21.760154  7257 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.805244  8348 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:13:21.817325  8367 tablet_copy_client.cc:323] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.130:40351
I20260709 13:13:21.819487  8370 raft_consensus.cc:359] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:21.821321  8370 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:21.822299  8370 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:21.825628  8370 ts_tablet_manager.cc:1434] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.002s
I20260709 13:13:21.890465  8406 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:13:21.987247  7271 tablet_copy_service.cc:140] P efc9ee9e1d86480790fa83f6ad0c295c: Received BeginTabletCopySession request for tablet a893449156a24240bd4ed83fc67f85f6 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:57560)
I20260709 13:13:21.988183  7271 tablet_copy_service.cc:161] P efc9ee9e1d86480790fa83f6ad0c295c: Beginning new tablet copy session on tablet a893449156a24240bd4ed83fc67f85f6 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:57560: session id = 9a54ecc9fb4541df915f9f8c01e19429-a893449156a24240bd4ed83fc67f85f6
I20260709 13:13:21.991192  7272 tablet_copy_service.cc:342] P efc9ee9e1d86480790fa83f6ad0c295c: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-a4c394fe784e4244b68716ee824f271f received from {username='slave'} at 127.0.0.1:57560
I20260709 13:13:21.991961  7272 tablet_copy_service.cc:434] P efc9ee9e1d86480790fa83f6ad0c295c: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-a4c394fe784e4244b68716ee824f271f on tablet a4c394fe784e4244b68716ee824f271f with peer 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:22.000172  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52352.5us
I20260709 13:13:22.001240  8319 raft_consensus.cc:1064] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:22.021021  8319 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:22.107344  7896 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:22.111320  8395 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:22.129002  7336 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:22.213088  7331 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:22.215616  8350 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:22.219427  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 97272.2us
W20260709 13:13:22.220383  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 115834us
I20260709 13:13:22.224062  7271 tablet_copy_source_session.cc:215] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:22.241954  8367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a893449156a24240bd4ed83fc67f85f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:22.325547  8350 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:22.340528  7254 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:22.362577  8367 tablet_copy_client.cc:806] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:22.369323  8367 tablet_copy_client.cc:670] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:22.384677  8367 tablet_copy_client.cc:538] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:22.384732  8383 raft_consensus.cc:2955] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.395818  7896 raft_consensus.cc:1217] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:22.401000  8349 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:22.404433  8367 tablet_bootstrap.cc:492] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
W20260709 13:13:22.429332  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 45447.7us
I20260709 13:13:22.433413  7334 raft_consensus.cc:2955] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.439939  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:22.449538  7896 raft_consensus.cc:2955] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.458576  7082 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.460518  8367 tablet_bootstrap.cc:492] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:22.461640  8367 tablet_bootstrap.cc:492] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:22.462951  8367 ts_tablet_manager.cc:1403] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.011s
I20260709 13:13:22.466405  8367 raft_consensus.cc:359] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:22.472724  8367 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:22.476478  8367 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:22.479516  8367 ts_tablet_manager.cc:1434] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:13:22.482093  7271 tablet_copy_service.cc:342] P efc9ee9e1d86480790fa83f6ad0c295c: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-a893449156a24240bd4ed83fc67f85f6 received from {username='slave'} at 127.0.0.1:57560
I20260709 13:13:22.482677  7271 tablet_copy_service.cc:434] P efc9ee9e1d86480790fa83f6ad0c295c: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-a893449156a24240bd4ed83fc67f85f6 on tablet a893449156a24240bd4ed83fc67f85f6 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:22.493443  8382 raft_consensus.cc:1064] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:22.496812  8382 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:22.532816  7254 raft_consensus.cc:2955] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.556910  7182 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:22.567131  7334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:22.567855  7334 raft_consensus.cc:606] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:22.570092  7892 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:22.572755  7330 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:22.576823  8383 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:22.577344  7254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:35332
I20260709 13:13:22.577948  7254 raft_consensus.cc:606] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:22.586925  7182 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:22.589502  8335 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:22.592840  8335 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:22.597169  7330 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:22.603492  7893 raft_consensus.cc:1217] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:13:22.636065  7896 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:22.639945  8412 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:22.646349  8335 raft_consensus.cc:2955] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.650892  8350 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:22.653360  8383 raft_consensus.cc:2955] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.658456  7330 raft_consensus.cc:2955] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.666765  7072 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3393557a6cf4e58b575e336ba525fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:22.673590  7894 raft_consensus.cc:2955] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.676455  7334 raft_consensus.cc:2955] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.688274  7182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:13:22.688925  7182 raft_consensus.cc:606] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:22.692595  7186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:13:22.691998  7182 raft_consensus.cc:2955] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.693238  7186 raft_consensus.cc:606] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:22.706269  7081 catalog_manager.cc:5697] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:22.712213  7083 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 3 to 4, VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) evicted. New cstate: current_term: 1 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:22.731146  7186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:13:22.732034  7186 raft_consensus.cc:606] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:22.732419  7245 tablet_service.cc:1558] Processing DeleteTablet for tablet b3393557a6cf4e58b575e336ba525fe9 with delete_type TABLET_DATA_TOMBSTONED (TS efc9ee9e1d86480790fa83f6ad0c295c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55484
I20260709 13:13:22.740417  8436 tablet_replica.cc:333] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:13:22.743010  8436 raft_consensus.cc:2243] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.746564  8436 raft_consensus.cc:2272] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.750732  7186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:13:22.752595  7186 raft_consensus.cc:606] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:22.754426  8349 raft_consensus.cc:993] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: : Instructing follower 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:22.754956  8349 raft_consensus.cc:1081] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Signalling peer 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:22.756552  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:22.758204  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:22.760793  7896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:33208
I20260709 13:13:22.761415  7896 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.761742  7896 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.764762  7891 raft_consensus.cc:2955] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.774330  8436 ts_tablet_manager.cc:1916] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:22.775312  7896 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:22.778294  7896 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:22.779103  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:22.779779  7186 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:22.780114  7186 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:22.780947  7186 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:22.782255  7186 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.782162  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:22.784111  7330 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.791446  7254 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:22.794039  8436 ts_tablet_manager.cc:1929] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:22.799170  8436 log.cc:1199] T b3393557a6cf4e58b575e336ba525fe9 P efc9ee9e1d86480790fa83f6ad0c295c: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/wals/b3393557a6cf4e58b575e336ba525fe9
I20260709 13:13:22.800706  7186 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:22.804626  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:22.805683  8356 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.806876  7186 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:22.807559  7896 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:22.808694  8335 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:22.809530  7330 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:22.810688  7071 catalog_manager.cc:5028] TS efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): tablet b3393557a6cf4e58b575e336ba525fe9 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:22.813133  8356 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:22.814216  8356 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:22.814684  8417 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:22.819664  8335 raft_consensus.cc:1064] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:22.821408  8382 raft_consensus.cc:2955] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.822849  7182 raft_consensus.cc:2955] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.825685  8335 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:22.854902  7082 catalog_manager.cc:5697] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.858358  7071 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4637971bd855417fac5632325ab8f119 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:22.857419  7891 raft_consensus.cc:2955] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.868091  7324 tablet_service.cc:1558] Processing DeleteTablet for tablet 4637971bd855417fac5632325ab8f119 with delete_type TABLET_DATA_TOMBSTONED (TS c85cf49c63cc4e66b4747d8c4fa14022 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33680
I20260709 13:13:22.874034  7896 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:22.875481  8440 tablet_replica.cc:333] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:13:22.875933  7335 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:22.875437  7186 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:13:22.878192  8417 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:22.880065  8417 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:22.881809  8417 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:22.892453  8440 raft_consensus.cc:2243] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.893482  8440 raft_consensus.cc:2272] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.889014  7083 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 1 to 2, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:22.903998  8440 ts_tablet_manager.cc:1916] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:22.923748  8248 raft_consensus.cc:993] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: : Instructing follower 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:22.924335  8248 raft_consensus.cc:1081] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Signalling peer 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:22.926272  8414 raft_consensus.cc:993] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:22.926940  8361 raft_consensus.cc:1081] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:22.926843  7186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:50456
I20260709 13:13:22.928901  7186 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.929530  7186 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.934043  8440 ts_tablet_manager.cc:1929] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:22.934654  7896 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:33196
I20260709 13:13:22.938922  8386 raft_consensus.cc:2955] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.938957  7186 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:22.947479  7896 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.941771  7330 raft_consensus.cc:2955] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.947947  7896 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.953095  7186 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:22.953996  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:22.954572  7335 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.960484  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:22.961118  7253 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:22.961444  7253 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:22.962037  7335 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:22.947455  8440 log.cc:1199] T 4637971bd855417fac5632325ab8f119 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/wals/4637971bd855417fac5632325ab8f119
I20260709 13:13:22.962285  7253 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:22.963969  7896 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:22.963989  7150 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:22.965998  8350 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.966552  8350 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:22.967439  8350 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:22.968951  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:22.969502  7335 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:22.969782  7335 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:22.970467  7335 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:22.971558  7335 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.975109  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:22.975703  7255 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.978940  7069 catalog_manager.cc:5028] TS c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): tablet 4637971bd855417fac5632325ab8f119 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:22.979667  7335 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:22.980499  7182 raft_consensus.cc:2955] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.983194  7253 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:22.983570  7083 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:22.987313  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:22.990149  8356 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.990754  8356 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:22.991674  8356 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:22.995755  7253 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:22.996630  7255 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:22.997071  7896 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:23.031104  7083 catalog_manager.cc:5697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 2, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.026917  7081 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 1 to 2, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.036798  7891 raft_consensus.cc:2955] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.050161  8382 raft_consensus.cc:1064] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:13:23.052922  8382 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:23.067230  7255 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:23.067677  7896 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEARNER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:23.069165  7330 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:23.070686  8411 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.075110  7330 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:23.076545  7891 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:13:23.078673  8412 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:23.080765  7182 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:23.081106  8386 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:13:23.084601  8382 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.091609  8412 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:23.099789  8383 raft_consensus.cc:993] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: : Instructing follower efc9ee9e1d86480790fa83f6ad0c295c to start an election
I20260709 13:13:23.100293  8383 raft_consensus.cc:1081] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Signalling peer efc9ee9e1d86480790fa83f6ad0c295c to start an election
I20260709 13:13:23.103399  7255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:55492
I20260709 13:13:23.104024  7255 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:23.104420  7255 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.109961  8383 raft_consensus.cc:993] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: : Instructing follower 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:23.108966  8411 raft_consensus.cc:2955] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.110549  8383 raft_consensus.cc:1081] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Signalling peer 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:23.112296  7891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:33208
I20260709 13:13:23.112876  7891 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:23.113307  7891 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.115181  7334 raft_consensus.cc:2955] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.116698  7255 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:23.119522  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:23.120095  7180 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:23.120401  7180 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:23.121126  7180 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:23.122349  7180 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.125717  7892 raft_consensus.cc:2955] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.127202  7071 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a4c394fe784e4244b68716ee824f271f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:23.128454  7891 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:23.134435  7180 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:23.135895  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:23.137315  8386 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:23.138139  8386 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:23.139257  8412 raft_consensus.cc:2955] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.145519  7082 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 3 to 4, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.153199  8386 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:23.159123  7894 raft_consensus.cc:2955] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.170315  7172 tablet_service.cc:1558] Processing DeleteTablet for tablet a4c394fe784e4244b68716ee824f271f with delete_type TABLET_DATA_TOMBSTONED (TS 2ecdd7dc4a144f5aa0f2f91c7b94434d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50448
I20260709 13:13:23.155884  7334 raft_consensus.cc:2955] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.183339  7255 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:23.184078  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:23.184700  7186 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:23.185283  7186 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:23.183318  7083 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.186388  7186 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:23.187532  7186 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.194726  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:23.195369  7335 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.195086  7180 raft_consensus.cc:2955] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } attrs { replace: true } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.205735  7335 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:23.208398  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:23.209221  7255 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.211845  8451 tablet_replica.cc:333] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:13:23.209826  7891 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:23.242933  8406 raft_consensus.cc:993] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: : Instructing follower 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:23.244628  8383 raft_consensus.cc:1081] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Signalling peer 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:23.253451  7182 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:23.254912  8356 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:23.256675  7255 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:23.257730  7861 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:23.258816  7186 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:23.259701  8356 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:23.261621  8356 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:23.262501  8356 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:23.262873  7892 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:33208
I20260709 13:13:23.263489  7892 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:23.263859  7892 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.268043  8451 raft_consensus.cc:2243] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.269002  8451 raft_consensus.cc:2272] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.273245  8451 ts_tablet_manager.cc:1916] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:23.286123  7892 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:23.304881  7085 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 2 to 3, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 3 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.307336  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:23.307924  7182 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:23.308209  7182 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:23.310500  7083 catalog_manager.cc:5697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 2 to 3, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 3 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.313058  7334 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:23.314409  8356 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:23.315784  7182 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:23.319680  7182 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.327773  7182 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:23.329378  7892 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:23.329981  7862 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:23.331868  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:23.332453  7335 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.334874  8437 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:23.337447  8437 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:23.338544  8437 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:23.340896  8451 ts_tablet_manager.cc:1929] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:13:23.352682  8451 log.cc:1199] T a4c394fe784e4244b68716ee824f271f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/wals/a4c394fe784e4244b68716ee824f271f
I20260709 13:13:23.340924  7255 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:23.354722  7072 catalog_manager.cc:5028] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): tablet a4c394fe784e4244b68716ee824f271f (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:23.359318  7892 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:23.360720  7186 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:13:23.360320  7083 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 1 to 2, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.362056  8411 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:23.363922  8411 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:23.339006  7335 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:23.370358  8382 raft_consensus.cc:2955] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.375525  7186 raft_consensus.cc:2955] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.379201  7891 raft_consensus.cc:2955] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:23.388933  7071 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a893449156a24240bd4ed83fc67f85f6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:23.394438  7335 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.402093  8383 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.401592  7081 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 3 to 4, VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) evicted. New cstate: current_term: 2 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.420218  7324 tablet_service.cc:1558] Processing DeleteTablet for tablet a893449156a24240bd4ed83fc67f85f6 with delete_type TABLET_DATA_TOMBSTONED (TS c85cf49c63cc4e66b4747d8c4fa14022 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33680
I20260709 13:13:23.421487  8440 tablet_replica.cc:333] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:13:23.422600  8440 raft_consensus.cc:2243] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.423452  8440 raft_consensus.cc:2272] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.425844  7255 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.428833  8383 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.433421  8440 ts_tablet_manager.cc:1916] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:23.467072  8440 ts_tablet_manager.cc:1929] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:13:23.468523  8440 log.cc:1199] T a893449156a24240bd4ed83fc67f85f6 P c85cf49c63cc4e66b4747d8c4fa14022: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/wals/a893449156a24240bd4ed83fc67f85f6
I20260709 13:13:23.488163  7069 catalog_manager.cc:5028] TS c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): tablet a893449156a24240bd4ed83fc67f85f6 (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
I20260709 13:13:23.515723  7334 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:23.517813  8437 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:23.557238  7261 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:23.558830  8437 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:23.708613  7335 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:23.716109  8386 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:23.786610  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:24.384032  7335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.007s	sys 0.047s
W20260709 13:13:24.384529  7335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.007s	sys 0.047s
I20260709 13:13:24.504961  8408 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.505730  8408 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:24.509232  8408 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:24.528753  8408 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.530001  8361 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.530689  8361 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:24.533450  8361 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:24.529479  8408 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:24.537515  8408 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:24.538223  8408 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.540464  8408 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:24.542914  8361 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.543871  8361 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:24.547202  8361 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:24.580555  8408 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:24.617785  8408 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.618680  8408 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:24.622074  8408 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:24.653610  8361 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.654314  8361 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:24.658006  8361 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:24.683609  8408 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.684508  8408 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:24.687844  8408 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:24.654516  8476 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:24.690349  8476 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.706475  8476 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:24.750773  8476 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.751593  8476 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.754187  8476 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:24.730242  7226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.010s	sys 0.002s
I20260709 13:13:24.807403  8476 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.736414  8361 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.808565  8361 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.811553  8361 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:24.718505  8479 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.813126  8479 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.816532  8479 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:24.765938  8481 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:24.817667  8481 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.820438  8481 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:24.807720  7226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.010s	sys 0.002s
W20260709 13:13:24.730739  7861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.001s	sys 0.007s
W20260709 13:13:24.821501  7861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.001s	sys 0.007s
I20260709 13:13:24.835196  8476 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.844246  8361 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:24.845075  8361 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.848783  8361 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:24.854807  8481 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.855662  8481 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.861186  8482 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.862053  8482 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.864913  8482 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:24.930485  8482 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:13:24.873531  7301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.013s	sys 0.024s
W20260709 13:13:24.931185  7301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.013s	sys 0.024s
W20260709 13:13:24.931474  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 707240us
I20260709 13:13:24.932991  8483 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.933597  8483 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:24.874464  7299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.003s	sys 0.009s
I20260709 13:13:24.893872  8476 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:24.936303  8476 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.895820  8484 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:24.913007  8477 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.922334  8481 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:24.870671  8480 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:13:24.935735  7299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.003s	sys 0.009s
W20260709 13:13:24.937824  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 783175us
I20260709 13:13:24.937625  8361 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.938545  8484 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.938545  8477 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.936820  8476 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.967092  8481 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:24.968015  8481 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:24.969234  7334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.446s	user 0.017s	sys 0.009s
W20260709 13:13:24.969766  7334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.447s	user 0.018s	sys 0.009s
I20260709 13:13:24.970849  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 43) took 1450 ms. Trace:
I20260709 13:13:24.988682  8478 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:24.989449  8478 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:24.971447  7334 rpcz_store.cc:276] 0709 13:13:23.520650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.520830 (+   180us) service_pool.cc:224] Handling call
0709 13:13:23.521239 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:23.521661 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.521703 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:23.522352 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 13:13:24.970261 (+1447909us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:24.970320 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.970410 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.970486 (+    76us) raft_consensus.cc:1685] finished
0709 13:13:24.970506 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.970742 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5900,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"thread_start_us":1447411,"threads_started":1,"wal-append.queue_time_us":542118}
I20260709 13:13:24.958619  8480 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.018813  8482 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:24.939394  8361 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.024853  8480 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.028880  8480 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.030848  8480 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.034475  8482 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.026610  8476 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.031265  8478 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.031734  8486 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.038488  8478 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.038801  8486 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.039268  8480 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.041178  8486 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.025276  8483 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.030155  8477 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.041878  8494 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.039285  8478 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.042028  8477 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:25.043066  8486 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.038403  8361 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.028244  8481 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.032244  8491 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.051430  8477 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.054246  8478 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.054970  8477 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.052167  8491 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.049062  8497 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.065943  8496 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.052915  8486 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.104005  8478 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.104602  8478 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.044325  8494 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.066838  8491 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.060731  8497 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.118001  8497 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.102547  8483 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.113534  8361 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.135130  8497 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.135178  8482 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.139592  8497 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.139729  8482 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.139964  8486 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.144496  8502 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.143494  8492 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.134771  8483 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.150882  8487 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.138231  8361 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.111634  8496 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.145419  8497 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.151530  8492 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.159217  8501 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.149186  8488 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.147859  8484 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.168514  8499 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.160902  8491 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:25.145077  8502 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.173048  8492 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.173358  8494 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.162696  8487 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.163384  8482 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.181363  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.182389  7253 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.182601  8489 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.174278  8478 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.170552  8501 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.178926  8492 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.183240  8489 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.185334  8493 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.175925  8491 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.169152  8499 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.208946  8498 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.225596  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.225900  8489 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.226320  7262 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:25.219354  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.230677  8504 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.176296  8488 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.210549  8492 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.219092  8500 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.235539  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.224030  8361 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.236310  8506 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.237015  8478 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.230083  8489 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.232249  8483 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.240803  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.220543  8493 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.242514  7254 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.225816  8498 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.235280  7253 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.243479  8507 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.243633  8490 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.239504  8478 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.238308  8494 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.252332  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.253170  7254 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:25.239212  8504 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.240703  8497 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.239770  8501 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.260324  8478 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.260527  8493 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.261093  8495 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.244246  8507 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.261477  8502 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.275759  8361 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.262564  8497 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.276302  8361 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.276757  8491 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.261710  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.239334  8506 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.250861  8489 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.283128  8499 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.266767  8478 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.255991  8494 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.271468  8487 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.243528  8500 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.272732  8496 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.244433  8490 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.298020  7262 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:25.281719  8495 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.283747  7253 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.300858  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.289731  8414 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.289296  8478 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.292965  8496 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.291396  8498 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.302567  8503 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.305759  8487 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.312626  8499 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:25.318826  8361 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.318502  8499 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.322530  8499 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.322738  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.323948  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.312716  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.311707  8414 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.328976  8503 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.331928  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.332659  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.332749  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.333555  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.333920  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.334415  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.334729  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.335386  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.335762  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.336001  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.336325  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.336030  7180 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:25.337018  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.337733  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.337960  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.338333  7179 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.338543  8414 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.339850  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.340607  7186 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:25.344010  8503 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.317340  8492 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.344376  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.346125  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.350682  7186 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.344453  8487 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.346808  8506 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.347196  8509 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.347664  8489 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.320015  8510 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.325508  8497 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.314267  8496 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.362695  8508 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.366355  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.367370  8478 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.367530  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.368647  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.366513  8490 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.369767  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.370347  7256 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:25.373204  8507 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.375324  8496 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.344375  8504 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.365438  8509 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.366389  8508 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.365702  8500 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.386288  8509 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.386742  8487 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.398010  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:25.399225  8509 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:25.399263  7302 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:25.399714  8509 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:25.400125  8509 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:25.400332  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:25.401598  8466 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:25.401607  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:25.402066  8488 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.402153  8466 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.402702  8466 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:25.402772  8478 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:25.385335  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.493959  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:25.383061  8495 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.389351  8504 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.495064  8470 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:25.495589  8470 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.495138  8504 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.495952  8470 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.497537  8504 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.389746  8494 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.389779  8508 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.390944  8500 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.498571  8500 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.501179  8500 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.391870  8496 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:25.391803  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.403224  8478 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.400828  8514 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:25.536686  8478 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.536800  8514 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.370980  8510 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.539465  8510 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.412503  8509 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.540382  7334 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:25.541489  8509 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.412477  8466 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.537451  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.543233  7259 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.544106  8466 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.544199  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.417111  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.420323  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.421710  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.422039  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.420029  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.422549  7085 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47542 (request call id 229) took 1993 ms. Trace:
I20260709 13:13:25.423678  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.425494  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.427362  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.423498  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.430022  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:25.434031  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.436808  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.437635  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.438350  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.440450  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.442190  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.446449  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.437057  8471 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:25.428042  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:25.545756  7330 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:25.555277  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.556561  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.556694  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.557303  7185 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.557353  7330 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:25.456503  7083 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 148) took 1834 ms. Trace:
I20260709 13:13:25.545786  7327 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:25.558828  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.558768  7083 rpcz_store.cc:276] 0709 13:13:23.622414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.408898 (+1786484us) service_pool.cc:224] Handling call
0709 13:13:25.456433 (+ 47535us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43661,"reported_tablets":1}
I20260709 13:13:25.559608  7894 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.559693  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.561502  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.501866  8496 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.545956  7329 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:25.563139  7327 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:25.542547  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.558444  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.564795  7334 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:25.546111  7085 rpcz_store.cc:276] 0709 13:13:23.429058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.431260 (+  2202us) service_pool.cc:224] Handling call
0709 13:13:25.422441 (+1991181us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:13:25.546373  7331 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:25.546638  7333 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:25.573998  8490 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.574592  8490 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.546838  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.547497  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.575847  7335 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:25.576705  8490 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.576866  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.577527  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1647) took 2082 ms. Trace:
W20260709 13:13:25.547837  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 117891us
I20260709 13:13:25.547657  7332 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:25.581964  8511 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:25.550820  8481 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:25.584939  8481 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.585322  8481 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.578421  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.551290  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.588006  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.552407  7888 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.594053  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.594619  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.588006  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.525717  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.530669  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.537317  8514 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.600958  7890 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:25.508627  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.563464  8496 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:25.545521  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.548178  7896 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.582472  8511 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.605351  8511 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.549808  7260 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:25.607753  8469 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:25.503326  8470 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.547920  7892 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.552510  8471 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.610826  8471 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.551913  7887 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.613022  7186 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:25.614810  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.611447  8514 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.615769  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.616472  7329 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:25.577924  7255 rpcz_store.cc:276] 0709 13:13:23.495058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.548184 (+2053126us) service_pool.cc:224] Handling call
0709 13:13:25.548480 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.576654 (+ 28174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:25.576683 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:25.576722 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:25.576752 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.577315 (+   563us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b5400216bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:25.577355 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.577473 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64372096}
I20260709 13:13:25.540248  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:25.618103  7254 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.618386  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.603394  7259 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:25.620638  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.623636  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.624634  8514 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.626322  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.627328  8478 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.629164  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.629746  7332 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:25.631767  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.632333  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:25.633116  8514 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:25.633591  8514 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.633955  8514 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.633998  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.640559  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.646266  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.649363  8481 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.650700  7894 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 2: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:25.651160  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:25.651505  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.652400  8356 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:25.652839  8356 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:25.653234  8356 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.505564  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:25.667418  8514 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.676888  8478 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.674825  8356 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.981741  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:25.983525  8356 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.671191  8470 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.388389  7187 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:25.689415  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.694376  8481 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:25.700654  8519 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.985469  8519 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.986024  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.987284  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.987686  8519 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.988361  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.989480  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.702543  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:25.925238  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 419720us
I20260709 13:13:25.704604  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.705369  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.006125  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:26.006410  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:26.007093  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.007632  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:26.008456  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.009521  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:26.009675  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.010128  7893 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:13:26.010533  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:25.705523  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.705641  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:25.706818  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 123588us
I20260709 13:13:26.012184  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.709163  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:25.709968  8479 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:25.856882  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.892913  8504 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:25.924474  8514 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:25.925122  8478 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:25.947041  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 295955us
I20260709 13:13:26.012269  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.019099  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.019505  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.019760  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.020156  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.020289  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.020578  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:25.858237  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:26.040921  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 182767us
I20260709 13:13:26.041077  8514 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:25.878674  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 246381us
I20260709 13:13:25.873579  7334 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.106845  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.108068  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.108670  7334 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:26.109439  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.110062  7334 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:25.995998  8497 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.110884  8497 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:25.970316  7336 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.005825  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:26.020747  7262 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.990535  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:26.115029  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 109282us
I20260709 13:13:26.021858  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.115797  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.116135  7182 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:26.116289  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.116904  7301 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.117036  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.117350  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.118011  7336 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:26.117995  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.020294  7261 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.022895  8478 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.115823  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.006153  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.023641  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.024223  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.120049  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.120800  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.120978  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.121230  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.122222  7179 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:26.122327  7183 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:26.122816  8516 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.024601  8479 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:26.123184  8516 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.123399  8479 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:26.123589  8516 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.120060  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.124308  8479 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.125666  8479 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:26.126359  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 84482us
I20260709 13:13:26.118148  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.130878  8414 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:26.127772  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:26.131412  8414 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.131796  8414 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.027652  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.130898  8470 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.133152  8470 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.133529  8470 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.134027  8525 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:26.134454  8525 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:26.134835  8525 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:26.135363  7185 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:26.136432  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:26.138078  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:25.703930  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.139261  8471 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:26.140187  8509 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.141968  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.142489  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.143464  8509 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.143837  8509 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:26.144186  8509 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.145408  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.146307  8512 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.146680  8512 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.147019  8512 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.148187  8414 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.150151  8414 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:26.150722  7261 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:26.151751  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:26.152667  7262 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:26.153788  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:25.652429  7332 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:26.041996  8514 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:26.158207  8514 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.158964  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.025449  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:13:26.026226  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 317131us
I20260709 13:13:26.172631  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:26.173473  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:26.173750  8519 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.174129  8479 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.174188  8519 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:26.174850  8519 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.175007  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.175761  8485 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.176105  8485 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.176453  8485 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.999711  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:26.015695  7895 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.179235  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.032711  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.027097  8356 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.183435  8356 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.183799  8356 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:26.184145  8356 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.076591  7329 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.187482  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.078914  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:26.188485  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 155855us
I20260709 13:13:26.189075  7330 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.190193  7862 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.081117  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.081974  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.082753  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.088105  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.112798  8497 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:26.192021  8519 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.110572  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.118889  8478 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.196605  8485 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:25.991370  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.198410  8519 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:26.131014  8466 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.199451  8466 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.199880  8466 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.201022  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.205768  8516 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.208135  8516 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:26.209178  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.209815  7261 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.210073  8478 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.211153  7329 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:26.214282  8478 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:26.215448  8514 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.216751  8466 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.217689  8514 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:26.153570  8470 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.153674  8512 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.155177  8509 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.045078  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.056780  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:26.219519  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 162821us
I20260709 13:13:26.220192  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.220458  8512 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:26.220549  8509 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:26.221077  8512 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.221287  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.221498  8512 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:26.221683  8509 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.221884  8512 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.222113  8509 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.161898  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.163657  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.222584  8509 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.164340  8510 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:26.223369  8510 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.223543  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.223773  8510 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.224135  7257 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.224781  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.163468  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.164615  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.162454  8408 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.228632  7255 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:26.166239  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.164350  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.230103  7332 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.167891  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.003002  7889 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.041347  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:25.998745  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:26.232824  8458 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:26.234105  8513 raft_consensus.cc:2764] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:13:26.235610  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 194330us
I20260709 13:13:26.238722  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:26.239534  8504 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:26.170545  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 145148us
I20260709 13:13:26.180151  8469 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:26.241878  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.242519  8469 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:26.242846  8534 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.243665  8534 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.243856  8469 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.246966  8510 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.249100  8510 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:26.250530  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:26.251915  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61788.7us
I20260709 13:13:26.252650  7862 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.253947  8497 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:26.255016  8495 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:26.255116  8532 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.255460  8495 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:26.256201  7257 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:26.077732  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.079630  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.222764  8414 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.222393  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.267323  8414 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.267619  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.174258  8481 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:26.268115  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 45801.2us
I20260709 13:13:26.268275  8481 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.268661  8481 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.269091  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.269886  8536 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.169407  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.270310  8536 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.256343  8495 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.271231  8495 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.271502  7328 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:26.273768  8478 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.274737  8510 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.179091  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.259056  8512 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.259398  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.259583  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.276387  7256 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.277732  8512 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:26.254447  8519 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:13:26.278684  7262 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.278966  8519 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:26.279358  8519 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:26.280222  8519 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.286121  7261 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:26.259820  8509 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.262277  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.299678  7253 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.302059  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.264149  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.265236  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.303494  7259 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.304726  8509 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:26.306941  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:26.307726  8504 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.308835  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.309563  8504 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:26.309937  8504 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.310273  8504 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.267804  8414 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.229493  8408 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.286584  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.253921  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:26.318473  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 64616.1us
I20260709 13:13:26.319417  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.287911  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.288246  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.180378  8479 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.289852  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.290835  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.321815  7862 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.261296  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.297721  7262 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:26.311482  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:26.317345  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48314.3us
I20260709 13:13:26.314182  7256 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
W20260709 13:13:26.320154  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 65627.6us
I20260709 13:13:26.315665  8536 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.324924  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.326082  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:26.327503  8532 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:26.326900  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 147743us
I20260709 13:13:26.315232  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.317426  8519 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.332172  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.318188  8485 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:26.319145  8408 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.355080  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.318692  8458 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:26.358788  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.358434  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:26.325100  8479 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.332346  8500 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:26.321272  8494 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.326418  8533 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.332959  8466 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:26.351246  8487 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.332801  8469 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.366942  7894 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.355690  8534 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:13:26.378788  8514 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:26.379140  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:26.379230  8514 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.321318  8356 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.397269  7894 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:26.398329  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:26.361028  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:26.402897  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:26.415169  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.418977  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 61151.5us
I20260709 13:13:26.399029  8514 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.389098  8534 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:26.420954  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65939.5us
I20260709 13:13:26.375316  7259 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:26.388830  8485 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.424062  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:26.425714  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.358414  8532 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:13:26.402500  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:26.442021  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.380620  8531 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.428336  7180 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.372813  8513 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:13:26.484756  8408 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.490062  7336 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.491521  8408 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:26.487218  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 150537us
I20260709 13:13:26.499621  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.426762  8534 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:26.506253  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:26.470332  8531 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:26.509405  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:26.513340  8541 raft_consensus.cc:2764] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:13:26.514384  8541 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.519085  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.510577  8534 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.515938  7253 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:26.549988  8490 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:26.508220  8531 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.508210  8470 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:26.551577  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 226700us
I20260709 13:13:26.556103  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:26.485898  8481 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.556241  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:26.569567  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.439544  8458 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.510725  8511 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:13:26.582599  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 73288us
I20260709 13:13:26.580968  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.541848  8537 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:13:26.585739  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:13:26.587217  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 77265.4us
I20260709 13:13:26.561664  7328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:26.581604  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:26.602025  8356 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:26.602255  7332 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:26.603684  8481 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:26.600826  8470 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:26.610612  8541 raft_consensus.cc:2764] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:13:26.633875  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48218.8us
W20260709 13:13:26.634068  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.610790  8540 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:13:26.634766  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:26.637627  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.638870  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.598326  7328 raft_consensus.cc:606] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:13:26.640082  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 59255.7us
I20260709 13:13:26.592959  8498 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:13:26.643779  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:26.601071  8511 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:13:26.642944  8513 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.640555  8496 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:26.645998  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.647617  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:26.610528  8543 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.655257  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:26.652077  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.657464  7301 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.650601  8487 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:26.648926  8513 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:13:26.676637  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 114941us
I20260709 13:13:26.680785  8546 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.664014  8470 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:26.686096  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:26.687526  7283 debug-util.cc:398] Leaking SignalData structure 0x7b0800131400 after lost signal to thread 6033
W20260709 13:13:26.689049  7283 debug-util.cc:398] Leaking SignalData structure 0x7b080009a5c0 after lost signal to thread 7119
W20260709 13:13:26.690733  7283 debug-util.cc:398] Leaking SignalData structure 0x7b080032d2e0 after lost signal to thread 7211
W20260709 13:13:26.691098  7283 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0300 after lost signal to thread 7212
W20260709 13:13:26.692428  7283 debug-util.cc:398] Leaking SignalData structure 0x7b0800352680 after lost signal to thread 7286
I20260709 13:13:26.695470  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.674903  8408 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.677805  8513 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.659148  8496 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.679466  8511 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:26.706072  8537 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:26.706200  8551 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.682022  8466 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:26.674157  8514 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.698491  8541 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.701978  8470 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:26.709144  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.710516  8511 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:13:26.720584  7283 debug-util.cc:398] Leaking SignalData structure 0x7b0800342f80 after lost signal to thread 7360
I20260709 13:13:26.714476  8546 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:26.720240  8466 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:26.737612  8491 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:26.744367  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 86966.4us
I20260709 13:13:26.730505  8496 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:26.746050  7301 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.748620  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:26.750284  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:26.751947  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 96807.8us
I20260709 13:13:26.752082  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.750180  8545 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:26.752683  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:26.753762  7150 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2278b8a74ae4c04882dae719a92af7d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.756999  8548 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.746647  8539 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:26.758994  7334 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:26.761127  8470 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.762795  8539 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.756067  8546 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.764757  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:26.763554  8506 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:26.771545  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.767549  7225 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:13:26.758070  7283 debug-util.cc:398] Leaking SignalData structure 0x7b0800329140 after lost signal to thread 7920
I20260709 13:13:26.776535  8550 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.782972  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.801792  8466 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.768536  8496 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.804349  7183 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:26.805475  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:26.773355  8548 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:26.812348  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:26.764207  8545 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:26.806967  8541 raft_consensus.cc:2764] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:13:26.813362  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.765164  8497 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:13:26.776427  8478 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:26.776032  8506 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:26.776494  7891 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.814769  8543 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:26.826020  7336 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.816376  7328 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.773082  8495 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:13:26.839279  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.823038  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:26.841071  7255 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.768684  8414 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.769083  8479 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.823475  8551 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:26.765336  8511 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.813129  8487 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.832695  8536 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.833048  8545 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.834192  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:26.820679  8525 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.000s
I20260709 13:13:26.857450  7332 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.854118  7255 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:26.816838  8532 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:13:26.843914  8552 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.858951  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:26.839053  8500 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:26.835623  8514 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:26.867369  7893 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.837031  8478 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:26.825573  8548 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:26.856737  8515 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:13:26.867686  8525 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.867357  8551 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:26.873903  8536 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:26.851104  8543 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:26.881210  7254 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:26.880645  8551 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.886180  7256 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:26.870678  8500 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:13:26.877689  8504 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.001s
I20260709 13:13:26.872852  8506 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.890019  8506 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:26.890405  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 69802.8us
I20260709 13:13:26.892119  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:26.879165  7327 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.881589  8511 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.896883  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:26.891359  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 190444us
I20260709 13:13:26.893067  8546 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:26.902560  8554 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:26.903033  8554 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:26.902951  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.904475  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:26.872623  8534 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.908514  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:26.909525  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.909875  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.910274  7260 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.911638  8513 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.916142  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.916615  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.919518  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.927688  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.928040  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.928890  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.930930  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.932334  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:26.933139  8559 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.932972  8478 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.933380  8543 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.892936  8504 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.934759  7896 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.908349  8546 raft_consensus.cc:2764] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:26.934155  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:26.939025  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:26.912550  8553 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.938575  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:26.942673  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.918972  8494 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:26.947244  7254 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:26.947413  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.949308  7257 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.943358  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:26.907931  8487 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:13:26.954277  7889 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:26.954365  8513 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:26.933854  8548 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.954200  8512 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:26.919179  8500 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.955030  8414 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:26.965029  8512 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:26.967145  7257 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:26.961632  8479 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:26.962603  8539 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:26.970206  8512 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.981806  7257 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:26.959769  8494 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:26.955685  8554 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:26.979002  8534 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:26.989028  7257 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:26.987226  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:26.980580  8525 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:26.980552  8500 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.998857  8554 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.005451  8494 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:27.007148  7257 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.015169  8504 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:27.018841  8519 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.019461  8519 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:27.020581  8519 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:27.022185  8519 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.024713  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:27.039932  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:27.040343  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:27.041795  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:27.042925  7328 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 2: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:27.046900  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.049584  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:27.050490  8491 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:27.051064  8491 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.014737  7180 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:27.053453  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:27.055282  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:27.029110  8531 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:27.040315  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:27.057103  8479 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.056825  8458 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.062670  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:27.063055  8533 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:27.076495  7152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.500s (SENT) [suppressed 1 similar messages]
I20260709 13:13:27.090356  8552 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:13:27.069372  7357 debug-util.cc:398] Leaking SignalData structure 0x7b08000bff80 after lost signal to thread 6033
I20260709 13:13:27.094166  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:27.064925  8516 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.091157  8552 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:27.096925  8479 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:27.100772  7357 debug-util.cc:398] Leaking SignalData structure 0x7b08001e95c0 after lost signal to thread 7119
I20260709 13:13:27.093619  8414 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:27.119577  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:27.121196  7328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:27.121485  8479 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:27.121905  7328 raft_consensus.cc:606] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:27.122989  8533 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.123025  8538 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:27.124245  8538 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:27.123493  8479 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:27.128958  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:27.129755  7334 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 2: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:13:27.130455  8544 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.469s	user 0.006s	sys 0.000s
I20260709 13:13:27.125119  8538 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:27.128321  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:27.134811  7357 debug-util.cc:398] Leaking SignalData structure 0x7b080035e220 after lost signal to thread 7211
I20260709 13:13:27.136534  7259 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:27.142155  7333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:27.143690  7333 raft_consensus.cc:606] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:27.147298  7253 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:27.148960  8458 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:27.152745  8533 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:27.154089  8533 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:27.154672  8533 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:27.126150  8414 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:27.158365  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.159294  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:27.159700  8538 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.153972  8458 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:27.186728  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:27.060835  8562 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.278s
I20260709 13:13:27.188176  8562 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.188638  8562 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:27.188982  7254 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.190387  7256 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:27.155675  8533 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:27.201813  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:27.206774  8547 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:27.207304  7893 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:27.186256  7357 debug-util.cc:398] Leaking SignalData structure 0x7b080035ea60 after lost signal to thread 7286
I20260709 13:13:27.218642  7256 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.219427  7332 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:27.221515  7896 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.224400  7333 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.226769  7328 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.226696  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:27.212637  7357 debug-util.cc:398] Leaking SignalData structure 0x7b080035ea80 after lost signal to thread 7287
I20260709 13:13:27.209847  8547 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:27.241122  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:27.249737  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.243847  7254 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.265480  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:27.268191  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:27.270396  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.271885  7180 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:27.262619  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:27.285259  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:27.135447  8552 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:27.244494  8533 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:27.351444  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 275067us
I20260709 13:13:27.353883  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.361212  7152 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.363077  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:27.364806  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.317588  7357 debug-util.cc:398] Leaking SignalData structure 0x7b08001ffe60 after lost signal to thread 7360
I20260709 13:13:27.370705  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.292840  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:27.281947  8458 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:13:27.375540  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.380622  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.381764  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:27.383014  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.383315  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:27.384616  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.386106  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.243396  8414 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:27.388669  7894 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:27.371502  7357 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4ae0 after lost signal to thread 7361
I20260709 13:13:27.369866  8519 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:27.400425  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 456553us
I20260709 13:13:27.373602  8511 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.406441  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.373184  8508 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:27.409377  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.409970  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.410391  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.410805  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.380158  8515 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.393649  8498 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.398860  8538 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.378924  8541 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 13:13:27.447432  8564 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:13:27.479463  8565 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:13:27.489224  7889 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.435774  8506 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.431249  8494 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.429188  8545 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:27.429945  7181 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:27.497149  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 106162us
I20260709 13:13:27.546893  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:27.547147  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 135624us
I20260709 13:13:27.376914  8547 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:27.502382  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 131796us
I20260709 13:13:27.432570  8559 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.408634  8542 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.435436  8569 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:27.521068  7357 debug-util.cc:398] Leaking SignalData structure 0x7b080034ebc0 after lost signal to thread 7920
I20260709 13:13:27.449268  8511 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:13:27.536847  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:27.560695  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 121369us
W20260709 13:13:27.562409  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.563357  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:27.558606  7357 debug-util.cc:398] Leaking SignalData structure 0x7b0800323aa0 after lost signal to thread 7921
I20260709 13:13:27.569798  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:27.541558  8498 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:13:27.577142  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:27.597362  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:27.555801  8490 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:13:27.598306  7254 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:27.551167  8545 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:27.557479  8538 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:13:27.571650  8458 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.599926  7256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:35332
I20260709 13:13:27.557950  8506 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:13:27.603972  7256 raft_consensus.cc:606] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:27.564986  8496 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:13:27.564636  8525 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:13:27.578402  8553 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:27.568634  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 125507us
W20260709 13:13:27.608310  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.597474  8471 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.578212  8513 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.610000  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:27.611366  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.572733  8547 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.600529  8569 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:27.608502  8487 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.582072  8494 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:13:27.622956  8470 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:27.617234  8531 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:27.643317  8569 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:27.654980  7186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:13:27.656859  7186 raft_consensus.cc:606] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:27.657229  7186 raft_consensus.cc:614] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:27.658325  8574 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:13:27.627208  8578 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:13:27.654677  8500 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.654s	user 0.013s	sys 0.000s
I20260709 13:13:27.671691  7327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:27.671978  8515 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.672397  7327 raft_consensus.cc:606] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:27.672909  8512 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:27.666337  8491 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.615s	user 0.004s	sys 0.008s
I20260709 13:13:27.678391  8556 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.680540  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:27.682888  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:27.685875  8562 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:27.687904  8562 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.700058  7896 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
W20260709 13:13:27.696842  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 128003us
I20260709 13:13:27.733958  8539 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:27.684142  8491 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:27.770673  7178 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:27.689291  8556 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:27.737480  8545 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:27.752707  8508 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.735595  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:27.697798  8471 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:27.760975  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.703612  7253 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:27.795393  8552 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.792889  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.780685  8545 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.771857  8539 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:27.807170  7889 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:27.838457  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:27.803622  8545 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:27.791239  8471 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:27.857546  8539 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:27.823803  8470 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:13:27.865315  7187 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:27.866195  7187 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:27.867028  7187 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:27.847178  8576 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.877530  8471 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:27.888696  7181 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:27.893095  8491 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:27.831039  8556 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:27.896219  8556 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.902901  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:27.916226  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:27.917095  7179 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:27.922786  7257 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.929523  7336 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.930605  7333 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.933470  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:27.946134  7332 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:27.946918  7335 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.949440  7331 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:27.925926  8356 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:27.968052  7334 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.929368  8533 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:27.871865  8545 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:27.970485  8458 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:27.974184  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:27.975602  8458 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:27.976305  7185 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:27.956210  8356 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:27.976958  7328 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:27.977727  8458 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:27.978056  8356 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:27.955950  8532 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:27.974480  8533 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:27.978912  8532 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:27.971280  8547 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.980227  7327 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:27.974946  8470 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:13:27.984370  8533 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:27.985384  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:27.988093  7186 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.991353  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:27.997100  8555 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:27.998320  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:27.999446  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:27.990521  8533 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:13:28.004071  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.991393  8356 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:28.002334  8555 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:28.003225  8547 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:28.030961  8547 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:28.031668  8547 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.032445  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:28.017961  8356 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.033124  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:27.997342  8542 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 13:13:28.033715  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.034204  7896 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:13:28.034296  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.035774  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.037966  7179 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:28.040560  7225 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:28.041148  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:28.042135  7179 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:28.043501  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:28.043913  7862 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:28.044945  7179 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:28.048684  7862 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:28.052121  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:28.052979  7179 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:28.016034  8555 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:28.039783  8498 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:28.006501  8533 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.065537  8498 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.079928  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:28.057467  8479 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:28.018610  8490 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:13:28.086303  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:28.088943  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.062904  8534 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:28.066037  8539 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:28.089769  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:28.051916  8458 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:13:28.103281  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.081554  8532 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:28.057543  8511 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:13:28.091948  8479 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:28.099025  8534 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:28.127301  8600 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:28.119518  8532 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:28.115844  8539 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:28.118676  8479 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.126463  8534 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.035118  8580 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:13:28.143518  8594 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:13:28.146813  8585 ts_tablet_manager.cc:933] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
I20260709 13:13:28.147344  7262 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:28.131207  8600 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.136143  8532 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:28.139722  8547 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:28.154371  8498 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:28.179896  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.162998  8356 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:28.164645  8519 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:28.150571  8578 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:13:28.169827  8532 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.187777  8595 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:13:28.191159  8578 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:28.191653  8578 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:28.161379  8594 consensus_queue.cc:1243] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:28.198297  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 70) took 1048 ms. Trace:
I20260709 13:13:28.182173  8498 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:28.165058  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 363596us
I20260709 13:13:28.182766  8519 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:28.198861  7178 rpcz_store.cc:276] 0709 13:13:27.150046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:27.150281 (+   235us) service_pool.cc:224] Handling call
0709 13:13:27.150603 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:27.771219 (+620616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.197959 (+426740us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b5400256a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:28.198206 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425386752}
I20260709 13:13:28.211313  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:28.209169  8587 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:13:28.201189  8595 consensus_queue.cc:1243] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:28.192579  8578 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.221397  8519 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.178365  8577 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.170s
I20260709 13:13:28.199630  8539 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.224722  8533 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:28.244108  8600 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:28.245465  8588 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:13:28.246212  8589 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:28.248598  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.222671  8586 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.257062  8513 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:28.257537  8513 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:28.265758  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:28.270362  8554 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:13:28.270980  8566 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.743s	user 0.004s	sys 0.004s
I20260709 13:13:28.271126  8538 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:28.271625  8494 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:28.271659  8538 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.281018  7892 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:28.276679  8494 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:28.279791  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:28.283833  8538 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:28.271005  8554 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.290509  7334 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:28.240685  8595 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:13:28.264492  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 60) took 1331 ms. Trace:
I20260709 13:13:28.299641  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:28.303020  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:28.281118  8586 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.287969  8577 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.287359  8543 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:13:28.319303  8471 raft_consensus.cc:993] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:28.319818  8471 raft_consensus.cc:1081] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:28.321707  7181 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:28.322127  7181 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:28.295660  7330 rpcz_store.cc:276] 0709 13:13:26.919412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.920633 (+  1221us) service_pool.cc:224] Handling call
0709 13:13:27.407713 (+487080us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b5800094b98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:13:27.435520 (+ 27807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:27.540685 (+105165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:27.541668 (+   983us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:27.603286 (+ 61618us) log.cc:844] Serialized 26 byte log entry
0709 13:13:28.039676 (+436390us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:28.050465 (+ 10789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.057132 (+  6667us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:28.246826 (+189694us) raft_consensus.cc:1685] finished
0709 13:13:28.248732 (+  1906us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.250591 (+  1859us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29283,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":6936320,"thread_start_us":393198,"threads_started":1,"wal-append.queue_time_us":462498}
I20260709 13:13:28.324852  7183 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:28.325240  7183 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:28.312139  8577 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:28.336838  8496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.038s	sys 0.121s
I20260709 13:13:28.341346  8575 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.337904  7183 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.341920  8575 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.349916  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.350440  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.347003  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:28.353899  7183 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.357774  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.359325  7262 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:28.357995  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.358280  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:28.312275  8494 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.365772  8494 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.330875  8577 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:28.329068  8479 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.372756  8554 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:28.344286  7181 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:28.341337  8496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.038s	sys 0.122s
I20260709 13:13:28.330817  8498 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:28.375577  7181 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:28.368432  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:28.382507  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:28.383464  7896 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:28.386583  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.388168  7185 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:28.389415  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:28.383210  8534 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:28.397397  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 307742us
W20260709 13:13:28.397843  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.358520  8586 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:28.376379  8577 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.409116  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.409601  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:28.410311  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.413717  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:28.380765  8504 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:28.398759  7327 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:28.419450  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.397459  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.399739  8534 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:28.427868  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.410830  7889 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:28.452562  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 54034.3us
I20260709 13:13:28.416146  8496 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:28.420707  8498 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:28.420567  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:28.479528  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:28.480160  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:28.482131  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 395886us
I20260709 13:13:28.488135  7333 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:13:28.490701  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 73742.3us
I20260709 13:13:28.411957  8577 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.480664  8575 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:28.495568  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:28.500866  7336 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:28.421423  8504 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:28.503894  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.428085  8555 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.481444  8496 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.484123  8498 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:28.522065  8498 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:28.455971  8554 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:13:28.504631  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 212586us
I20260709 13:13:28.502434  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:28.521404  8496 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:28.517447  8595 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:28.517325  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:28.497705  8533 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:13:28.527004  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:28.510289  8490 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:28.539494  8543 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:13:28.548391  7330 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:28.549041  8575 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.569918  8575 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.564386  8538 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.571666  8538 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.572049  8575 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:28.573757  8538 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:28.558748  8479 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:28.579376  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 285956us
I20260709 13:13:28.581429  7183 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.581913  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:28.582577  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:28.583137  7183 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.584892  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:28.585124  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.585706  7259 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:28.585888  8408 raft_consensus.cc:993] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:28.587292  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:28.588809  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:28.574541  8578 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.577013  8599 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:28.592108  8598 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:13:28.608657  7178 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:28.579679  8575 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.610837  7178 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:28.586227  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:28.554337  8595 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.599104  7891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:33196
W20260709 13:13:28.619096  8584 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:13:28.619819  8573 raft_consensus.cc:1081] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Signalling peer 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:28.592404  8512 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:13:28.599519  8408 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.617512  8534 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.627214  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:28.629673  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.575197  8490 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.628330  8546 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:28.614166  8585 tablet_copy_client.cc:323] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.129:44171
I20260709 13:13:28.645967  8408 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:28.654157  8603 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:13:28.612768  8586 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.671476  8586 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.671881  8408 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:28.673370  8555 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:28.673588  8586 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:28.592644  8608 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:28.628679  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:28.656339  7180 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
W20260709 13:13:28.660298  8601 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:13:28.607458  8458 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:13:28.662021  8479 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:28.663929  8546 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:28.664153  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.691061  7197 tablet_copy_service.cc:140] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Received BeginTabletCopySession request for tablet b2278b8a74ae4c04882dae719a92af7d from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:54396)
I20260709 13:13:28.691681  7197 tablet_copy_service.cc:161] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Beginning new tablet copy session on tablet b2278b8a74ae4c04882dae719a92af7d from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:54396: session id = 9a54ecc9fb4541df915f9f8c01e19429-b2278b8a74ae4c04882dae719a92af7d
I20260709 13:13:28.664050  8560 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:28.700313  8550 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.700678  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:28.694392  7257 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.704438  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:28.701287  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.700829  8550 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.675154  8577 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:28.618472  8575 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.707258  7253 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:28.709695  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:28.699904  8498 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.716280  8597 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.664316  8534 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.696357  8504 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:28.694927  7184 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:28.706243  8479 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:28.730439  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 56) took 1121 ms. Trace:
I20260709 13:13:28.718900  8597 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.725349  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:28.725485  8498 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:28.731356  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:28.707818  8560 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:28.712368  8586 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:28.745666  7225 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:28.746055  7183 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:28.747697  7862 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:28.751660  7183 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:28.731078  7261 rpcz_store.cc:276] 0709 13:13:27.602233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:27.602376 (+   143us) service_pool.cc:224] Handling call
0709 13:13:27.602716 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:27.830690 (+227974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:27.830721 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:27.831188 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:13:28.226529 (+395341us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:28.226602 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.229355 (+  2753us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:28.722840 (+493485us) raft_consensus.cc:1685] finished
0709 13:13:28.722869 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:28.723053 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23572,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":118,"thread_start_us":507666,"threads_started":2,"wal-append.queue_time_us":649333}
I20260709 13:13:28.733253  7891 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:28.744248  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:28.832861  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 87292.8us
W20260709 13:13:28.834841  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 87239.9us
I20260709 13:13:28.835902  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:28.856637  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 112443us
I20260709 13:13:28.832250  8546 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:28.865888  8563 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:13:28.867079  8550 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:28.834429  7891 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.868854  8509 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.869035  7184 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:28.869207  8555 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.870066  8604 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:13:28.870337  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:28.744195  8490 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:28.832032  8539 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:28.983048  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 85452.5us
I20260709 13:13:28.834210  8586 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:28.834219  8556 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:28.858537  8458 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:28.883240  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.883175  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:28.743866  8560 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:28.874133  8532 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.679s	user 0.013s	sys 0.000s
I20260709 13:13:28.874606  8408 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:28.737557  8479 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:28.962390  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.887787  8546 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.900266  8608 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:28.896050  8509 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:28.889027  8504 consensus_queue.cc:1175] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:13:28.985165  8577 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 13:13:29.041813  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.009897  8408 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.017942  8458 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:29.042124  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 73) took 1006 ms. Trace:
I20260709 13:13:29.051826  7186 rpcz_store.cc:276] 0709 13:13:28.036322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.036582 (+   260us) service_pool.cc:224] Handling call
0709 13:13:28.036882 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:28.045750 (+  8868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:28.045795 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:28.046370 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:13:28.298974 (+252604us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:28.299031 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.299124 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:29.041845 (+742721us) raft_consensus.cc:1685] finished
0709 13:13:29.041873 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:29.042046 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8395,"raft.queue_time_us":73799,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":11376,"thread_start_us":227617,"threads_started":1,"wal-append.queue_time_us":470609}
I20260709 13:13:29.034287  8490 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.039883  8608 raft_consensus.cc:697] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:29.009169  8532 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.053504  8408 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:28.983464  8555 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.054664  8458 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:29.056222  8494 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.059067  8597 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:29.074445  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 240680us
I20260709 13:13:29.089879  7893 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:29.090802  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:29.091111  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:29.091420  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:29.063388  8575 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.063545  8534 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.103585  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:29.119035  7261 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
W20260709 13:13:29.127358  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.128185  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.128648  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:29.087536  8458 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.137583  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:29.092724  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 236246us
I20260709 13:13:29.063135  8490 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.160591  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:29.161594  7334 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
W20260709 13:13:29.162952  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.125649  8506 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:29.136617  8534 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.135782  8599 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:29.137387  8511 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:29.092796  8494 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.219375  8586 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:29.188413  8588 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:13:29.253479  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 260) took 1200 ms. Trace:
I20260709 13:13:29.254200  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 261) took 1200 ms. Trace:
I20260709 13:13:29.283054  7896 rpcz_store.cc:276] 0709 13:13:28.053075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.054000 (+   925us) service_pool.cc:224] Handling call
0709 13:13:28.054201 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.384047 (+329846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.220242 (+836195us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54006c02d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:29.253369 (+ 33127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756669312}
I20260709 13:13:29.253489  7891 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.203272  8508 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.286808  8508 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:29.197199  8623 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.256561  7187 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.256770  8539 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.259259  8532 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:29.186414  8622 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:29.260785  8509 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:29.263319  8479 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.266484  8555 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:29.269966  8625 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.186558  8591 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.200033  8608 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.284340  7889 rpcz_store.cc:276] 0709 13:13:28.053354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.057333 (+  3979us) service_pool.cc:224] Handling call
0709 13:13:28.256020 (+198687us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:13:28.256232 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.483040 (+226808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.216321 (+733281us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54004c4854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:29.254146 (+ 37825us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326965248}
I20260709 13:13:29.288424  7887 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:29.202656  7181 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.823s	user 0.009s	sys 0.003s
I20260709 13:13:29.287880  8623 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:29.299642  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 162165us
I20260709 13:13:29.314702  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:29.317601  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:29.320044  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:29.314320  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:29.210180  8534 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.325181  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:29.291659  8584 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:29.323227  8479 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.336333  7331 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:29.370415  7225 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:29.372254  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:29.372538  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:29.372550  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:29.319103  8551 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.311522  8613 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.375586  7333 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:29.376017  7331 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 2: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:29.329618  7181 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:29.312057  8466 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:29.334126  8414 raft_consensus.cc:993] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:29.325948  8629 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.376168  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:29.375849  8584 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.329129  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:29.351812  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 476374us
I20260709 13:13:29.374451  8479 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.396867  8479 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.377352  8631 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:29.399410  8631 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:29.400305  8631 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.402472  8617 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:29.382332  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:29.383608  8613 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.405799  8613 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:29.406931  8616 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.352s	user 0.004s	sys 0.000s
I20260709 13:13:29.406661  8546 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:29.377795  8575 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:29.336615  8553 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:29.407485  8575 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.296473  8539 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.337090  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:29.386390  8630 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.387552  8534 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:29.389348  8578 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.001s
I20260709 13:13:29.389418  8408 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.390746  8466 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.393823  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:29.323064  8625 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.416802  8537 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.406405  8629 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.308983  8622 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.379873  8545 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.407893  8575 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.413368  7187 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260709 13:13:29.407948  8634 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.413122  8546 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 13:13:29.412303  8515 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:13:29.287902  8508 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:29.424871  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.446293  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.446815  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.408613  8584 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.426378  7182 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:29.428893  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:29.430276  7187 pending_rounds.cc:85] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 1
I20260709 13:13:29.421623  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1625) took 1512 ms. Trace:
I20260709 13:13:29.430401  8578 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:29.444588  7329 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:29.433988  7890 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:29.435698  8466 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:29.413419  7328 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:29.414419  8414 raft_consensus.cc:1081] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:29.380853  8551 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.461203  8599 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.413488  8630 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.385121  8586 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:13:29.465795  7896 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:29.432888  7888 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:29.433264  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:29.322850  8591 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.448755  7187 pending_rounds.cc:107] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:13:29.472738  7187 raft_consensus.cc:2917] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:13:29.431468  8634 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:29.419090  8537 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.407636  8553 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.464246  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:29.416144  8458 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.473166  7187 raft_consensus.cc:2889] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:29.476634  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:29.474050  8587 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:29.475296  8496 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.920s	user 0.007s	sys 0.006s
I20260709 13:13:29.479303  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:29.481177  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54386 (request call id 9) took 3558 ms. Trace:
I20260709 13:13:29.465812  8498 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.462380  8578 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.465058  8599 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.487501  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:29.479964  8511 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:29.483413  7187 rpcz_store.cc:276] 0709 13:13:25.920300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.133401 (+213101us) service_pool.cc:224] Handling call
0709 13:13:26.159475 (+ 26074us) log.cc:844] Serialized 506 byte log entry
0709 13:13:26.811378 (+651903us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5400149ea0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91bcb26 00007fece91b649a 00007fece91b5714 00007fece9195eaa 00007fece919cd53 00007fece919ccd9 00007fece919cc69 00007fece919cc31 00007fece919bdfd 000000000038f354
0709 13:13:29.478821 (+2667443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15135,"raft.queue_time_us":31790,"raft.run_cpu_time_us":6721,"raft.run_wall_time_us":561532,"spinlock_wait_cycles":9502080,"thread_start_us":123739,"threads_started":1,"wal-append.queue_time_us":28191,"wal-append.run_cpu_time_us":2016,"wal-append.run_wall_time_us":1181980}
I20260709 13:13:29.488240  8506 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:29.488451  8625 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.451690  7181 rpcz_store.cc:276] 0709 13:13:27.901501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:27.903614 (+  2113us) service_pool.cc:224] Handling call
0709 13:13:27.903959 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.321606 (+417647us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540014dfa0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece923e1c0 00007fece923f231 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c
0709 13:13:29.382765 (+1061159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.414040 (+ 31275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257438976}
I20260709 13:13:29.506808  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1617) took 1642 ms. Trace:
I20260709 13:13:29.507148  7187 rpcz_store.cc:276] 0709 13:13:27.864776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:27.864917 (+   141us) service_pool.cc:224] Handling call
0709 13:13:27.865189 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.269770 (+404581us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b58005600d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91980aa 00007fece921a447 00007fece9232fe7 00007fece92347de 00007fece923eb49 00007fece923f416 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4
0709 13:13:29.219802 (+950032us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400149ea0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b1a1d 00007fece91981a4 00007fece921a447 00007fece9232fe7 00007fece92347de 00007fece923eb49 00007fece923f416 00007fece923bd8f 00007fece923b83e 00007fecee200419
0709 13:13:29.506547 (+286745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.506760 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208882944}
I20260709 13:13:29.497221  7889 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:29.485451  8496 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.487051  8498 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.505846  8511 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:29.499823  8639 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:29.508668  8623 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.517937  7260 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:29.482890  8634 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.520147  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:29.519383  7133 auto_rebalancer.cc:629] Failed to schedule move for tablet b2278b8a74ae4c04882dae719a92af7d: Aborted: Op aborted by new leader
I20260709 13:13:29.524917  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:29.513305  8551 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:29.516714  8539 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.515920  8639 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.516690  8408 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:29.539314  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.543249  8496 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.545281  8578 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.547561  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:29.554031  8599 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.556063  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:29.556787  7328 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
W20260709 13:13:29.557701  8632 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:13:29.547119  8629 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:29.554500  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:29.559823  8498 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.491520  8587 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.549717  7262 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.520147  8634 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.562191  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:29.553604  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:29.562976  8553 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:29.563199  7890 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:29.563546  8553 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:29.563880  8553 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.525157  8547 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:29.526676  8511 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.564222  8553 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.566025  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:29.568866  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.526490  8638 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.548393  8591 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:29.522193  8622 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:29.572852  8537 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:29.551234  8639 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.528270  8630 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.579856  8587 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:29.600941  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:29.592634  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:29.608609  8519 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.573769  8511 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.590837  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1036) took 1240 ms. Trace:
I20260709 13:13:29.579268  8638 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.572248  8547 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.629010  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.629583  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.629879  7181 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:29.630239  7180 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:29.631189  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.631440  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.632030  7187 raft_consensus.cc:2410] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:29.617551  8576 raft_consensus.cc:993] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:29.640349  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 267) took 1136 ms. Trace:
I20260709 13:13:29.645314  7893 rpcz_store.cc:276] 0709 13:13:28.504283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.507439 (+  3156us) service_pool.cc:224] Handling call
0709 13:13:28.507841 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:29.090336 (+582495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.640018 (+549682us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b5400582ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:29.640257 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338065280}
I20260709 13:13:29.623486  8580 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.622148  8595 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.592793  8458 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:29.610868  7330 rpcz_store.cc:276] 0709 13:13:28.332902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.341574 (+  8672us) service_pool.cc:224] Handling call
0709 13:13:28.342077 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.572646 (+230569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.566675 (+994029us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54000e10d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:29.573419 (+  6744us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450509696}
I20260709 13:13:29.702044  8543 raft_consensus.cc:1081] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer 9a54ecc9fb4541df915f9f8c01e19429 to start an election
W20260709 13:13:29.734871  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.728739  8587 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.755290  8587 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.756075  8513 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.757460  8513 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.762907  8630 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.779044  8630 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:29.777137  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.712113  8580 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.782003  8623 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.782575  8623 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.782846  8575 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.788969  8458 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.789186  8531 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.789628  8458 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.789776  8531 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.791963  8531 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.792454  8531 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:29.792618  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1178) took 1461 ms. Trace:
I20260709 13:13:29.792930  8458 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.793114  7185 rpcz_store.cc:276] 0709 13:13:28.331721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.625649 (+293928us) service_pool.cc:224] Handling call
0709 13:13:29.791879 (+1166230us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:13:29.792085 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:29.792273 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:29.792301 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:29.792350 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:29.792383 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.792446 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:29.792566 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9410816}
I20260709 13:13:29.807044  8560 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.792984  8531 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.841077  8623 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:29.841934  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.848300  8633 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.848934  8633 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.849401  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.850245  7183 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
W20260709 13:13:29.851536  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.852245  7183 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.857625  7330 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:29.857772  8519 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:29.858013  8545 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.832974  8587 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:29.859122  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.859386  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:29.858392  8519 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.870244  8515 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.868323  8545 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.880321  8545 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.873447  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.872833  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.886138  8494 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.870559  8519 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:29.872051  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.887580  7181 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:29.888754  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:29.889479  7181 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.871435  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.891145  7891 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.891449  7184 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:29.891710  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:33196 (request call id 404) took 1308 ms. Trace:
I20260709 13:13:29.892163  7891 rpcz_store.cc:276] 0709 13:13:28.583438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.586287 (+  2849us) service_pool.cc:224] Handling call
0709 13:13:29.789230 (+1202943us) spinlock_profiling.cc:243] Waited 89.8 ms on lock 0x7b5400521f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9233a3d 00007fecee203cd0 00007fece7788254 00007fece77881e2 00007fece7788111 00007fece778808c 00007fece7787342 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:29.891618 (+102388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206576384}
I20260709 13:13:29.896767  8356 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:29.875887  7183 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:29.897927  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.897372  8356 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:29.897605  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.901810  7185 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:29.901949  8356 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.870895  8515 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.903539  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1765) took 1211 ms. Trace:
I20260709 13:13:29.882447  7186 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:29.907883  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:29.908716  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:29.916088  7180 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:29.917050  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:29.919076  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.920516  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:29.923974  7186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:13:29.872524  8631 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:29.894065  8630 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.894959  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:29.945690  8638 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.906520  7260 rpcz_store.cc:276] 0709 13:13:28.691842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.694753 (+  2911us) service_pool.cc:224] Handling call
0709 13:13:28.713076 (+ 18323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:29.522715 (+809639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.903357 (+380642us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54002166d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:29.903495 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850337024}
I20260709 13:13:29.949311  7261 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:29.900540  8513 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:29.952853  8575 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.957578  8531 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:29.942590  8487 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.929077  8511 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:29.961352  8584 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.006s
I20260709 13:13:29.929970  7256 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:29.947081  8356 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.905001  8633 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:29.947954  8562 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:29.933807  8504 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:13:29.946066  8631 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:29.961766  8584 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.962067  8582 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:13:29.962857  8513 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:29.984759  8514 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:13:29.984997  8470 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:13:29.985850  8562 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:29.992586  8612 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:13:29.985409  8553 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:30.030745  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.035969  7184 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:30.064028  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.063704  8562 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.055186  8508 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:30.064934  7150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.009s	sys 0.046s
W20260709 13:13:30.065259  7150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.009s	sys 0.046s
W20260709 13:13:30.065805  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 578326us
I20260709 13:13:30.065938  8553 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:30.045864  8639 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.050662  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:30.067620  7180 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
W20260709 13:13:30.033394  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.069365  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:30.069360  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:30.048838  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 141034us
I20260709 13:13:30.073347  7862 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:30.074777  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:30.032572  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:30.079247  7187 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:30.073907  8504 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:30.080525  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:30.082566  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:30.028311  8584 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.085196  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:30.087316  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:30.044662  8631 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:30.068722  8487 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:30.090113  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.085386  7150 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:30.090794  7262 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:30.095655  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:30.087775  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.097087  7260 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:30.087879  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.097649  7255 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:30.096925  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:30.099565  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:30.100842  7862 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:30.072111  8356 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.083425  8618 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:30.087966  7187 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:30.082827  8531 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.110569  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1179) took 1778 ms. Trace:
I20260709 13:13:30.121034  7178 rpcz_store.cc:276] 0709 13:13:28.332076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.643735 (+311659us) service_pool.cc:224] Handling call
0709 13:13:28.644053 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.680386 (+ 36333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:28.680420 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:28.680465 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:28.680509 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.110330 (+1429821us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b540039cbd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:30.110377 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:30.110507 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82979200}
I20260709 13:13:30.103116  8496 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.101830  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.085134  8513 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:30.115842  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.116569  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:30.120417  7257 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:30.123704  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:30.131698  7262 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.102427  8633 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:30.110944  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:30.122890  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:30.102121  8575 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.124161  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1176) took 1794 ms. Trace:
I20260709 13:13:30.111723  8630 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:30.111322  8560 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:30.106594  8625 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.137027  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:30.124764  8494 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.127990  8584 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:30.124347  8514 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.114794  8618 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:30.122524  8531 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.141955  8515 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.136443  8612 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.136090  8487 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:30.142977  7179 rpcz_store.cc:276] 0709 13:13:28.329598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.123402 (+1793804us) service_pool.cc:224] Handling call
0709 13:13:30.123732 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.123888 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:30.123910 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:30.123947 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:30.123972 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.124020 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:30.124109 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:30.127216  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.124534  8496 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.127475  7891 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:30.116103  8593 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:30.146497  8631 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.131812  8512 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:30.140213  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:30.149237  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.146271  8575 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:30.168361  7253 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:30.168888  8575 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.169605  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:30.170816  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.170698  8548 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:30.151307  8625 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.171809  8625 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.171933  8548 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.172044  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.172456  8548 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:30.173352  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.173295  8548 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.174014  7253 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
W20260709 13:13:30.154034  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.175244  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.176433  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.176761  8513 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:30.177280  7253 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:30.154277  7892 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:33196
I20260709 13:13:30.154397  8633 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.155638  8618 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.180174  8633 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.116466  8638 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:30.161715  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:30.187666  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:30.141947  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.188727  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:30.166604  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:30.190722  7187 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:30.191560  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:30.189538  7179 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:30.194783  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:30.196231  7179 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:30.197265  7262 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:30.195372  7187 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:30.198547  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.199095  7187 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:30.199447  7262 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
W20260709 13:13:30.204089  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.162176  8569 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:13:30.208292  8569 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:30.208766  8569 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:30.127650  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:30.210752  8591 raft_consensus.cc:3055] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.147912  8645 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.211184  8591 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:30.211436  8645 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:30.211833  8645 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.212074  8591 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.213505  8591 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.213716  7260 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:30.217033  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:30.218469  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:30.219364  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:30.219606  8547 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.219756  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:30.220127  8631 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:30.220422  8547 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.221055  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:30.164366  8543 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:13:30.223560  8580 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.223950  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:30.225055  8580 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:30.154345  8494 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.155820  8531 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.162955  8593 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.164815  8512 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.136166  8504 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:30.227487  8511 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:30.156203  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.146828  8630 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:30.228243  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:30.263700  7895 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.158996  7258 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:13:30.228464  8560 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:30.161473  8639 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.235743  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:30.236544  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:30.178443  7892 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.242508  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.174554  8548 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.243078  7082 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47542 (request call id 230) took 2843 ms. Trace:
I20260709 13:13:30.209776  8569 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.228488  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:30.246130  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:30.247659  7893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:33196
I20260709 13:13:30.223877  7197 tablet_copy_source_session.cc:215] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:30.343614  7893 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.344161  7893 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.248518  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.254179  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:30.161079  8496 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.323753  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.155764  8490 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.220557  8631 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:30.276497  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:30.281783  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 46187.7us
I20260709 13:13:30.255082  8511 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:30.253279  8546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.023s	sys 0.033s
I20260709 13:13:30.351660  7333 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:30.290593  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.352309  7150 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:30.177335  8513 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.241346  8597 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:30.355660  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.244848  8608 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.229185  8638 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.360833  8638 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.361606  8608 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:30.239172  7181 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:30.252455  8618 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.267444  8630 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.155454  8514 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.157444  8612 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.157977  8487 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.267812  8580 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:30.221123  8547 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.336514  7082 rpcz_store.cc:276] 0709 13:13:27.399306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:27.399456 (+   150us) service_pool.cc:224] Handling call
0709 13:13:30.242977 (+2843521us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":5}
I20260709 13:13:30.320887  8504 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:30.293179  8584 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:30.321322  7892 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.341423  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.323130  7186 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.362452  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.291356  8560 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:30.353279  8546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.023s	sys 0.033s
I20260709 13:13:30.353439  8511 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.363008  7327 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:30.364778  7328 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:30.370443  8512 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:30.371013  7197 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:54396 (request call id 87) took 1694 ms. Trace:
I20260709 13:13:30.371206  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:30.373536  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.379069  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.378031  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.382079  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 69) took 1070 ms. Trace:
I20260709 13:13:30.388132  8513 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:30.389067  7260 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:30.389326  7180 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:30.392630  7261 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:30.392565  7893 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.396938  8494 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.397173  8556 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:30.443670  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:30.414309  8608 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.403478  7895 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:30.404239  8510 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:30.404919  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.407508  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:30.354374  8631 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.357406  8633 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.357246  8515 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:30.412024  7182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1170) took 2132 ms (client timeout 2106 ms). Trace:
I20260709 13:13:30.465322  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.467612  7331 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
W20260709 13:13:30.416965  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 178071us
I20260709 13:13:30.363368  8625 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.409628  8508 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:30.423981  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.427138  7186 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.428853  8593 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.431105  8612 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:30.433143  8514 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:30.367933  8597 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.433745  7336 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:30.458444  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.500257  7333 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:30.347102  8623 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.450244  7334 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:30.450673  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.455276  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:30.455550  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:30.454677  7893 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.449822  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:30.504971  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49770.6us
I20260709 13:13:30.505431  7335 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:30.447431  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.439509  7184 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:30.366092  8569 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.468621  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.440296  8487 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.442502  8547 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:30.450059  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:30.444366  8618 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:30.467424  7182 rpcz_store.cc:269] 0709 13:13:28.276571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.279333 (+  2762us) service_pool.cc:224] Handling call
0709 13:13:30.408806 (+2129473us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001b3fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:30.408891 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2595122560}
I20260709 13:13:30.448060  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:30.442538  8560 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.458129  8556 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:30.534375  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.462582  8634 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.464840  8512 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.543431  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.543784  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.544170  7327 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:30.545135  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.512035  8494 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.450342  8626 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:13:30.448413  7197 rpcz_store.cc:276] 0709 13:13:28.676415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.677704 (+  1289us) service_pool.cc:224] Handling call
0709 13:13:30.223524 (+1545820us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b5400247054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92463f7 00007fecee1dc036 00007fecee1e5a3e 00007fece5aa927b 00007fecee1e59ba 00007fecee1e0acc 00007fecee1dbc7b 00007fecee1d08d1 00007feced2844b4 00007feced284442
0709 13:13:30.369030 (+145506us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799012224}
I20260709 13:13:30.506037  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:30.508756  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:30.479118  8591 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:30.563062  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 57151.7us
I20260709 13:13:30.563539  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.563805  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:30.514987  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:30.564272  7256 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:30.564742  7333 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.507237  8612 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:30.465119  8575 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.514145  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.567008  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:30.519381  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 331836us
I20260709 13:13:30.515726  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.519676  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:30.521502  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.568887  7335 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.517773  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.466849  8582 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:13:30.525763  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 54537.5us
I20260709 13:13:30.526678  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.527346  7890 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:30.442934  8580 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.576683  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.530298  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.577723  7331 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:30.481236  8515 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.537675  7181 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.541056  7892 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.543555  8512 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.465981  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.434607  8645 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.545399  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:30.498085  8508 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.568303  7150 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:30.625690  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 57481.2us
I20260709 13:13:30.626593  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:30.628005  7150 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:30.546259  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:30.576259  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:30.582435  7186 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.558439  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:30.587838  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 168747us
I20260709 13:13:30.588230  7335 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:30.519348  8623 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.593044  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:30.595516  7332 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:30.598826  7262 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:30.567019  8633 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.636976  7253 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:30.603289  8512 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.607475  7257 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.571332  8547 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.655181  7895 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:30.656636  8652 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:13:30.655576  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:30.658213  8653 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:30.658737  8547 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.659365  8547 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.624478  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:30.638056  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.569888  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.653393  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:30.644513  7186 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.677517  7894 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 2: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:30.571147  8591 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:30.678789  7183 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:30.650982  8519 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:30.701313  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 108395us
I20260709 13:13:30.709534  7893 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:30.640621  8584 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.635737  8490 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.604701  8638 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
W20260709 13:13:30.712474  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.604338  8560 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:13:30.663138  7327 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.591073  8531 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.687507  8519 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.648782  7892 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.638166  7150 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:30.677735  8545 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:30.684477  7889 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:30.711922  8546 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:30.713899  7256 raft_consensus.cc:3055] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:13:30.739866  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.750800  7256 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:30.450054  7259 rpcz_store.cc:276] 0709 13:13:29.311592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.319038 (+  7446us) service_pool.cc:224] Handling call
0709 13:13:29.377691 (+ 58653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:29.466940 (+ 89249us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:29.515051 (+ 48111us) log.cc:844] Serialized 14 byte log entry
0709 13:13:30.070910 (+555859us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:30.070964 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:30.071012 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.381781 (+310769us) spinlock_profiling.cc:243] Waited 79.4 ms on lock 0x7b54002d3a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:30.381843 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:30.382013 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71207,"prepare.queue_time_us":78527,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1157,"raft.queue_time_us":79725,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":182603136,"thread_start_us":495895,"threads_started":2,"wal-append.queue_time_us":589250}
I20260709 13:13:30.713366  8584 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.742110  8519 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:30.767951  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 360489us
I20260709 13:13:30.755208  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.689728  8494 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:13:30.754175  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:30.771714  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 303150us
I20260709 13:13:30.738194  8625 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.763700  7256 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:30.766893  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 298621us
I20260709 13:13:30.770236  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:30.771029  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 132934us
I20260709 13:13:30.770095  8584 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.772857  7253 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
W20260709 13:13:30.782650  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 127115us
I20260709 13:13:30.738610  8597 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:30.742015  8545 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:30.629222  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 173736us
W20260709 13:13:30.760737  8658 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:13:30.777616  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:30.778715  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:30.780942  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:30.756600  8490 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.785454  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:30.783593  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:30.802060  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:30.799700  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:30.804322  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:30.816123  7225 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:30.730561  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 287717us
W20260709 13:13:30.799422  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 136331us
I20260709 13:13:30.756618  8562 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:13:30.818333  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:30.782864  8662 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.840633  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.837725  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.796473  8545 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:30.819020  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 43868.5us
I20260709 13:13:30.851438  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:30.799867  7891 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:30.861016  7334 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:30.795789  7257 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:30.774480  8667 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.794921  8546 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:30.864774  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:30.783960  8508 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:30.804463  8597 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.811209  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:30.808019  8638 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:30.873283  7333 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
W20260709 13:13:30.866204  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 45454.3us
I20260709 13:13:30.807821  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:30.877139  7336 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.883404  7336 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:30.852702  8513 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:30.892215  7333 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:30.858942  8651 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:30.894970  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:30.931408  7333 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:30.864171  8575 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.860512  8661 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.874112  8667 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.864339  8490 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:30.919642  7336 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:30.871155  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:31.134430  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:31.145973  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:30.881390  8638 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:31.002246  8591 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.962054  8667 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.084125  8546 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:13:31.085289  8680 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:13:30.960970  8661 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.931638  8515 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.882220  8597 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.134297  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:31.212563  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 78413.2us
W20260709 13:13:31.213984  7225 consensus_peers.cc:597] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 242a63190870450082200759c7f513ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:31.122409  8585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2278b8a74ae4c04882dae719a92af7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:31.127301  8633 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:31.219151  7333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06475a21ebc249129fc41345c177538a"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:31.219797  7333 raft_consensus.cc:606] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:31.216090  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:31.221925  7895 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:31.225705  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.227872  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:31.229979  7893 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:31.117303  8666 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:13:31.080772  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:31.096481  8639 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.011142  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:31.123716  8512 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:31.241225  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:31.209010  8546 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.082263  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:31.128410  8663 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.365s	user 0.000s	sys 0.010s
I20260709 13:13:31.209245  8661 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:31.065104  8569 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.003s
I20260709 13:13:30.881069  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:31.077529  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:31.236478  8662 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.138550  8679 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:13:30.958818  8659 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:13:30.799798  8556 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:31.046763  8660 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:13:31.053426  8531 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.885738  8508 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:31.249722  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:31.274535  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 456243us
I20260709 13:13:31.274600  7257 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:31.002020  8645 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:30.878311  8678 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:31.273319  8584 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:31.302887  8546 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:31.267194  8519 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:31.307680  8519 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:31.309857  7330 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:31.311870  8519 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:31.068755  8656 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:13:31.119412  8608 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.625s	user 0.004s	sys 0.005s
I20260709 13:13:31.313007  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:31.118299  8630 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.000s
I20260709 13:13:31.313503  8656 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:31.313706  8630 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:31.314306  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:31.315414  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:31.315896  8630 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:31.316002  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:31.071858  8665 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:13:31.316349  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:31.005995  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1756) took 2392 ms. Trace:
I20260709 13:13:31.134032  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:31.083580  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:31.317406  8634 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:31.095367  8513 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:31.318082  8634 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.316928  7254 rpcz_store.cc:276] 0709 13:13:28.608036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.609162 (+  1126us) service_pool.cc:224] Handling call
0709 13:13:28.609487 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:28.612883 (+  3396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:28.612915 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:28.635419 (+ 22504us) log.cc:844] Serialized 26 byte log entry
0709 13:13:30.243882 (+1608463us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b180012cdc0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:13:30.455491 (+211609us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:30.455544 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.455663 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:30.977881 (+522218us) raft_consensus.cc:1685] finished
0709 13:13:30.977911 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:31.000574 (+ 22663us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3030,"raft.queue_time_us":4641,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":21663,"spinlock_wait_cycles":37619456,"thread_start_us":211448,"threads_started":1,"wal-append.queue_time_us":1925888}
I20260709 13:13:31.314430  8656 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:31.318778  8513 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:31.319773  8656 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.046099  8494 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:31.324527  8494 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:31.324960  8494 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.325484  8562 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:31.133258  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:31.201599  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 401956us
I20260709 13:13:31.327622  7185 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:31.317135  7179 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:13:31.205170  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 318562us
I20260709 13:13:31.328806  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:31.329339  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:31.209435  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 346121us
I20260709 13:13:31.234764  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:31.240002  8672 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:31.241080  7184 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.007050  8623 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:31.218894  8597 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.234576  8504 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:31.251262  7329 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.342136  7329 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:31.252805  8685 raft_consensus.cc:993] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:31.343752  8470 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.344494  8471 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:31.344868  8672 raft_consensus.cc:1081] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:31.345240  8470 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:31.345690  8470 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:31.345964  8471 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:31.346326  8471 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:31.346532  8470 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:31.347150  8471 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:31.347738  8470 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.348311  8471 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:31.253386  7181 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.649s	user 0.015s	sys 0.001s
I20260709 13:13:31.218760  8633 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:31.256057  7335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:31.236083  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:31.244892  8639 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:31.250031  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:31.268625  8679 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:31.265211  8674 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:13:31.268389  8662 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:31.280015  8626 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.274712  8508 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.280709  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:31.283053  8673 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.271s	user 0.000s	sys 0.003s
I20260709 13:13:31.283206  8661 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:31.242437  8560 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:13:31.290262  8667 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:31.290978  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:31.295770  8547 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.000s
W20260709 13:13:31.267779  7327 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.000s
I20260709 13:13:31.268535  8496 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:13:31.296872  7259 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:31.297303  8512 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:31.312786  8608 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:31.095317  8651 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:13:30.943054  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 65936.3us
I20260709 13:13:30.868855  8511 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:31.139405  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1772) took 1006 ms. Trace:
I20260709 13:13:31.321727  7254 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:31.322538  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:31.322695  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:31.322980  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:31.204985  8638 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.330806  7333 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.330823  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:31.397868  7262 rpcz_store.cc:276] 0709 13:13:30.132956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.200358 (+ 67402us) service_pool.cc:224] Handling call
0709 13:13:30.263276 (+ 62918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.663957 (+400681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.139077 (+475120us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400217ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:31.139319 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771254144}
I20260709 13:13:31.330821  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:31.381206  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:31.401187  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 70443us
I20260709 13:13:31.342468  8504 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:31.358508  7335 raft_consensus.cc:606] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:31.359508  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 417) took 1135 ms. Trace:
I20260709 13:13:31.359642  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 313) took 1177 ms. Trace:
I20260709 13:13:31.553490  7891 rpcz_store.cc:276] 0709 13:13:30.182540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.203626 (+ 21086us) service_pool.cc:224] Handling call
0709 13:13:31.359345 (+1155719us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54006608d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:31.359536 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946393472}
I20260709 13:13:31.554019  8504 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:31.556434  7256 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.328284  7150 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:32.648619  7184 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.302s	user 0.014s	sys 0.013s
I20260709 13:13:32.649339  7184 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:31.330013  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:32.856184  7185 raft_consensus.cc:2368] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3.
I20260709 13:13:32.854835  8720 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:31.379072  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:32.867657  8496 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:32.868201  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 1.48897e+06us
W20260709 13:13:31.402850  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 80398us
I20260709 13:13:31.330473  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:32.873389  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:32.874145  7179 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:31.368045  7253 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.807415  7256 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:32.885138  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 81) took 2368 ms. Trace:
I20260709 13:13:32.885493  7256 rpcz_store.cc:276] 0709 13:13:30.516547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.565119 (+ 48572us) service_pool.cc:224] Handling call
0709 13:13:30.565466 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.713761 (+148295us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b5400316620. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece923e1c0 00007fece923f231 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c
0709 13:13:31.403862 (+690101us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b58001484d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91980aa 00007fece921a447 00007fece9232fe7 00007fece92347de 00007fece923eb49 00007fece923f416 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4
0709 13:13:32.884555 (+1480693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.884954 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991535616}
I20260709 13:13:31.398891  7257 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.831748  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1798) took 1397 ms. Trace:
I20260709 13:13:31.363076  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:32.906497  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 1.54327e+06us
I20260709 13:13:32.905282  7258 rpcz_store.cc:276] 0709 13:13:30.429688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.447933 (+ 18245us) service_pool.cc:224] Handling call
0709 13:13:30.448389 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:30.494873 (+ 46484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:30.496959 (+  2086us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:30.528139 (+ 31180us) log.cc:844] Serialized 26 byte log entry
0709 13:13:30.791005 (+262866us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:30.798747 (+  7742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.808063 (+  9316us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:31.282516 (+474453us) spinlock_profiling.cc:243] Waited 969 us on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:13:31.799378 (+516862us) raft_consensus.cc:1685] finished
0709 13:13:31.803337 (+  3959us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:31.827222 (+ 23885us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49050,"raft.queue_time_us":33320,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":11770,"spinlock_wait_cycles":2227968,"thread_start_us":245931,"threads_started":1,"wal-append.queue_time_us":359582,"wal-append.run_cpu_time_us":7899,"wal-append.run_wall_time_us":1906447}
W20260709 13:13:31.412458  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 81705.3us
I20260709 13:13:31.382735  7327 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:32.916313  7257 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
W20260709 13:13:32.917117  7257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 964) took 1594 ms (client timeout 1619 ms). Trace:
W20260709 13:13:32.917598  7257 rpcz_store.cc:269] 0709 13:13:31.322310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.322442 (+   132us) service_pool.cc:224] Handling call
0709 13:13:32.916983 (+1594541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:31.373903  7328 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.919567  7253 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
W20260709 13:13:32.920588  7253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 961) took 1692 ms (client timeout 2089 ms). Trace:
W20260709 13:13:32.921047  7253 rpcz_store.cc:269] 0709 13:13:31.227766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.233409 (+  5643us) service_pool.cc:224] Handling call
0709 13:13:32.920480 (+1687071us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:32.922706  8721 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:32.923560  8721 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:31.797719  7330 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 2: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:32.031446  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:32.916522  7327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1062) took 2521 ms (client timeout 2149 ms). Trace:
W20260709 13:13:32.930007  7327 rpcz_store.cc:269] 0709 13:13:30.394728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.546017 (+151289us) service_pool.cc:224] Handling call
0709 13:13:32.916275 (+2370258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:32.930413  7331 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.931768  8691 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:31.593925  7333 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:32.935395  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 92) took 1701 ms. Trace:
I20260709 13:13:32.935799  7333 rpcz_store.cc:276] 0709 13:13:31.233833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.234433 (+   600us) service_pool.cc:224] Handling call
0709 13:13:32.935194 (+1700761us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:31.317193  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:31.800598  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 243937us
I20260709 13:13:32.941493  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:31.373133  7887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06475a21ebc249129fc41345c177538a"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:33196
I20260709 13:13:32.945168  7887 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:32.945693  7887 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.069712  7888 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:31.422930  7889 rpcz_store.cc:276] 0709 13:13:30.223690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.226484 (+  2794us) service_pool.cc:224] Handling call
0709 13:13:30.247438 (+ 20954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.757251 (+509813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.359224 (+601973us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54004fa1d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:31.359443 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901319936}
I20260709 13:13:31.783638  7892 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:32.951746  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:32.955425  7892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 420) took 2115 ms (client timeout 1818 ms). Trace:
W20260709 13:13:32.955912  7892 rpcz_store.cc:269] 0709 13:13:30.839979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.852401 (+ 12422us) service_pool.cc:224] Handling call
0709 13:13:32.954996 (+2102595us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540043a8d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:32.955184 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318291328}
I20260709 13:13:31.406062  7896 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:32.959686  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 317) took 2723 ms. Trace:
I20260709 13:13:32.960057  7896 rpcz_store.cc:276] 0709 13:13:30.236041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.318618 (+ 82577us) service_pool.cc:224] Handling call
0709 13:13:30.319071 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:32.958172 (+2639101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.959283 (+  1111us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54005631d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:32.959510 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2490406784}
W20260709 13:13:32.060029  8694 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:13:32.597867  8701 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:32.598651  8702 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:32.962114  8701 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:32.962260  8702 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:32.602311  8703 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.963672  8703 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:32.965023  8702 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:32.965116  8701 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:32.651465  8705 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:32.965898  8703 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:32.966382  7178 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:32.966087  8705 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:32.910230  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:32.967614  7178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1217) took 1679 ms (client timeout 1824 ms). Trace:
W20260709 13:13:32.968217  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 58277.3us
I20260709 13:13:32.968585  8705 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:32.650406  7184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 105) took 1756 ms (client timeout 1752 ms). Trace:
W20260709 13:13:32.968142  7178 rpcz_store.cc:269] 0709 13:13:31.287855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.316945 (+ 29090us) service_pool.cc:224] Handling call
0709 13:13:32.967398 (+1650453us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b54002c4554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:32.967556 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60467584}
W20260709 13:13:32.969204  7184 rpcz_store.cc:269] 0709 13:13:30.893440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.925591 (+ 32151us) service_pool.cc:224] Handling call
0709 13:13:32.650188 (+1724597us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:32.970711  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:32.663082  8708 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:32.664332  8707 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:32.971004  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:32.972047  7178 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.971629  8708 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:32.671926  8709 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:32.679332  8711 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:32.973445  8711 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:32.687659  8712 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.974700  7862 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:32.756767  7186 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 2: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:31.595433  8356 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:32.975325  8712 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:32.979283  8712 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:32.979950  7184 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.980109  8711 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:32.064170  8470 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.003s
I20260709 13:13:32.982911  7331 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
W20260709 13:13:31.952451  8471 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 13:13:32.998802  8573 raft_consensus.cc:2764] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:32.999435  8718 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.591774  8512 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:33.001051  7186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1204) took 1724 ms (client timeout 1924 ms). Trace:
I20260709 13:13:31.617940  8513 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:32.048139  8545 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.175s	user 0.010s	sys 0.001s
I20260709 13:13:33.022827  8545 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.025877  8545 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:31.385317  8547 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:31.944859  8553 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:31.382050  8584 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:31.377018  8626 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:31.404529  8631 consensus_meta.cc:287] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.923s	user 0.008s	sys 0.010s
I20260709 13:13:31.391098  8633 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:31.918241  8634 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.002s
I20260709 13:13:33.045317  8634 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.030567  8547 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.047688  8634 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:31.375592  8508 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.662009  8556 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.056346  8633 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:32.076673  8585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33208 (request call id 302) took 4504 ms. Trace:
W20260709 13:13:33.063809  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 112236us
W20260709 13:13:32.076458  8638 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.521s	user 0.001s	sys 0.006s
I20260709 13:13:33.067234  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:32.038590  8494 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.001s
I20260709 13:13:33.072034  8494 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:31.367628  8546 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:31.395344  8651 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:32.076342  8656 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.000s
I20260709 13:13:31.927191  8661 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:31.788811  8662 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.091286  8729 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:32.085228  8667 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:31.802702  8674 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.096506  8674 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:31.814699  8677 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.429s	user 0.001s	sys 0.000s
I20260709 13:13:31.773103  8679 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:32.766669  8608 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:32.781172  8713 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:33.123592  8713 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.126108  8713 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:32.786926  7082 catalog_manager.cc:5697] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 2 to 3, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 3 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.127575  7082 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 3 to 4, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 4 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:32.789944  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1797) took 2367 ms. Trace:
I20260709 13:13:32.799192  7329 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:32.801435  7336 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:32.803527  7859 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.709s (SENT) [suppressed 1 similar messages]
I20260709 13:13:32.799176  8715 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.806468  8714 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:33.132889  7329 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.133128  8714 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.135671  8714 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:32.828926  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.136288  8674 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:33.136514  7335 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.132884  8715 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:33.138955  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 335594us
W20260709 13:13:32.840543  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.140118  8715 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.130395  7255 rpcz_store.cc:276] 0709 13:13:30.422122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.436341 (+ 14219us) service_pool.cc:224] Handling call
0709 13:13:30.436611 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.463485 (+ 26874us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:30.787881 (+324396us) log.cc:844] Serialized 14 byte log entry
0709 13:13:30.814847 (+ 26966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:30.850197 (+ 35350us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:30.850263 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.092844 (+242581us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b18001d8960. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007feced11058f 00007fece614f571 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd
0709 13:13:31.136334 (+ 43490us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b18001d8960. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419
0709 13:13:32.789434 (+1653100us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b54002e7a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:32.789479 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:32.789702 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12800,"prepare.queue_time_us":396566,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":47,"raft.queue_time_us":113,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6453,"spinlock_wait_cycles":74306432,"thread_start_us":334596,"threads_started":2,"wal-append.queue_time_us":95863,"wal-append.run_cpu_time_us":4782,"wal-append.run_wall_time_us":1621786}
I20260709 13:13:32.846423  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.142908  7334 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.129932  7082 catalog_manager.cc:5697] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 1 to 2, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:13:33.145963  8546 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:32.856808  7185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1222) took 1549 ms (client timeout 1992 ms). Trace:
I20260709 13:13:32.857167  7332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
W20260709 13:13:33.146891  7185 rpcz_store.cc:269] 0709 13:13:31.307493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.329757 (+ 22264us) service_pool.cc:224] Handling call
0709 13:13:32.856691 (+1526934us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:31.357808  7181 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
W20260709 13:13:33.150745  7181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 103) took 2706 ms (client timeout 1621 ms). Trace:
W20260709 13:13:33.151178  7181 rpcz_store.cc:269] 0709 13:13:30.444656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.449815 (+  5159us) service_pool.cc:224] Handling call
0709 13:13:33.150534 (+2700719us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:32.874751  8496 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:32.875622  7179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1214) took 1588 ms (client timeout 2109 ms). Trace:
W20260709 13:13:33.152315  7179 rpcz_store.cc:269] 0709 13:13:31.287062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.330249 (+ 43187us) service_pool.cc:224] Handling call
0709 13:13:32.875537 (+1545288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:33.153141  8656 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:33.153342  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:33.154047  7179 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.153867  8656 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.157101  8656 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.146991  7082 catalog_manager.cc:5697] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 1 to 2, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:33.146610  8546 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:32.878213  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.879621  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:32.888409  8586 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:13:33.159284  8634 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.903782  8664 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:32.926349  8721 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:32.929132  7330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1076) took 1562 ms (client timeout 1992 ms). Trace:
I20260709 13:13:32.933941  8691 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.949479  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:32.599488  7227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.008s	sys 0.020s
I20260709 13:13:32.605340  8704 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.971716  8707 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:32.665688  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 1.33722e+06us
I20260709 13:13:32.978305  8356 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:32.998267  8708 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:31.713963  8511 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.000064  8718 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:33.172957  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 105965us
I20260709 13:13:33.174041  7861 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:33.175043  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 225833us
I20260709 13:13:33.175532  8718 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:33.175846  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:33.009543  8711 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:33.176698  8715 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:33.176599  8711 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.177376  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:33.178256  8715 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:33.011170  7328 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:33.016937  8709 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:33.178674  8715 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:33.179176  8718 raft_consensus.cc:2764] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:13:33.179504  8513 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:33.179107  8709 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.168499  8691 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.180544  8715 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.180258  8513 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.181664  8709 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.017202  8703 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:33.182451  8513 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.182420  8703 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.183226  8513 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:33.183796  8634 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.184576  8711 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.184691  8703 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.017385  8701 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:33.019631  8705 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.185856  8634 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.185604  8701 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.185714  8705 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.005369  7184 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:33.169981  8664 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:33.186928  7184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 113) took 1860 ms (client timeout 2150 ms). Trace:
W20260709 13:13:33.187371  7184 rpcz_store.cc:269] 0709 13:13:31.326926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.970247 (+1643321us) service_pool.cc:224] Handling call
0709 13:13:33.186840 (+216593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:33.187836  8701 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.018920  8712 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:33.188632  8664 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:33.188584  8712 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.189275  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1206) took 1912 ms. Trace:
I20260709 13:13:33.178941  8704 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.040321  8626 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.042126  8631 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.040187  7182 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:33.033676  7887 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.033620  8553 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.191372  8704 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:33.040881  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 64075.7us
W20260709 13:13:33.060563  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 86171.9us
W20260709 13:13:33.192595  7182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 106) took 2298 ms (client timeout 3024 ms). Trace:
I20260709 13:13:33.193095  8553 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:33.192997  7182 rpcz_store.cc:269] 0709 13:13:30.893797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.894608 (+   811us) service_pool.cc:224] Handling call
0709 13:13:33.192393 (+2297785us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54000ed8d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:33.192535 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4850872192}
I20260709 13:13:33.061498  8724 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:32.073643  8597 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.000s
I20260709 13:13:33.196183  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:33.196045  8597 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:33.066007  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:33.199476  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.200220  7887 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.200871  7887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:33196 (request call id 426) took 1850 ms. Trace:
I20260709 13:13:33.201152  8706 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:33.067926  8638 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:31.790462  8639 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.075249  7187 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:33.074401  8494 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.082934  8508 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.216229  8508 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.110919  8692 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.217413  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1203) took 1941 ms. Trace:
I20260709 13:13:33.217132  8692 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.217780  7187 rpcz_store.cc:276] 0709 13:13:31.275975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.278710 (+  2735us) service_pool.cc:224] Handling call
0709 13:13:31.279000 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.214165 (+1935165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.217050 (+  2885us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b540039dfd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:33.217332 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4129676544}
I20260709 13:13:33.220176  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1215) took 1932 ms. Trace:
I20260709 13:13:33.169061  8656 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:33.112447  8661 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:33.147085  7332 raft_consensus.cc:606] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:33.221474  7183 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:33.148284  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:32.857522  8720 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.155141  8556 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:33.233295  8556 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.233779  8674 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.233960  8553 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.234331  8674 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.234602  8553 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.235533  8556 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.236558  8674 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.236641  8553 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.158993  7082 catalog_manager.cc:5697] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 2 to 3, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:13:33.239527  7255 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:33.240787  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:33.242585  7258 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:33.238054  7082 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 1 to 2, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:33.154086  7335 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:33.222126  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:33.167721  7179 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:33.159933  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:33.169742  7227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.282s	user 0.009s	sys 0.021s
I20260709 13:13:33.160188  7334 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
W20260709 13:13:33.166980  7330 rpcz_store.cc:269] 0709 13:13:31.366181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.367042 (+   861us) service_pool.cc:224] Handling call
0709 13:13:32.928917 (+1561875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:33.170485  8356 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.171913  8707 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:33.171972  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:33.001533  7186 rpcz_store.cc:269] 0709 13:13:31.276327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.280435 (+  4108us) service_pool.cc:224] Handling call
0709 13:13:32.997778 (+1717343us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540039d5d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:33.000993 (+  3215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3179607936}
W20260709 13:13:33.179652  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 300261us
I20260709 13:13:33.179023  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 90) took 1960 ms. Trace:
I20260709 13:13:33.188969  8715 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.043684  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:33.059549  7178 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:33.064324  8585 rpcz_store.cc:276] 0709 13:13:27.572152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:27.574309 (+  2157us) service_pool.cc:224] Handling call
0709 13:13:28.147282 (+572973us) ts_tablet_manager.cc:934] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
0709 13:13:31.120767 (+2973485us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:13:31.774394 (+653627us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:31.774532 (+   138us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:13:32.075874 (+301342us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:13:32.076175 (+   301us) tablet_replica.cc:206] Creating consensus instance
0709 13:13:32.076517 (+   342us) ts_tablet_manager.cc:989] Replica registered.
0709 13:13:32.076590 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":43126,"tablet-copy.queue_time_us":465205,"thread_start_us":562951,"threads_started":2}
I20260709 13:13:33.189675  7184 rpcz_store.cc:276] 0709 13:13:31.276863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.188156 (+1911293us) service_pool.cc:224] Handling call
0709 13:13:33.188631 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.188905 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.188933 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:33.188994 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:33.189029 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.189080 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.189181 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:33.206862  7336 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:33.212558  8730 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:13:33.260962  7336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 89) took 2451 ms (client timeout 1752 ms). Trace:
I20260709 13:13:33.213502  8586 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.221789  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:33.220633  7187 rpcz_store.cc:276] 0709 13:13:31.287334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.219226 (+1931892us) service_pool.cc:224] Handling call
0709 13:13:33.219628 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.219838 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.219864 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:33.219925 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:33.219953 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.220002 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.220101 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:33.262903  7178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1209) took 1983 ms (client timeout 2149 ms). Trace:
W20260709 13:13:33.260260  7183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 109) took 2124 ms (client timeout 2702 ms). Trace:
I20260709 13:13:33.221624  8656 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.231666  8713 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:33.196115  8631 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.220386  8638 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.201246  7887 rpcz_store.cc:276] 0709 13:13:31.350890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.356776 (+  5886us) service_pool.cc:224] Handling call
0709 13:13:33.200738 (+1843962us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:33.247013  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.130052  8729 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:33.211699  8704 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:33.258801  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1211) took 1978 ms. Trace:
W20260709 13:13:33.274986  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 132884us
I20260709 13:13:33.262074  7332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:56808
W20260709 13:13:33.261404  7336 rpcz_store.cc:269] 0709 13:13:30.809936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.810858 (+   922us) service_pool.cc:224] Handling call
0709 13:13:32.800101 (+1989243us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b580020b1d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91980aa 00007fece921a447 00007fece9232fe7 00007fece92347de 00007fece924027c 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c
0709 13:13:33.260902 (+460801us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60219136}
I20260709 13:13:33.221819  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.221479  8712 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.220953  8692 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:33.263291  7178 rpcz_store.cc:269] 0709 13:13:31.277632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.969843 (+1692211us) service_pool.cc:224] Handling call
0709 13:13:33.260672 (+290829us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:33.226553  7329 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:33.222761  8546 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:33.265560  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 56113.1us
I20260709 13:13:33.265488  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:33.212710  7180 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:33.275115  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:33.260085  7185 raft_consensus.cc:2376] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4. Re-sending same reply.
W20260709 13:13:33.263397  7183 rpcz_store.cc:269] 0709 13:13:31.136312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.145616 (+  9304us) service_pool.cc:224] Handling call
0709 13:13:33.229869 (+2084253us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b540036db54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:33.260193 (+ 30324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4642042752}
I20260709 13:13:33.275672  7182 rpcz_store.cc:276] 0709 13:13:31.278122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.194067 (+1915945us) service_pool.cc:224] Handling call
0709 13:13:33.194511 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.256223 (+ 61712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.256262 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:33.256325 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:33.256372 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.256456 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.256615 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:33.305166  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:33.383028  7187 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:13:33.404232  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:33.336310  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:33.275947  7332 raft_consensus.cc:606] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:33.386706  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.347260  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1218) took 2059 ms. Trace:
I20260709 13:13:33.423823  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:33.467047  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 98831.2us
I20260709 13:13:33.467312  7179 rpcz_store.cc:276] 0709 13:13:31.288093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.341450 (+2053357us) service_pool.cc:224] Handling call
0709 13:13:33.346588 (+  5138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.346858 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.346893 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:33.346945 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:33.347012 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.347079 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.347194 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:33.381573  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:33.335884  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 292522us
W20260709 13:13:33.347790  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 139122us
I20260709 13:13:33.382072  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.255652  8664 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:33.402546  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:33.302573  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.474336  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1216) took 2179 ms. Trace:
I20260709 13:13:33.474759  7187 rpcz_store.cc:276] 0709 13:13:31.287594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.275213 (+1987619us) service_pool.cc:224] Handling call
0709 13:13:33.382506 (+107293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.462832 (+ 80326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.467225 (+  4393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:33.476397  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:33.476397  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:33.476941  7888 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:33.477715  8651 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:33.347968  8718 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:33.429044  8731 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:33.421020  8705 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:33.346022  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 172157us
I20260709 13:13:33.414330  8701 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:33.344942  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1220) took 2056 ms. Trace:
I20260709 13:13:33.439391  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.400652  8656 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.419924  8715 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:33.420293  8704 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:33.302711  8717 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.303767  8707 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.260254  7328 rpcz_store.cc:276] 0709 13:13:31.218240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.234223 (+ 15983us) service_pool.cc:224] Handling call
0709 13:13:33.178934 (+1944711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:33.418699  8720 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:33.414032  8733 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:33.489925  7896 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:13:33.474081  7329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 88) took 2662 ms (client timeout 1709 ms). Trace:
I20260709 13:13:33.417227  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:33.348202  7890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 280) took 2272 ms (client timeout 2071 ms). Trace:
I20260709 13:13:33.493312  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:33.416594  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.276401  8553 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:33.430683  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:33.276273  8597 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.381063  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.493991  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1673) took 3073 ms. Trace:
I20260709 13:13:33.488344  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:33.528546  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.485198  8716 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.486377  8718 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.502211  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:33.504415  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:33.485675  8731 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:33.539777  7331 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:33.526321  7260 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:33.526866  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:33.501947  7887 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
W20260709 13:13:33.527906  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44305.8us
I20260709 13:13:33.412269  8470 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:13:33.500001  8546 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:33.497336  7181 rpcz_store.cc:276] 0709 13:13:31.288575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.334758 (+2046183us) service_pool.cc:224] Handling call
0709 13:13:33.344274 (+  9516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.344533 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.344568 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:33.344613 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:33.344659 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.344726 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.344857 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:33.532496  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:33.498312  8692 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.333470  8586 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.533600  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.527256  7255 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:33.496801  8701 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:33.484649  8712 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:13:33.386934  8585 tablet_copy_client.cc:806] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:33.563320  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:33.528680  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:33.348475  8729 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.411692  8471 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:13:33.537006  7180 rpcz_store.cc:276] 0709 13:13:30.412978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.454481 (+ 41503us) service_pool.cc:224] Handling call
0709 13:13:30.454822 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.477752 (+3022930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.478417 (+   665us) spinlock_profiling.cc:243] Waited 2.75 s on lock 0x7b54002706d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:33.486361 (+  7944us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6317384576}
I20260709 13:13:33.506284  8707 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:33.264245  8730 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:33.546125  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 284492us
I20260709 13:13:33.547399  7330 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:33.526888  7889 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:13:33.529578  8733 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:33.575011  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:33.576260  8585 tablet_copy_client.cc:670] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
W20260709 13:13:33.557900  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.547459  8720 raft_consensus.cc:2764] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:13:33.501374  7329 rpcz_store.cc:269] 0709 13:13:30.809573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.852677 (+ 43104us) service_pool.cc:224] Handling call
0709 13:13:31.082030 (+229353us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b5800094b98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:13:32.798168 (+1716138us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b54002385a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91ba06f 00007fece9232f60 00007fece92347de 00007fece924027c 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2
0709 13:13:33.471981 (+673813us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96262144}
I20260709 13:13:33.547994  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:33.561203  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:33.556089  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.478372  8651 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.505939  8704 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.541286  8718 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.567939  7336 raft_consensus.cc:2410] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:33.590876  8546 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:33.591473  8546 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:33.591675  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.538836  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.527659  8691 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.570587  8731 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:33.503552  7890 rpcz_store.cc:269] 0709 13:13:31.075966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.083250 (+  7284us) service_pool.cc:224] Handling call
0709 13:13:33.347800 (+2264550us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b5400521f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:33.347993 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4638776576}
I20260709 13:13:33.571377  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.596911  8508 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:33.571986  8734 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:33.601488  8586 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.601878  8651 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.601662  8508 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.573308  8707 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.582894  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.603960  8508 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.501587  8717 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.605484  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:33.605993  8731 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.557160  7896 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:33.561350  8701 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.566841  8639 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.607823  8717 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.607930  8639 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.608294  8656 raft_consensus.cc:2955] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:33.586602  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.613246  7331 raft_consensus.cc:2376] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2. Re-sending same reply.
I20260709 13:13:33.615561  7256 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:33.599130  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:33.582214  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:33.587081  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 89415.3us
I20260709 13:13:33.591877  8704 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.592337  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:33.561064  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.593756  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.592471  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:33.576284  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.564918  8553 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:33.627836  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 85347.8us
I20260709 13:13:33.610478  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.592465  8546 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.612416  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:33.606325  7259 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.584254  8631 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:33.575137  8733 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.626572  7335 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:33.545756  8716 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.582075  8692 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.592525  7887 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:33.635154  7895 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:33.630367  7261 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.596917  8512 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:13:33.648000  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:33.711058  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:33.647590  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.711684  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:33.686925  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:33.776739  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 179148us
I20260709 13:13:33.931313  7336 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:33.624035  8508 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.789934  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:33.705068  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:33.637600  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:33.821305  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.753816  7262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:35332
I20260709 13:13:33.647919  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:33.940476  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 108206us
I20260709 13:13:33.627840  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:33.806867  8738 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:13:33.703447  7332 raft_consensus.cc:2376] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2. Re-sending same reply.
W20260709 13:13:33.848814  7150 connection.cc:256] RPC call timeout handler was delayed by -1.1735251860000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
W20260709 13:13:33.944591  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 309864us
I20260709 13:13:33.944811  7893 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:33.939258  7262 raft_consensus.cc:606] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:33.757051  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:33.802680  8356 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.687705  8661 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:33.695487  8721 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.776170  8494 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:33.687481  8704 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:33.858574  8691 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:33.636724  8717 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:33.952533  8674 raft_consensus.cc:2764] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:13:33.976001  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.953437  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:33.716197  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.714267  8631 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.705690  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:33.646914  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:33.888118  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:33.929044  8553 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:33.865707  7327 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:13:33.776409  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5060 after lost signal to thread 6033
I20260709 13:13:33.967948  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:33.775969  8639 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:33.760989  8705 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:33.761790  8712 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:33.627668  8720 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.317s
I20260709 13:13:33.972352  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:33.953104  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:33.979007  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:33.979889  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:33.799362  8725 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:13:33.980764  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 122672us
I20260709 13:13:33.983718  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:33.945874  8508 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:33.970088  8745 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.978186  8717 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.978276  8734 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:33.995213  8662 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.995471  7891 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:33.995898  8356 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:33.994388  7253 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:34.009841  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 380243us
I20260709 13:13:33.982788  8704 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.971853  8721 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:33.992502  7327 pending_rounds.cc:85] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 1
I20260709 13:13:33.982722  8494 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.017225  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.036738  7335 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:34.017148  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:34.018077  8508 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.010053  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.023301  8759 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:34.023468  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 70481.5us
I20260709 13:13:33.987449  8729 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:34.030862  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.031769  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:34.030156  8736 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:34.007242  8725 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:34.013530  8717 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.054273  7331 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:34.028839  8733 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:13:34.033448  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5740 after lost signal to thread 7119
I20260709 13:13:34.025913  8734 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:34.059882  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:34.060930  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 107723us
I20260709 13:13:34.062222  7260 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:34.029551  7327 pending_rounds.cc:107] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:13:34.063426  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 345360us
I20260709 13:13:34.054857  8508 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:34.064369  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5800 after lost signal to thread 7133
I20260709 13:13:34.051944  8759 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:34.055363  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.051349  8661 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:34.016297  8745 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.059656  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.025033  8705 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:34.112934  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 81270us
W20260709 13:13:34.126498  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 66315.1us
I20260709 13:13:34.127398  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:34.128244  8639 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:34.128818  7228 leader_election.cc:400] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3.
I20260709 13:13:34.129158  7228 leader_election.cc:403] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:13:34.129745  8749 log.cc:927] Time spent T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:13:34.114063  8748 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:13:34.114301  8754 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:13:34.130025  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:34.113794  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.115550  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:34.115103  8731 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.004s
I20260709 13:13:34.118535  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:34.132795  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:34.116170  8725 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.105886  8733 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:34.064213  8729 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:34.107813  7329 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.034536  8662 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.050303  8712 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:34.146431  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0b60 after lost signal to thread 7211
W20260709 13:13:34.147629  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3140 after lost signal to thread 7286
W20260709 13:13:34.148013  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3260 after lost signal to thread 7287
I20260709 13:13:34.124308  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.148700  7262 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:34.118947  8508 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:34.149333  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0ec0 after lost signal to thread 7360
I20260709 13:13:34.149621  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.113803  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.150904  7254 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.148953  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:34.151643  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.152887  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.106563  7327 raft_consensus.cc:2889] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:34.156260  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.156392  8730 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.156874  7327 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:34.158284  7327 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:34.129689  8639 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3.
I20260709 13:13:34.158147  8733 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.158762  8674 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:34.159686  8639 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.160363  7332 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:34.160704  7336 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:34.160940  8761 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:34.115747  8494 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:34.162143  8761 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:34.162490  8761 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:34.163332  8761 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.163465  8729 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.164721  8761 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.165539  8722 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:34.150697  8508 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:34.150475  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0620 after lost signal to thread 7920
I20260709 13:13:34.131327  7256 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:34.138854  8736 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:34.119764  8759 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:34.142511  7261 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:34.145320  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.145045  8734 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.173007  8692 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.178726  8704 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:34.170939  8736 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:34.179555  8736 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.179845  8716 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.147542  8745 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:34.147935  8712 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.169544  7254 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:34.144459  8731 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:34.170362  7262 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:34.195089  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.195469  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 112) took 2884 ms. Trace:
I20260709 13:13:34.195936  7262 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:34.197095  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.196189  7178 rpcz_store.cc:276] 0709 13:13:31.311358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.474586 (+2163228us) service_pool.cc:224] Handling call
0709 13:13:33.489851 (+ 15265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.500068 (+ 10217us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:33.561740 (+ 61672us) log.cc:844] Serialized 14 byte log entry
0709 13:13:34.194990 (+633250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:34.195060 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:34.195129 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.195218 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:34.195372 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":94544,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":5065,"raft.queue_time_us":47976,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":4478,"thread_start_us":643149,"threads_started":3,"wal-append.queue_time_us":452161}
W20260709 13:13:34.198120  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52024us
I20260709 13:13:34.171746  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.183529  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.168767  7327 pending_rounds.cc:85] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 2
I20260709 13:13:34.108539  8356 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.150771  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:34.197688  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 87391.3us
I20260709 13:13:34.200695  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.201956  7262 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:34.130828  7150 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:34.168661  8722 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:34.201651  8597 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:34.206223  8701 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 13:13:34.199059  7258 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:34.227156  8701 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.211642  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.228729  7255 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:13:34.229521  8701 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.229592  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.230923  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.231400  7255 raft_consensus.cc:2376] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3. Re-sending same reply.
I20260709 13:13:34.232198  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.232669  7255 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:13:34.233438  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.233986  7255 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:34.235526  8634 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:34.150475  7253 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:34.212564  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.220247  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.203835  7327 pending_rounds.cc:107] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:34.192395  8721 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:34.224980  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 95470.7us
I20260709 13:13:34.235054  8722 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.208388  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.218783  7333 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:34.271167  7256 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:34.207058  8725 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.272683  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:34.236548  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.276055  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.271792  7260 raft_consensus.cc:2376] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3. Re-sending same reply.
W20260709 13:13:34.279922  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 67891.7us
W20260709 13:13:34.224565  7259 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.001s
W20260709 13:13:34.282354  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.290285  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 166253us
I20260709 13:13:34.269981  7327 raft_consensus.cc:2889] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:34.280949  8634 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:34.239534  8755 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:13:34.268764  8712 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:34.268219  8638 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:34.359941  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 57947.4us
I20260709 13:13:34.362140  8662 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:34.223824  8661 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.378950  8691 raft_consensus.cc:993] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:34.379478  8691 raft_consensus.cc:1081] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer 9a54ecc9fb4541df915f9f8c01e19429 to start an election
I20260709 13:13:34.379834  7178 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:13:34.380231  8718 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.004s
I20260709 13:13:34.380702  8718 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.381795  7334 raft_consensus.cc:2368] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:34.381871  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:34.382525  7185 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.382768  8718 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:34.382874  8736 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.380689  8634 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:34.362308  8759 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.384415  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.384821  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.385188  7178 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:34.385746  7262 raft_consensus.cc:2368] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:34.301203  8705 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:34.299468  8707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.018s	sys 0.044s
I20260709 13:13:34.365038  8722 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.301323  8721 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:34.391009  8721 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:34.391364  8470 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:34.391487  8721 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.391837  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.392194  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.392544  7180 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:34.391515  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:34.238683  8356 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:34.394563  7181 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.395398  8356 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:34.373003  8656 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
W20260709 13:13:34.370088  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.370040  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 70007us
I20260709 13:13:34.300119  7259 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
W20260709 13:13:34.334331  8750 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:13:34.373602  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:34.401292  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.405542  7256 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.374781  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.387903  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.407758  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.408432  7334 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
W20260709 13:13:34.389525  8707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.019s	sys 0.045s
W20260709 13:13:34.414511  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.413856  8718 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:34.424405  8718 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.421963  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:34.429067  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:34.391860  8470 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:34.428993  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.430766  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.431798  7178 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 2: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:34.431659  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.372798  8712 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:34.436190  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.437000  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:34.468547  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.469475  7179 raft_consensus.cc:2410] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:34.469841  7184 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.399336  8717 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.470650  7896 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:34.471336  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.424923  8718 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.429175  7893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:33196
I20260709 13:13:34.475363  7331 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:34.475608  7893 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:34.476011  7893 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.479583  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.480424  7254 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:34.470288  8712 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.488029  7335 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:34.488967  7180 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:34.410851  8638 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.485512  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.474046  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.478241  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:34.495995  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 62589.8us
I20260709 13:13:34.498279  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.499038  7328 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:34.498145  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:34.479242  8765 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:34.507411  7184 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:34.509059  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.509584  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.511947  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.512823  7254 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:34.514366  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1221) took 3225 ms. Trace:
I20260709 13:13:34.508827  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.487450  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.517100  7179 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:34.517164  7184 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:34.523636  7896 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:34.514828  7182 rpcz_store.cc:276] 0709 13:13:31.288862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.467072 (+2178210us) service_pool.cc:224] Handling call
0709 13:13:33.504034 (+ 36962us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:33.537626 (+ 33592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.537660 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:33.568809 (+ 31149us) log.cc:844] Serialized 26 byte log entry
0709 13:13:33.887193 (+318384us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:33.887243 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.887330 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:34.514155 (+626825us) raft_consensus.cc:1685] finished
0709 13:13:34.514175 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:34.514310 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3881,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":21355,"thread_start_us":275559,"threads_started":1,"wal-append.queue_time_us":434973}
I20260709 13:13:34.523151  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.531286  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.531926  7178 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:34.528271  7186 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:34.532795  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.514211  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:34.518798  8736 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:34.520921  8765 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:34.582844  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:34.583122  8765 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.583806  8761 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:34.585570  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:34.538322  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:34.559518  7180 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:34.540009  7299 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:34.587208  8761 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:34.587430  7180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:13:34.552331  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.588205  7180 raft_consensus.cc:606] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:34.588303  8751 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:34.553431  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:34.588590  7180 raft_consensus.cc:614] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:34.588943  8751 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.588774  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:34.538043  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.538445  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:34.589250  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51014.8us
I20260709 13:13:34.589691  8761 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:34.589380  8751 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.555233  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:34.590813  7150 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:34.591024  8729 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:34.591395  8729 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.591455  7228 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:34.591804  8729 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.592885  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:34.594049  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:34.554379  7179 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:34.594949  8761 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:34.534689  7887 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:34.596704  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.598081  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.557140  8736 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:13:34.564941  8585 tablet_copy_client.cc:538] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:34.606132  8717 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.565604  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.565696  7184 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:34.560122  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:34.567279  7178 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:34.567463  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.540216  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.571395  8773 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:34.551213  8759 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.578274  8712 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.528546  7181 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:34.526456  8656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:57558 (request call id 9) took 4615 ms. Trace:
I20260709 13:13:34.533772  8470 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.633857  8470 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.554734  8705 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:34.635001  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.637068  7178 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:34.640452  7182 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:34.580484  8763 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.581758  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:34.647428  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 65736us
I20260709 13:13:34.574359  7185 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
W20260709 13:13:34.587257  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 47355.7us
I20260709 13:13:34.653014  8759 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:34.653451  8759 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.653759  8759 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:34.540354  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.588307  7186 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:34.589092  7187 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.659518  7328 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:34.547151  7329 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:34.598251  8638 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.598019  8751 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.544216  8779 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:13:34.546856  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.687556  7888 raft_consensus.cc:2393] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:34.688059  7861 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:34.688478  8751 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.689093  8751 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:34.599856  8553 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:34.689431  8751 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:34.600411  8634 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:34.689689  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:34.600917  8556 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:34.690591  8556 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:34.691108  8556 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.690330  8751 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.692400  8716 raft_consensus.cc:993] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:34.692956  8716 raft_consensus.cc:1081] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Signalling peer 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:13:34.601415  8546 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.590301  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.694964  7330 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:34.695513  7330 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:34.696576  7330 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.629079  7896 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:34.630692  7891 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:34.705562  7330 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.627046  8736 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:13:34.632831  8712 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.711288  8758 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:13:34.713605  8674 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.702144  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.714080  8674 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.722224  8546 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:34.723098  8736 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.723629  8546 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.645490  7254 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:34.627449  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:34.725823  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 98477.1us
I20260709 13:13:34.638758  8656 rpcz_store.cc:276] 0709 13:13:29.900963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.901111 (+   148us) service_pool.cc:224] Handling call
0709 13:13:30.094701 (+193590us) log.cc:844] Serialized 506 byte log entry
0709 13:13:30.467327 (+372626us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b1800338620. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9195b0b 00007fece921ab63 00007fece9242752 00007fecee202d29
0709 13:13:34.516720 (+4049393us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91290,"raft.queue_time_us":87476,"raft.run_cpu_time_us":5033,"raft.run_wall_time_us":167407,"spinlock_wait_cycles":5017984,"thread_start_us":282327,"threads_started":1,"wal-append.queue_time_us":421928,"wal-append.run_cpu_time_us":2791,"wal-append.run_wall_time_us":1244643}
I20260709 13:13:34.723641  8736 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.726550  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:34.650398  8763 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.730697  8763 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.651232  8773 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:34.662168  7261 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:34.676756  8356 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:34.736151  8631 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:34.677626  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:34.680845  7187 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:34.683964  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.742740  7335 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:13:34.743609  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54016.9us
I20260709 13:13:34.658509  8585 tablet_bootstrap.cc:492] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:34.690109  8634 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.698355  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:34.689637  8553 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:34.620348  7893 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.622375  7256 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:34.703310  8733 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.753206  8733 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.749790  8634 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.755730  7893 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:34.630610  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.756731  7253 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.759048  8760 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:34.727213  8597 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:34.760799  8597 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:34.761175  8597 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.762944  7887 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:34.707008  8556 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:34.708289  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 116154us
I20260709 13:13:34.767294  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:34.768465  8556 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:34.768766  8701 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:34.766392  8733 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:34.769570  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:34.770610  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.771597  8761 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:34.771914  7258 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.709333  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.635043  8705 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.772878  7253 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:34.774071  8705 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:34.734246  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.734865  8706 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:34.736172  8656 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:34.780567  8656 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.780972  8656 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.781145  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:34.781785  7329 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:34.782096  7329 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:34.782873  7329 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.736848  8734 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:34.784556  8734 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:34.784894  8734 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:34.785794  8734 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.786404  8705 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.677027  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:34.787043  7333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1005) took 1588 ms (client timeout 1756 ms). Trace:
W20260709 13:13:34.787858  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 110910us
I20260709 13:13:34.788185  8705 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:34.785725  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:34.788782  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:34.724864  8674 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.789748  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:34.752493  8553 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.646246  8721 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.771296  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:34.776885  7150 leader_election.cc:400] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
W20260709 13:13:34.787604  7333 rpcz_store.cc:269] 0709 13:13:33.198943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.209299 (+ 10356us) service_pool.cc:224] Handling call
0709 13:13:34.786892 (+1577593us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54001f4ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:34.786988 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560749440}
I20260709 13:13:34.783949  7329 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.736675  7261 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:34.787009  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:34.738561  8707 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:34.792589  8763 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:34.790952  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:34.805765  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:34.793735  8762 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.792868  8471 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.805614  7085 catalog_manager.cc:5697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 2, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.806577  8701 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:34.807129  8471 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:34.807310  8701 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:34.807405  8762 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:34.808228  8471 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.808502  8762 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.808880  8701 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.809739  8721 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:34.789688  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.787128  8734 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.807893  7085 catalog_manager.cc:5697] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 2, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.796476  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:34.798921  8656 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.802315  7150 leader_election.cc:403] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:13:34.821139  7133 auto_rebalancer.cc:629] Failed to schedule move for tablet be83b72d4b17414e8521b6707cd8a597: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:13:34.821230  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:34.750226  8736 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:34.803493  7261 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:34.824097  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:34.824188  8721 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.824538  7261 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.825655  7261 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.825858  8705 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:34.826289  8705 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.826699  8705 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.793188  7259 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.794699  8674 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:34.814548  8707 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:34.828677  8707 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:34.829764  8707 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.831806  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:34.832545  7893 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.833118  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:34.833884  8761 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:34.814882  7082 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47554 (request call id 232) took 4182 ms. Trace:
I20260709 13:13:34.805435  8763 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:34.828552  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:34.839397  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.834703  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:34.815335  8597 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:34.844277  7333 raft_consensus.cc:2410] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:34.845382  7334 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:34.864885  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.874603  7085 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 2, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:13:34.878252  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 43637us
I20260709 13:13:34.878839  7256 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:34.879117  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:34.881572  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:34.883339  7085 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 2, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:34.829527  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:13:34.887378  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 376733us
I20260709 13:13:34.889989  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.890178  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:34.890771  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.891525  7332 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:34.896770  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.821269  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:34.885807  7085 catalog_manager.cc:5697] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 2 to 3, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.835846  8761 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:34.903414  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:34.906435  7331 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:34.907832  7895 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:34.888413  8712 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:34.887131  7183 raft_consensus.cc:2955] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:34.914330  7892 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:34.903012  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:34.980049  7181 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:34.910830  8761 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.887795  8718 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:34.888383  7861 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:34.919664  8631 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:35.044853  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.834848  7082 rpcz_store.cc:276] 0709 13:13:30.632328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.632491 (+   163us) service_pool.cc:224] Handling call
0709 13:13:34.814800 (+4182309us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:33.528713 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:33.531741 (+  3028us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:33.531808 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:13:33.531843 (+    35us) tablet.cc:662] Decoding operations
0709 13:13:33.532742 (+   899us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:33.532841 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:33.532876 (+    35us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:13:33.585948 (+ 53072us) tablet.cc:701] Row locks acquired
0709 13:13:33.600058 (+ 14110us) write_op.cc:260] PREPARE: finished
0709 13:13:33.657166 (+ 57108us) write_op.cc:270] Start()
0709 13:13:33.713692 (+ 56526us) write_op.cc:276] Timestamp: P: 1783602813630733 usec, L: 0
0709 13:13:33.753044 (+ 39352us) op_driver.cc:348] REPLICATION: starting
0709 13:13:33.807201 (+ 54157us) log.cc:844] Serialized 2467 byte log entry
0709 13:13:34.235192 (+427991us) op_driver.cc:464] REPLICATION: finished
0709 13:13:34.364978 (+129786us) write_op.cc:301] APPLY: starting
0709 13:13:34.365074 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:34.365276 (+   202us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:34.371195 (+  5919us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:34.391642 (+ 20447us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:34.391935 (+   293us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:13:34.391977 (+    42us) write_op.cc:312] APPLY: finished
0709 13:13:34.392326 (+   349us) log.cc:844] Serialized 53 byte log entry
0709 13:13:34.392513 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:34.392629 (+   116us) write_op.cc:454] Released schema lock
0709 13:13:34.392688 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:34.393083 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:34.393110 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26262,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":68066,"apply.run_cpu_time_us":3495,"apply.run_wall_time_us":28116,"num_ops":6,"prepare.queue_time_us":193890,"prepare.run_cpu_time_us":55559,"prepare.run_wall_time_us":462283,"raft.queue_time_us":69475,"raft.run_cpu_time_us":9566,"raft.run_wall_time_us":40339,"replication_time_us":481974,"thread_start_us":407390,"threads_started":4,"wal-append.queue_time_us":244625}]]}
I20260709 13:13:35.010095  8631 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:35.052986  8733 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:35.071939  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:35.085508  7334 raft_consensus.cc:2410] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:35.086519  7261 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:35.087826  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:35.088289  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 206784us
I20260709 13:13:35.119155  7334 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:35.120762  7893 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:35.132647  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:35.164904  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:35.067708  8631 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.170998  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:35.169800  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:35.174423  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:35.130724  8713 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:35.118235  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 268080us
I20260709 13:13:35.165552  8597 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:35.183694  7184 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:13:35.175843  8722 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.771s	user 0.016s	sys 0.003s
I20260709 13:13:35.166548  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:35.210815  8597 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:35.211128  8553 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:35.211926  8597 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:35.213197  8713 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:35.214140  8553 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:35.216128  8713 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:35.218166  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:35.218916  7327 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:35.234145  8751 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:35.240999  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 986) took 1082 ms. Trace:
I20260709 13:13:35.247298  7255 rpcz_store.cc:276] 0709 13:13:34.158275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.234523 (+ 76248us) service_pool.cc:224] Handling call
0709 13:13:34.236655 (+  2132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:34.271021 (+ 34366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:34.271052 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:34.660261 (+389209us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b1800156040. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a
0709 13:13:34.661338 (+  1077us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:13:34.661847 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:13:35.010594 (+348747us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:35.010660 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.010728 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.240706 (+229978us) raft_consensus.cc:1685] finished
0709 13:13:35.240734 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.240916 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":812,"raft.queue_time_us":5531,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5099,"spinlock_wait_cycles":16079232,"thread_start_us":348343,"threads_started":1,"wal-append.queue_time_us":469086}
I20260709 13:13:35.241446  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:35.244875  7179 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:13:35.246366  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.254503  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:35.295516  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:35.170996  8656 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:35.251835  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:35.252581  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:35.261005  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:35.273252  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.251127  7256 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:35.293790  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:35.296020  7333 raft_consensus.cc:2368] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:35.305145  7262 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:35.171774  8787 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:35.206491  8759 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.547s	user 0.020s	sys 0.000s
W20260709 13:13:35.315439  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.316102  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:35.255407  8782 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:13:35.325691  7331 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:35.317694  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:35.299239  8780 ts_tablet_manager.cc:933] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:35.364832  7182 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:35.367030  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:35.367676  7179 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:35.372857  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 45584.4us
I20260709 13:13:35.259099  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:35.376791  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:35.379045  7184 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:35.298837  8662 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:35.382933  7181 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:13:35.400151  7150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.010s	sys 0.030s
I20260709 13:13:35.399147  7334 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:35.364308  8553 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:35.401428  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:35.401899  7150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.010s	sys 0.030s
W20260709 13:13:35.402609  7152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.009s	sys 0.008s
W20260709 13:13:35.407955  7152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.009s	sys 0.008s
W20260709 13:13:35.408142  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 518006us
W20260709 13:13:35.408478  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 529414us
I20260709 13:13:35.408592  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:35.408979  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:35.409212  7182 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:35.409307  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:35.314862  8765 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
W20260709 13:13:35.403468  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 229092us
I20260709 13:13:35.412230  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:35.386826  8792 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.382329  8662 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.410205  7179 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:35.415149  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:35.402755  8701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.010s	sys 0.009s
I20260709 13:13:35.363452  8759 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:35.426501  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:35.402719  8763 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:35.418228  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:35.384681  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 84979.7us
I20260709 13:13:35.419409  7334 raft_consensus.cc:2955] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:35.386010  8674 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:13:35.421816  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:35.585464  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 163717us
I20260709 13:13:35.422734  8662 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:35.467692  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49590.2us
I20260709 13:13:35.597357  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:35.566067  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:35.429586  8701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.010s	sys 0.009s
W20260709 13:13:35.432385  8729 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.840s	user 0.013s	sys 0.009s
I20260709 13:13:35.586913  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:35.589803  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 180903us
I20260709 13:13:35.465402  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:35.593739  8784 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:13:35.422189  8712 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:35.422264  8785 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:35.464635  7258 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.692s	user 0.016s	sys 0.002s
I20260709 13:13:35.596024  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:35.412727  8720 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.176s
I20260709 13:13:35.599941  7179 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:35.585693  8804 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:35.587544  8634 consensus_meta.cc:287] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.833s	user 0.021s	sys 0.013s
I20260709 13:13:35.423237  8792 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:35.415374  8553 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:35.420460  8546 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.178s
I20260709 13:13:35.671468  8546 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:35.671953  8546 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:35.673241  8546 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:35.625073  7336 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:35.674417  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 81812.5us
W20260709 13:13:35.675464  8798 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:13:35.675997  7336 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:13:35.677703  8797 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:13:35.622776  7180 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
W20260709 13:13:35.601141  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.594925  8787 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:35.681411  7333 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:13:35.685657  7133 auto_rebalancer.cc:629] Failed to schedule move for tablet cb0912958bd849238a8f104a7916c427: Illegal state: Replica c85cf49c63cc4e66b4747d8c4fa14022 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:13:35.685724  8725 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.686240  8725 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:35.687474  8790 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:13:35.688450  8725 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:35.689464  8791 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:13:35.690407  7333 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:35.694885  8718 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:35.695497  8789 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:13:35.702452  8764 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:35.704912  8764 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:35.705088  8553 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:35.706079  8764 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:35.707792  8764 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:35.709692  8734 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.899s	user 0.000s	sys 0.008s
W20260709 13:13:35.720227  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.721935  7187 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:35.737754  8806 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.635890  7258 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:35.738461  8806 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:35.739010  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 129) took 1089 ms. Trace:
I20260709 13:13:35.739392  7178 rpcz_store.cc:276] 0709 13:13:34.649981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.650719 (+   738us) service_pool.cc:224] Handling call
0709 13:13:34.651143 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:34.731572 (+ 80429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:34.731600 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:34.732156 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:13:35.065348 (+333192us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:35.065386 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.227828 (+162442us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b5400248454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:35.227893 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.738692 (+510799us) raft_consensus.cc:1685] finished
0709 13:13:35.738718 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.738950 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2247,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"spinlock_wait_cycles":184138496,"thread_start_us":332139,"threads_started":1,"wal-append.queue_time_us":999815}
I20260709 13:13:35.740932  8806 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:35.741400  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:35.742113  7178 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:35.743580  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:35.743912  8722 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.744486  8722 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:35.744801  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:35.745644  7178 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:35.745730  8722 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:35.662411  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:35.640748  7150 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:35.795581  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 154962us
I20260709 13:13:35.796171  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:35.796365  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:35.797742  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 200491us
I20260709 13:13:35.746707  8556 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:35.759153  8712 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:35.768174  8759 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:35.669497  8634 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:35.611346  7332 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:13:35.783057  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 107824us
I20260709 13:13:35.827466  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:35.784726  7183 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.867s	user 0.010s	sys 0.001s
W20260709 13:13:35.754302  7259 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.923s	user 0.009s	sys 0.009s
W20260709 13:13:35.781530  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 365760us
I20260709 13:13:35.598939  8796 raft_consensus.cc:2764] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:13:35.829633  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1240) took 1278 ms. Trace:
I20260709 13:13:35.830770  7183 rpcz_store.cc:276] 0709 13:13:34.550852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.556356 (+  5504us) service_pool.cc:224] Handling call
0709 13:13:34.556844 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:34.557184 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:34.557209 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:34.558303 (+  1094us) log.cc:844] Serialized 506 byte log entry
0709 13:13:34.886958 (+328655us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:35.828451 (+941493us) log.cc:844] Serialized 14 byte log entry
0709 13:13:35.828802 (+   351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.828875 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.828910 (+    35us) raft_consensus.cc:1685] finished
0709 13:13:35.828921 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.829558 (+   637us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":328215,"threads_started":1,"wal-append.queue_time_us":358799}
I20260709 13:13:35.832086  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:35.665704  8804 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:35.799907  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 91) took 1136 ms. Trace:
I20260709 13:13:35.799697  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:35.801273  7085 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.000s	sys 0.022s
W20260709 13:13:35.651796  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52995.3us
I20260709 13:13:35.817373  8674 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.802618  8763 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:35.844528  7180 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 4. Ops: []
W20260709 13:13:35.806577  8721 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.982s	user 0.010s	sys 0.014s
I20260709 13:13:35.793706  7327 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:35.816524  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:35.799027  8692 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:35.770717  7329 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.964s	user 0.008s	sys 0.014s
I20260709 13:13:35.857756  7329 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:35.840430  8804 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.828481  7187 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:35.810614  7330 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.100s	user 0.015s	sys 0.006s
I20260709 13:13:35.835253  7256 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:35.821002  8546 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:35.823810  8556 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.624784  8729 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:35.813830  8705 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.987s	user 0.008s	sys 0.004s
I20260709 13:13:35.838449  8801 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:35.843843  7260 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:35.839085  7085 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.000s	sys 0.023s
I20260709 13:13:35.840577  7183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:13:35.897895  7183 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.898413  7183 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.838441  7257 rpcz_store.cc:276] 0709 13:13:34.659726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.662478 (+  2752us) service_pool.cc:224] Handling call
0709 13:13:34.683010 (+ 20532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:35.009858 (+326848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:35.009889 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:35.083681 (+ 73792us) log.cc:844] Serialized 26 byte log entry
0709 13:13:35.411555 (+327874us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:35.795886 (+384331us) log.cc:844] Serialized 14 byte log entry
0709 13:13:35.796139 (+   253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.796219 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.796259 (+    40us) raft_consensus.cc:1685] finished
0709 13:13:35.796271 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.796386 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41782,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":4613,"thread_start_us":778174,"threads_started":3,"wal-append.queue_time_us":553546}
I20260709 13:13:35.841835  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:35.899449  7261 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:35.852258  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.899549  7255 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:35.854291  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:35.829428  7259 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:35.854951  8792 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:35.838670  8808 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:35.856961  8806 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:13:35.859565  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.858367  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 115) took 1081 ms. Trace:
I20260709 13:13:35.860188  8553 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:13:35.844460  8763 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.843145  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:35.873711  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 57303.9us
W20260709 13:13:35.892892  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 336448us
I20260709 13:13:35.850564  8674 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:35.825107  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:35.852401  8656 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:35.842198  8722 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.848022  8785 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:35.847726  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:35.862135  8721 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:35.895644  8759 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:35.910518  7894 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:35.915352  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:35.862676  7330 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:35.916774  7260 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:35.879608  8779 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:35.917305  7182 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 13:13:35.955826  7182 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:35.859333  8639 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:13:35.956979  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:35.955310  8721 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:35.909843  7329 rpcz_store.cc:276] 0709 13:13:34.777486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.780869 (+  3383us) service_pool.cc:224] Handling call
0709 13:13:35.858308 (+1077439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:35.953172  8794 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:35.961756  8573 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:13:35.906450  8760 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:13:35.919821  7257 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:35.878351  8556 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:35.953768  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 130291us
I20260709 13:13:35.968238  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:35.968715  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:35.953038  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 105417us
I20260709 13:13:35.917275  8781 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.957799  8701 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:35.953631  7187 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:35.919275  8471 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:13:35.988611  8759 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:35.989081  8780 tablet_copy_client.cc:323] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.130:40351
I20260709 13:13:35.989851  8759 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:35.990191  8729 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:35.990316  8759 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.901787  8705 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:35.990505  8674 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:35.991493  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:35.992321  8705 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:35.950819  8656 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.993018  8656 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:35.916321  8806 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:35.995209  8787 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:35.995615  8787 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:35.996524  8787 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:35.997088  8806 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:35.997758  8787 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:35.919996  8763 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.002765  8356 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:35.915095  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 1847) took 1215 ms. Trace:
I20260709 13:13:35.970736  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:35.975034  7336 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:35.878607  8662 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:35.977696  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:35.981771  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:36.018968  7894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 298) took 1439 ms. Trace:
I20260709 13:13:35.985477  7179 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:35.986289  8762 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:36.005128  7184 raft_consensus.cc:2368] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4.
W20260709 13:13:36.027501  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56892.8us
I20260709 13:13:35.955626  8779 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.011353  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:36.008839  8761 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.010s	user 0.021s	sys 0.000s
I20260709 13:13:36.006978  7183 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.030097  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:35.967289  7330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 104) took 2403 ms (client timeout 1994 ms). Trace:
W20260709 13:13:36.035794  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 58178us
I20260709 13:13:36.035982  7182 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:36.022410  7894 rpcz_store.cc:276] 0709 13:13:34.570407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.630439 (+ 60032us) service_pool.cc:224] Handling call
0709 13:13:34.630737 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:35.953443 (+1322706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:36.009824 (+ 56381us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400690854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:36.010022 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2942769920}
I20260709 13:13:35.982703  8807 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:35.970826  8721 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:36.010504  8806 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.045136  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:36.037433  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 237829us
I20260709 13:13:36.045656  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:36.047343  7260 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:36.047636  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:36.048915  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:36.019217  8799 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.051810  7150 leader_election.cc:400] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:36.051090  7183 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:36.034610  8779 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.054483  7150 leader_election.cc:403] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:36.037757  8471 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:36.016139  8792 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:13:36.009392  8785 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:13:36.033283  8705 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:36.020150  8764 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:13:36.010252  8781 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.009424  7259 rpcz_store.cc:276] 0709 13:13:34.699710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.709041 (+  9331us) service_pool.cc:224] Handling call
0709 13:13:35.912709 (+1203668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:36.044061  8720 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:36.056175  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 148470us
I20260709 13:13:36.026979  8713 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:13:36.036898  8712 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:36.031409  8639 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:13:36.058516  8661 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.049643  8725 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:13:36.049652  8813 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:36.039013  8721 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:36.038336  8761 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:36.044355  8512 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:13:36.090441  8720 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.086077  8674 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.102012  8356 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:13:36.104708  8701 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:36.104777  8817 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:36.105010  7181 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:36.101116  8807 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:36.099123  8819 raft_consensus.cc:2764] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:36.128043  8813 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:36.141592  7178 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:36.129961  8712 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.141892  8813 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.130818  8725 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:36.144388  8725 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:36.107455  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:36.124078  8720 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.049961  8806 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.145393  8792 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:36.145841  8792 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.133479  8512 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:36.103011  8661 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:36.145421  8725 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.102270  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:36.094599  8471 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:36.148571  8471 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.144449  8807 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:36.109668  8639 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:36.150482  8639 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.150801  8807 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.102355  8634 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:36.146378  8792 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:36.038846  7330 rpcz_store.cc:269] 0709 13:13:33.563528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.576008 (+ 12480us) service_pool.cc:224] Handling call
0709 13:13:34.694754 (+1118746us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b540023ada0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece923fe18 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6
0709 13:13:35.962893 (+1268139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969369984}
I20260709 13:13:36.137382  7182 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:36.111944  8705 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:36.178970  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 75456.3us
W20260709 13:13:36.185585  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.146412  8512 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:36.187301  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:36.187186  8512 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.188442  8512 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:36.188373  8785 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:36.194474  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.226183  8822 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:36.226866  8822 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:36.227872  8785 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.148604  8725 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:36.255954  8634 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.256553  8634 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:36.171365  8807 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.170429  8674 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:36.168104  8734 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:13:36.275434  8760 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:36.275902  8760 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:36.277218  8760 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:36.278730  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.278829  8760 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:36.321379  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 284876us
I20260709 13:13:36.322568  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:36.324903  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:36.330641  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 143404us
W20260709 13:13:36.334751  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 285857us
I20260709 13:13:36.335765  7152 leader_election.cc:400] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:36.337255  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:36.341287  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:36.329209  8573 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.356747  8656 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:36.253293  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 391539us
I20260709 13:13:36.363674  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:36.364743  7183 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:36.368284  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:36.368595  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46140.3us
I20260709 13:13:36.369803  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:36.343513  8762 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:36.375770  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 360463us
W20260709 13:13:36.377058  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 328366us
I20260709 13:13:36.377643  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:36.377766  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:36.363935  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 341344us
I20260709 13:13:36.379897  8827 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:36.380335  8827 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:36.380692  8827 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:36.385483  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48320.6us
I20260709 13:13:36.399211  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:36.404469  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:36.405854  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:36.407228  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:36.408485  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:36.409438  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.411864  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:36.412791  7327 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:36.414990  7335 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:13:36.421960  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44288.6us
I20260709 13:13:36.422971  7150 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:36.424778  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:36.429127  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:36.429821  7255 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:36.430013  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:36.371065  8713 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:36.374992  8764 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:36.430794  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:36.435971  7183 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:36.436399  7178 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:36.375567  8761 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:36.444738  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:36.445475  7183 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:36.446254  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:36.382419  8762 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:36.445050  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:36.422554  8788 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:13:36.461287  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.462707  7262 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.382247  8751 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:36.464046  8751 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:36.465029  8751 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:36.459874  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:36.467576  7261 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:36.467411  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 70682.5us
I20260709 13:13:36.470818  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:36.471069  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:36.473310  7893 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:36.429522  8639 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:36.343448  8573 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.484661  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:36.491730  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:36.500846  7182 raft_consensus.cc:2376] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3. Re-sending same reply.
I20260709 13:13:36.491199  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:36.499359  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:36.502321  7333 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:36.386704  8692 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:13:36.504771  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:36.505546  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 106467us
I20260709 13:13:36.511373  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:36.512238  7179 raft_consensus.cc:2376] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2. Re-sending same reply.
I20260709 13:13:36.447017  8662 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:36.512600  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:36.490851  7889 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:13:36.512300  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 127383us
I20260709 13:13:36.472824  8762 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.472610  8674 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:36.515051  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:36.519994  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:36.520797  7182 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:36.503711  7262 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:36.516793  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:36.508585  7261 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:36.514097  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:36.521575  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:36.428049  7861 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:36.522794  7179 raft_consensus.cc:2376] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4. Re-sending same reply.
I20260709 13:13:36.530298  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:36.491653  8661 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:36.475898  8829 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:36.484921  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:36.484475  8819 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:36.537153  7331 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.527709  8764 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:36.542773  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:36.554435  7182 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:36.518941  8781 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:36.543845  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:36.528801  8701 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:36.559466  7178 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:36.559517  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:36.560182  7261 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
W20260709 13:13:36.520514  8631 consensus_meta.cc:287] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.351s	user 0.020s	sys 0.000s
I20260709 13:13:36.548156  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:36.564245  7333 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:36.509596  8801 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:36.483233  8765 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:13:36.514657  8796 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:36.567473  8796 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:36.567924  8796 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:36.568856  8796 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:36.515292  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:36.556517  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:36.572029  7890 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.518745  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:36.519079  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:36.557502  7182 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:36.580363  7187 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:36.524155  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:36.545849  7179 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:36.530006  8822 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:36.564647  7333 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:36.562330  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:36.518893  8785 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:36.546557  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:36.548065  8692 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:36.589627  8794 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.631s	user 0.013s	sys 0.009s
I20260709 13:13:36.575472  8806 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:36.556815  8761 raft_consensus.cc:2764] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:13:36.551889  8634 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:36.572846  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 190534us
I20260709 13:13:36.504568  8817 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:13:36.536384  8639 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:13:36.622104  8639 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:36.622534  8639 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:13:36.580360  8722 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.625s	user 0.015s	sys 0.004s
W20260709 13:13:36.579207  8759 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.588s	user 0.014s	sys 0.001s
W20260709 13:13:36.589921  8556 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.588s	user 0.013s	sys 0.003s
W20260709 13:13:36.634316  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 117619us
I20260709 13:13:36.572500  8826 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:36.576076  8631 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:36.591279  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 67204us
I20260709 13:13:36.604482  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:36.589607  7328 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.601923  7333 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.649724  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:36.650048  7333 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:36.563208  8553 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:13:36.612819  8850 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:36.617748  7331 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:36.607126  8785 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:36.608520  7892 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.602311  8781 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:36.629446  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 116921us
I20260709 13:13:36.609071  8713 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:36.651012  7302 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:36.609514  8783 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.609760  8794 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:36.579039  8801 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:36.659145  8840 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:13:36.607489  8692 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.706485  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:36.652993  8722 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:36.659982  8761 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:36.721735  7261 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:36.702528  8701 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.683825  8713 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.680450  8850 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:36.645879  8556 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:36.706943  8585 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:13:36.713289  8639 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:36.646421  8759 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:36.722777  7302 leader_election.cc:400] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4.
I20260709 13:13:36.914811  7302 leader_election.cc:403] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:36.659757  8826 raft_consensus.cc:697] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:36.662374  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:36.751729  8804 consensus_meta.cc:287] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.893s	user 0.025s	sys 0.010s
I20260709 13:13:36.723119  7185 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:36.949856  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 133) took 2094 ms. Trace:
I20260709 13:13:36.751825  8828 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.633533  8764 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:36.800700  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.807670  8573 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:36.663430  8785 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:36.729892  8713 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.719391  8781 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.994269  8781 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.723872  8807 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:13:36.730376  8787 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.732s	user 0.015s	sys 0.000s
I20260709 13:13:36.725018  8761 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:36.841666  8813 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:36.812891  8721 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.007s
I20260709 13:13:36.733616  8692 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:36.873171  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.726022  8701 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.011722  8807 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:37.032235  8807 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.035024  8759 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:36.734023  7256 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:36.714208  8783 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:36.731843  8850 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:36.932866  8826 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:36.936874  7259 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:37.000476  8631 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:37.000685  7330 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:36.881309  8639 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:36.956709  7255 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.514s	user 0.017s	sys 0.018s
I20260709 13:13:37.087584  7255 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:36.959877  8828 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:36.962721  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.996676  7184 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:36.969354  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:37.001997  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.043191  8759 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.955718  8674 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:37.007213  8763 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.004s	user 0.020s	sys 0.015s
I20260709 13:13:37.097136  7255 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:36.998273  7258 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:36.950291  7185 rpcz_store.cc:276] 0709 13:13:34.855496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.878109 (+ 22613us) service_pool.cc:224] Handling call
0709 13:13:35.223457 (+345348us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:13:35.223774 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:36.948578 (+1724804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:36.949592 (+  1014us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400117e54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:36.949794 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3351024768}
W20260709 13:13:36.941270  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 218562us
W20260709 13:13:37.025738  8720 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.880s	user 0.017s	sys 0.020s
W20260709 13:13:37.022078  8831 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:13:36.942447  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.084601  8656 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:37.085538  8725 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.821s	user 0.011s	sys 0.019s
W20260709 13:13:37.091240  8546 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.213s	user 0.021s	sys 0.007s
I20260709 13:13:37.100100  7253 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:37.100476  8674 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:37.102092  8828 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:37.103121  7259 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:37.039465  8721 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.104387  8701 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:37.105307  7271 tablet_copy_service.cc:140] P efc9ee9e1d86480790fa83f6ad0c295c: Received BeginTabletCopySession request for tablet 242a63190870450082200759c7f513ab from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:57560)
I20260709 13:13:37.106208  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:37.106805  8763 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.108245  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:37.111047  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:37.087822  8827 consensus_meta.cc:287] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.707s	user 0.015s	sys 0.012s
W20260709 13:13:37.121034  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 151759us
I20260709 13:13:36.991662  8585 tablet_bootstrap.cc:492] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260709 13:13:37.172937  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 66822.5us
I20260709 13:13:37.173384  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:37.127422  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:37.128605  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:37.174842  7178 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:37.129525  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:37.130414  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:37.113673  8759 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.096836  8806 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.135934  8848 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:13:37.136731  8842 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.137749  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:37.143014  7331 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:37.026096  8846 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:13:37.144274  7333 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:37.131356  8356 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:13:37.112309  8556 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:37.191201  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:36.955927  8804 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.152428  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:37.224440  7184 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:37.007284  8785 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.115734  8720 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.113950  8801 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:37.163658  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:37.167208  7254 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:37.172493  7186 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:37.172387  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:37.174242  7262 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:13:37.152077  8751 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.013s
I20260709 13:13:37.127331  8761 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.233328  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:37.234380  7333 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:37.011446  8813 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:37.176513  7182 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:37.177327  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:13:37.186023  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.009s	sys 0.055s
W20260709 13:13:37.241997  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.010s	sys 0.055s
W20260709 13:13:37.242347  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 794192us
I20260709 13:13:37.243578  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:37.186369  7859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.005s	sys 0.021s
W20260709 13:13:37.244458  7859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.005s	sys 0.021s
W20260709 13:13:37.244804  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 860392us
I20260709 13:13:37.119284  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:37.226431  7335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.016s	sys 0.055s
W20260709 13:13:37.183339  8712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.028s	sys 0.053s
W20260709 13:13:37.232731  7257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.019s	sys 0.014s
W20260709 13:13:37.246423  7335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.016s	sys 0.055s
I20260709 13:13:37.246456  7260 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:37.222249  8718 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:37.276050  7257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.019s	sys 0.014s
I20260709 13:13:37.277015  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:37.226413  8760 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.944s	user 0.003s	sys 0.041s
I20260709 13:13:37.212991  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 1878) took 1141 ms. Trace:
W20260709 13:13:37.305809  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 59758.4us
I20260709 13:13:37.307875  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:37.308897  7893 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 4: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:37.309294  8843 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:37.309626  8801 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:37.310230  8801 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:37.310428  8793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.027s	sys 0.040s
W20260709 13:13:37.311111  8793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.028s	sys 0.040s
I20260709 13:13:37.309950  8843 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:37.226118  8631 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:37.183398  7271 tablet_copy_service.cc:161] P efc9ee9e1d86480790fa83f6ad0c295c: Beginning new tablet copy session on tablet 242a63190870450082200759c7f513ab from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:57560: session id = 9a54ecc9fb4541df915f9f8c01e19429-242a63190870450082200759c7f513ab
W20260709 13:13:37.275193  8712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.029s	sys 0.053s
I20260709 13:13:37.317013  7336 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:37.320849  8856 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:37.321539  8856 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:37.322407  8843 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:37.322665  8856 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.323421  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:37.178256  8827 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:37.225996  7892 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:37.276546  8785 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.306360  8556 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:37.183477  8806 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.316228  7253 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 4: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:37.315413  7181 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:37.330075  7228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.023s	sys 0.044s
I20260709 13:13:37.294327  8718 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.240586  7185 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:37.335855  7332 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.009s
I20260709 13:13:37.363158  7332 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:37.338009  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:37.353399  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:37.317706  8471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.006s	sys 0.013s
I20260709 13:13:37.364173  7184 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:37.319285  8573 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:37.364138  7333 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:37.355962  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:37.354396  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:37.250644  8751 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:37.365216  7183 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.326386  8725 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:37.366318  7178 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:37.324808  8819 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:37.361367  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 182016us
I20260709 13:13:37.330044  8631 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:37.222510  8842 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:37.344139  8762 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.794s	user 0.012s	sys 0.000s
W20260709 13:13:37.342494  8796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.019s	sys 0.015s
I20260709 13:13:37.364997  8718 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:37.366194  7152 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.002s	sys 0.026s
W20260709 13:13:37.357713  7228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.023s	sys 0.044s
I20260709 13:13:37.312930  8848 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:13:37.335978  8662 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.357259  8585 tablet_bootstrap.cc:492] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:37.406711  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:37.366607  8471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.006s	sys 0.013s
I20260709 13:13:37.346644  8556 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:37.359515  8783 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:37.367869  7890 consensus_meta.cc:287] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.003s
W20260709 13:13:37.362290  7862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.011s	sys 0.030s
W20260709 13:13:37.548767  7862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.012s	sys 0.030s
W20260709 13:13:37.549223  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 1.03547e+06us
I20260709 13:13:37.395615  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:37.407713  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1101) took 1005 ms. Trace:
I20260709 13:13:37.552567  7333 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:37.552450  7336 rpcz_store.cc:276] 0709 13:13:36.402687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.404080 (+  1393us) service_pool.cc:224] Handling call
0709 13:13:37.407512 (+1003432us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54001b8d54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:37.407643 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2076849024}
I20260709 13:13:37.312474  7258 rpcz_store.cc:276] 0709 13:13:36.041010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.043686 (+  2676us) service_pool.cc:224] Handling call
0709 13:13:37.176578 (+1132892us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54002d3f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:37.182737 (+  6159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355162368}
W20260709 13:13:37.404918  7152 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.002s	sys 0.026s
W20260709 13:13:37.553817  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 864608us
I20260709 13:13:37.554423  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:37.539058  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 133728us
I20260709 13:13:37.368547  8843 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:37.541801  7183 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
W20260709 13:13:37.542944  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.331848  8859 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:13:37.397753  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:37.345016  8656 consensus_queue.cc:1059] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:13:37.394873  8853 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:37.391322  8573 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:37.373210  8725 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:37.398504  8796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.020s	sys 0.015s
W20260709 13:13:38.006438  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:37.601811  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 47439.8us
I20260709 13:13:37.975819  7184 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:37.712684  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:38.011526  7333 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
W20260709 13:13:37.785511  7328 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.100s	user 0.017s	sys 0.021s
W20260709 13:13:37.538596  8764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.013s	sys 0.029s
W20260709 13:13:37.397792  8838 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.005s	sys 0.009s
I20260709 13:13:38.027921  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:37.372934  8854 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:37.620613  7327 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:37.685463  8825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.010s	sys 0.022s
W20260709 13:13:37.669881  8713 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.001s
I20260709 13:13:38.071444  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:37.622596  7179 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:37.669534  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:37.776182  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:37.730021  8585 ts_tablet_manager.cc:1403] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 3.072s	user 0.039s	sys 0.056s
I20260709 13:13:37.548225  8556 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:37.835773  7301 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.796s (SENT) [suppressed 11 similar messages]
I20260709 13:13:37.687870  8721 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:37.726718  8674 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:37.408288  8819 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.013674  7328 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:37.547845  7890 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:38.023277  8843 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.770736  8844 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:37.669510  7330 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:37.632602  8828 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:37.403800  8762 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:37.751586  8763 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:37.706552  8701 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:13:38.073621  8850 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.016s	sys 0.020s
I20260709 13:13:37.621155  8712 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.770272  8729 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.354s
I20260709 13:13:38.196619  8827 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.183056  7333 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:37.780285  8759 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:38.105574  8825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.586s	user 0.010s	sys 0.032s
W20260709 13:13:38.022743  8764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.026s	sys 0.035s
I20260709 13:13:37.538451  8662 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:37.782002  8799 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.704s	user 0.011s	sys 0.016s
I20260709 13:13:37.780025  8751 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:38.197573  7299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.022s	sys 0.030s
I20260709 13:13:37.782570  8813 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.224987  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1043) took 1748 ms. Trace:
W20260709 13:13:38.255745  7890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 307) took 1763 ms (client timeout 1786 ms). Trace:
I20260709 13:13:38.005744  8720 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:37.785778  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:38.028589  8838 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.401s	user 0.018s	sys 0.047s
I20260709 13:13:38.031868  8842 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.150131  8854 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:38.029279  8804 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:37.622069  8794 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.654s
I20260709 13:13:38.014309  8853 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.249491  8725 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:38.251506  7887 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.894s	user 0.008s	sys 0.001s
I20260709 13:13:38.252161  8828 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:38.256246  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 235231us
I20260709 13:13:38.002990  7185 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:38.184535  8713 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.262210  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1108) took 1837 ms. Trace:
W20260709 13:13:38.245699  8852 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:13:38.220693  8843 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:38.225258  8847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.006s	sys 0.020s
I20260709 13:13:38.270328  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:38.459838  7333 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:38.256276  8850 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.016s	sys 0.021s
I20260709 13:13:37.620913  8864 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:38.246173  8808 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4.
I20260709 13:13:37.668856  8631 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:38.288727  8867 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
W20260709 13:13:38.292057  8792 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 2.057s	user 0.010s	sys 0.010s
I20260709 13:13:38.292614  8662 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:38.104931  8796 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:13:38.293402  7299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.023s	sys 0.031s
I20260709 13:13:38.038002  8871 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:38.273435  7329 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.623s	user 0.007s	sys 0.005s
I20260709 13:13:38.264293  8806 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:38.293395  8718 consensus_meta.cc:287] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.754s	user 0.006s	sys 0.000s
I20260709 13:13:38.255609  8859 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
W20260709 13:13:38.391676  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 415149us
I20260709 13:13:38.296298  8799 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:38.390851  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:38.328081  8827 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.262770  8701 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.267645  8712 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.333235  8879 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:38.456281  7335 rpcz_store.cc:276] 0709 13:13:36.416728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.418721 (+  1993us) service_pool.cc:224] Handling call
0709 13:13:36.419026 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:36.525014 (+105988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:36.525231 (+   217us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:36.537740 (+ 12509us) log.cc:844] Serialized 26 byte log entry
0709 13:13:37.275729 (+737989us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:37.275768 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.275854 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:38.253432 (+977578us) raft_consensus.cc:1685] finished
0709 13:13:38.253458 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:38.253604 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103978,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":16797,"thread_start_us":793840,"threads_started":2,"wal-append.queue_time_us":1151966}
I20260709 13:13:38.325822  7328 rpcz_store.cc:276] 0709 13:13:36.476059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.483434 (+  7375us) service_pool.cc:224] Handling call
0709 13:13:38.221151 (+1737717us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:38.458356  8785 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.112s	user 0.007s	sys 0.003s
W20260709 13:13:38.330164  7890 rpcz_store.cc:269] 0709 13:13:36.483716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.503841 (+ 20125us) service_pool.cc:224] Handling call
0709 13:13:38.225509 (+1721668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:38.386277  7887 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
W20260709 13:13:38.466385  8847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.006s	sys 0.020s
I20260709 13:13:38.466524  8759 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.526721  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:38.618211  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 91668.6us
I20260709 13:13:38.530885  7329 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:38.621898  8801 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:38.530294  7258 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:38.532341  7254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 997) took 2146 ms (client timeout 1771 ms). Trace:
I20260709 13:13:38.587481  8573 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:38.622987  7254 rpcz_store.cc:269] 0709 13:13:36.377221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.377388 (+   167us) service_pool.cc:224] Handling call
0709 13:13:38.523277 (+2145889us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54002d4454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:38.523387 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764148608}
I20260709 13:13:38.506526  8864 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.524680  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:38.585855  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 750065us
I20260709 13:13:38.589466  7260 raft_consensus.cc:2368] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
I20260709 13:13:38.522737  8804 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:38.601799  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 48013.6us
W20260709 13:13:38.611141  8779 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 2.513s	user 0.018s	sys 0.020s
W20260709 13:13:38.532213  8862 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.745s	user 0.000s	sys 0.002s
W20260709 13:13:38.562263  8781 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.567s	user 0.011s	sys 0.002s
W20260709 13:13:38.609236  8868 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
I20260709 13:13:38.534507  8764 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.534852  8813 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.552032  8656 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.532132  8888 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:38.536401  8882 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.535140  8871 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.554148  8881 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.615619  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:38.552886  8718 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.624646  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:38.540901  7180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1706) took 2592 ms (client timeout 2032 ms). Trace:
I20260709 13:13:38.625522  7335 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:38.523424  8792 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.639530  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:38.673913  8718 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:38.663671  8888 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.675675  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:38.676766  8888 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.676964  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:38.678136  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:38.589411  7271 tablet_copy_source_session.cc:215] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:13:38.679101  8875 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.242s	user 0.000s	sys 0.002s
I20260709 13:13:38.679665  7271 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:57560 (request call id 106) took 1575 ms. Trace:
I20260709 13:13:38.578157  7333 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
W20260709 13:13:38.641069  8878 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:13:38.628898  8512 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.641021  8804 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.555091  8885 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:38.647830  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:38.616948  8721 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:13:38.650906  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.619366  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:38.667681  8874 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:13:38.623836  8799 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.629159  8880 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:38.649355  8873 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
I20260709 13:13:38.652210  8781 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.694569  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:38.699932  8701 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.655047  8764 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.657302  8813 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.709421  8864 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:38.658031  8656 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.710615  8813 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:38.711647  8656 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.626902  8819 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:38.600505  8827 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.712509  8764 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.713647  8827 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.634971  8785 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:13:38.699800  8781 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:38.685030  8718 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.715638  8718 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.717866  7184 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:38.680065  7271 rpcz_store.cc:276] 0709 13:13:37.104411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.105006 (+   595us) service_pool.cc:224] Handling call
0709 13:13:38.679552 (+1574546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:38.535225  8796 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.662809  8882 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:38.670871  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1047) took 1500 ms. Trace:
W20260709 13:13:38.670435  7180 rpcz_store.cc:269] 0709 13:13:35.948661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.963863 (+ 15202us) service_pool.cc:224] Handling call
0709 13:13:38.540545 (+2576682us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400271ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:38.540815 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3116481280}
I20260709 13:13:38.671481  8881 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:38.727402  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:38.728420  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.673485  8886 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.641963  8759 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.680826  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1115) took 1366 ms. Trace:
I20260709 13:13:38.733631  7333 rpcz_store.cc:276] 0709 13:13:37.314235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.269970 (+955735us) service_pool.cc:224] Handling call
0709 13:13:38.680768 (+410798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:38.734571  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:38.681501  7894 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:13:38.685328  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 69837us
I20260709 13:13:38.661711  8762 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.645121  8779 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.605490  8879 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.680276  8792 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:38.697625  7185 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:13:38.688216  7260 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:38.687558  7254 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:38.685113  8512 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:38.690275  8721 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:38.756376  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 100937us
I20260709 13:13:38.732720  8864 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.760491  7254 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:38.697849  8799 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:38.691411  8869 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 13:13:38.596943  8854 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.692569  8712 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:38.684893  8828 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:13:38.701707  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1877) took 2661 ms. Trace:
I20260709 13:13:38.696039  8713 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:38.723873  7335 rpcz_store.cc:276] 0709 13:13:37.171031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.624667 (+1453636us) service_pool.cc:224] Handling call
0709 13:13:38.625076 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:38.670562 (+ 45486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.670815 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:38.728731  8859 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:13:38.700381  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:38.695611  8585 raft_consensus.cc:359] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.730211  8882 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.730901  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1705) took 2782 ms. Trace:
I20260709 13:13:38.697345  8804 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.736646  7152 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:38.739640  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:38.740083  7302 connection.cc:256] RPC call timeout handler was delayed by -1.1428237769998759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 13:13:38.741882  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:38.786206  7180 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:38.786571  7333 raft_consensus.cc:2376] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2. Re-sending same reply.
I20260709 13:13:38.787561  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:38.788326  7333 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:38.789641  7333 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:38.690312  8891 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:38.746848  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:38.634449  8853 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.754861  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:38.690418  8885 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:38.759642  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 81570.5us
I20260709 13:13:38.680498  8794 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.758273  8825 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:13:38.762641  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:38.764266  7334 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:13:38.766773  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.725312  8662 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:13:38.741026  8785 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:38.741143  8813 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:38.771886  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:38.699098  8639 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.609s	user 0.011s	sys 0.000s
I20260709 13:13:38.769680  7257 rpcz_store.cc:276] 0709 13:13:36.040648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.041190 (+   542us) service_pool.cc:224] Handling call
0709 13:13:36.052686 (+ 11496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:36.362294 (+309608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:36.362339 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:36.441207 (+ 78868us) log.cc:844] Serialized 26 byte log entry
0709 13:13:37.296010 (+854803us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:37.296089 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.296216 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:38.701413 (+1405197us) raft_consensus.cc:1685] finished
0709 13:13:38.701445 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:38.701628 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56484,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"thread_start_us":1099068,"threads_started":2,"wal-append.queue_time_us":1309253}
I20260709 13:13:38.770977  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:38.763970  8656 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.770118  8718 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.853526  8813 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.862928  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:38.863535  7257 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:38.864503  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:38.864691  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:38.835091  8860 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:13:38.865571  8718 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:38.751091  8886 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:38.844944  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 108362us
I20260709 13:13:38.761498  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:38.866117  8718 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:38.845273  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:38.866492  7254 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:13:38.866575  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:38.867497  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:38.867647  8886 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:38.868197  7254 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:38.868208  8886 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:38.868913  8886 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:38.834049  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1701) took 3104 ms. Trace:
W20260709 13:13:38.778497  8556 consensus_meta.cc:287] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.003s
I20260709 13:13:38.846840  7184 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:38.847681  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:38.873323  7255 raft_consensus.cc:2410] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:38.846326  7260 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:38.851135  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 107) took 1746 ms. Trace:
I20260709 13:13:38.874468  7302 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:38.875201  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:38.852109  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 81210.5us
I20260709 13:13:38.871531  8718 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:38.853338  8892 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:38.881068  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:38.792613  8512 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.844158  8794 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:38.858551  8760 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:38.858786  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1118) took 1523 ms. Trace:
I20260709 13:13:38.886180  7335 rpcz_store.cc:276] 0709 13:13:37.335718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.857949 (+1522231us) service_pool.cc:224] Handling call
0709 13:13:38.858275 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:38.858454 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.858483 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:38.858526 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:38.858557 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.858613 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:38.858735 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:38.886984  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:38.850986  8882 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.860015  8780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a63190870450082200759c7f513ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.850993  7258 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:38.860980  8656 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.866055  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1046) took 1914 ms. Trace:
I20260709 13:13:38.869153  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:38.846220  7182 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:38.871395  7186 rpcz_store.cc:276] 0709 13:13:35.729417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.987750 (+258333us) service_pool.cc:224] Handling call
0709 13:13:35.988007 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:37.232591 (+1244584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.833763 (+1601172us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002715d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:38.833979 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2723607296}
I20260709 13:13:38.790505  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1117) took 1459 ms. Trace:
I20260709 13:13:38.874337  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:38.877502  7180 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:38.874775  7261 rpcz_store.cc:276] 0709 13:13:37.104770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.108867 (+  4097us) service_pool.cc:224] Handling call
0709 13:13:37.109257 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.109639 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:37.109667 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:37.110198 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:13:37.372359 (+262161us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:37.372403 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.372478 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:38.850911 (+1478433us) raft_consensus.cc:1685] finished
0709 13:13:38.850932 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:38.851066 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1243,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"thread_start_us":261655,"threads_started":1,"wal-append.queue_time_us":1100738}
I20260709 13:13:38.870132  8631 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.812799  8713 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:38.812594  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:38.851364  8712 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.870126  8887 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:38.873282  8819 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.865605  8860 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:38.811317  8843 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.845863  8864 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:38.880439  7259 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:38.877485  8827 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:38.890481  8794 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.895610  8764 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:38.890703  8760 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.954459  7184 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:38.852115  8785 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.785641  7181 rpcz_store.cc:276] 0709 13:13:35.948370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.142367 (+193997us) service_pool.cc:224] Handling call
0709 13:13:36.142818 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:37.365885 (+1223067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.730582 (+1364697us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001b3ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:38.730827 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2608146176}
I20260709 13:13:38.888697  8877 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.955116  7333 rpcz_store.cc:276] 0709 13:13:37.330722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.788898 (+1458176us) service_pool.cc:224] Handling call
0709 13:13:38.789306 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.790161 (+   855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.790439 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:38.972440  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:38.958118  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:38.883667  8853 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:38.870076  8886 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.975127  7152 leader_election.cc:400] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
I20260709 13:13:38.883461  8891 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:13:38.955446  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 74036.9us
I20260709 13:13:38.980667  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:38.986321  8828 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.893106  8781 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:13:38.992389  7336 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:38.955296  8804 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:38.975615  8842 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.970469  7254 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:38.974675  8585 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
W20260709 13:13:39.069026  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 52879.1us
I20260709 13:13:38.893337  8556 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:38.970136  8860 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:39.074501  7182 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:39.074568  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:39.076607  7184 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:39.077263  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:39.078104  7186 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 2: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:38.954466  8713 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:38.982460  8796 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:39.085237  7152 leader_election.cc:403] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:38.892843  8871 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:38.987931  8892 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:39.069931  8896 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:13:38.979628  8779 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:39.002692  8887 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:38.992858  8899 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.008488  8760 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:38.991919  8843 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:39.005425  8764 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:38.979301  8806 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:13:39.007926  8903 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:38.982064  8881 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:39.083468  8853 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.074018  8877 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:39.003605  8827 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.083743  8639 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:38.975327  8819 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.093645  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.004925  8900 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.148s
I20260709 13:13:38.980422  8864 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:39.239148  7332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1104) took 2835 ms (client timeout 1810 ms). Trace:
W20260709 13:13:39.277441  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.268579  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:39.282207  7261 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:39.284291  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:39.268339  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 293353us
I20260709 13:13:39.084062  8725 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.286553  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.286917  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.286787  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:39.288769  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:39.289904  7184 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:39.291200  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:39.291775  7184 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:39.269547  7332 rpcz_store.cc:269] 0709 13:13:36.403868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.408151 (+  4283us) service_pool.cc:224] Handling call
0709 13:13:39.238879 (+2830728us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400319cd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:39.239064 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492785920}
I20260709 13:13:39.284934  7333 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:39.298092  7260 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:39.204367  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1109) took 2787 ms. Trace:
I20260709 13:13:39.303788  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:39.287374  8631 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:39.269528  8892 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.304302  7186 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:39.175338  7259 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:39.100678  8902 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:39.101128  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:39.148132  8879 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:39.104482  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:39.140931  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:39.104064  8799 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:39.285429  8764 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:39.307104  7254 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:39.280990  8877 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.308112  7261 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
W20260709 13:13:39.308709  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 212764us
W20260709 13:13:39.202360  7887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 340) took 2725 ms (client timeout 2209 ms). Trace:
I20260709 13:13:39.250113  8553 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:39.285663  8853 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:39.307121  7327 rpcz_store.cc:276] 0709 13:13:36.417164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.420900 (+  3736us) service_pool.cc:224] Handling call
0709 13:13:36.421229 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:38.104500 (+1683271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.203958 (+1099458us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b540031bfd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:39.204256 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260724480}
I20260709 13:13:38.970185  7330 rpcz_store.cc:276] 0709 13:13:36.952135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.103492 (+151357us) service_pool.cc:224] Handling call
0709 13:13:37.538524 (+435032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:38.245498 (+706974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.865847 (+620349us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54001b8d50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:38.865996 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705789824}
I20260709 13:13:39.146733  8897 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:39.253309  8813 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:39.300362  8796 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.298844  8843 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.292546  7185 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:39.289202  8762 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:13:39.301708  8885 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:39.285804  8639 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.292559  8804 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.322559  8712 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:39.286248  8828 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.344944  7181 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.347201  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:39.404814  7254 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:39.333482  8902 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.297336  8725 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.179085  8891 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.286501  8899 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.387403  8785 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:39.324414  8892 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:39.316463  8881 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:13:39.380142  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:39.404062  8712 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.292608  8903 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.348170  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:39.387866  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:39.339196  7892 raft_consensus.cc:2376] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3. Re-sending same reply.
I20260709 13:13:39.420156  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:39.341996  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56534.1us
W20260709 13:13:39.393184  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53884.3us
W20260709 13:13:39.397639  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 89895.3us
I20260709 13:13:39.425202  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:39.397177  8843 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:39.376484  7887 rpcz_store.cc:269] 0709 13:13:36.477108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.483223 (+  6115us) service_pool.cc:224] Handling call
0709 13:13:39.202073 (+2718850us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54000bbb54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:39.202257 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713461120}
I20260709 13:13:39.347924  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:39.431730  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:39.343561  8879 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:13:39.409075  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:39.394064  8656 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:39.413036  7228 connection.cc:256] RPC call timeout handler was delayed by -1.1861122459999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 13:13:39.456789  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:39.417670  8900 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:39.433725  8556 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:39.458933  7254 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:39.461758  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1005) took 1117 ms. Trace:
I20260709 13:13:39.293146  8842 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.384320  8553 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:39.430022  8904 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:13:39.415338  7184 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:39.391429  8796 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.410419  8713 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:39.312139  8585 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:39.391871  8897 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.408731  8885 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:39.422204  8712 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:39.465332  8725 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:39.430828  8813 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:39.336256  8860 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.478752  7260 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:13:39.480065  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 60005.3us
I20260709 13:13:39.508071  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.528960  7184 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:39.529258  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:39.530097  8725 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:39.428357  8762 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:39.518843  7181 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:39.522352  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:39.533815  8725 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.534349  8725 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:39.534729  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:39.535440  7181 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:39.524271  8813 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.536722  8813 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:39.538769  8854 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:39.539330  8854 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.520232  8843 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:39.519964  8885 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.509752  8656 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.521461  8899 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:39.541412  8854 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:39.480046  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.530043  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:39.548403  7184 raft_consensus.cc:2368] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:13:39.549575  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:39.512624  8631 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
I20260709 13:13:39.551606  8631 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:39.498304  8893 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:39.531317  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:39.552063  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:39.552106  8631 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.552948  7887 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:39.552963  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.543360  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:39.559209  7333 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:39.391544  8887 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.462321  7259 rpcz_store.cc:276] 0709 13:13:38.344344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.365794 (+ 21450us) service_pool.cc:224] Handling call
0709 13:13:39.461526 (+1095732us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400125554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:39.461676 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540944128}
I20260709 13:13:39.552278  8893 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:39.555114  7184 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:39.554567  7228 leader_election.cc:400] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:13:39.509466  8722 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:39.531414  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:39.480248  8900 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.522557  8713 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.525985  8819 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:39.581666  7182 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:39.577762  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:39.585736  7228 leader_election.cc:403] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:13:39.585701  7333 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
W20260709 13:13:39.541661  8882 consensus_meta.cc:287] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.648s	user 0.004s	sys 0.004s
I20260709 13:13:39.585407  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:39.564503  7150 connection.cc:256] RPC call timeout handler was delayed by -1.0457834450000973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 13:13:39.541633  8656 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.581288  8860 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:39.563489  8899 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:39.576978  8923 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.597954  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:39.597277  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65932.8us
I20260709 13:13:39.584858  8762 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:39.589296  8713 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.606066  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:39.591969  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:39.605253  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:39.589254  8886 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:13:39.601269  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:39.564402  7185 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:39.611949  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:39.612957  8844 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:39.613471  8844 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:39.613549  8861 raft_consensus.cc:3055] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:39.614082  8861 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:39.593060  8819 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:39.598950  8881 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.599951  8899 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.600114  8722 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:39.647351  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.647861  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.649565  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:39.651659  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:39.644865  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:39.620795  8854 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:39.659286  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.602543  8917 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:39.644912  8899 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:39.651767  8908 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:39.648597  7185 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:39.685257  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:39.653558  8903 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:39.619119  8923 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.629496  8881 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.663309  8917 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.702961  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.676455  8847 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.710901  7180 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
W20260709 13:13:39.717368  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.661119  8922 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.739228  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:39.742208  8911 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:39.614988  8861 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.684487  8712 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.700384  8908 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:39.758255  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:39.738180  8794 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 13:13:39.760104  7331 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:39.708045  8902 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:39.764341  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:39.769953  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:39.769994  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.771245  7333 raft_consensus.cc:2376] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2. Re-sending same reply.
I20260709 13:13:39.771378  7180 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:39.737546  8917 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:39.758145  8842 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:39.781970  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:39.782737  7333 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:39.783507  8585 ts_tablet_manager.cc:1434] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 1.570s	user 0.016s	sys 0.026s
W20260709 13:13:39.783926  8585 ts_tablet_manager.cc:1467] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Tablet startup took 1584ms
I20260709 13:13:39.756026  8765 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:39.782156  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:39.758608  7328 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:39.680466  8762 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.761308  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:39.797343  7255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 105) took 2693 ms (client timeout 2349 ms). Trace:
W20260709 13:13:39.805433  7255 rpcz_store.cc:269] 0709 13:13:37.104035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.107956 (+  3921us) service_pool.cc:224] Handling call
0709 13:13:39.794454 (+2686498us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54002f7954. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:39.797249 (+  2795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3927190400}
I20260709 13:13:39.776994  8861 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:39.783762  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:39.750809  8764 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.811764  7259 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:13:39.813442  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:39.819073  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.688804  8893 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.824820  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.777571  8922 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:39.750336  8722 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.785559  8900 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:39.839793  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:39.829802  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:39.841130  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:39.765864  8794 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.757203  8911 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.762243  8847 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:39.845014  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 233138us
I20260709 13:13:39.806860  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.848393  7255 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:39.848860  7180 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:39.851224  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:39.851254  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:39.808570  8765 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:39.860085  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:39.860545  8713 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:39.834667  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1114) took 2526 ms. Trace:
I20260709 13:13:39.842339  8819 raft_consensus.cc:697] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:39.854053  8870 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:39.856825  8718 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.968s	user 0.011s	sys 0.010s
I20260709 13:13:39.862017  7255 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:39.860761  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:39.858244  7181 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:39.861097  8843 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:39.874468  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:39.876088  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:39.872972  8922 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:39.843611  8854 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:39.873235  8765 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:39.861840  8908 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:40.355870  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:40.326519  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 175355us
W20260709 13:13:40.226758  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.359397  7180 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:39.869063  8870 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.360143  7255 raft_consensus.cc:2368] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
W20260709 13:13:40.321930  8892 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.900s	user 0.008s	sys 0.006s
W20260709 13:13:39.914212  8760 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.000s
W20260709 13:13:40.073474  8932 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 13:13:40.387086  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.267438  8891 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.183s
I20260709 13:13:40.040702  8713 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:40.451370  7894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 302) took 3982 ms (client timeout 2186 ms). Trace:
W20260709 13:13:40.073221  8925 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
W20260709 13:13:40.258307  8725 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.723s	user 0.008s	sys 0.004s
W20260709 13:13:40.208360  8853 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.808s	user 0.009s	sys 0.009s
W20260709 13:13:40.160519  8934 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:13:40.137355  8926 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:13:40.491019  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 112) took 1732 ms. Trace:
I20260709 13:13:40.420253  7259 raft_consensus.cc:2376] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5. Re-sending same reply.
I20260709 13:13:40.441939  8794 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:40.467880  7187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1713) took 3348 ms (client timeout 1994 ms). Trace:
W20260709 13:13:40.501645  7187 rpcz_store.cc:269] 0709 13:13:37.119537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.159459 (+ 39922us) service_pool.cc:224] Handling call
0709 13:13:40.451624 (+3292165us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54002c4554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:40.467770 (+ 16146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5051513088}
W20260709 13:13:40.376386  8844 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.762s	user 0.003s	sys 0.017s
I20260709 13:13:40.472653  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:40.503037  7180 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:39.897701  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:40.040280  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:40.228271  8881 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:40.413941  8870 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:40.419682  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1731) took 1629 ms. Trace:
I20260709 13:13:39.914911  8718 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.479264  8930 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 13:13:40.484897  8813 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.948s	user 0.004s	sys 0.015s
I20260709 13:13:40.364624  8897 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:40.487133  8923 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:40.491446  7261 rpcz_store.cc:276] 0709 13:13:38.758928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.471339 (+712411us) service_pool.cc:224] Handling call
0709 13:13:39.506596 (+ 35257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:39.544616 (+ 38020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.544662 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:39.562661 (+ 17999us) log.cc:844] Serialized 26 byte log entry
0709 13:13:39.675997 (+113336us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:39.676037 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.676111 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.490763 (+814652us) raft_consensus.cc:1685] finished
0709 13:13:40.490782 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.490940 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39145,"raft.queue_time_us":39675,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":34093,"thread_start_us":74184,"threads_started":1,"wal-append.queue_time_us":212981}
I20260709 13:13:40.500449  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 132) took 1854 ms. Trace:
I20260709 13:13:40.500041  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 111) took 1741 ms. Trace:
I20260709 13:13:39.866648  7328 rpcz_store.cc:276] 0709 13:13:37.308202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.675185 (+2366983us) service_pool.cc:224] Handling call
0709 13:13:39.707761 (+ 32576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:39.795881 (+ 88120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.827503 (+ 31622us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.476042  8712 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:40.535777  8860 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.933s	user 0.003s	sys 0.017s
I20260709 13:13:40.476750  8713 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.536532  8759 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:40.538393  8713 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:40.540436  8718 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:39.784286  8585 ts_tablet_manager.cc:1469] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Trace:
0709 13:13:27.572152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:27.574309 (+  2157us) service_pool.cc:224] Handling call
0709 13:13:28.147282 (+572973us) ts_tablet_manager.cc:934] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171)
0709 13:13:31.120767 (+2973485us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:13:31.774394 (+653627us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:31.774532 (+   138us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:13:32.075874 (+301342us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:13:32.076175 (+   301us) tablet_replica.cc:206] Creating consensus instance
0709 13:13:32.076517 (+   342us) ts_tablet_manager.cc:989] Replica registered.
0709 13:13:32.076590 (+    73us) inbound_call.cc:177] Queueing success response
0709 13:13:34.658099 (+2581509us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:13:38.219603 (+3561504us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:13:38.681513 (+461910us) tablet_replica.cc:261] Starting instrumentation
0709 13:13:38.693740 (+ 12227us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":43126,"raft.queue_time_us":180859,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":37828,"tablet-copy.queue_time_us":465205,"tablet-download-pool.queue_time_us":2894,"tablet-download-pool.run_cpu_time_us":1763,"tablet-download-pool.run_wall_time_us":983285,"thread_start_us":641183,"threads_started":3}
W20260709 13:13:40.544405  8877 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.160s	user 0.010s	sys 0.009s
I20260709 13:13:40.544863  8877 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:40.525518  7327 rpcz_store.cc:276] 0709 13:13:38.646025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.392035 (+746010us) service_pool.cc:224] Handling call
0709 13:13:39.419981 (+ 27946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:39.550907 (+130926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.550947 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:39.636121 (+ 85174us) log.cc:844] Serialized 26 byte log entry
0709 13:13:39.840204 (+204083us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:40.096527 (+256323us) log.cc:844] Serialized 14 byte log entry
0709 13:13:40.366479 (+269952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.432892 (+ 66413us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.500195 (+ 67303us) raft_consensus.cc:1685] finished
0709 13:13:40.500224 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.500375 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38584,"raft.queue_time_us":65803,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":5410,"thread_start_us":293766,"threads_started":3,"wal-append.queue_time_us":204139}
I20260709 13:13:40.548884  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:40.549721  7327 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:40.528996  7258 rpcz_store.cc:276] 0709 13:13:38.758664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.466002 (+707338us) service_pool.cc:224] Handling call
0709 13:13:39.507172 (+ 41170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:39.562247 (+ 55075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.564883 (+  2636us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:39.602068 (+ 37185us) log.cc:844] Serialized 26 byte log entry
0709 13:13:39.733017 (+130949us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:39.853684 (+120667us) log.cc:844] Serialized 14 byte log entry
0709 13:13:39.863325 (+  9641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.868296 (+  4971us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.499791 (+631495us) raft_consensus.cc:1685] finished
0709 13:13:40.499809 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.499970 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37124,"prepare.queue_time_us":134545,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":5253,"raft.queue_time_us":48317,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":4220,"spinlock_wait_cycles":49064704,"thread_start_us":212219,"threads_started":2,"wal-append.queue_time_us":165544}
I20260709 13:13:40.553030  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:40.553833  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1020) took 1081 ms. Trace:
W20260709 13:13:40.553962  8861 consensus_meta.cc:287] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.731s	user 0.007s	sys 0.003s
I20260709 13:13:40.555127  7330 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:40.507813  8844 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:40.557700  8827 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:40.558076  8844 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:40.558851  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1276) took 1099 ms. Trace:
I20260709 13:13:40.559274  7185 rpcz_store.cc:276] 0709 13:13:39.459038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.936864 (+477826us) service_pool.cc:224] Handling call
0709 13:13:40.558782 (+621918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.518950  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:40.466120  7894 rpcz_store.cc:269] 0709 13:13:36.469430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.470824 (+  1394us) service_pool.cc:224] Handling call
0709 13:13:40.451074 (+3980250us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b5400684f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:40.451282 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5081719552}
I20260709 13:13:40.554188  7258 rpcz_store.cc:276] 0709 13:13:39.472507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.552743 (+1080236us) service_pool.cc:224] Handling call
0709 13:13:40.553770 (+  1027us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.522957  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:40.563642  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1028) took 1089 ms. Trace:
I20260709 13:13:40.563972  7261 rpcz_store.cc:276] 0709 13:13:39.474761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.522678 (+1047917us) service_pool.cc:224] Handling call
0709 13:13:40.563586 (+ 40908us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.492671  8853 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:40.459267  8892 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.529488  7332 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:40.506897  8847 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:40.491465  8725 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:40.472846  8911 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:40.518347  8854 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:40.528682  8899 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.840s	user 0.011s	sys 0.000s
W20260709 13:13:40.533738  8917 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.005s
I20260709 13:13:40.593585  7256 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:40.510947  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1018) took 1036 ms. Trace:
I20260709 13:13:40.535377  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:40.516258  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:40.597039  7180 raft_consensus.cc:2410] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:40.460016  8760 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.564896  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:40.600219  7261 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:13:40.522821  8813 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:40.600839  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1031) took 1091 ms. Trace:
I20260709 13:13:40.194084  8819 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.563023  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1733) took 1717 ms. Trace:
W20260709 13:13:40.603325  7859 connection.cc:256] RPC call timeout handler was delayed by -1.8033605519999583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 13:13:40.603410  7187 rpcz_store.cc:276] 0709 13:13:38.845302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.505505 (+1660203us) service_pool.cc:224] Handling call
0709 13:13:40.562952 (+ 57447us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:40.603821  7859 connection.cc:256] RPC call timeout handler was delayed by -1.4757605520001107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
I20260709 13:13:40.513522  7181 rpcz_store.cc:276] 0709 13:13:38.790113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.534374 (+744261us) service_pool.cc:224] Handling call
0709 13:13:40.406134 (+871760us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:40.588424  7860 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.011s	sys 0.013s
I20260709 13:13:40.601830  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1732) took 1768 ms. Trace:
I20260709 13:13:40.607550  7180 rpcz_store.cc:276] 0709 13:13:38.833923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.503598 (+1669675us) service_pool.cc:224] Handling call
0709 13:13:40.601773 (+ 98175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.601186  7261 rpcz_store.cc:276] 0709 13:13:39.509360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.564630 (+1055270us) service_pool.cc:224] Handling call
0709 13:13:40.600782 (+ 36152us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:40.604822  7859 connection.cc:256] RPC call timeout handler was delayed by -1.438860552000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 13:13:40.608485  7859 connection.cc:256] RPC call timeout handler was delayed by -1.1562605520000488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23490000000000003s for a response
I20260709 13:13:40.608788  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:40.609161  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:40.566830  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:40.612529  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:40.616518  7860 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.013s	sys 0.013s
I20260709 13:13:40.601416  8923 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:40.624765  8935 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.632936  8935 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.634912  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:40.635720  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1287) took 1019 ms. Trace:
I20260709 13:13:40.636049  7180 rpcz_store.cc:276] 0709 13:13:39.616616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.608267 (+991651us) service_pool.cc:224] Handling call
0709 13:13:40.635660 (+ 27393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.637506  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1727) took 1899 ms. Trace:
I20260709 13:13:40.639294  8892 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:40.642452  7152 leader_election.cc:336] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.771s (SENT)
I20260709 13:13:40.642988  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:40.596868  7259 rpcz_store.cc:276] 0709 13:13:39.471898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.856142 (+384244us) service_pool.cc:224] Handling call
0709 13:13:40.508395 (+652253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.646459  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:40.647768  7259 raft_consensus.cc:2410] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:40.648356  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1024) took 1174 ms. Trace:
I20260709 13:13:40.648875  7327 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:40.648818  7259 rpcz_store.cc:276] 0709 13:13:39.473645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.646023 (+1172378us) service_pool.cc:224] Handling call
0709 13:13:40.648276 (+  2253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.649978  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:40.613236  8858 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:40.651265  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:40.610550  8940 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:40.637879  7180 rpcz_store.cc:276] 0709 13:13:38.738117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.636703 (+1898586us) service_pool.cc:224] Handling call
0709 13:13:40.637016 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.637192 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.637218 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.637263 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:40.637293 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.637344 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.637456 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.607455  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:40.596076  8899 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:40.610348  8877 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:40.650346  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:40.613322  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:40.633009  8761 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:40.628504  8859 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.675400  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1729) took 1909 ms. Trace:
I20260709 13:13:40.677978  7180 rpcz_store.cc:276] 0709 13:13:38.765593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.655176 (+1889583us) service_pool.cc:224] Handling call
0709 13:13:40.674736 (+ 19560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.674962 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.675001 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.675059 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:40.675104 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.675177 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.675325 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.652138  8940 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.658187  8763 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:40.626462  8765 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:40.681699  8853 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:40.600399  8917 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.685211  7261 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:40.671532  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:40.694955  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:40.696482  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:40.697067  7180 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:40.702457  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1724) took 1965 ms. Trace:
I20260709 13:13:40.702980  7181 rpcz_store.cc:276] 0709 13:13:38.737122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.623565 (+1886443us) service_pool.cc:224] Handling call
0709 13:13:40.671528 (+ 47963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.683122 (+ 11594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.684653 (+  1531us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.687558 (+  2905us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:40.688221 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.702221 (+ 14000us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.702388 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.704099  8940 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:40.704862  8935 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:40.687578  7258 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:40.706103  8813 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:40.706471  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1030) took 1197 ms. Trace:
I20260709 13:13:40.706861  7258 rpcz_store.cc:276] 0709 13:13:39.509076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.587617 (+1078541us) service_pool.cc:224] Handling call
0709 13:13:40.706404 (+118787us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.707940  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:40.708567  7258 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.708325  8870 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:40.710587  7333 raft_consensus.cc:2368] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:40.683243  8859 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.712430  8917 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:40.713042  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1277) took 1233 ms. Trace:
I20260709 13:13:40.713470  7185 rpcz_store.cc:276] 0709 13:13:39.459298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.582271 (+1122973us) service_pool.cc:224] Handling call
0709 13:13:40.692409 (+110138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.713888  8859 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:40.685025  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:40.715117  7328 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:40.715375  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1110) took 4297 ms. Trace:
I20260709 13:13:40.716136  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:40.716642  7183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1260) took 4321 ms (client timeout 1786 ms). Trace:
I20260709 13:13:40.717438  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:40.677450  8725 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:40.717145  7183 rpcz_store.cc:269] 0709 13:13:36.395537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.446033 (+ 50496us) service_pool.cc:224] Handling call
0709 13:13:40.716388 (+4270355us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b5400257954. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:40.716533 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111912320}
I20260709 13:13:40.657881  8923 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.715885  7334 rpcz_store.cc:276] 0709 13:13:36.417487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.417653 (+   166us) service_pool.cc:224] Handling call
0709 13:13:36.418047 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.849035 (+2430988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.715019 (+1865984us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b5400191ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:40.715281 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5395215616}
I20260709 13:13:40.718669  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1021) took 1220 ms. Trace:
I20260709 13:13:40.723913  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:40.725111  7259 rpcz_store.cc:276] 0709 13:13:39.472827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.649947 (+1177120us) service_pool.cc:224] Handling call
0709 13:13:40.693264 (+ 43317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.731220  7334 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:40.731963  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 133) took 2083 ms. Trace:
I20260709 13:13:40.732255  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 114) took 1972 ms. Trace:
I20260709 13:13:40.730149  7180 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:13:40.732267  7334 rpcz_store.cc:276] 0709 13:13:38.648403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.730687 (+2082284us) service_pool.cc:224] Handling call
0709 13:13:40.731040 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.731714 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.731908 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.722198  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:40.735656  7334 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:40.722412  7327 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:40.737103  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 134) took 2084 ms. Trace:
I20260709 13:13:40.737543  7334 rpcz_store.cc:276] 0709 13:13:38.655417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.733790 (+2078373us) service_pool.cc:224] Handling call
0709 13:13:40.735436 (+  1646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.736120 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.736341 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.734826  7185 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:40.739240  7180 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:40.750870  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.747236  8870 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:40.751813  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 139320us
I20260709 13:13:40.754397  8639 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:40.757354  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 126) took 2136 ms. Trace:
W20260709 13:13:40.757714  7329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1103) took 4354 ms (client timeout 1810 ms). Trace:
W20260709 13:13:40.761018  7260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 1906) took 1907 ms (client timeout 1906 ms). Trace:
I20260709 13:13:40.758726  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:40.761591  7260 rpcz_store.cc:269] 0709 13:13:38.853304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.874949 (+ 21645us) service_pool.cc:224] Handling call
0709 13:13:40.760762 (+1885813us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54002161d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:40.760927 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970956544}
I20260709 13:13:40.732669  7259 rpcz_store.cc:276] 0709 13:13:38.759444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.731188 (+1971744us) service_pool.cc:224] Handling call
0709 13:13:40.731580 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.731890 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.731924 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.731977 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:40.732015 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.732075 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.732201 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112}
I20260709 13:13:40.793157  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.752596  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1270) took 1863 ms. Trace:
W20260709 13:13:40.758347  7329 rpcz_store.cc:269] 0709 13:13:36.403507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.406872 (+  3365us) service_pool.cc:224] Handling call
0709 13:13:40.757479 (+4350607us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540025c454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:40.757614 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505224064}
I20260709 13:13:40.808378  7185 rpcz_store.cc:276] 0709 13:13:38.888036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.714283 (+1826247us) service_pool.cc:224] Handling call
0709 13:13:40.722616 (+  8333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.740484 (+ 17868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.751405 (+ 10921us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.796818  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.809667  7329 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:40.810105  7185 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:40.810712  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.799116  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:40.811990  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.803790  8899 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:40.802911  7327 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:40.817094  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1122) took 1812 ms. Trace:
I20260709 13:13:40.817592  7327 rpcz_store.cc:276] 0709 13:13:39.004788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.747316 (+1742528us) service_pool.cc:224] Handling call
0709 13:13:40.802612 (+ 55296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.816647 (+ 14035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.817011 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.819363  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1901) took 2057 ms. Trace:
I20260709 13:13:40.819904  7259 rpcz_store.cc:276] 0709 13:13:38.761506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.793363 (+2031857us) service_pool.cc:224] Handling call
0709 13:13:40.818735 (+ 25372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.818963 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.819013 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.819078 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:40.819116 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.819178 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.819302 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.806253  8923 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:40.828588  7259 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:40.800417  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.799916  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.799392  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.757750  7335 rpcz_store.cc:276] 0709 13:13:38.620963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.887298 (+266335us) service_pool.cc:224] Handling call
0709 13:13:38.887605 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.891367 (+  3762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.891399 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:38.955752 (+ 64353us) log.cc:844] Serialized 26 byte log entry
0709 13:13:39.283190 (+327438us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:39.298683 (+ 15493us) log.cc:844] Serialized 14 byte log entry
0709 13:13:39.298873 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.298954 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.729572 (+1430618us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b18001ef5e0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:13:40.757061 (+ 27489us) raft_consensus.cc:1685] finished
0709 13:13:40.757159 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.757296 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7344,"prepare.queue_time_us":15727,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":11559,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":70144,"spinlock_wait_cycles":16930176,"thread_start_us":291648,"threads_started":1,"wal-append.queue_time_us":355177}
I20260709 13:13:40.794523  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.916059  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1902) took 2151 ms. Trace:
I20260709 13:13:40.794138  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.917218  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 150) took 3359 ms. Trace:
I20260709 13:13:40.857546  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1274) took 1968 ms. Trace:
W20260709 13:13:40.866760  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.917640  7178 rpcz_store.cc:276] 0709 13:13:37.551077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.558119 (+1007042us) service_pool.cc:224] Handling call
0709 13:13:38.558549 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:38.626207 (+ 67658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.626228 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:38.626257 (+    29us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:38.626275 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.854607 (+2228332us) spinlock_profiling.cc:243] Waited 67.5 ms on lock 0x7b540036db54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:40.910459 (+ 55852us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.910587 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155157760}
I20260709 13:13:40.919063  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:40.919652  7256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 115) took 2160 ms (client timeout 2503 ms). Trace:
I20260709 13:13:40.916814  7259 rpcz_store.cc:276] 0709 13:13:38.764630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.821309 (+2056679us) service_pool.cc:224] Handling call
0709 13:13:40.828181 (+  6872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.915693 (+ 87512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.915975 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.903175  7187 raft_consensus.cc:2410] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:40.925683  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.926503  8879 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.903769  7253 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:40.906535  8631 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:40.927145  8879 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:40.927989  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1007) took 2566 ms. Trace:
I20260709 13:13:40.928606  7253 rpcz_store.cc:276] 0709 13:13:38.361575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.365390 (+  3815us) service_pool.cc:224] Handling call
0709 13:13:40.858450 (+2493060us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b5800003098. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117eee 0000000000375939 00007fecee18b1e0 00007fecee2540c4 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:13:40.903574 (+ 45124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.927675 (+ 24101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.927925 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63171968}
I20260709 13:13:40.931124  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1908) took 2075 ms. Trace:
I20260709 13:13:40.931967  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1055) took 1136 ms. Trace:
I20260709 13:13:40.932389  7333 rpcz_store.cc:276] 0709 13:13:39.796121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.829135 (+ 33014us) service_pool.cc:224] Handling call
0709 13:13:40.931759 (+1102624us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54001919d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:40.931909 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961897856}
I20260709 13:13:40.934374  8721 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:40.931689  7253 rpcz_store.cc:276] 0709 13:13:38.855855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.929992 (+2074137us) service_pool.cc:224] Handling call
0709 13:13:40.930408 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.930655 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.930698 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.930752 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:40.930802 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.930887 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.931056 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.935279  7328 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:40.936977  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1123) took 1930 ms. Trace:
I20260709 13:13:40.937302  7328 rpcz_store.cc:276] 0709 13:13:39.006186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.763000 (+1756814us) service_pool.cc:224] Handling call
0709 13:13:40.935059 (+172059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.935728 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.936770 (+  1042us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54001919d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:40.936920 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303687424}
I20260709 13:13:40.940439  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1271) took 2052 ms. Trace:
I20260709 13:13:40.940970  7183 rpcz_store.cc:276] 0709 13:13:38.888275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.720059 (+1831784us) service_pool.cc:224] Handling call
0709 13:13:40.720468 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.722023 (+  1555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.722077 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.724679 (+  2602us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.938512 (+213833us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:40.938554 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.938621 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.940223 (+  1602us) raft_consensus.cc:1685] finished
0709 13:13:40.940241 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.940381 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2135,"raft.queue_time_us":122,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":3798,"spinlock_wait_cycles":1818368,"thread_start_us":205691,"threads_started":1,"wal-append.queue_time_us":206067}
I20260709 13:13:40.909675  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1272) took 2021 ms. Trace:
I20260709 13:13:40.909576  7258 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:40.943482  7183 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:40.943727  7260 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:40.944186  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1280) took 1484 ms. Trace:
I20260709 13:13:40.944484  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1017) took 1489 ms. Trace:
I20260709 13:13:40.944592  7183 rpcz_store.cc:276] 0709 13:13:39.459979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.942792 (+1482813us) service_pool.cc:224] Handling call
0709 13:13:40.943185 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.943968 (+   783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.944136 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.945087  7258 rpcz_store.cc:276] 0709 13:13:39.471550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.707637 (+1236087us) service_pool.cc:224] Handling call
0709 13:13:40.944422 (+236785us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:40.948436  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.947187  7180 rpcz_store.cc:276] 0709 13:13:38.888515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.733776 (+1845261us) service_pool.cc:224] Handling call
0709 13:13:40.739124 (+  5348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.909302 (+170178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.909345 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.909397 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:40.909432 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.909502 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.909617 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":309,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58}
I20260709 13:13:40.910470  7329 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:13:40.920019  7256 rpcz_store.cc:269] 0709 13:13:38.759712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.387499 (+627787us) service_pool.cc:224] Handling call
0709 13:13:40.857422 (+1469923us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001a3454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:40.919596 (+ 62174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2688400640}
I20260709 13:13:40.920941  7896 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:40.957216  7256 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:40.957425  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.957844  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 116) took 2096 ms. Trace:
I20260709 13:13:40.958088  7896 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:40.958204  7256 rpcz_store.cc:276] 0709 13:13:38.861482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.956806 (+2095324us) service_pool.cc:224] Handling call
0709 13:13:40.957060 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.957607 (+   547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.957779 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.958958  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.958333  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:40.959998  7180 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 2: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:40.960068  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.961550  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.868999  8656 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:40.921613  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 135) took 2257 ms. Trace:
I20260709 13:13:40.922515  7327 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.922056  7185 rpcz_store.cc:276] 0709 13:13:38.889084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.809467 (+1920383us) service_pool.cc:224] Handling call
0709 13:13:40.809852 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.810560 (+   708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.857469 (+ 46909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.924163  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.963456  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.963708  8764 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:40.924937  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.925084  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.963955  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.964282  7896 raft_consensus.cc:2410] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:40.925560  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:40.925859  8856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.593s	user 0.007s	sys 0.021s
I20260709 13:13:40.964632  7890 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
W20260709 13:13:40.964949  8856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.639s	user 0.008s	sys 0.022s
I20260709 13:13:40.950007  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.924517  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.965698  7894 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
W20260709 13:13:40.966365  7182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1268) took 2079 ms (client timeout 2120 ms). Trace:
W20260709 13:13:40.966804  7182 rpcz_store.cc:269] 0709 13:13:38.887390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.288522 (+401132us) service_pool.cc:224] Handling call
0709 13:13:40.966229 (+1677707us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54001b44d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:40.966312 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601992064}
I20260709 13:13:40.968061  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1281) took 1507 ms. Trace:
I20260709 13:13:40.953104  8804 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:40.962689  7334 rpcz_store.cc:276] 0709 13:13:38.664131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.738561 (+2074430us) service_pool.cc:224] Handling call
0709 13:13:40.738948 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.739139 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:40.748273 (+  9134us) log.cc:844] Serialized 14 byte log entry
0709 13:13:40.921252 (+172979us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.921300 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:40.921341 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.921407 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.921548 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9148,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":102,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":12160,"thread_start_us":172345,"threads_started":1,"wal-append.queue_time_us":172630}
I20260709 13:13:40.969993  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:40.969333  7183 rpcz_store.cc:276] 0709 13:13:39.460205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.945614 (+1485409us) service_pool.cc:224] Handling call
0709 13:13:40.945926 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.946933 (+  1007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.946975 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.947621 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.967682 (+ 20061us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:40.967730 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.967812 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.967862 (+    50us) raft_consensus.cc:1685] finished
0709 13:13:40.967873 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.967986 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":341,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":167,"thread_start_us":8443,"threads_started":1,"wal-append.queue_time_us":6950}
I20260709 13:13:40.971410  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.973397  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 313) took 1449 ms. Trace:
I20260709 13:13:40.973832  7892 rpcz_store.cc:276] 0709 13:13:39.524437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.527057 (+  2620us) service_pool.cc:224] Handling call
0709 13:13:40.971285 (+1444228us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117eee 0000000000375939 00007fecee18b1e0 00007fecee2540c4 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:13:40.973332 (+  2047us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8522112}
I20260709 13:13:40.974444  7183 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:40.975721  8780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33224 (request call id 289) took 6505 ms. Trace:
I20260709 13:13:40.975818  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1284) took 1514 ms. Trace:
I20260709 13:13:40.921561  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:40.977301  7183 rpcz_store.cc:276] 0709 13:13:39.460928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.973647 (+1512719us) service_pool.cc:224] Handling call
0709 13:13:40.974284 (+   637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.975586 (+  1302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.975770 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:40.976286  8780 rpcz_store.cc:276] 0709 13:13:34.470066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.470209 (+   143us) service_pool.cc:224] Handling call
0709 13:13:35.373767 (+903558us) ts_tablet_manager.cc:934] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
0709 13:13:38.858694 (+3484927us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:13:40.244357 (+1385663us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:40.244516 (+   159us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:13:40.612690 (+368174us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:13:40.661668 (+ 48978us) tablet_replica.cc:206] Creating consensus instance
0709 13:13:40.975588 (+313920us) ts_tablet_manager.cc:989] Replica registered.
0709 13:13:40.975648 (+    60us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8723,"tablet-copy.queue_time_us":585348,"thread_start_us":621825,"threads_started":2}
I20260709 13:13:40.979511  8780 tablet_copy_client.cc:806] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:40.980100  8780 tablet_copy_client.cc:670] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
W20260709 13:13:40.968493  8898 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.802s	user 0.005s	sys 0.019s
I20260709 13:13:40.981612  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 157) took 2264 ms. Trace:
I20260709 13:13:40.982004  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1913) took 2121 ms. Trace:
I20260709 13:13:40.982419  8804 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:40.983457  8804 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.978176  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1023) took 1504 ms. Trace:
I20260709 13:13:40.984566  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:40.984373  7261 rpcz_store.cc:276] 0709 13:13:39.473368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.608549 (+1135181us) service_pool.cc:224] Handling call
0709 13:13:40.977933 (+369384us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54002e7554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:40.978119 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162917248}
I20260709 13:13:40.985821  8804 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:40.986146  7261 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 13:13:40.956063  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 161) took 1952 ms. Trace:
I20260709 13:13:40.986454  7258 rpcz_store.cc:276] 0709 13:13:38.860412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.946084 (+2085672us) service_pool.cc:224] Handling call
0709 13:13:40.946418 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.946671 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:40.968989 (+ 22318us) log.cc:844] Serialized 14 byte log entry
0709 13:13:40.975565 (+  6576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:40.975630 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:40.975682 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.981827 (+  6145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.981946 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21834,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":9226,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":28200,"threads_started":2}
I20260709 13:13:40.987350  7184 rpcz_store.cc:276] 0709 13:13:39.003213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.905279 (+1902066us) service_pool.cc:224] Handling call
0709 13:13:40.905615 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.906002 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.906043 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.906663 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.942392 (+ 35729us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:40.942445 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.942520 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.955842 (+ 13322us) raft_consensus.cc:1685] finished
0709 13:13:40.955865 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.956008 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2963,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":35319,"threads_started":1,"wal-append.queue_time_us":35668}
I20260709 13:13:40.990263  7184 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:40.983347  8721 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.991308  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1034) took 1411 ms. Trace:
I20260709 13:13:40.991271  8721 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:40.993989  8760 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:40.994791  7261 rpcz_store.cc:276] 0709 13:13:39.579812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.985559 (+1405747us) service_pool.cc:224] Handling call
0709 13:13:40.985904 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:40.986607 (+   703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.991223 (+  4616us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:40.995532  7262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1014) took 2537 ms (client timeout 1897 ms). Trace:
I20260709 13:13:40.995647  8796 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:40.995954  7262 rpcz_store.cc:269] 0709 13:13:38.458284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.995333 (+2537049us) service_pool.cc:211] Skipping call since client already timed out
0709 13:13:40.995450 (+   117us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:13:40.996484  8721 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:40.982015  7179 rpcz_store.cc:276] 0709 13:13:38.716801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.716933 (+   132us) service_pool.cc:224] Handling call
0709 13:13:38.717270 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.717592 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.717619 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:38.731475 (+ 13856us) log.cc:844] Serialized 26 byte log entry
0709 13:13:38.881826 (+150351us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:38.881864 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.881945 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.967895 (+2085950us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:13:40.981332 (+ 13437us) raft_consensus.cc:1685] finished
0709 13:13:40.981351 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.981558 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1078,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":23837,"spinlock_wait_cycles":94211456,"thread_start_us":116461,"threads_started":1,"wal-append.queue_time_us":327246}
I20260709 13:13:40.997727  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:40.998009  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47437.1us
I20260709 13:13:40.999686  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1741) took 1335 ms. Trace:
I20260709 13:13:40.998363  7179 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.000293  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:13:41.005797  7186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1275) took 2116 ms (client timeout 1946 ms). Trace:
I20260709 13:13:41.016168  8356 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:41.016932  8356 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:41.017522  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1283) took 1556 ms. Trace:
I20260709 13:13:41.008291  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:41.025789  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:41.026028  8897 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:41.026510  8897 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:41.026738  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 128) took 2405 ms. Trace:
I20260709 13:13:41.026890  8897 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.027138  7332 rpcz_store.cc:276] 0709 13:13:38.625949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.293691 (+667742us) service_pool.cc:224] Handling call
0709 13:13:39.293985 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.577650 (+1283665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.026476 (+448826us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540013d154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:41.026678 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2840921472}
I20260709 13:13:41.005353  8885 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:41.028694  8856 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:41.029177  8856 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:41.029544  8856 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.009239  8806 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.030552  8806 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:41.031361  8806 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.031810  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:41.032438  8806 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:41.015861  7186 rpcz_store.cc:269] 0709 13:13:38.889311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.286203 (+396892us) service_pool.cc:224] Handling call
0709 13:13:41.005625 (+1719422us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b54001b3fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:41.005725 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38676352}
I20260709 13:13:41.000136  7184 rpcz_store.cc:276] 0709 13:13:39.664513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.989660 (+1325147us) service_pool.cc:224] Handling call
0709 13:13:40.990030 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.999441 (+  9411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.999631 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:41.011060  8828 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:41.004643  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1012) took 2568 ms. Trace:
I20260709 13:13:41.043812  7254 rpcz_store.cc:276] 0709 13:13:38.435991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.459501 (+1023510us) service_pool.cc:224] Handling call
0709 13:13:39.459753 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:39.595508 (+135755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.595527 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:39.595555 (+    28us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:39.595573 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.003249 (+1407676us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b18003df120. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419
0709 13:13:41.004416 (+  1167us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002e7054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:41.004459 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.004589 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":838,"raft.queue_time_us":964,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3159,"spinlock_wait_cycles":307090560}
I20260709 13:13:40.998418  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:41.034541  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:40.973366  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.017953  7182 rpcz_store.cc:276] 0709 13:13:39.460697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.016607 (+1555910us) service_pool.cc:224] Handling call
0709 13:13:41.016958 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.017148 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.017189 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:41.017250 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:41.017286 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.017355 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.017471 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:41.036769  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1025) took 1562 ms. Trace:
I20260709 13:13:41.043361  8721 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:13:41.045622  8556 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:41.048354  8556 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:41.048753  8556 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.049108  8893 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.006610  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:41.032835  8885 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:41.039597  8909 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.032939  8880 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.009611  8871 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.068336  7261 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:41.071266  8656 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.072329  8899 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:41.072711  8899 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:41.072804  7179 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:41.073498  8899 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.074093  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:41.074782  7179 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:41.078799  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1895) took 2318 ms. Trace:
I20260709 13:13:41.079205  7260 rpcz_store.cc:276] 0709 13:13:38.759973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.782716 (+2022743us) service_pool.cc:224] Handling call
0709 13:13:40.943527 (+160811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.944162 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.078567 (+134405us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002265d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:41.078738 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369040128}
I20260709 13:13:41.080353  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:41.080937  7197 tablet_copy_service.cc:342] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-b2278b8a74ae4c04882dae719a92af7d received from {username='slave'} at 127.0.0.1:54396
I20260709 13:13:41.081452  7197 tablet_copy_service.cc:434] P 2ecdd7dc4a144f5aa0f2f91c7b94434d: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-b2278b8a74ae4c04882dae719a92af7d on tablet b2278b8a74ae4c04882dae719a92af7d with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:41.081673  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:41.082909  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:41.084049  7185 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:41.084813  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1743) took 1418 ms. Trace:
I20260709 13:13:41.085217  7185 rpcz_store.cc:276] 0709 13:13:39.666031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.083256 (+1417225us) service_pool.cc:224] Handling call
0709 13:13:41.083633 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.084525 (+   892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.084749 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:41.086689  8871 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:41.087667  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:41.088253  7184 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.087765  8871 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.088910  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:41.089051  8871 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.997756  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:41.046401  7256 rpcz_store.cc:276] 0709 13:13:39.473885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.959189 (+1485304us) service_pool.cc:224] Handling call
0709 13:13:40.959474 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.959670 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.959693 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.960142 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.036430 (+ 76288us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:41.036468 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.036535 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.036576 (+    41us) raft_consensus.cc:1685] finished
0709 13:13:41.036588 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.036703 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":75845,"threads_started":1,"wal-append.queue_time_us":56371}
I20260709 13:13:41.053326  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:41.092151  7254 raft_consensus.cc:2410] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:41.040313  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:41.058090  8828 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.047145  8713 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.910108  8923 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.065035  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:41.110109  7259 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:41.095985  7178 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:41.092800  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.093721  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:41.114095  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:41.114545  7332 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:41.094997  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:41.117690  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:41.095920  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:41.080950  7260 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 1.
I20260709 13:13:41.058686  7258 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:41.059857  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.017982  8356 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:41.091406  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:41.095943  7180 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:41.124063  7256 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:41.133061  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:41.139492  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:41.142474  7332 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:41.106334  7184 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:41.107338  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:41.107656  8639 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.060285  8885 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:41.108422  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:41.191845  7254 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:41.108634  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:41.109222  8556 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.110862  8721 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:41.098292  8880 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:41.195391  7083 catalog_manager.cc:5697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.074813  8899 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:41.111688  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46777us
W20260709 13:13:41.112232  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 114574us
I20260709 13:13:41.220687  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:41.112746  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 72509.4us
W20260709 13:13:41.113411  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48126.1us
W20260709 13:13:41.223204  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.051133  8796 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
W20260709 13:13:41.121976  7152 leader_election.cc:336] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.500s (SENT)
I20260709 13:13:41.225088  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:41.172590  7256 raft_consensus.cc:2410] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:41.220196  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:41.202234  7179 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:41.227003  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:41.227278  7182 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: [3.6-4.7]
I20260709 13:13:41.228442  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:41.119648  8764 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:41.119220  8779 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:41.174567  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:41.242048  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:41.090315  8909 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.110122  8923 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:41.190482  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:41.130904  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:41.111665  8828 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.210774  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:41.205760  8962 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:13:41.193171  8885 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.241755  8764 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:41.213481  8897 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:41.214092  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:41.214843  8859 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:41.216470  8880 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:41.115139  8713 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.222844  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:13:41.276867  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54133.8us
I20260709 13:13:41.224145  7254 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:13:41.224288  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:41.119007  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:41.279537  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:41.281042  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:41.225586  8781 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:41.288908  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1744) took 1622 ms. Trace:
I20260709 13:13:41.289485  7187 rpcz_store.cc:276] 0709 13:13:39.666746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.604277 (+937531us) service_pool.cc:224] Handling call
0709 13:13:40.758533 (+154256us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:13:41.275812 (+517279us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54002b57d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:41.288826 (+ 13014us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293689472}
I20260709 13:13:41.224944  7085 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47556 (request call id 252) took 7965 ms. Trace:
I20260709 13:13:41.207211  8721 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:41.231830  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:41.293782  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:41.234303  7185 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 3. Ops: []
I20260709 13:13:41.272729  7887 raft_consensus.cc:2368] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:41.238301  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:41.234912  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:41.240259  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 118318us
I20260709 13:13:41.244053  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:41.244649  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 144478us
I20260709 13:13:41.248651  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:41.314574  7336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1119) took 3972 ms (client timeout 2120 ms). Trace:
I20260709 13:13:41.245298  8887 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:13:41.325892  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:41.253430  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:41.241472  8763 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:41.328249  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:41.243300  8804 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:41.245479  8779 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:41.273516  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:41.279650  7260 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:41.229823  8796 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:41.335078  8796 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:41.335897  8796 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.337003  8796 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:41.345705  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:41.282346  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:41.347512  7261 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:41.310111  8721 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:41.229234  7179 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:41.270816  8948 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 13:13:41.298532  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.299811  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:41.234906  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:41.359421  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:41.360291  7187 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 2: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:41.275228  7329 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:41.361276  8631 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:41.361779  8631 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:41.361837  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:41.362367  8631 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.355233  8553 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:41.363492  8828 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:41.364791  8897 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:41.365800  8909 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:41.367467  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:41.368088  7185 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:41.353610  8892 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.370934  8879 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:41.370855  8892 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:41.314551  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:41.253202  7332 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:41.371867  7328 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:41.372521  7332 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:41.372952  8892 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:41.373257  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:13:41.326997  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 112998us
I20260709 13:13:41.374871  7861 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:41.375106  8780 tablet_copy_client.cc:538] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:41.375813  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:41.378437  8713 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:41.378921  8947 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:41.379375  8947 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:41.379745  8947 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.380527  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1032) took 1861 ms. Trace:
W20260709 13:13:41.321796  7336 rpcz_store.cc:269] 0709 13:13:37.342602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.553468 (+210866us) service_pool.cc:224] Handling call
0709 13:13:41.314390 (+3760922us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54000e10d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:41.314516 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861167488}
I20260709 13:13:41.381019  7255 rpcz_store.cc:276] 0709 13:13:39.519265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.984605 (+1465340us) service_pool.cc:224] Handling call
0709 13:13:40.984912 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.985259 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.985287 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.985749 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.180235 (+194486us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:41.180288 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.180386 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.380244 (+199858us) raft_consensus.cc:1685] finished
0709 13:13:41.380276 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.380446 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6895,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":194124,"threads_started":1,"wal-append.queue_time_us":302490}
I20260709 13:13:41.347126  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:41.323995  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 80038.7us
I20260709 13:13:41.290745  7085 rpcz_store.cc:276] 0709 13:13:33.241926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.242188 (+   262us) service_pool.cc:224] Handling call
0709 13:13:41.206901 (+7964713us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:35.910127 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:36.081159 (+171032us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:36.086088 (+  4929us) write_op.cc:435] Acquired schema lock
0709 13:13:36.088057 (+  1969us) tablet.cc:662] Decoding operations
0709 13:13:36.131330 (+ 43273us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:36.131408 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:36.131437 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:13:36.131987 (+   550us) tablet.cc:701] Row locks acquired
0709 13:13:36.132006 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:13:36.132147 (+   141us) write_op.cc:270] Start()
0709 13:13:36.132293 (+   146us) write_op.cc:276] Timestamp: P: 1783602816132105 usec, L: 0
0709 13:13:36.132310 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:13:36.132922 (+   612us) log.cc:844] Serialized 2080 byte log entry
0709 13:13:36.230768 (+ 97846us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece61320ac 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b
0709 13:13:36.579288 (+348520us) op_driver.cc:464] REPLICATION: finished
0709 13:13:37.900606 (+1321318us) write_op.cc:301] APPLY: starting
0709 13:13:37.900719 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:38.038398 (+137679us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:38.071495 (+ 33097us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:38.205807 (+134312us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:38.206083 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:13:38.206151 (+    68us) write_op.cc:312] APPLY: finished
0709 13:13:38.206465 (+   314us) log.cc:844] Serialized 47 byte log entry
0709 13:13:38.594466 (+388001us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:38.599003 (+  4537us) write_op.cc:454] Released schema lock
0709 13:13:38.599056 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:38.639922 (+ 40866us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:38.642421 (+  2499us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":1303445,"apply.run_cpu_time_us":27660,"apply.run_wall_time_us":706829,"num_ops":5,"prepare.queue_time_us":791722,"prepare.run_cpu_time_us":14627,"prepare.run_wall_time_us":482330,"raft.queue_time_us":187586,"raft.run_cpu_time_us":79078,"raft.run_wall_time_us":1818967,"replication_time_us":424417,"spinlock_wait_cycles":59740544,"thread_start_us":3207197,"threads_started":5,"wal-append.queue_time_us":644651,"wal-append.run_cpu_time_us":60676,"wal-append.run_wall_time_us":2248899}]]}
I20260709 13:13:41.321802  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:41.388612  7186 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 1.
I20260709 13:13:41.389703  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:41.327648  7330 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:41.329651  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:41.390712  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1064) took 1227 ms. Trace:
I20260709 13:13:41.390815  7182 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:41.391055  7330 rpcz_store.cc:276] 0709 13:13:40.163466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.555767 (+392301us) service_pool.cc:224] Handling call
0709 13:13:41.253282 (+697515us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b5800094b98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:13:41.390653 (+137371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15472512}
I20260709 13:13:41.391693  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:41.331122  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:41.264454  8883 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:13:41.334223  8779 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:41.348618  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:41.278450  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:41.311050  8870 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:41.309655  8940 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:41.352412  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:41.400851  7179 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:41.401854  7179 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:41.402149  7186 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:13:41.294734  7895 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:41.354045  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1737) took 1699 ms. Trace:
I20260709 13:13:41.403833  7183 rpcz_store.cc:276] 0709 13:13:39.655084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.978937 (+1323853us) service_pool.cc:224] Handling call
0709 13:13:40.979715 (+   778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.980845 (+  1130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.980882 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.981331 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.037627 (+ 56296us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:41.137761 (+100134us) log.cc:844] Serialized 14 byte log entry
0709 13:13:41.137999 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.138074 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.353838 (+215764us) raft_consensus.cc:1685] finished
0709 13:13:41.353859 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.353992 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":233799,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":12531,"raft.queue_time_us":35773,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":5524,"thread_start_us":146215,"threads_started":2,"wal-append.queue_time_us":42766}
I20260709 13:13:41.314750  8781 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:41.360157  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 125323us
I20260709 13:13:41.408926  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:41.409693  7187 raft_consensus.cc:2376] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5. Re-sending same reply.
I20260709 13:13:41.269093  8764 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.328861  8808 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:41.383307  7255 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:41.322892  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:41.212169  7083 catalog_manager.cc:5697] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 2, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:41.392411  7182 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:41.398766  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:41.406917  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 128549us
I20260709 13:13:41.502955  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:41.504932  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:41.505002  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 182172us
W20260709 13:13:41.532509  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.397913  8948 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:41.593905  8948 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.594422  8948 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:41.406454  8713 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.599032  8713 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.601800  8713 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:41.408368  8909 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.171s
I20260709 13:13:41.407593  8556 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:41.457042  8734 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:41.414455  8880 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:41.587116  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 362853us
I20260709 13:13:41.664376  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:41.512351  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:41.590411  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 269050us
I20260709 13:13:41.381623  8970 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:13:41.606899  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.358080  8760 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:13:41.557078  8923 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:41.400357  7258 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:41.399298  8924 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.185s
I20260709 13:13:41.557173  8854 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:41.413607  8870 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:41.687849  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 289132us
I20260709 13:13:41.604372  8828 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:41.575364  8806 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:41.575533  8808 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:41.511313  8860 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.226s
I20260709 13:13:41.459889  8705 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.209s
I20260709 13:13:41.693781  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:41.513037  8804 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.175s
I20260709 13:13:41.667564  8722 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:41.662184  8897 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.663929  8880 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:41.725764  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 61491.9us
I20260709 13:13:41.726694  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:41.728250  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:41.690014  8954 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:13:41.664234  8734 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:41.682469  8639 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:41.719599  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:41.733996  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.692754  8854 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:41.696770  8828 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:13:41.738327  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.670464  8885 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.764978  8639 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.765146  8808 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:41.698227  8879 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:41.730517  8806 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:41.733549  8897 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:41.795601  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 292690us
W20260709 13:13:41.795701  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 283422us
I20260709 13:13:41.732775  8887 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:41.766116  8948 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:41.733884  8880 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.738164  8892 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:41.785286  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 160) took 2889 ms. Trace:
W20260709 13:13:41.798224  8856 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.002s
I20260709 13:13:41.738677  8722 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:41.790405  8854 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.813351  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:41.809285  8556 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.830991  8806 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:41.737706  8781 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.821758  8892 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:41.880998  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 152815us
I20260709 13:13:41.884001  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:41.885553  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:41.838871  8713 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:13:41.836310  8856 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:41.890475  7862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.004s	sys 0.026s
I20260709 13:13:41.812142  8870 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.893249  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:41.897186  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:13:41.897521  7862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.004s	sys 0.026s
I20260709 13:13:41.883607  8892 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:41.904794  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 552884us
I20260709 13:13:41.854786  8556 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.905424  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:41.911103  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:41.913647  7262 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:41.913741  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:41.840727  8828 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:41.916937  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 103645us
I20260709 13:13:41.917804  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:41.923134  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:41.919430  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:41.908070  8976 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:41.932368  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:41.934748  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:41.913190  8573 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:41.910411  8984 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:41.917179  8909 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:41.932351  8985 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:41.944585  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 107497us
I20260709 13:13:41.924651  8887 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:41.931833  8976 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:41.927309  8970 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:41.953809  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:41.940431  8981 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:13:41.935863  8806 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:41.906311  8722 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:41.935268  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1911) took 3075 ms. Trace:
I20260709 13:13:41.935922  8871 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:41.936865  8897 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:41.940079  8656 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:41.958766  8993 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:41.954723  8887 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:41.971980  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:41.960599  8631 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.006s
W20260709 13:13:41.975883  8983 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:13:41.974114  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:41.954969  8976 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:41.964293  8987 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:13:41.954754  8885 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:41.948938  8883 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:13:41.958338  8909 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:41.957417  8967 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:42.105980  8996 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:41.960551  8639 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:41.817966  7181 rpcz_store.cc:276] 0709 13:13:38.880914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.704101 (+1823187us) service_pool.cc:224] Handling call
0709 13:13:40.704505 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.704875 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.704915 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.705509 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.584086 (+878577us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54001471a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a6090 00007fece91b36b8 00007fece923c92b 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c
0709 13:13:41.587827 (+  3741us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:41.591455 (+  3628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.684217 (+ 92762us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.688891 (+  4674us) raft_consensus.cc:1685] finished
0709 13:13:41.690946 (+  2055us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.769870 (+ 78924us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1883,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":3029,"spinlock_wait_cycles":26669312,"thread_start_us":213737,"threads_started":1,"wal-append.queue_time_us":209744}
I20260709 13:13:42.119359  8970 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.122576  8997 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:42.123268  8990 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.123427  8997 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:42.123863  8990 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.124795  8885 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.125505  8885 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.126260  8990 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:41.986985  8796 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.005s
W20260709 13:13:42.111191  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.973455  8948 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:42.099468  8656 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:42.118535  8967 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:13:42.118727  8971 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:13:42.105257  8993 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.114117  8780 tablet_bootstrap.cc:492] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:13:42.127355  8856 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:42.128016  8885 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:42.128808  9000 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:42.097230  8713 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.287714  9000 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:42.284072  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1736) took 2937 ms. Trace:
W20260709 13:13:42.109222  8982 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 13:13:41.969700  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 54954us
I20260709 13:13:42.288923  9000 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.289961  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:42.149067  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.202346  7336 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:42.103390  8887 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:42.101512  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 139432us
I20260709 13:13:42.246703  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1073) took 1153 ms. Trace:
W20260709 13:13:42.173018  8979 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:13:42.283951  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 136) took 1017 ms. Trace:
I20260709 13:13:42.287958  8713 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.134135  8996 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:13:42.207083  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 272424us
I20260709 13:13:42.291822  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:42.356225  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:42.356899  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:42.289245  7178 rpcz_store.cc:276] 0709 13:13:39.346496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.919155 (+1572659us) service_pool.cc:224] Handling call
0709 13:13:41.095687 (+176532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.115809 (+ 20122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.283780 (+1167971us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54001b3fd0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:42.283965 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405288704}
I20260709 13:13:42.358234  7301 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:42.200309  8656 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:42.355954  7328 rpcz_store.cc:276] 0709 13:13:41.266984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.372436 (+105452us) service_pool.cc:224] Handling call
0709 13:13:41.372750 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:41.373046 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.373083 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:41.373516 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.589546 (+216030us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:41.589685 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.589760 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.283683 (+693923us) raft_consensus.cc:1685] finished
0709 13:13:42.283721 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.283876 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1218,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":215631,"threads_started":1,"wal-append.queue_time_us":339492}
I20260709 13:13:42.131453  8998 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:42.111379  8631 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.203178  8967 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:42.358970  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 67240us
W20260709 13:13:42.328588  8899 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.088s	user 0.008s	sys 0.002s
W20260709 13:13:42.313169  8721 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.956s	user 0.010s	sys 0.000s
I20260709 13:13:42.386756  7225 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:42.290436  9000 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:42.237483  8796 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:42.316751  8947 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.937s	user 0.006s	sys 0.003s
I20260709 13:13:42.291371  8556 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:42.278082  8993 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:42.355582  7334 rpcz_store.cc:276] 0709 13:13:41.093664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.094198 (+   534us) service_pool.cc:224] Handling call
0709 13:13:41.108082 (+ 13884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:41.113306 (+  5224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.113335 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:41.115725 (+  2390us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.399081 (+283356us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:41.399140 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.399235 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.246430 (+847195us) raft_consensus.cc:1685] finished
0709 13:13:42.246451 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.246618 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4825,"raft.queue_time_us":5427,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":15635,"thread_start_us":206261,"threads_started":1,"wal-append.queue_time_us":683297}
I20260709 13:13:42.334106  9002 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.334206  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 128) took 1276 ms. Trace:
I20260709 13:13:42.329141  8885 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:42.386438  7254 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.008s	sys 0.008s
I20260709 13:13:42.362798  8909 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:42.390110  7330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.006s	sys 0.009s
I20260709 13:13:42.396821  7180 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:42.396361  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:42.427013  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 487664us
I20260709 13:13:42.363206  8856 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:42.382381  8998 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.450364  8998 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:42.400518  8899 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.325608  8880 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.389297  8639 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:42.321388  8854 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:42.448786  7254 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.008s	sys 0.008s
I20260709 13:13:42.461694  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 127) took 1404 ms. Trace:
W20260709 13:13:42.449692  7330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.007s	sys 0.010s
W20260709 13:13:42.452535  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56266.8us
I20260709 13:13:42.367388  8871 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:42.394938  8995 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:42.454171  7862 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:42.396010  8721 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.461927  7254 rpcz_store.cc:276] 0709 13:13:41.057544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.574807 (+517263us) service_pool.cc:224] Handling call
0709 13:13:41.665093 (+ 90286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.665284 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:41.693103 (+ 27819us) log.cc:844] Serialized 14 byte log entry
0709 13:13:42.461333 (+768230us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.461388 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:42.461429 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.461494 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.461632 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22138,"prepare.queue_time_us":30892,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":118590,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8055,"thread_start_us":745178,"threads_started":2,"wal-append.queue_time_us":189207}
I20260709 13:13:42.463034  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 143) took 1135 ms. Trace:
I20260709 13:13:42.462932  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:42.453584  8856 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:41.975687  7253 rpcz_store.cc:276] 0709 13:13:38.856624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.935340 (+2078716us) service_pool.cc:224] Handling call
0709 13:13:40.935754 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.936005 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:41.300147 (+364142us) log.cc:844] Serialized 14 byte log entry
0709 13:13:41.904207 (+604060us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:41.910205 (+  5998us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:41.913332 (+  3127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.923950 (+ 10618us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.932057 (+  8107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70675,"prepare.queue_time_us":32283,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":129725,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":22244,"thread_start_us":810996,"threads_started":3,"wal-append.queue_time_us":532460}
I20260709 13:13:42.449476  8909 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.389518  9001 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:13:42.475044  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:42.469449  8639 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:42.433619  8796 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.414466  8947 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.479049  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1905) took 3658 ms. Trace:
I20260709 13:13:42.469820  8996 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.480446  8880 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:42.476560  8856 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:42.468259  8765 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:42.483309  7184 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:42.457222  9012 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:42.491235  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 125676us
I20260709 13:13:42.471760  8899 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.486907  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:42.480979  8854 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:42.481352  8764 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.923s	user 0.008s	sys 0.005s
I20260709 13:13:42.477674  8909 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:42.499851  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:42.477684  8970 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:42.482126  7329 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:42.507632  8796 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:42.509974  8721 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:42.477437  9003 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:42.511114  9003 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.511658  9003 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:42.494462  8885 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:42.454583  9002 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.512635  8764 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.494109  8765 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:42.486200  7259 rpcz_store.cc:276] 0709 13:13:38.818673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.928550 (+2109877us) service_pool.cc:224] Handling call
0709 13:13:41.109925 (+181375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.110535 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.469620 (+1359085us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54002e7550. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:42.477336 (+  7716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416228224}
I20260709 13:13:42.471603  8995 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.500850  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:42.519886  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 1.17927e+06us
I20260709 13:13:42.535300  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:42.535907  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:42.535965  7260 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:42.495465  9001 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:13:42.538662  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:42.545037  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:42.526595  8970 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:42.547772  8970 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.549345  8947 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:42.551295  7185 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.183s	user 0.013s	sys 0.001s
I20260709 13:13:42.551119  8639 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.551698  7185 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:42.552322  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1295) took 1232 ms. Trace:
I20260709 13:13:42.552651  7185 rpcz_store.cc:276] 0709 13:13:41.319465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.367180 (+ 47715us) service_pool.cc:224] Handling call
0709 13:13:42.552253 (+1185073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.553316  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 139) took 1281 ms. Trace:
I20260709 13:13:42.553732  7329 rpcz_store.cc:276] 0709 13:13:41.272026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.588422 (+316396us) service_pool.cc:224] Handling call
0709 13:13:41.693176 (+104754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.502884 (+809708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.553059 (+ 50175us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540016c1d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:42.553257 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779242880}
I20260709 13:13:42.555209  8995 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:42.556177  8765 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.556455  9003 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.557533  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:42.557663  8765 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:42.551537  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:13:42.559163  7890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 471) took 1297 ms (client timeout 1546 ms). Trace:
W20260709 13:13:42.559543  7890 rpcz_store.cc:269] 0709 13:13:41.262204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.263553 (+  1349us) service_pool.cc:224] Handling call
0709 13:13:42.551442 (+1287889us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117f8c 00007fece6117ef6 0000000000375939 00007fecee18b1e0 00007fecee2540c4 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:13:42.559088 (+  7646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27284096}
I20260709 13:13:42.561511  8713 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:42.522781  8885 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:42.546357  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 57512.6us
I20260709 13:13:42.499936  8899 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.593392  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:42.563421  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:42.511927  8976 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.543188  8870 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:42.584106  8885 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:42.582680  8779 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.614845  7225 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:42.545625  8631 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:42.585284  8781 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:42.597613  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:42.445731  7258 rpcz_store.cc:276] 0709 13:13:41.057841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.723020 (+665179us) service_pool.cc:224] Handling call
0709 13:13:41.723451 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:41.723705 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.723736 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:41.724293 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.881643 (+157350us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:41.881705 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.881802 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.333882 (+452080us) raft_consensus.cc:1685] finished
0709 13:13:42.333917 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.334128 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":123289,"threads_started":1,"wal-append.queue_time_us":386169}
W20260709 13:13:42.622471  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 59178.4us
I20260709 13:13:42.625600  9019 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:42.621493  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:42.638667  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:42.537976  9010 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:13:42.622946  8722 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:42.638501  9003 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:42.618602  8909 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.652760  8781 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:42.652626  8639 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:42.647954  9019 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:42.659516  8899 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:42.665998  9016 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:13:42.666687  9013 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:13:42.675506  9019 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.676242  8967 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.677907  8967 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:42.670002  8639 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:42.668081  8940 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:42.681667  8940 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:42.680608  8976 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:42.680974  8764 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:42.681288  8993 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.679850  8909 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:42.670933  9002 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:42.686872  8998 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:42.722424  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.624890  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:42.612912  7185 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:42.726538  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 101581us
W20260709 13:13:42.737232  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.655182  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:42.738706  7256 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:13:42.740252  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 88022us
I20260709 13:13:42.746174  8764 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:42.736999  7258 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:42.747865  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1917) took 1635 ms. Trace:
I20260709 13:13:42.747364  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:42.749086  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:42.749289  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 466) took 1492 ms. Trace:
I20260709 13:13:42.750291  7328 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:42.670552  7893 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:13:42.751746  7893 pending_rounds.cc:85] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 4
I20260709 13:13:42.682076  8639 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.748488  7258 rpcz_store.cc:276] 0709 13:13:41.112094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.646448 (+1534354us) service_pool.cc:224] Handling call
0709 13:13:42.736318 (+ 89870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.747370 (+ 11052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.747737 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.752274  7893 pending_rounds.cc:107] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:13:42.754521  8639 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:42.760200  7887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 344) took 1841 ms (client timeout 1890 ms). Trace:
I20260709 13:13:42.763459  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:42.763698  7332 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:42.764307  8998 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:42.763785  7887 rpcz_store.cc:269] 0709 13:13:40.918589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.921278 (+  2689us) service_pool.cc:224] Handling call
0709 13:13:42.746371 (+1825093us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54006c02d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:42.759456 (+ 13085us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656166656}
I20260709 13:13:42.767379  9019 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:42.765713  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:42.756059  7893 raft_consensus.cc:2889] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:42.749823  7888 rpcz_store.cc:276] 0709 13:13:41.257109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.260405 (+  3296us) service_pool.cc:224] Handling call
0709 13:13:42.746798 (+1486393us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:13:42.749097 (+  2299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23068032}
I20260709 13:13:42.765621  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:42.773955  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:42.769483  8993 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:42.773627  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 473) took 1503 ms. Trace:
I20260709 13:13:42.689327  8940 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.774919  7893 rpcz_store.cc:276] 0709 13:13:41.270013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.270148 (+   135us) service_pool.cc:224] Handling call
0709 13:13:42.669928 (+1399780us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:13:42.670157 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.773128 (+102971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.773522 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5641472}
I20260709 13:13:42.777928  8940 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:42.781647  7257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 1909) took 3925 ms (client timeout 1525 ms). Trace:
W20260709 13:13:42.782263  7257 rpcz_store.cc:269] 0709 13:13:38.856144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.864264 (+  8120us) service_pool.cc:224] Handling call
0709 13:13:42.781064 (+3916800us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b5400226ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:42.781396 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5464749952}
I20260709 13:13:42.784914  7253 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:42.785867  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1923) took 1612 ms. Trace:
I20260709 13:13:42.788517  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 131) took 1405 ms. Trace:
I20260709 13:13:42.788995  7260 rpcz_store.cc:276] 0709 13:13:41.383371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.787447 (+1404076us) service_pool.cc:224] Handling call
0709 13:13:42.787816 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.788140 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.788160 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.788208 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:42.788228 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.788269 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.788351 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.472615  7330 rpcz_store.cc:276] 0709 13:13:41.327576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.754742 (+427166us) service_pool.cc:224] Handling call
0709 13:13:41.768388 (+ 13646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.768578 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:41.869225 (+100647us) log.cc:844] Serialized 14 byte log entry
0709 13:13:42.462739 (+593514us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.462784 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:42.462820 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.462880 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.462982 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":544797,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":172,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3970,"thread_start_us":680149,"threads_started":2}
I20260709 13:13:42.790606  7260 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:42.784953  7257 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:13:42.807590  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:42.811704  7254 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:42.812250  7254 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:42.786288  7253 rpcz_store.cc:276] 0709 13:13:41.173049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.783666 (+1610617us) service_pool.cc:224] Handling call
0709 13:13:42.784315 (+   649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.785525 (+  1210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.785785 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.802924  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:42.820425  7187 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:42.800303  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:42.829623  9029 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:13:42.830391  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1135) took 1625 ms. Trace:
I20260709 13:13:42.830930  7333 rpcz_store.cc:276] 0709 13:13:41.205155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.207139 (+  1984us) service_pool.cc:224] Handling call
0709 13:13:42.829860 (+1622721us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001b8d54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:42.830152 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2795932544}
I20260709 13:13:42.833078  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 144) took 1493 ms. Trace:
I20260709 13:13:42.833698  7336 rpcz_store.cc:276] 0709 13:13:41.339825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.766422 (+426597us) service_pool.cc:224] Handling call
0709 13:13:41.766795 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.359843 (+593048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.832407 (+472564us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b5400421b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:42.832808 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001010048}
I20260709 13:13:42.832943  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:42.831154  7260 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:42.838253  7182 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:42.838794  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:42.840339  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.813756  7254 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.841820  7254 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:42.845538  8893 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:42.845463  8764 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:42.846096  7258 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:42.846217  8893 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:42.847023  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1921) took 1729 ms. Trace:
I20260709 13:13:42.847538  7258 rpcz_store.cc:276] 0709 13:13:41.118051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.755260 (+1637209us) service_pool.cc:224] Handling call
0709 13:13:42.836748 (+ 81488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.846674 (+  9926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.846952 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.836042  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 130) took 1432 ms. Trace:
I20260709 13:13:42.852120  7257 rpcz_store.cc:276] 0709 13:13:41.383110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.783790 (+1400680us) service_pool.cc:224] Handling call
0709 13:13:42.784322 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.805289 (+ 20967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.815511 (+ 10222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792}
I20260709 13:13:42.854067  7254 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:42.856017  7254 pending_rounds.cc:85] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 2
I20260709 13:13:42.856824  7254 pending_rounds.cc:107] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:42.857187  7254 raft_consensus.cc:2889] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:42.857498  8885 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:42.861977  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.865221  8828 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:42.795351  8808 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
W20260709 13:13:42.867427  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.871207  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:42.872409  7182 raft_consensus.cc:2410] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:42.874028  7180 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:42.875088  9012 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:42.875618  9012 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:42.881901  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:42.882380  7261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 125) took 1825 ms (client timeout 1545 ms). Trace:
I20260709 13:13:42.882905  7181 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
W20260709 13:13:42.882937  7261 rpcz_store.cc:269] 0709 13:13:41.057004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.069220 (+ 12216us) service_pool.cc:224] Handling call
0709 13:13:42.881958 (+1812738us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400058a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:42.882182 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535316736}
I20260709 13:13:42.873966  8808 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.884469  8808 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.885535  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:42.886523  7180 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:42.891168  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:42.892205  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:42.860946  8893 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.895004  9012 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.897086  9012 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:42.892406  8656 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.010s
I20260709 13:13:42.900022  7187 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
W20260709 13:13:42.901822  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 1.49126e+06us
I20260709 13:13:42.904291  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 137) took 1632 ms. Trace:
I20260709 13:13:42.904726  8885 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:42.904688  7332 rpcz_store.cc:276] 0709 13:13:41.271518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.373222 (+101704us) service_pool.cc:224] Handling call
0709 13:13:41.373468 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.764355 (+1390887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.903993 (+139638us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001928d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:42.904234 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3187431168}
I20260709 13:13:42.905529  8656 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.906900  7255 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:42.907275  8512 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:42.908377  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1916) took 1811 ms. Trace:
I20260709 13:13:42.908754  7255 rpcz_store.cc:276] 0709 13:13:41.096982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.159057 (+1062075us) service_pool.cc:224] Handling call
0709 13:13:42.159500 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.907353 (+747853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.908067 (+   714us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b5400058f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:42.908301 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717924096}
I20260709 13:13:42.912001  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:42.913306  8909 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:42.914605  8909 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:42.915004  8909 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.915354  8909 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:42.918515  7299 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.132:39125 timed out after 1.546s (SENT) [suppressed 51 similar messages]
I20260709 13:13:42.919028  9002 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:42.919613  9002 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:42.921121  9002 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.927712  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:42.928021  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:42.926838  8856 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.929962  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:42.931231  8856 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:42.932283  9002 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:42.933526  8893 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:42.935967  7150 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:42.937101  8763 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:42.938840  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:42.939265  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:42.939456  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 118) took 1885 ms. Trace:
I20260709 13:13:42.940094  8879 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:42.941100  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:42.940936  8879 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:42.941831  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 175) took 1812 ms. Trace:
I20260709 13:13:42.939870  7262 rpcz_store.cc:276] 0709 13:13:41.054180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.054341 (+   161us) service_pool.cc:224] Handling call
0709 13:13:41.054707 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.914234 (+859527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.938974 (+1024740us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b540009a1d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:42.939278 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974917504}
I20260709 13:13:42.940155  8763 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:42.944401  8923 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:42.942260  7184 rpcz_store.cc:276] 0709 13:13:41.129539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.239346 (+109807us) service_pool.cc:224] Handling call
0709 13:13:41.239619 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.494377 (+1254758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.941347 (+446970us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002b48d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:42.941638 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2859628288}
I20260709 13:13:42.944950  8923 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:42.952080  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:42.953599  8556 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:42.954213  8556 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:42.955379  8556 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.955941  7181 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:42.911870  8892 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.996s	user 0.013s	sys 0.006s
I20260709 13:13:42.953627  7183 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:42.960268  7184 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:13:42.926144  8887 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.536s	user 0.013s	sys 0.002s
I20260709 13:13:42.959816  8705 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:42.971535  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:42.975214  9005 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:13:42.975356  8734 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.978399  9005 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:42.978885  9005 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:42.968808  8892 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.979897  9005 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:42.981383  8892 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:42.981189  8984 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:42.978458  8734 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:42.983798  8980 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.187s	user 0.000s	sys 0.018s
I20260709 13:13:42.958990  8763 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:42.985409  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1074) took 1891 ms. Trace:
I20260709 13:13:42.985993  8763 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:42.985865  7327 rpcz_store.cc:276] 0709 13:13:41.093949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.098014 (+  4065us) service_pool.cc:224] Handling call
0709 13:13:41.188844 (+ 90830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:41.339135 (+150291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.339169 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:41.339715 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.604638 (+264923us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:41.661595 (+ 56957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.747898 (+1086303us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540013e554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:42.748036 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.982961 (+234925us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:13:42.984969 (+  2008us) raft_consensus.cc:1685] finished
0709 13:13:42.985005 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.985207 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1734,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":334021760,"thread_start_us":252113,"threads_started":1,"wal-append.queue_time_us":357460}
I20260709 13:13:42.988766  7180 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:13:42.976495  7257 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:42.977097  7185 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
W20260709 13:13:42.994740  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 68444.8us
W20260709 13:13:42.997633  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.003719  8879 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:42.946416  8923 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.008023  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.009867  7336 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:43.009805  7302 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:43.011564  8871 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:13:43.014088  9001 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.014856  9001 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.017254  8764 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:43.017681  9001 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:43.017724  8764 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.018370  8764 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:43.005106  8923 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.015393  7178 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: [3.3-4.4]
W20260709 13:13:43.023389  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 57670.7us
I20260709 13:13:43.026976  7083 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47542 (request call id 231) took 8499 ms. Trace:
I20260709 13:13:42.972513  8887 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:43.055140  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.033084  9005 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:43.062536  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 87613.3us
W20260709 13:13:43.060480  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50769.4us
I20260709 13:13:43.067480  7255 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:43.069020  7254 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:13:43.064409  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:43.071844  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 109532us
I20260709 13:13:43.074210  8968 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:43.085884  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:43.081382  8850 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:43.080560  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.079809  8825 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:43.087050  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:43.081409  8860 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:43.083515  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.099238  8871 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:43.099710  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 158773us
I20260709 13:13:43.087965  7259 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:43.079064  8977 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:43.089165  8948 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.084722  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.088575  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.082330  8859 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:13:43.099287  7861 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:43.066730  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.093698  7081 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 2 to 3, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:13:43.082324  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48794.5us
I20260709 13:13:43.081292  7862 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:13:43.098773  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.102372  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:43.111527  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.053892  8808 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:43.123174  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.135706  7256 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:43.137627  7260 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 2: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:43.124550  8871 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.148524  7178 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:43.149760  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.154392  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:43.155052  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:43.169477  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.156687  7261 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:43.142146  8656 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:43.177150  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:43.178555  9031 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.003s
W20260709 13:13:43.180884  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 81817.4us
I20260709 13:13:43.182075  8783 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.182703  8512 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:43.186041  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.155800  7887 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:43.190037  8909 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:43.211349  8860 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:43.212050  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.212435  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.191968  7889 raft_consensus.cc:2410] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:13:43.198997  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.192497  8734 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:43.204002  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.204378  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.204717  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.205089  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.205802  7334 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:43.206159  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.206560  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.203586  7332 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:43.212970  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.170126  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:43.140110  8984 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.200s
I20260709 13:13:43.244204  7182 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:43.336645  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.211974  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.241171  8848 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:43.382418  8892 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:43.383832  7260 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:43.383574  8892 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.221766  7256 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:43.242818  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:43.241688  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.249691  7257 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:43.233587  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1918) took 2121 ms. Trace:
I20260709 13:13:43.242416  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:43.241415  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:43.240757  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:43.151885  8871 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:43.235513  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 103056us
I20260709 13:13:43.390574  7183 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:43.241918  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:43.397228  7184 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:43.391948  7259 rpcz_store.cc:276] 0709 13:13:41.112465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.736818 (+1624353us) service_pool.cc:224] Handling call
0709 13:13:42.737439 (+   621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.128563 (+391124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.233295 (+104732us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b540034a3d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:43.233514 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772150016}
I20260709 13:13:43.190969  8887 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:43.387077  8828 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.005s
I20260709 13:13:43.235455  8765 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:43.402280  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.242367  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:43.239919  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:43.413681  7178 raft_consensus.cc:2410] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:43.390262  8848 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.414701  7255 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:43.380167  8734 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.401592  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.035405  7083 rpcz_store.cc:276] 0709 13:13:34.485328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.506450 (+ 21122us) service_pool.cc:224] Handling call
0709 13:13:42.984695 (+8478245us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:42.335076 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:42.335966 (+   890us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:42.336018 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:13:42.336044 (+    26us) tablet.cc:662] Decoding operations
0709 13:13:42.336707 (+   663us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:42.336790 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:42.336835 (+    45us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:13:42.337293 (+   458us) tablet.cc:701] Row locks acquired
0709 13:13:42.337315 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:13:42.337519 (+   204us) write_op.cc:270] Start()
0709 13:13:42.337672 (+   153us) write_op.cc:276] Timestamp: P: 1783602822337454 usec, L: 0
0709 13:13:42.337705 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:13:42.364290 (+ 26585us) log.cc:844] Serialized 924 byte log entry
0709 13:13:42.689581 (+325291us) op_driver.cc:464] REPLICATION: finished
0709 13:13:42.691291 (+  1710us) write_op.cc:301] APPLY: starting
0709 13:13:42.691383 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:42.691510 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:42.691624 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:42.692045 (+   421us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:42.692253 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:13:42.692308 (+    55us) write_op.cc:312] APPLY: finished
0709 13:13:42.692542 (+   234us) log.cc:844] Serialized 29 byte log entry
0709 13:13:42.692746 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:42.692862 (+   116us) write_op.cc:454] Released schema lock
0709 13:13:42.692913 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:42.693290 (+   377us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:42.693334 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":409700,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":1455,"apply.run_cpu_time_us":1953,"apply.run_wall_time_us":1956,"num_ops":2,"prepare.queue_time_us":537548,"prepare.run_cpu_time_us":39350,"prepare.run_wall_time_us":337839,"raft.queue_time_us":65310,"raft.run_cpu_time_us":1115,"raft.run_wall_time_us":9061,"replication_time_us":351348,"thread_start_us":416441,"threads_started":4,"wal-append.queue_time_us":234019}]]}
I20260709 13:13:43.413345  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.415194  7187 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:43.408145  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.257287  8859 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:43.414340  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:43.433195  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.433545  7255 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:43.434249  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:43.434839  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.435694  7255 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:43.435598  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.243361  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:43.436645  7181 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:43.437112  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.427073  7329 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:43.439642  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.442574  8859 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.443121  8859 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.443663  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.444423  7180 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:43.444741  7329 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:43.431326  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.445518  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:43.442271  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:43.418651  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.405716  7328 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:43.421619  7256 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:43.393476  8783 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:43.421989  7893 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:13:43.422248  7185 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 2: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:43.389230  8860 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:43.423403  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.448693  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.438702  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.425649  7254 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:43.427717  7253 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:13:43.443590  7261 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.450647  7253 pending_rounds.cc:85] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 2
I20260709 13:13:43.451030  7253 pending_rounds.cc:107] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:13:43.451320  7253 raft_consensus.cc:2889] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:43.452596  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 371386us
I20260709 13:13:43.456143  7333 raft_consensus.cc:2368] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4.
I20260709 13:13:43.170469  8977 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:43.458913  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 321596us
I20260709 13:13:43.459687  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:43.244480  8764 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.422734  8765 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:43.158166  8968 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.430086  8848 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.446815  8734 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:43.492986  8764 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:43.494580  8924 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:43.494323  8765 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.495273  8924 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:43.495918  8765 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:43.496260  8924 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.497829  8924 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.498724  8940 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.499056  8781 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:13:43.499369  8940 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.501677  8783 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:43.501768  8940 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:43.456650  9012 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.004s
I20260709 13:13:43.467564  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.477074  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.503104  8892 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:43.503446  7256 raft_consensus.cc:2410] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:43.472709  7331 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:43.504302  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1940) took 1053 ms. Trace:
I20260709 13:13:43.504407  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.504804  7253 rpcz_store.cc:276] 0709 13:13:42.451289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.827976 (+376687us) service_pool.cc:224] Handling call
0709 13:13:42.828409 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.458545 (+630136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.504028 (+ 45483us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b54002166d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:43.504232 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370593536}
I20260709 13:13:43.505442  7256 raft_consensus.cc:2410] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:43.506289  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.507040  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.507483  8808 raft_consensus.cc:3055] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:43.507664  7262 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.507910  8808 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:43.509081  8808 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:43.462006  7187 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.511795  8860 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:43.469228  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 367054us
I20260709 13:13:43.516826  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:43.470158  8762 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:43.458927  7330 raft_consensus.cc:2376] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5. Re-sending same reply.
I20260709 13:13:43.472530  8977 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:43.472651  8887 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:43.528874  8887 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.528748  8880 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.116s
I20260709 13:13:43.529553  8887 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:43.473171  7336 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:43.466099  9002 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.005s
I20260709 13:13:43.532723  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.533700  7254 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:43.452297  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.534578  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.535245  7329 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:43.535389  7255 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:43.475831  8909 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:43.223824  8948 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.536945  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.537261  8850 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:43.537631  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:43.537918  8948 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:43.476995  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.539232  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.478227  7332 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:43.293345  8825 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.540663  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:43.541234  7259 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:43.427493  8512 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:13:43.486594  7889 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 470) took 2225 ms (client timeout 1927 ms). Trace:
W20260709 13:13:43.546294  7889 rpcz_store.cc:269] 0709 13:13:41.261111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.261523 (+   412us) service_pool.cc:224] Handling call
0709 13:13:42.807062 (+1545539us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:13:43.486290 (+679228us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400551ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:43.486477 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887281792}
I20260709 13:13:43.486935  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.488449  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:43.492318  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 309549us
I20260709 13:13:43.499801  7182 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:43.471730  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:43.518004  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.489501  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.548339  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.506398  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.535619  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:43.551996  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.552685  7896 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:43.551550  7261 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:43.555819  7257 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:43.558923  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:43.518389  7258 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:43.559641  7187 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:43.521682  8808 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.563983  7258 pending_rounds.cc:85] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 1
I20260709 13:13:43.565739  7258 pending_rounds.cc:107] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:43.566090  7258 raft_consensus.cc:2889] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:43.567840  7333 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:43.568596  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.568959  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.569461  7332 raft_consensus.cc:2368] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:43.569577  7333 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:43.570932  8995 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:43.570876  8783 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:43.571476  8995 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.571908  8995 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:43.572464  8783 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:43.573573  8783 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:43.573887  8783 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:43.574211  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.575237  7335 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:43.565348  7182 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:43.567875  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.559180  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:43.563539  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 91892.3us
I20260709 13:13:43.570286  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.576774  7333 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:43.576493  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:43.577234  7336 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:43.580247  7262 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:43.559454  7888 pending_rounds.cc:85] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 4
I20260709 13:13:43.558501  8968 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:43.555189  8825 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:43.584009  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:43.527735  9005 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:13:43.490520  8859 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.588227  7888 pending_rounds.cc:107] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:13:43.594267  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:43.596940  7888 raft_consensus.cc:2889] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:43.598841  7896 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:43.599558  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:43.600100  9040 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:13:43.594718  8909 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:13:43.570492  9002 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:13:43.581770  8850 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:43.601835  8850 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:43.602303  8850 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.605500  7150 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:43.606674  8631 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:43.606854  8825 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:43.607115  8631 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.607614  8631 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.607810  8825 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:43.608310  8825 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.608690  8825 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:43.611282  7184 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:13:43.611794  8909 consensus_queue.cc:1243] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:43.612998  9002 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:43.613152  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:43.613723  9002 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:43.614148  9002 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:43.615145  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.615669  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.616005  8764 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:43.616405  7262 raft_consensus.cc:2368] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:43.616748  8764 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:43.617887  8783 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.619047  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.619253  8783 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.621325  7261 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:43.619858  7260 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:43.619098  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.620185  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.624513  7262 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:43.626129  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.606943  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.631211  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.635169  7332 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:43.635576  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.636106  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.636264  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.636824  7255 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
I20260709 13:13:43.637364  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.637750  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.638049  7332 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:43.638583  7255 raft_consensus.cc:2410] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:43.639123  7336 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:43.639573  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.631379  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:43.676397  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 69771.5us
I20260709 13:13:43.677489  7150 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:43.636819  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:43.642189  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.679423  7253 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:43.584224  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.679630  7332 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:43.643242  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:43.644814  7331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1053) took 3954 ms (client timeout 2148 ms). Trace:
I20260709 13:13:43.681309  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:13:43.685082  7331 rpcz_store.cc:269] 0709 13:13:39.692440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.771631 (+ 79191us) service_pool.cc:224] Handling call
0709 13:13:43.644598 (+3872967us) spinlock_profiling.cc:243] Waited 3.69 s on lock 0x7b540031abd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:43.644732 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8478330624}
I20260709 13:13:43.634999  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:43.692348  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.693197  7260 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 2: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:43.693606  7334 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:43.696218  7890 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:13:43.701967  7262 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:43.703426  7262 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:43.704411  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:43.705255  7178 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:43.714296  8783 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:43.714727  8968 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.715051  9002 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:43.715438  8968 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:43.716658  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.717860  8968 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:43.719770  8859 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:43.584508  8948 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:13:43.689349  7259 raft_consensus.cc:2376] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2. Re-sending same reply.
I20260709 13:13:43.729480  8859 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:43.734539  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.735101  8848 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:43.729729  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 52348.3us
I20260709 13:13:43.737893  8848 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:43.739239  7330 raft_consensus.cc:2368] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:43.767302  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.771641  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:43.772380  8986 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:43.772724  7890 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:13:43.780471  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 106188us
I20260709 13:13:43.682814  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.638856  8762 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
W20260709 13:13:43.793826  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 57068.6us
I20260709 13:13:43.795004  7327 raft_consensus.cc:2368] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
I20260709 13:13:43.799183  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.800822  9002 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.802867  8631 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.814157  7333 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:43.818271  8825 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.819952  7893 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:43.822391  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.823123  7256 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:43.721102  8887 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:43.836793  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.836793  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.845587  7334 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:43.882383  7331 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:43.786199  8850 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.843456  7258 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:43.785245  8734 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.885670  7336 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:43.884021  7256 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:43.890347  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:43.892712  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.894069  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:43.894264  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:43.895830  7333 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:43.897169  7328 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:43.898200  8923 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:43.898600  8923 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:43.898790  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.899645  8781 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:43.906929  7178 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:43.899495  8923 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.909423  7302 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:43.902499  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:43.912133  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.839749  8825 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:43.848220  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:43.814303  8995 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:43.816831  8763 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:13:43.917375  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:43.915475  8848 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:13:43.918960  8512 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:43.834156  8808 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:13:43.837095  8986 consensus_queue.cc:1059] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:13:43.923939  7336 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:43.912966  8948 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:43.927119  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:43.845639  8871 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:43.930677  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.936087  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:43.953776  7256 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:43.938855  7331 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:43.924022  8984 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:43.928079  7260 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:43.950130  7259 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:43.959997  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:43.960875  7891 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 2: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:43.961825  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.964098  8995 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:43.965252  8848 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.965765  8848 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:43.967794  8848 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:43.969473  7259 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:43.941856  7332 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:43.956544  7257 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:43.956993  7334 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:13:43.971097  7334 pending_rounds.cc:85] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 3
I20260709 13:13:43.971380  7334 pending_rounds.cc:107] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:13:43.971619  7334 raft_consensus.cc:2889] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:43.920969  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:43.973397  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:43.934811  8762 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:43.925199  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:43.974995  8762 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:43.949630  7887 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:43.976061  8762 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:43.935392  7329 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:43.981704  8948 raft_consensus.cc:697] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:43.983038  7178 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.982818  8948 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:43.986166  8796 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.986827  8796 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:43.988993  8796 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:43.989127  7329 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:43.989938  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:43.997035  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.912806  8781 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:13:44.007262  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.933687  8512 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:43.962579  7891 raft_consensus.cc:2393] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:13:44.011889  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.968269  8848 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.918555  8909 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:13:44.027007  7178 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:44.029256  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:44.065878  7183 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.033s	sys 0.029s
W20260709 13:13:44.069659  7183 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.033s	sys 0.029s
W20260709 13:13:44.068254  7185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.005s	sys 0.039s
W20260709 13:13:44.100219  7185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.005s	sys 0.039s
W20260709 13:13:44.102415  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.015293  7889 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:44.113193  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:44.127607  7184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.017s	sys 0.004s
W20260709 13:13:44.128198  7184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.017s	sys 0.004s
W20260709 13:13:44.116147  8860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.000s	sys 0.032s
I20260709 13:13:44.109067  8968 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:44.132846  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 126902us
W20260709 13:13:44.144124  7859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.009s	sys 0.013s
W20260709 13:13:44.144712  7859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.009s	sys 0.013s
W20260709 13:13:44.145645  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 627895us
I20260709 13:13:44.145793  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:44.124295  7181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.021s	sys 0.016s
I20260709 13:13:44.146763  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:44.140455  8860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.000s	sys 0.033s
I20260709 13:13:44.099803  8848 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:13:44.212101  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65469us
W20260709 13:13:44.207912  7181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.021s	sys 0.017s
W20260709 13:13:44.125506  8764 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.002s	sys 0.018s
I20260709 13:13:44.215409  8859 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:44.116575  8512 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:44.224115  7152 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.001s	sys 0.023s
W20260709 13:13:44.231567  9033 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:13:44.228062  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:44.230523  7862 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:44.231132  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:44.226435  8850 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:44.139925  8887 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:44.180048  8995 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:44.242075  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 96366.4us
I20260709 13:13:44.210273  8656 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:44.230718  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:44.231244  8721 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:44.306000  7152 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.002s	sys 0.024s
W20260709 13:13:44.361737  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 905328us
W20260709 13:13:44.362321  7152 leader_election.cc:336] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.897s (SENT)
W20260709 13:13:44.331907  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 101501us
I20260709 13:13:44.297952  8631 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:44.291898  7896 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
W20260709 13:13:44.373303  7261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.008s	sys 0.059s
W20260709 13:13:44.373808  7261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.008s	sys 0.059s
I20260709 13:13:44.234738  9003 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:44.301852  8764 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.003s	sys 0.018s
I20260709 13:13:44.331537  8860 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:44.305544  8783 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:44.342510  8512 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.368111  7892 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:44.366132  8721 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:44.340070  8796 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:44.384011  7335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.026s	sys 0.042s
I20260709 13:13:44.346834  8734 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:44.393817  7335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.027s	sys 0.043s
I20260709 13:13:44.373576  8871 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:44.388890  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:44.338819  7888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.003s	sys 0.044s
W20260709 13:13:44.395320  7182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.012s	sys 0.062s
W20260709 13:13:44.398419  7182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.012s	sys 0.062s
I20260709 13:13:44.384735  8783 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:44.298975  8879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.022s	sys 0.034s
I20260709 13:13:44.392230  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:44.391682  7253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.000s	sys 0.032s
I20260709 13:13:44.350165  8995 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:44.383047  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:13:44.397187  7255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.019s	sys 0.034s
W20260709 13:13:44.413746  7255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.020s	sys 0.034s
W20260709 13:13:44.377379  8705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.012s	sys 0.026s
W20260709 13:13:44.386148  8880 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.025s	sys 0.072s
I20260709 13:13:44.395741  7895 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:44.407513  7253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.000s	sys 0.032s
W20260709 13:13:44.398092  7888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.004s	sys 0.045s
I20260709 13:13:44.396569  8721 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:44.415369  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 498025us
W20260709 13:13:44.419710  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.429270  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.403435  8656 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:44.429025  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:44.407238  8879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.022s	sys 0.035s
W20260709 13:13:44.429641  7187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.004s	sys 0.022s
I20260709 13:13:44.433386  7178 raft_consensus.cc:2368] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3.
I20260709 13:13:44.389542  9003 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:44.442116  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:44.418933  8705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.013s	sys 0.026s
W20260709 13:13:44.434747  7187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.004s	sys 0.022s
W20260709 13:13:44.418337  8880 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.026s	sys 0.073s
W20260709 13:13:44.452409  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.440922  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:44.433586  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:44.491760  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 58274.1us
I20260709 13:13:44.492554  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:44.493029  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:44.493842  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 63454.4us
I20260709 13:13:44.435916  8656 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:13:44.495378  7152 leader_election.cc:336] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.582s (SENT)
W20260709 13:13:44.500051  7186 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.021s	sys 0.049s
W20260709 13:13:44.500391  7186 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.021s	sys 0.049s
I20260709 13:13:44.493654  9046 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:44.491037  8783 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:44.505446  8783 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:44.507475  9056 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:13:44.507642  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65660.5us
I20260709 13:13:44.509019  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:44.500402  7150 leader_election.cc:400] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4.
I20260709 13:13:44.509783  7150 leader_election.cc:403] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:44.511237  8848 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:44.512732  9043 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:13:44.513749  9047 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 13:13:44.514673  8871 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:44.518128  9048 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:13:44.523831  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.520115  8705 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4.
I20260709 13:13:44.495810  8909 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:44.521005  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:44.498922  8656 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:44.497799  8781 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.497941  8968 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:44.522668  7257 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
W20260709 13:13:44.523782  7179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.016s	sys 0.049s
W20260709 13:13:44.534751  7179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.017s	sys 0.049s
W20260709 13:13:44.523473  8986 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.004s	sys 0.030s
I20260709 13:13:44.525808  7184 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.514667  8995 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:44.522760  8763 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.027s
I20260709 13:13:44.497514  8808 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:13:44.528569  7178 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
W20260709 13:13:44.533387  7299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.006s	sys 0.017s
I20260709 13:13:44.519470  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:44.546412  8986 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.005s	sys 0.030s
I20260709 13:13:44.550323  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 194) took 1076 ms. Trace:
I20260709 13:13:44.534053  8765 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:13:44.553159  7299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.007s	sys 0.017s
I20260709 13:13:44.532279  8909 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:44.557143  7893 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:44.524552  8871 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:44.549782  8763 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.008s	sys 0.028s
W20260709 13:13:44.563042  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 43650us
I20260709 13:13:44.553293  7179 rpcz_store.cc:276] 0709 13:13:43.473956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.480052 (+  6096us) service_pool.cc:224] Handling call
0709 13:13:43.700270 (+220218us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:13:43.700502 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.700787 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:43.701104 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.547301 (+846197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:44.547376 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:44.548726 (+  1350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.549109 (+   383us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.550151 (+  1042us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10108,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":11490,"spinlock_wait_cycles":44458880,"thread_start_us":834893,"threads_started":1}
I20260709 13:13:44.548593  8968 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:44.564774  7894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 359) took 1325 ms. Trace:
W20260709 13:13:44.579720  7256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.017s	sys 0.025s
W20260709 13:13:44.580163  7256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.017s	sys 0.025s
I20260709 13:13:44.534430  8984 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:44.583206  8984 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:44.585036  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.585863  8924 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.586549  8924 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:44.589437  8924 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:44.597450  7184 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:44.578100  7894 rpcz_store.cc:276] 0709 13:13:43.239543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.241904 (+  2361us) service_pool.cc:224] Handling call
0709 13:13:44.556838 (+1314934us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54006c02d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:44.564701 (+  7863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035938560}
I20260709 13:13:44.558477  8923 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.604519  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 195) took 1130 ms. Trace:
I20260709 13:13:44.604590  7150 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:44.554613  8765 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:44.610422  7185 rpcz_store.cc:276] 0709 13:13:43.474380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.486325 (+ 11945us) service_pool.cc:224] Handling call
0709 13:13:43.486715 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.487130 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:43.487165 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.487692 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.100694 (+613002us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:44.100736 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.100804 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.604237 (+503433us) raft_consensus.cc:1685] finished
0709 13:13:44.604257 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.604441 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27755,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":612568,"threads_started":1,"wal-append.queue_time_us":893879}
I20260709 13:13:44.618711  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:44.619465  7178 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:44.619645  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 198) took 1044 ms. Trace:
I20260709 13:13:44.620034  7184 rpcz_store.cc:276] 0709 13:13:43.575293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.609555 (+1034262us) service_pool.cc:224] Handling call
0709 13:13:44.615230 (+  5675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.615973 (+   743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:44.616007 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:44.619199 (+  3192us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:44.619398 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.619457 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.619588 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:44.608449  7180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.010s	sys 0.019s
I20260709 13:13:44.623360  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:44.622692  7180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.011s	sys 0.019s
I20260709 13:13:44.624317  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1316) took 1229 ms. Trace:
I20260709 13:13:44.626401  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:44.630008  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:44.627938  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 59260.1us
I20260709 13:13:44.632025  7259 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:44.640731  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:44.641638  7254 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:44.641881  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:44.643741  7862 leader_election.cc:400] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3.
I20260709 13:13:44.608821  8763 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:44.646389  7259 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:44.646463  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:44.648418  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 202112us
I20260709 13:13:44.627580  7183 rpcz_store.cc:276] 0709 13:13:43.395094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.430465 (+ 35371us) service_pool.cc:224] Handling call
0709 13:13:43.435394 (+  4929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.435755 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:44.097152 (+661397us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.615800 (+518648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:44.621960 (+  6160us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:44.622439 (+   479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.623012 (+   573us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.623836 (+   824us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48171,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":8150,"thread_start_us":1127273,"threads_started":2}
I20260709 13:13:44.650676  7262 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:44.656795  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1784) took 1102 ms. Trace:
I20260709 13:13:44.657189  7182 rpcz_store.cc:276] 0709 13:13:43.553888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.687654 (+133766us) service_pool.cc:224] Handling call
0709 13:13:43.691138 (+  3484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.771086 (+ 79948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.771131 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.771698 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.402214 (+630516us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:44.402261 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.402331 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.656592 (+254261us) raft_consensus.cc:1685] finished
0709 13:13:44.656612 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.656738 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83449,"raft.queue_time_us":73248,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":189,"thread_start_us":626797,"threads_started":1,"wal-append.queue_time_us":841992}
W20260709 13:13:44.664942  8780 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:13:44.667865  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.669513  7254 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:44.664974  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 146) took 1016 ms. Trace:
I20260709 13:13:44.675501  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:44.676072  7150 leader_election.cc:400] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:44.676179  7254 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.676416  7150 leader_election.cc:403] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:44.646361  8860 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.651767  9076 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:44.683089  9076 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:44.685385  9076 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:44.674499  8765 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:44.689340  8765 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.689646  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1775) took 1174 ms. Trace:
I20260709 13:13:44.689883  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1776) took 1174 ms. Trace:
I20260709 13:13:44.690825  8909 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:44.690404  7186 rpcz_store.cc:276] 0709 13:13:43.515959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.527547 (+ 11588us) service_pool.cc:224] Handling call
0709 13:13:43.707141 (+179594us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:13:43.707384 (+   243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.779251 (+ 71867us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:43.779627 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.500867 (+721240us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:44.501421 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.501567 (+   146us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:44.501609 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.501700 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.689586 (+187886us) raft_consensus.cc:1685] finished
0709 13:13:44.689688 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.689826 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56998,"prepare.queue_time_us":793,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":95256,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":232,"spinlock_wait_cycles":38665984,"thread_start_us":720773,"threads_started":1,"wal-append.queue_time_us":900051}
I20260709 13:13:44.693006  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1099) took 1135 ms. Trace:
W20260709 13:13:44.694707  7152 leader_election.cc:336] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.704s (SENT)
I20260709 13:13:44.695142  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:44.695343  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:44.697193  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 147) took 1047 ms. Trace:
I20260709 13:13:44.651751  8705 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:44.712761  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44437.8us
I20260709 13:13:44.716147  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:44.672586  7255 rpcz_store.cc:276] 0709 13:13:43.648991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.695190 (+ 46199us) service_pool.cc:224] Handling call
0709 13:13:43.695526 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.766138 (+ 70612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.766191 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.791134 (+ 24943us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.414346 (+623212us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:44.432176 (+ 17830us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.432458 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.432557 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.664752 (+232195us) raft_consensus.cc:1685] finished
0709 13:13:44.664774 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.664919 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27527,"prepare.queue_time_us":19992,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":50392,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":21256,"spinlock_wait_cycles":9760640,"thread_start_us":567092,"threads_started":1,"wal-append.queue_time_us":829160}
I20260709 13:13:44.697798  7253 rpcz_store.cc:276] 0709 13:13:43.649388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.696570 (+ 47182us) service_pool.cc:224] Handling call
0709 13:13:43.696931 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.720204 (+ 23273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.720244 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.720836 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.420372 (+699536us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:44.420478 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.420628 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.696923 (+276295us) raft_consensus.cc:1685] finished
0709 13:13:44.696950 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.697120 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22803,"raft.queue_time_us":30101,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":35635,"thread_start_us":698909,"threads_started":1,"wal-append.queue_time_us":946129}
I20260709 13:13:44.693388  7335 rpcz_store.cc:276] 0709 13:13:43.557586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.583944 (+ 26358us) service_pool.cc:224] Handling call
0709 13:13:43.647711 (+ 63767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.683822 (+ 36111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.683870 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.745458 (+ 61588us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.394337 (+648879us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:44.394379 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.394458 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.692805 (+298347us) raft_consensus.cc:1685] finished
0709 13:13:44.692825 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.692950 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":21521,"thread_start_us":594240,"threads_started":1,"wal-append.queue_time_us":773411}
I20260709 13:13:44.713316  7183 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:44.675431  9069 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:44.653713  8986 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:44.690023  7180 rpcz_store.cc:276] 0709 13:13:43.515648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.520075 (+  4427us) service_pool.cc:224] Handling call
0709 13:13:43.647746 (+127671us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:13:43.647948 (+   202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.780088 (+132140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.780130 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.835630 (+ 55500us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.624770 (+789140us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:44.624807 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.624871 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.689325 (+ 64454us) raft_consensus.cc:1685] finished
0709 13:13:44.689350 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.689585 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69205,"raft.queue_time_us":76306,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"spinlock_wait_cycles":13477632,"thread_start_us":739085,"threads_started":1,"wal-append.queue_time_us":842416}
I20260709 13:13:44.729501  7182 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:44.735348  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:44.737529  7862 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:44.729939  7182 pending_rounds.cc:85] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 2
I20260709 13:13:44.755546  7182 pending_rounds.cc:107] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:44.755914  7182 raft_consensus.cc:2889] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:44.714717  8762 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:44.791235  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 96604.2us
I20260709 13:13:44.716886  8860 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:44.793120  7254 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:44.795425  7262 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:44.796911  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:44.796895  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:44.780992  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 404677us
W20260709 13:13:44.764506  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 254837us
I20260709 13:13:44.785831  8763 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:44.818665  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 173806us
I20260709 13:13:44.786401  8762 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.787951  9005 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:44.837239  7302 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:44.839358  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.814538  8986 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:13:44.848659  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 113379us
I20260709 13:13:44.815840  9039 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.835408  8762 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.870920  7183 raft_consensus.cc:3055] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:44.875819  7183 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:44.818104  8880 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:13:44.853504  8783 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:44.853608  8986 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.846139  8808 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:44.880383  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:44.881381  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 92507.6us
I20260709 13:13:44.844998  8871 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:44.895169  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 72039.6us
W20260709 13:13:44.899395  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 78981.9us
I20260709 13:13:44.917586  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:44.845173  9070 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:13:44.837090  9073 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:13:44.922981  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:44.921556  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 93361.2us
I20260709 13:13:44.847045  9005 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:44.912082  8512 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.002s
I20260709 13:13:44.925385  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:44.891644  8783 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.900497  8986 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:44.926762  8826 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:44.931565  9081 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:13:44.931939  9070 consensus_queue.cc:1243] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:13:44.932269  9065 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.284s	user 0.001s	sys 0.001s
I20260709 13:13:44.911864  8968 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:13:44.918100  8871 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:44.921134  8808 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:44.943550  9073 consensus_queue.cc:1243] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:44.944319  9005 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:44.947983  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 111958us
W20260709 13:13:44.948863  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.870828  9039 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:44.935586  9002 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.118s	user 0.011s	sys 0.001s
W20260709 13:13:44.978749  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.006544  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.922744  9101 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:44.949652  8826 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.949299  8783 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.947994  9046 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:45.027678  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 170300us
I20260709 13:13:44.951200  9088 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:45.047816  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:45.100067  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 188725us
W20260709 13:13:45.101195  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.103646  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 202090us
I20260709 13:13:45.105465  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:45.045936  8780 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:13:45.095786  8826 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:45.103001  9070 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:45.099056  9088 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.111720  8880 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.112090  9002 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.200208  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:45.205859  7184 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:45.206167  9085 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
W20260709 13:13:45.206667  9091 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:13:44.952466  8860 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:45.206991  9095 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:13:45.207170  9075 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:45.210983  9101 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:45.211791  9077 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:13:45.211823  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1960) took 1304 ms. Trace:
I20260709 13:13:45.211030  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1785) took 1656 ms. Trace:
I20260709 13:13:45.213971  8780 tablet_bootstrap.cc:492] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:45.215512  9039 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:45.217423  9102 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:45.217971  7225 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:45.098901  8871 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.203738  9070 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:45.241662  7256 rpcz_store.cc:276] 0709 13:13:43.907202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.990653 (+ 83451us) service_pool.cc:224] Handling call
0709 13:13:43.991004 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.991662 (+   658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.991691 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.992387 (+   696us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.580686 (+588299us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:44.580744 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.580848 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.211601 (+630753us) raft_consensus.cc:1685] finished
0709 13:13:45.211622 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.211760 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":587864,"threads_started":1,"wal-append.queue_time_us":1107607}
W20260709 13:13:45.237407  7892 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.834s	user 0.007s	sys 0.004s
I20260709 13:13:45.243218  7187 rpcz_store.cc:276] 0709 13:13:43.554165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.709468 (+155303us) service_pool.cc:224] Handling call
0709 13:13:43.709955 (+   487us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:44.471517 (+761562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:44.471560 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:44.493835 (+ 22275us) log.cc:844] Serialized 52 byte log entry
0709 13:13:44.673631 (+179796us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:44.758233 (+ 84602us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.890217 (+131984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.890330 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.210752 (+320422us) raft_consensus.cc:1685] finished
0709 13:13:45.210773 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.210955 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113748,"prepare.queue_time_us":117622,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":6843,"raft.queue_time_us":252548,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":86309,"thread_start_us":993053,"threads_started":4,"wal-append.queue_time_us":599948}
W20260709 13:13:45.263979  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 166546us
W20260709 13:13:45.246702  8781 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.715s	user 0.011s	sys 0.000s
W20260709 13:13:45.293111  9054 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:13:45.219893  9088 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:45.241400  9002 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.236007  8808 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.295369  8871 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:45.341238  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:45.296363  9070 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.299366  7893 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:45.346028  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:45.318732  8721 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.879s	user 0.011s	sys 0.000s
I20260709 13:13:45.295589  8780 tablet_bootstrap.cc:492] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:13:45.312155  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:13:45.278528  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 230789us
I20260709 13:13:45.355945  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:45.352218  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.358805  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.238258  8880 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.362598  7894 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:45.300879  7892 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:45.328506  8781 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:45.342554  8763 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:45.389245  7889 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:13:45.389739  7889 pending_rounds.cc:85] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 6
I20260709 13:13:45.389657  9101 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:45.390202  7889 pending_rounds.cc:107] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:13:45.390515  7889 raft_consensus.cc:2889] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:45.390846  8763 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:45.392084  9106 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:45.390223  9101 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:45.393015  9106 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:45.393426  9106 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:45.393517  9101 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.366322  7183 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.362309  8871 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:45.362416  8968 consensus_queue.cc:1243] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:13:45.394459  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1958) took 1487 ms. Trace:
I20260709 13:13:45.323999  8986 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.437670  7183 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:45.465677  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 261020us
I20260709 13:13:45.463248  7152 leader_election.cc:400] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:45.384438  8796 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:45.490479  9103 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.491235  9103 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.490583  8796 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.493723  9103 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:45.363466  8721 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:45.387939  7892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 330) took 1570 ms (client timeout 1534 ms). Trace:
W20260709 13:13:45.507177  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44101.3us
W20260709 13:13:45.513303  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 213725us
I20260709 13:13:45.403206  9070 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:45.465022  9116 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:13:45.419021  8968 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:45.419595  9102 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:45.459858  9101 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:45.518512  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:45.521443  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 213188us
W20260709 13:13:45.555158  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 355052us
W20260709 13:13:45.499586  8762 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.002s
I20260709 13:13:45.519632  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1786) took 1876 ms. Trace:
W20260709 13:13:45.558688  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 47584.7us
W20260709 13:13:45.559317  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 45599.5us
I20260709 13:13:45.563045  7178 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:45.561800  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:45.559140  7299 connection.cc:256] RPC call timeout handler was delayed by -1.1651202430000467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:13:45.565594  7299 connection.cc:256] RPC call timeout handler was delayed by -1.0589202430001023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 13:13:45.565879  7299 connection.cc:256] RPC call timeout handler was delayed by -1.0328202430000601s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 13:13:45.566452  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:45.556241  7179 rpcz_store.cc:276] 0709 13:13:43.642877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.620781 (+977904us) service_pool.cc:224] Handling call
0709 13:13:44.650464 (+ 29683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.650742 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:44.677105 (+ 26363us) log.cc:844] Serialized 14 byte log entry
0709 13:13:45.300320 (+623215us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b180035d160. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a
0709 13:13:45.519181 (+218861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:45.519250 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:45.519306 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.519391 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.519544 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62641,"prepare.queue_time_us":48711,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":90076,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":32073600,"thread_start_us":254341,"threads_started":2,"wal-append.queue_time_us":167176}
I20260709 13:13:45.466915  9077 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:13:45.512074  8780 ts_tablet_manager.cc:1403] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 3.522s	user 0.032s	sys 0.045s
W20260709 13:13:45.575418  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.575563  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:45.419183  8871 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.554958  8984 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.394359  9106 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.581022  7152 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:45.551414  9102 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:45.556540  8796 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:45.561748  8764 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.596925  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:45.588287  8923 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.968s	user 0.013s	sys 0.000s
W20260709 13:13:45.602479  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.590382  8656 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.043s	user 0.006s	sys 0.006s
I20260709 13:13:45.577018  9070 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.587486  8968 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:45.512814  7892 rpcz_store.cc:269] 0709 13:13:43.811873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.812909 (+  1036us) service_pool.cc:224] Handling call
0709 13:13:44.029636 (+216727us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117eee 0000000000375939 00007fecee18b1e0 00007fecee2540c4 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:13:45.382325 (+1352689us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6295808}
I20260709 13:13:45.562426  8762 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.613417  7150 leader_election.cc:400] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:45.618783  7150 leader_election.cc:403] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:13:45.619752  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 58065.7us
I20260709 13:13:45.608636  9005 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.624796  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1787) took 1904 ms. Trace:
I20260709 13:13:45.604781  9106 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:45.630950  7185 rpcz_store.cc:276] 0709 13:13:43.720787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.618369 (+897582us) service_pool.cc:224] Handling call
0709 13:13:44.653196 (+ 34827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:44.686029 (+ 32833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:44.695850 (+  9821us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:44.717338 (+ 21488us) log.cc:844] Serialized 26 byte log entry
0709 13:13:45.112821 (+395483us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:45.112880 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.112977 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.624506 (+511529us) raft_consensus.cc:1685] finished
0709 13:13:45.624528 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.624713 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45913,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":51033,"thread_start_us":311301,"threads_started":1,"wal-append.queue_time_us":543113}
I20260709 13:13:45.607113  8968 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:45.607535  9110 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:45.599208  8984 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.616700  9077 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:45.657214  9077 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:45.658218  9077 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:45.636153  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.636749  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55798.1us
I20260709 13:13:45.632138  9070 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.638592  9130 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3.
I20260709 13:13:45.663295  8986 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:45.642700  9126 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:45.664438  9125 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.081s	user 0.000s	sys 0.003s
I20260709 13:13:45.664994  9070 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:45.666138  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:45.667599  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:45.669862  7180 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.670198  8705 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:45.616654  9099 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:45.599421  8764 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:45.651360  9059 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:13:45.652024  9052 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.134s	user 0.006s	sys 0.009s
I20260709 13:13:45.687539  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:45.688079  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 79263.4us
I20260709 13:13:45.652379  8968 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.654109  8721 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:45.620322  9002 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:45.654444  9080 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:45.656520  8631 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:45.638888  9127 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:45.712001  9127 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:45.713367  8826 consensus_meta.cc:287] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:13:45.664330  9126 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:45.714562  9126 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.715525  8871 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:45.670105  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:45.718518  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1777) took 2202 ms. Trace:
I20260709 13:13:45.719946  7179 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:45.719029  7181 rpcz_store.cc:276] 0709 13:13:43.516278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.538757 (+ 22479us) service_pool.cc:224] Handling call
0709 13:13:43.539194 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.539435 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.539467 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.540031 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.305400 (+765369us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:44.328007 (+ 22607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.340795 (+ 12788us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.651298 (+1310503us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:13:45.714387 (+ 63089us) raft_consensus.cc:1685] finished
0709 13:13:45.714416 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.718411 (+  3995us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17509760,"thread_start_us":747355,"threads_started":1,"wal-append.queue_time_us":888841}
I20260709 13:13:45.720101  8762 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:45.629717  8860 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.721170  8860 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.703612  8631 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:45.694123  8796 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:45.723476  8860 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:45.724514  7184 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:13:45.650451  9102 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.649614  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 475) took 2571 ms. Trace:
I20260709 13:13:45.689172  7150 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:45.690910  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:45.691555  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.609786  8656 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:45.704174  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 145697us
I20260709 13:13:45.635833  9005 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.613929  8783 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:13:45.707356  9117 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:13:45.708326  8512 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:45.480268  7258 rpcz_store.cc:276] 0709 13:13:43.906578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.934720 (+ 28142us) service_pool.cc:224] Handling call
0709 13:13:43.991450 (+ 56730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.991843 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:44.556619 (+564776us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.879246 (+322627us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:44.946765 (+ 67519us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.946951 (+   186us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:44.946988 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.947068 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.394227 (+447159us) raft_consensus.cc:1685] finished
0709 13:13:45.394254 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.394396 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52575,"prepare.queue_time_us":77936,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":5597,"raft.queue_time_us":49925,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"spinlock_wait_cycles":35128704,"thread_start_us":679000,"threads_started":2,"wal-append.queue_time_us":786606}
I20260709 13:13:45.710991  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:45.694032  9080 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:45.758219  7185 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:13:45.808732  7185 pending_rounds.cc:85] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 2
I20260709 13:13:45.809294  7185 pending_rounds.cc:107] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:45.809953  7185 raft_consensus.cc:2889] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:45.776396  7183 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:13:45.777922  7186 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:45.781208  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:45.787577  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:45.798331  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 160794us
I20260709 13:13:45.798396  7180 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:45.658284  8780 raft_consensus.cc:359] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:45.713814  8826 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.811441  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:45.811822  7187 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:45.810647  7183 pending_rounds.cc:85] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 5
W20260709 13:13:45.812695  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.724857  8764 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:45.816067  8984 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:45.778901  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 89868.3us
I20260709 13:13:45.782112  8721 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.684366  9130 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.107s
I20260709 13:13:45.842783  7183 pending_rounds.cc:107] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:13:45.850183  7183 raft_consensus.cc:2889] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:45.791340  8512 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:45.854135  7150 leader_election.cc:400] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
I20260709 13:13:45.781476  8986 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
W20260709 13:13:45.855070  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 233402us
I20260709 13:13:45.859833  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:45.856878  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 208) took 1205 ms. Trace:
I20260709 13:13:45.822181  8968 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:45.808272  8796 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:45.860802  7183 rpcz_store.cc:276] 0709 13:13:44.651315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.825172 (+173857us) service_pool.cc:224] Handling call
0709 13:13:44.851181 (+ 26009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.354032 (+502851us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b4c00248640. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7508a20 00007fece7519a29 00007fece74df644 00007fece7506f2d 00007fece7506b93 00007fece923718b 00007fece9237cb5 00007fece9232f30 00007fece92347de 00007fece923eb49 00007fece923f416
0709 13:13:45.856535 (+502503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.856803 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13771008}
I20260709 13:13:45.817009  8780 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:13:45.866958  8796 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.823347  9127 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:45.871639  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.813136  8887 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:45.865496  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53357.9us
W20260709 13:13:45.865768  9053 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 1.349s	user 0.005s	sys 0.011s
I20260709 13:13:45.776818  7888 rpcz_store.cc:276] 0709 13:13:43.078754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.082428 (+  3674us) service_pool.cc:224] Handling call
0709 13:13:43.082900 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.597697 (+514797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.597742 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.598324 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.439022 (+840698us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:44.794766 (+355744us) log.cc:844] Serialized 14 byte log entry
0709 13:13:45.107302 (+312536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.649037 (+541735us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b5400521f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:45.649114 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.649181 (+    67us) raft_consensus.cc:1685] finished
0709 13:13:45.649302 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.649507 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2874,"prepare.queue_time_us":478072,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2346,"raft.queue_time_us":36571,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11363,"spinlock_wait_cycles":1068572416,"thread_start_us":1289882,"threads_started":3,"wal-append.queue_time_us":932489}
I20260709 13:13:45.870582  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 485) took 1511 ms. Trace:
I20260709 13:13:45.870121  8796 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:45.854494  9122 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:45.880332  7891 rpcz_store.cc:276] 0709 13:13:44.359715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.381034 (+ 21319us) service_pool.cc:224] Handling call
0709 13:13:44.399159 (+ 18125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:44.419348 (+ 20189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:44.426274 (+  6926us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:44.490985 (+ 64711us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.719028 (+228043us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:44.719066 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.719131 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.870335 (+1151204us) raft_consensus.cc:1685] finished
0709 13:13:45.870362 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.870511 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":520,"raft.queue_time_us":4615,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":9820,"thread_start_us":209760,"threads_started":1,"wal-append.queue_time_us":1366214}
I20260709 13:13:45.891214  9078 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:13:45.892838  9003 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:45.895605  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:45.885730  9127 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:45.900189  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.902061  7261 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:45.902251  7258 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:45.902434  7261 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:45.902894  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:45.903208  7261 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.904165  7261 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:45.904919  9111 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:45.905614  9111 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:45.906124  9111 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.906750  8880 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:45.908228  9111 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:45.908769  9111 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.909188  9111 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.888026  9130 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:13:45.867906  8780 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:45.914036  8780 ts_tablet_manager.cc:1434] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.326s	user 0.004s	sys 0.005s
I20260709 13:13:45.915081  8512 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:45.916200  8512 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:45.916563  8879 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:45.916980  8879 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:45.878188  7180 raft_consensus.cc:2410] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:45.917953  8879 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.878638  9132 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:45.947608  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.944195  7261 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:13:45.951063  7261 pending_rounds.cc:85] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 4
I20260709 13:13:45.951444  7261 pending_rounds.cc:107] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:13:45.951732  7261 raft_consensus.cc:2889] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:45.947595  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:45.952948  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:13:46.001971  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 79012.3us
I20260709 13:13:45.857167  8631 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:45.946714  9132 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.009671  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:45.932729  8808 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:46.016296  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:46.002240  8879 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.009377  9003 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.026521  9003 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.027769  9132 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.028785  9003 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:46.029770  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:46.030505  7335 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:46.031299  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1970) took 1319 ms. Trace:
I20260709 13:13:46.031677  7259 rpcz_store.cc:276] 0709 13:13:44.712455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.714719 (+  2264us) service_pool.cc:224] Handling call
0709 13:13:44.728529 (+ 13810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:44.728911 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:44.728945 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:44.775338 (+ 46393us) log.cc:844] Serialized 26 byte log entry
0709 13:13:45.088065 (+312727us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:45.088125 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.088232 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:46.031107 (+942875us) raft_consensus.cc:1685] finished
0709 13:13:46.031127 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.031245 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":38527,"thread_start_us":262809,"threads_started":1,"wal-append.queue_time_us":1086864}
I20260709 13:13:46.034996  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:46.035964  7327 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:46.022193  8871 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.029824  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:46.022994  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.044602  7258 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:46.045965  8871 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:46.048445  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.050808  7150 connection.cc:256] RPC call timeout handler was delayed by -1.0652412940000886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
W20260709 13:13:46.051230  7150 connection.cc:256] RPC call timeout handler was delayed by -1.0049412940002185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260709 13:13:46.052595  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:46.054240  7150 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:46.054786  9069 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.055289  8796 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:46.061987  9005 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:46.064965  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 201) took 1835 ms. Trace:
I20260709 13:13:46.066076  9002 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.067451  9099 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.067780  9115 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:46.070662  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.114921  7185 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:46.072909  9102 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.019479  9129 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:46.073768  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.114748  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:46.075225  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:46.115998  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.116175  7335 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.116297  7186 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.077108  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:45.932686  9122 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:46.080096  7081 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 150) took 11593 ms (client timeout 15000 ms). Trace:
I20260709 13:13:46.116034  7182 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:13:46.083436  9136 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 13:13:46.084167  7888 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:13:46.086769  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:46.085888  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.090150  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:46.117309  7081 rpcz_store.cc:269] 0709 13:13:34.488898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.506359 (+ 17461us) service_pool.cc:224] Handling call
0709 13:13:46.080028 (+11573669us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:43.559132 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:43.677011 (+117879us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:43.688102 (+ 11091us) write_op.cc:435] Acquired schema lock
0709 13:13:43.697309 (+  9207us) tablet.cc:662] Decoding operations
0709 13:13:43.697790 (+   481us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:43.697915 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:43.697959 (+    44us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:43.698279 (+   320us) tablet.cc:701] Row locks acquired
0709 13:13:43.698328 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:13:43.698514 (+   186us) write_op.cc:270] Start()
0709 13:13:43.698714 (+   200us) write_op.cc:276] Timestamp: P: 1783602823698452 usec, L: 0
0709 13:13:43.698761 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:13:43.741130 (+ 42369us) log.cc:844] Serialized 536 byte log entry
0709 13:13:43.744133 (+  3003us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b54000aa354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9237e28 00007fececc72581 00007fececc71d58 00007fececc769f1 00007fececc769a9 00007fececc76939 00007fececc76901 00007fececc75b2d 000000000038f354 000000000038f199
0709 13:13:44.522230 (+778097us) op_driver.cc:464] REPLICATION: finished
0709 13:13:44.884750 (+362520us) write_op.cc:301] APPLY: starting
0709 13:13:44.911915 (+ 27165us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:44.929188 (+ 17273us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:44.932317 (+  3129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:44.932725 (+   408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:44.933026 (+   301us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:44.933110 (+    84us) write_op.cc:312] APPLY: finished
0709 13:13:44.933413 (+   303us) log.cc:844] Serialized 23 byte log entry
0709 13:13:44.933623 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:44.933712 (+    89us) write_op.cc:454] Released schema lock
0709 13:13:44.933777 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:44.934153 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:44.934187 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":94105,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":308563,"apply.run_cpu_time_us":2405,"apply.run_wall_time_us":76702,"num_ops":1,"prepare.queue_time_us":310850,"prepare.run_cpu_time_us":6848,"prepare.run_wall_time_us":185334,"replication_time_us":803407,"spinlock_wait_cycles":69364608,"thread_start_us":397871,"threads_started":2}]]}
I20260709 13:13:46.117372  8762 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.106583  9073 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:13:46.105341  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 51159.5us
I20260709 13:13:45.930876  9046 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:13:46.002748  8887 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 13:13:46.107334  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.110208  7261 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:46.152361  7187 raft_consensus.cc:2410] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:13:46.115091  7152 leader_election.cc:336] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 3.135s (SENT)
I20260709 13:13:46.071367  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.075371  9003 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:46.121768  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:46.153169  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:46.012936  9071 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:13:46.085502  9111 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:46.169303  7330 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:13:46.119807  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:46.118260  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 258505us
I20260709 13:13:46.170953  7334 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:46.171365  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:46.172153  9111 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:46.172963  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:46.173633  7332 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:46.114413  9115 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.143488  7260 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:46.176520  9115 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:46.143292  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:46.111076  8763 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:46.174660  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:46.114282  9002 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.180445  9111 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:46.181922  9002 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:46.182315  8783 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:46.149891  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.108807  7178 rpcz_store.cc:276] 0709 13:13:44.229549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.641014 (+411465us) service_pool.cc:224] Handling call
0709 13:13:44.641327 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.565063 (+923736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.064657 (+499594us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54000ee2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:46.064888 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111828224}
I20260709 13:13:46.114264  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:46.120834  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 309422us
I20260709 13:13:46.115284  9069 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.155331  7336 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:13:46.190971  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69291us
I20260709 13:13:46.158776  9073 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.160109  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:46.142258  8940 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.119848  8656 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:46.117209  9126 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:46.162915  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.116706  8796 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:46.163398  7184 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:46.142676  8808 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:13:46.180024  7333 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:46.093232  7262 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:46.174530  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:46.170413  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:46.187146  7335 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:46.209089  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:46.130913  9099 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.013943  9120 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.196695  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:46.199331  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.209803  8940 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.223913  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.224442  9069 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.224575  7261 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:46.225144  8656 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.217309  9124 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:13:46.225907  8940 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:46.195236  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46498.6us
I20260709 13:13:46.219252  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:46.204188  8986 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:46.196612  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.229368  7178 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:46.229588  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.206097  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.192078  7334 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:46.230382  7262 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:46.210098  9127 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.216598  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:46.218183  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 103133us
I20260709 13:13:46.152977  8762 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.236536  7330 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:46.205710  9071 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.242023  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:46.227671  7183 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 1. Current term is 2. Ops: []
W20260709 13:13:46.230832  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 43801.5us
I20260709 13:13:46.243348  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:46.229040  9088 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.000s
W20260709 13:13:46.235761  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.927520  9080 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.228032  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:46.217308  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.204957  7327 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:46.255491  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:46.255924  7334 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:46.239590  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:46.235333  7335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:46.259119  7335 raft_consensus.cc:606] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:46.259683  7335 raft_consensus.cc:614] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:46.260478  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.246229  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:46.218492  9114 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:13:46.238986  8995 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:46.209967  9129 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:13:46.263643  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.266659  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:46.240314  9132 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.239362  9130 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:46.274474  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:46.278183  8512 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.278672  8512 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.280488  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:46.275285  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 266482us
I20260709 13:13:46.282395  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:46.240604  9103 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.305254  7260 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:46.254654  9115 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.261775  8986 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:46.282332  9138 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:46.286849  8656 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:46.287465  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:46.287724  8968 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.288620  9124 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:46.327447  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.327505  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:46.328408  7257 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:46.289151  8762 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:46.289603  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:46.289708  9134 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:46.271636  9135 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:46.271993  9120 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:13:46.316570  9103 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.337600  9119 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:46.338055  9119 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:46.331426  9129 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:46.338887  9103 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.339497  9103 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:46.291075  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.344532  7256 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:46.345085  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:46.345152  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:46.345975  7336 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:46.291682  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:46.347981  9139 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:46.348755  9139 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:46.294838  8796 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.289603  7262 raft_consensus.cc:2410] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:46.301208  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:46.351338  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.352208  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:46.352530  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.352954  7183 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:46.353201  7179 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:46.322427  9138 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.241636  8940 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:13:46.303731  9099 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:46.260433  9069 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:46.311811  8995 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:46.307639  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:46.309504  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:46.305635  7260 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:46.283499  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:46.355446  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 47896.1us
W20260709 13:13:46.321117  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.258723  9088 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.325284  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:46.275920  8826 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:46.283248  8763 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:46.334615  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 45086.6us
I20260709 13:13:46.354387  9138 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:46.320467  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.358464  7228 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:46.346382  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:46.304287  9130 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.363844  7260 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.322057  9093 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:46.361600  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:46.362880  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.363559  7336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:46.368100  7336 raft_consensus.cc:606] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:46.368430  7336 raft_consensus.cc:614] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:46.364091  9103 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:13:46.364843  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55442.6us
I20260709 13:13:46.316968  9105 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:13:46.372140  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.371948  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46772.9us
I20260709 13:13:46.373171  7260 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.372668  7183 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:46.374450  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:46.334383  9135 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:46.361974  9102 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:46.385262  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.322826  8986 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.385952  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:46.370844  8826 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:46.371855  9127 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:46.366698  9069 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:46.402792  7257 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:46.371662  9093 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.371660  9103 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:46.377926  8762 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:46.408572  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:46.375275  9129 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.358422  9134 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.383350  8940 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.379412  8763 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:46.384428  9122 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.390643  9102 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.403399  8968 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.403997  8826 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.405821  9127 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.387240  9135 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:46.405367  8808 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:46.386377  9120 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:13:46.384819  9124 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:13:46.412840  9126 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.413334  9093 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.410382  7258 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:46.405296  9073 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:46.402760  9099 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:13:46.417093  9132 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:46.440845  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:46.389127  9133 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
W20260709 13:13:46.425319  8721 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.001s
I20260709 13:13:46.440461  9127 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:46.425273  9102 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:46.464125  7895 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:46.412945  8995 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.468227  7183 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:46.469614  7183 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:46.438520  8968 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:46.422871  9129 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:13:46.447408  7336 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:46.430132  8826 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:46.456878  7186 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:46.440981  8808 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:13:46.485958  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 107229us
W20260709 13:13:46.505448  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 127293us
I20260709 13:13:46.462915  9088 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.462658  8721 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:46.511595  7186 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:46.504351  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:46.464356  9105 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:13:46.532111  7178 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:46.534725  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:46.510782  8808 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.425622  9119 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.506366  8879 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:13:46.485752  9103 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:46.559080  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 278668us
W20260709 13:13:46.555342  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 167018us
I20260709 13:13:46.543853  9093 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.560201  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:46.567842  9105 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.564503  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:46.566067  7862 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:46.534539  8763 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:46.587039  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 152904us
I20260709 13:13:46.534310  9069 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.569499  8986 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:46.594767  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.597252  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 62684.8us
I20260709 13:13:46.583922  9103 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.607965  7260 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:46.608541  7260 pending_rounds.cc:85] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 1
I20260709 13:13:46.590385  9120 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:46.608886  7260 pending_rounds.cc:107] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:46.612072  7260 raft_consensus.cc:2889] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:46.613191  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:46.591707  9118 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:46.614564  7225 connection.cc:256] RPC call timeout handler was delayed by -1.4760979699999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
I20260709 13:13:46.589012  8656 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:46.615630  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.616148  9159 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.616622  9159 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.619495  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:46.620033  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:46.620618  7260 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.623078  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.622996  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.624032  7257 raft_consensus.cc:2410] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:46.624404  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.624818  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:46.625044  7258 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:46.625532  7257 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:46.625831  8512 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:46.625993  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.626291  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:46.627257  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.592489  9134 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.630611  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.631313  7180 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 1.
I20260709 13:13:46.612164  9158 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.632347  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.629319  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.633335  7260 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:46.634567  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:46.584201  9105 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.636731  9159 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:46.637111  9143 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:13:46.638697  9105 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.639894  9093 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:46.640466  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.640807  9105 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:46.641372  9105 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:46.641611  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.643983  8940 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:46.643806  9138 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.644776  8940 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.595613  9157 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:46.647873  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.646803  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.648638  7260 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:46.648684  7181 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
W20260709 13:13:46.630928  9142 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:13:46.655433  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:46.647665  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49404.9us
I20260709 13:13:46.570384  8968 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.669855  7260 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:46.635028  8656 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.673125  9138 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.673890  9153 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.674402  9153 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.674963  7180 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:46.675042  8656 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.676488  7180 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:46.676698  9153 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:46.637147  9137 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.419s	user 0.004s	sys 0.000s
I20260709 13:13:46.676843  7180 pending_rounds.cc:85] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 1
I20260709 13:13:46.682121  7180 pending_rounds.cc:107] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:46.682456  7180 raft_consensus.cc:2889] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:46.690215  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:46.690909  7181 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.595360  9124 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:13:46.632972  9120 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:46.648100  9157 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:46.695104  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 129075us
I20260709 13:13:46.704738  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:46.707237  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 87814.5us
I20260709 13:13:46.697708  8986 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.715615  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.713528  8986 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.642338  9105 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.702983  9157 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:46.734275  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:46.739408  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:46.740991  9165 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:46.741477  9165 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.736829  9159 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:46.741848  9165 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.740603  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:46.749015  9159 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:46.752388  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:46.753229  7894 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:46.733788  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:46.745318  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:46.762109  7258 raft_consensus.cc:2376] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3. Re-sending same reply.
I20260709 13:13:46.747380  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:46.763608  9154 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.001s
W20260709 13:13:46.764132  9152 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:13:46.765017  9155 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:13:46.765933  9151 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:13:46.713806  8721 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.791806  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:46.799031  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 90559.1us
I20260709 13:13:46.819319  7895 raft_consensus.cc:1217] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:13:46.832222  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1972) took 2083 ms. Trace:
I20260709 13:13:46.800820  8705 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:13:46.834605  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 106385us
I20260709 13:13:46.845458  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:46.836827  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:46.832926  7255 rpcz_store.cc:276] 0709 13:13:44.749319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.755107 (+  5788us) service_pool.cc:224] Handling call
0709 13:13:44.803376 (+ 48269us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:44.839126 (+ 35750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:44.839172 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:44.863671 (+ 24499us) log.cc:844] Serialized 52 byte log entry
0709 13:13:46.068987 (+1205316us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b18003a4ec0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:13:46.375596 (+306609us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:46.440778 (+ 65182us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.679842 (+239064us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b18003a4ec0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:13:46.831751 (+151909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.831945 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:46.831987 (+    42us) raft_consensus.cc:1685] finished
0709 13:13:46.832012 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.832161 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3810,"prepare.queue_time_us":64599,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":1448,"raft.queue_time_us":74221,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":36329,"spinlock_wait_cycles":19085568,"thread_start_us":458127,"threads_started":2,"wal-append.queue_time_us":1565870}
I20260709 13:13:46.833653  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:46.839293  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:46.756258  9159 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.828889  9069 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:46.853986  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:46.855206  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.860921  8879 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:46.864861  7258 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:46.861168  9159 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:46.871806  8721 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:46.872337  8721 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:46.872545  8871 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:46.872763  8721 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:46.874408  9130 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.877347  9069 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.878897  9133 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.879292  9133 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:46.880282  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:46.880354  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:46.880131  9133 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:46.881707  9133 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.883512  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.883955  9123 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:46.884272  9119 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:46.889843  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.890555  7183 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:46.891562  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:46.892048  7183 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:46.892563  7254 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:13:46.892941  7254 pending_rounds.cc:85] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 3
I20260709 13:13:46.893183  7254 pending_rounds.cc:107] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:13:46.893433  7254 raft_consensus.cc:2889] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:46.897477  9127 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.897977  9157 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.884287  7179 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:46.899976  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:46.900537  7179 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:46.900835  7181 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:46.904433  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:46.905650  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:46.885867  8721 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.914254  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:46.916064  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.819814  9135 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.922461  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:46.921113  9159 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:46.926251  9159 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.910120  9123 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:46.954445  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.955324  7183 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:46.956651  9157 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.871784  9165 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.916790  9102 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:46.957446  9135 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.957979  7186 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:46.960731  9127 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:46.969007  9165 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.974793  9163 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:46.975265  9163 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:46.975617  9163 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:46.976476  7255 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:46.852114  8705 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.981547  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:46.983332  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:46.924409  8879 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:46.986608  8879 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.990321  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:46.991372  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:46.992208  7888 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:46.993691  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.994304  7255 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:46.994669  7261 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:46.995251  7271 tablet_copy_service.cc:342] P efc9ee9e1d86480790fa83f6ad0c295c: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-242a63190870450082200759c7f513ab received from {username='slave'} at 127.0.0.1:57560
I20260709 13:13:46.995811  7271 tablet_copy_service.cc:434] P efc9ee9e1d86480790fa83f6ad0c295c: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-242a63190870450082200759c7f513ab on tablet 242a63190870450082200759c7f513ab with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:46.995695  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.997268  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:46.997226  8826 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.997980  7261 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:46.998660  7889 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:46.998775  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:46.999337  7262 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:46.999490  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:47.002169  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:47.002830  7256 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:46.926694  9159 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:47.012487  8986 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:46.841043  9120 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:46.989305  8879 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:47.016680  8808 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:47.028223  8826 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:47.029896  7889 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:47.033097  7257 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 2: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:47.033349  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:47.035063  9111 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:47.035559  9111 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:47.036700  9111 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.042550  8879 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.043417  8879 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:47.044117  8986 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:47.045070  8986 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:47.045421  8986 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:47.046272  8986 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:47.046509  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:47.048985  8986 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.048346  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:47.051230  7254 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:47.042773  7256 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:47.059929  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.067873  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.068768  7330 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
I20260709 13:13:47.070596  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.071596  7330 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:13:47.075667  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.078480  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:47.080304  7262 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:47.082617  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:47.084952  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:47.073802  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:47.086944  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.088817  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:47.003618  9123 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:47.038359  9111 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.162927  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.137130  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:47.091836  7861 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:47.176100  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.132424  7262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4637971bd855417fac5632325ab8f119"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:35332
I20260709 13:13:47.117815  8512 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:47.225075  8512 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.225497  8512 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.165282  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.226555  7328 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
W20260709 13:13:47.164935  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 82401.6us
W20260709 13:13:47.200896  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.062779  8848 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:47.122376  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:47.229991  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:47.234481  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:47.234699  7257 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:47.127597  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.235191  7255 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:47.235659  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:47.235687  7331 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.236987  7257 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.234715  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:47.238147  7256 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
W20260709 13:13:47.229991  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 138227us
I20260709 13:13:47.240702  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:47.243394  7861 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:47.088012  9130 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.247591  7253 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:47.082973  9075 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.228917  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.260097  7329 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:47.262781  7327 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:47.090077  9070 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.264452  9070 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.266170  9159 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.267272  8631 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.163062  9149 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:47.258757  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:47.272809  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:47.127519  9123 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.165594  9168 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:47.276705  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:47.232147  8763 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.277127  7257 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:47.282277  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:47.285171  9070 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:47.246724  8848 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.251457  9171 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:47.250739  8879 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:47.166770  9103 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:13:47.164649  9163 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.275489  9003 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:47.292157  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:47.314029  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1339) took 1009 ms. Trace:
I20260709 13:13:47.348246  7254 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:13:47.271399  9105 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:47.356328  7186 rpcz_store.cc:276] 0709 13:13:46.304674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.536347 (+231673us) service_pool.cc:224] Handling call
0709 13:13:46.542250 (+  5903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:46.958382 (+416132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.313766 (+355384us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54001b44d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:47.313969 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955527040}
I20260709 13:13:47.363649  8512 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:47.270083  9149 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:47.365021  7335 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:47.323220  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:47.366957  7255 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:47.367530  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44485.6us
I20260709 13:13:47.368249  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:47.312846  9070 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:47.313659  9168 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:47.286254  9150 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.351320  9102 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:47.362274  9003 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.285982  8808 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:47.347692  8848 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.374790  8512 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:47.353346  9171 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.272022  9130 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.361475  9105 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.370369  9149 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.286055  8763 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.369508  9069 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:47.378065  9076 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:47.412850  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:47.281919  9075 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.373486  9159 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:47.399786  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:47.415402  7182 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:47.377162  9080 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.408928  8512 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.416621  8512 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.409518  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:47.384799  9003 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.383394  9119 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:47.412850  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:47.394363  9171 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.423585  7254 raft_consensus.cc:2376] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3. Re-sending same reply.
I20260709 13:13:47.410492  8808 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:13:47.424543  7184 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:47.426874  9075 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:47.395494  9070 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:47.428046  8512 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:47.409469  9105 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:47.419349  9076 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.396307  9150 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.421725  7331 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:47.433774  7179 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:47.432750  9159 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:47.466805  7187 raft_consensus.cc:2410] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:47.466250  7329 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:13:47.476877  9123 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.479696  9163 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:47.438797  9070 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.488916  7262 raft_consensus.cc:606] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:47.445186  9076 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.489364  7262 raft_consensus.cc:614] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:47.487381  7182 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:47.498905  7183 raft_consensus.cc:2410] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:47.462607  9120 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.503381  7182 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:47.511242  7259 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:47.491305  9070 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.512457  9149 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:47.523639  9149 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:47.525635  9123 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:47.528009  7182 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:47.529145  9170 raft_consensus.cc:3055] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:47.529610  9170 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:47.530781  9170 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:47.532121  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.532158  8986 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.532982  8986 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:47.535773  8986 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:47.532157  9170 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:47.537158  9182 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:13:47.529429  7182 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:47.541829  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.541749  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:47.547931  8512 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:47.548532  8512 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:47.617327  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.572543  8986 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:47.515715  9120 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.619490  8512 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.680971  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:47.681141  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:47.682062  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 422358us
I20260709 13:13:47.596572  9102 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:47.686240  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.694512  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:47.695343  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.695694  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.696300  7331 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:47.697108  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.698050  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.687559  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.689188  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.699980  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.701588  7331 raft_consensus.cc:2368] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:13:47.703192  7330 raft_consensus.cc:2410] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:47.703791  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.705704  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.706437  7331 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:13:47.707263  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:47.705787  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 337584us
I20260709 13:13:47.707973  7331 raft_consensus.cc:2410] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:47.708303  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:47.712158  7334 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:47.715793  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.716012  7331 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:47.716486  7332 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:47.711203  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.718915  9130 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:47.720062  9183 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 13:13:47.725732  9190 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:13:47.727029  9150 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:47.729862  9171 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:47.714939  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:47.740324  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:47.743381  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:47.746140  7896 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:47.702692  7889 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:47.748929  7261 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 2: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:47.708761  9191 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.755780  7262 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:47.752111  7334 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:13:47.760346  9075 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.709614  7888 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:47.764151  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.771819  7332 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:47.735823  9195 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.774708  7253 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:47.750900  9149 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:47.776867  7301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.024s	sys 0.050s
I20260709 13:13:47.748663  9130 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:47.706748  9102 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.776214  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:47.780579  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:13:47.766445  9187 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:13:47.788509  7332 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:47.769917  8763 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:47.740182  9165 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:13:47.786235  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:47.783927  7301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.024s	sys 0.050s
W20260709 13:13:47.796149  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 673778us
I20260709 13:13:47.791443  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:47.797402  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.796963  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:47.799045  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.799983  7331 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.801766  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.805181  9070 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.795846  9130 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:47.807058  9130 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.807739  9070 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:47.769100  9191 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.809461  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:47.776592  8986 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:13:47.819444  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:47.820493  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:47.810122  7333 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:47.811110  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.790444  9149 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:47.776544  8879 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:13:47.807071  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.816243  8631 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:47.824846  7225 leader_election.cc:400] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:13:47.818662  8763 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:47.827880  7302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.043s	sys 0.051s
I20260709 13:13:47.829049  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.814723  8871 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:47.832666  7302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.044s	sys 0.051s
W20260709 13:13:47.836302  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 549008us
I20260709 13:13:47.836475  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.796568  9168 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:13:47.783124  9195 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:47.832305  7225 leader_election.cc:403] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:13:47.838892  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:47.839951  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:47.832019  7327 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:47.842104  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.817798  9105 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:47.844061  7332 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:47.823993  9129 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.820576  9070 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:13:47.841264  9159 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:13:47.828619  9163 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:47.818452  9150 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:13:47.825615  9123 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:47.851315  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:47.846462  7331 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:47.835911  8871 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.834144  8721 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:47.835850  8631 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.843389  9139 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:47.859364  7331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:47.873747  7331 raft_consensus.cc:606] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:47.861083  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:47.860175  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 84050.8us
I20260709 13:13:47.856484  8848 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:47.866883  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:47.867491  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:47.868134  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:47.875952  7253 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.876012  7332 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:47.864266  8871 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:47.868680  9188 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:13:47.868848  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1342) took 1010 ms. Trace:
I20260709 13:13:47.877389  7186 rpcz_store.cc:276] 0709 13:13:46.858883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.368796 (+509913us) service_pool.cc:224] Handling call
0709 13:13:47.416944 (+ 48148us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:47.417390 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:47.417428 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:47.422683 (+  5255us) log.cc:844] Serialized 52 byte log entry
0709 13:13:47.766482 (+343799us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:47.781545 (+ 15063us) log.cc:844] Serialized 14 byte log entry
0709 13:13:47.781764 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.781843 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:47.868575 (+ 86732us) raft_consensus.cc:1685] finished
0709 13:13:47.868595 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:47.868775 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14823,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2887,"raft.queue_time_us":318,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":10690,"spinlock_wait_cycles":3264256,"thread_start_us":322252,"threads_started":1,"wal-append.queue_time_us":415486}
I20260709 13:13:47.925521  7327 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:47.954557  7332 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:47.955145  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 115267us
I20260709 13:13:47.877524  9159 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:47.871451  9120 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:47.964326  7332 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:47.951922  7335 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 2.
W20260709 13:13:47.952205  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 91227.9us
I20260709 13:13:47.953451  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:47.876880  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:13:47.952323  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.874945  8631 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:47.959223  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:47.954730  8721 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.854053  9129 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:48.036782  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 77656.8us
I20260709 13:13:47.957060  9123 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:48.038756  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 161947us
I20260709 13:13:47.952445  9171 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:47.964322  9163 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:48.055855  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:48.037595  9194 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:48.062808  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:48.062475  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 271117us
I20260709 13:13:48.068898  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1820) took 1461 ms. Trace:
I20260709 13:13:48.070456  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:48.047412  7889 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 3: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:47.957417  9165 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
W20260709 13:13:48.072001  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 248470us
I20260709 13:13:48.084836  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:48.060257  8986 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.043362  9102 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:48.062862  8879 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:48.069402  7181 rpcz_store.cc:276] 0709 13:13:46.607941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.901525 (+293584us) service_pool.cc:224] Handling call
0709 13:13:46.902048 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:46.923704 (+ 21656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:46.923733 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:46.955521 (+ 31788us) log.cc:844] Serialized 26 byte log entry
0709 13:13:47.372404 (+416883us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:47.372455 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.372544 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.068670 (+696126us) raft_consensus.cc:1685] finished
0709 13:13:48.068693 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.068813 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5352,"raft.queue_time_us":12368,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":7875,"thread_start_us":355572,"threads_started":1,"wal-append.queue_time_us":526792}
I20260709 13:13:48.078598  9207 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:48.072533  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:48.046332  9204 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:48.092881  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:48.044550  9209 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:13:48.047971  9120 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:48.111922  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 47607us
W20260709 13:13:48.097620  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 132090us
I20260709 13:13:48.066159  9159 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:48.104995  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:48.113691  7184 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:48.113863  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:47.952350  9149 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.108112  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:48.115348  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:48.116523  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.050997  8721 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:48.111014  9216 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:48.074362  9197 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:13:48.117122  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.061069  9123 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:48.117239  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:48.094758  9194 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:48.072752  9163 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:48.123980  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 106517us
I20260709 13:13:48.127704  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:48.128369  9194 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.129346  8721 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:48.112424  9192 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:48.158725  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 495) took 1418 ms. Trace:
I20260709 13:13:48.161221  7892 rpcz_store.cc:276] 0709 13:13:46.740199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.742720 (+  2521us) service_pool.cc:224] Handling call
0709 13:13:46.743055 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:46.743424 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:46.923781 (+180357us) log.cc:844] Serialized 14 byte log entry
0709 13:13:47.380559 (+456778us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.148085 (+767526us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b2c000474b8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:13:48.148598 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:13:48.148820 (+   222us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:48.148867 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.148962 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.158319 (+  9357us) raft_consensus.cc:1685] finished
0709 13:13:48.158430 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.158604 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":112558,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":11473,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":7888000,"thread_start_us":601853,"threads_started":2,"wal-append.queue_time_us":587933}
I20260709 13:13:48.128369  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:48.112514  9102 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:48.137326  9111 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.907s	user 0.009s	sys 0.001s
I20260709 13:13:48.145144  9120 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:48.116469  9207 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:48.168185  9207 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:48.146852  9195 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:48.147401  9197 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:48.118892  9210 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:13:48.148911  8796 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:48.150393  9209 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:48.133040  9216 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:48.120963  9205 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:48.159376  9129 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:48.159956  9080 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.001s
I20260709 13:13:48.160158  8848 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:48.160331  9213 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:48.160413  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:48.188217  7182 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:48.129528  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:48.125422  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:48.189194  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63891.9us
W20260709 13:13:48.189390  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 59951.5us
I20260709 13:13:48.189898  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:48.190351  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:48.165153  8631 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:48.170362  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.122447  9191 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:48.105650  8986 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:48.181097  7187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 219) took 2026 ms (client timeout 2519 ms). Trace:
W20260709 13:13:48.200030  7187 rpcz_store.cc:269] 0709 13:13:46.150502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.190742 (+ 40240us) service_pool.cc:224] Handling call
0709 13:13:48.171561 (+1980819us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002b43d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:48.176450 (+  4889us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2842981248}
I20260709 13:13:48.182027  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:48.127280  9105 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:48.193157  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:48.170552  9076 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.000s
I20260709 13:13:48.201035  7258 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:48.202457  7182 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:48.134066  9215 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:48.216189  9215 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.216764  9215 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:48.222764  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.226704  7258 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:13:48.227777  9215 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:48.230482  9215 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:48.195194  7336 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:48.120627  8879 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.179878  8796 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.199254  8631 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:48.237026  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:48.187624  9120 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:48.239988  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:48.184546  9217 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:48.189920  9111 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.196990  9171 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:48.193116  9102 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:48.244246  8796 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.204710  9069 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.205147  9165 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:48.204922  9195 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:48.209095  9192 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:48.259570  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:48.289009  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:48.311636  7254 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:48.288544  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:48.249760  9120 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:48.306357  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:48.304613  9200 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:48.315729  9192 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:48.321580  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:48.338251  7258 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:48.339432  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:48.340152  7258 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:48.282775  9070 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:48.282500  9129 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.235684  9076 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:48.288614  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:48.342788  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:48.406859  7255 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:48.263305  8871 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:48.293694  9210 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.304948  9195 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.400238  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:48.300115  9171 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:48.330515  9075 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.001s
I20260709 13:13:48.305943  9170 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:48.350831  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:48.287611  9215 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:13:48.284039  9111 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:48.256197  9218 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 13:13:48.411051  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:48.343385  9192 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.327509  9165 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:48.420923  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:48.418437  9195 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:48.422894  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 307602us
I20260709 13:13:48.425159  7254 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:48.305753  9102 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.430027  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:48.454660  7255 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
W20260709 13:13:48.455029  7253 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.005s
I20260709 13:13:48.433980  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:48.308197  9069 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.262646  9217 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:48.417583  9183 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:13:48.441255  7258 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:48.447060  7893 raft_consensus.cc:2410] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:48.422366  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:48.412074  8631 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.443236  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:48.415907  7889 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:48.428179  9003 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.996s	user 0.011s	sys 0.001s
W20260709 13:13:48.425755  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 192140us
I20260709 13:13:48.488101  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:48.488444  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 66145.4us
I20260709 13:13:48.489441  8631 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.490103  9069 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:48.490332  9226 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:48.490813  9226 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.491142  9226 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:48.491704  8631 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:48.492924  9102 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:48.490162  9205 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:13:48.455404  7253 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:48.495955  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:48.421430  8705 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:48.427268  9075 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:48.474486  7332 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:48.406164  9129 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:48.427001  9070 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:48.453982  7329 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:13:48.457641  9204 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:48.495887  7186 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:48.501907  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 1998) took 1354 ms. Trace:
I20260709 13:13:48.476033  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:48.711385  7259 rpcz_store.cc:276] 0709 13:13:47.147543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.147739 (+   196us) service_pool.cc:224] Handling call
0709 13:13:47.233960 (+ 86221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.511733 (+277773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.501537 (+989804us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54002166d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:48.501813 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637123840}
W20260709 13:13:48.711994  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 236039us
I20260709 13:13:48.713114  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:48.450417  9209 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:48.477444  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53486.4us
I20260709 13:13:48.427350  9171 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.433929  9170 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.487500  9191 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:13:48.706718  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 194294us
I20260709 13:13:48.775754  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:48.806797  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:48.812718  7254 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:13:48.505034  9046 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:48.849404  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:48.850260  7893 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:48.690981  9069 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.326s
W20260709 13:13:48.856578  9219 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.567s	user 0.000s	sys 0.001s
I20260709 13:13:48.692083  9102 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:48.419652  9210 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.839457  9080 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:48.447162  9120 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.898437  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:48.902447  7254 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.807425  8808 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:48.907585  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:48.774802  8705 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:48.840883  8986 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:48.501672  9003 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.904901  7330 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:48.955008  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:48.956423  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.013s	sys 0.017s
W20260709 13:13:48.956791  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.013s	sys 0.017s
W20260709 13:13:48.957093  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 513717us
I20260709 13:13:48.968353  7893 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:13:48.890151  8879 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:48.862149  7896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.014s	sys 0.004s
W20260709 13:13:48.907641  7183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 227) took 1903 ms (client timeout 1644 ms). Trace:
W20260709 13:13:49.013619  7896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.017s	sys 0.005s
W20260709 13:13:49.013689  7183 rpcz_store.cc:269] 0709 13:13:47.004115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.272480 (+268365us) service_pool.cc:224] Handling call
0709 13:13:48.907374 (+1634894us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400248454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:48.907548 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517484288}
I20260709 13:13:48.841809  9046 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.903612  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:49.015304  7891 raft_consensus.cc:2368] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4.
I20260709 13:13:48.808475  9191 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:48.904325  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1126) took 1215 ms. Trace:
I20260709 13:13:48.895533  7332 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:48.902868  9197 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:48.910784  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:48.900353  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:48.899149  9080 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.033427  9217 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:49.033752  9080 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:49.034004  9217 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:48.896463  9230 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:49.035312  9230 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:49.035871  9170 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.035804  9230 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.036585  9204 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.038117  9230 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:48.896035  9214 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:49.039047  9214 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:49.039966  9214 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.040620  9129 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.040763  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:49.041976  9210 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:49.042551  9210 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:48.938803  7257 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.016s	sys 0.006s
W20260709 13:13:49.043310  7257 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.017s	sys 0.006s
I20260709 13:13:49.043011  9210 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:49.045064  9223 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:13:49.045266  9210 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:48.977336  9194 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:13:48.984853  9070 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.055169  9157 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:48.897336  7186 raft_consensus.cc:2410] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:48.906527  9165 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:48.904693  8721 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.847996  9222 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.177s
I20260709 13:13:49.016191  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:49.018201  7333 rpcz_store.cc:276] 0709 13:13:47.688846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.688961 (+   115us) service_pool.cc:224] Handling call
0709 13:13:48.904097 (+1215136us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54000e10d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:48.904258 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246310272}
I20260709 13:13:49.021051  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.017823  9046 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:49.031320  9191 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:49.032234  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 897754us
I20260709 13:13:49.032440  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:49.033231  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:49.078944  7228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.009s	sys 0.007s
W20260709 13:13:49.086051  7228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.009s	sys 0.007s
I20260709 13:13:48.938186  8705 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.084136  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:49.065407  7889 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:13:49.068169  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56808 (request call id 16) took 1260 ms. Trace:
I20260709 13:13:49.086937  7331 rpcz_store.cc:276] 0709 13:13:47.807834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.859175 (+ 51341us) service_pool.cc:224] Handling call
0709 13:13:49.067832 (+1208657us) spinlock_profiling.cc:243] Waited 86.3 ms on lock 0x7b540023e4a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b9520 00007fece9236652 00007fecee20460a 00007fece778a7d4 00007fece778a762 00007fece778a691 00007fece778a60c 00007fece77898c2 00007fece757748c 00007fece75768c6
0709 13:13:49.068079 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198430592}
I20260709 13:13:49.076395  7254 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
W20260709 13:13:49.086934  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 769568us
I20260709 13:13:49.090373  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:49.090709  7259 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:49.087347  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:49.075278  7335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.023s	sys 0.039s
I20260709 13:13:49.071605  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:49.092255  7335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.023s	sys 0.039s
I20260709 13:13:49.095815  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.075331  9076 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:49.099916  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:49.075457  9157 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:49.079712  7332 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:49.103013  7331 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:49.103266  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.103926  7332 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:49.045765  9210 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.080030  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:49.061352  9212 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.923s	user 0.000s	sys 0.010s
I20260709 13:13:49.064919  7258 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:49.077333  8871 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:49.122162  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:49.120585  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:49.127494  7183 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:49.120172  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:49.104112  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:49.105940  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:49.076690  7227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.020s	sys 0.018s
I20260709 13:13:49.111361  7182 raft_consensus.cc:2410] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:13:49.077529  7226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.006s	sys 0.023s
I20260709 13:13:49.114401  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.080211  9111 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.163009  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:49.201884  7226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.007s	sys 0.024s
I20260709 13:13:49.115613  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:49.116185  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.210129  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:49.115206  9075 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:49.211212  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:49.234529  9197 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:49.235016  9197 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.235075  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:49.235437  9197 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:49.235870  7256 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:49.234597  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.245563  7182 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:49.108132  9191 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:49.091017  9207 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.012s	sys 0.005s
W20260709 13:13:49.253384  7302 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.626s (SENT) [suppressed 12 similar messages]
I20260709 13:13:49.214856  9221 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:13:49.223299  7227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.020s	sys 0.019s
I20260709 13:13:49.223555  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:49.255179  9207 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.012s	sys 0.005s
I20260709 13:13:49.229105  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:49.229637  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:49.164054  7892 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:49.076076  9230 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:13:49.230997  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1197) took 1020 ms. Trace:
I20260709 13:13:49.288786  7332 rpcz_store.cc:276] 0709 13:13:48.210845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.115947 (+905102us) service_pool.cc:224] Handling call
0709 13:13:49.230936 (+114989us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:49.162721  9069 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:49.084895  8721 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:13:49.232503  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 116973us
I20260709 13:13:49.246018  7256 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:49.245605  7333 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:49.110453  9213 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
I20260709 13:13:49.245558  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:49.121248  9210 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.212958  7184 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:49.221287  7331 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:49.246914  9075 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.232916  9218 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:13:49.276700  7183 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:49.228292  7179 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:13:49.292353  9235 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:13:49.297176  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56109.3us
I20260709 13:13:49.297317  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.272541  9221 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:13:49.311858  7861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.007s	sys 0.019s
W20260709 13:13:49.259073  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 535121us
W20260709 13:13:49.287492  9198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.025s	sys 0.042s
I20260709 13:13:49.313720  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.274809  9245 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:49.293359  9069 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:49.318194  7861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.007s	sys 0.019s
W20260709 13:13:49.325917  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 837843us
I20260709 13:13:49.327472  7861 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:49.324311  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 181) took 1151 ms. Trace:
I20260709 13:13:49.332942  7257 rpcz_store.cc:276] 0709 13:13:48.172941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.174747 (+  1806us) service_pool.cc:224] Handling call
0709 13:13:48.175038 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:48.175249 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:49.043668 (+868419us) log.cc:844] Serialized 14 byte log entry
0709 13:13:49.323931 (+280263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:49.323979 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:49.324027 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.324092 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:49.324241 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48135,"prepare.queue_time_us":813086,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"thread_start_us":1082902,"threads_started":2}
I20260709 13:13:49.333904  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:49.334513  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:49.335158  7257 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:49.330781  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:49.331080  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.323594  7332 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:49.337767  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.312407  9207 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:49.341531  7182 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:49.340723  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:49.326182  9195 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.839s	user 0.007s	sys 0.002s
I20260709 13:13:49.341081  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:49.254848  9157 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.315456  8986 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:49.354321  7256 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:49.362563  9207 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:49.363746  9207 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.364848  9046 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.365273  9172 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:49.365703  9172 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:49.277010  9234 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:13:49.366523  9172 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.328872  8631 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:49.328998  9069 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:49.357411  7183 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:13:49.323714  9198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.232s	user 0.025s	sys 0.042s
I20260709 13:13:49.317162  9003 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:49.359606  7332 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:13:49.374135  7257 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
W20260709 13:13:49.384408  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 256317us
I20260709 13:13:49.339390  9230 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.323745  9204 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.483616  9204 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:49.485258  7336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1118) took 1850 ms (client timeout 1769 ms). Trace:
I20260709 13:13:49.485816  9204 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:49.382479  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:49.487437  9237 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:13:49.488015  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 235) took 1293 ms. Trace:
I20260709 13:13:49.488417  7186 rpcz_store.cc:276] 0709 13:13:48.194536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.195525 (+   989us) service_pool.cc:224] Handling call
0709 13:13:49.487825 (+1292300us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54002b43d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:49.487953 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575015296}
I20260709 13:13:49.489678  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:49.490290  7186 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
W20260709 13:13:49.485682  7336 rpcz_store.cc:269] 0709 13:13:47.635029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.635215 (+   186us) service_pool.cc:224] Handling call
0709 13:13:49.485074 (+1849859us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400278654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:49.485187 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128656768}
I20260709 13:13:49.318112  9241 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.134s
I20260709 13:13:49.341218  8879 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:49.362717  9245 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:13:49.447600  9247 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:13:49.414984  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:49.479959  9159 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.336s	user 0.015s	sys 0.015s
I20260709 13:13:49.450408  9197 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:49.445387  7327 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.471s	user 0.004s	sys 0.008s
I20260709 13:13:49.441390  7331 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:13:49.440243  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1198) took 1225 ms. Trace:
I20260709 13:13:49.438951  7861 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:49.439558  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:49.450911  8631 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:49.479959  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 226604us
I20260709 13:13:49.329442  9229 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:13:49.482491  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 505) took 1287 ms. Trace:
I20260709 13:13:49.367544  9195 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.337697  9231 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
W20260709 13:13:49.495064  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 161254us
I20260709 13:13:49.463869  9210 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:49.498734  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:49.464468  8705 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.506210  7183 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:49.343492  9225 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:49.386839  9205 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.383095  8986 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:49.514559  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 192255us
I20260709 13:13:49.476810  9221 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.584746  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:49.593267  7184 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:49.507206  9242 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:49.623030  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:49.623884  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 185111us
I20260709 13:13:49.621356  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:49.624679  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:49.625748  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:49.612197  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 191795us
I20260709 13:13:49.627516  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:49.628216  7257 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
W20260709 13:13:49.631060  9080 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 13:13:49.631515  9080 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.631860  9240 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.632404  9240 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.633082  9119 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:49.634218  7256 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:13:49.621042  9245 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.632933  9069 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:49.610436  8763 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.769s	user 0.007s	sys 0.008s
I20260709 13:13:49.491155  9230 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.507666  9046 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:49.522796  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:49.627091  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:49.613904  7896 rpcz_store.cc:276] 0709 13:13:48.194598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.194890 (+   292us) service_pool.cc:224] Handling call
0709 13:13:48.195213 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.196752 (+  1539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.196796 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.204709 (+  7913us) log.cc:844] Serialized 26 byte log entry
0709 13:13:49.014369 (+809660us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:49.014430 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.014527 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:49.482169 (+467642us) raft_consensus.cc:1685] finished
0709 13:13:49.482201 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:49.482408 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1139,"raft.queue_time_us":1270,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":38254,"thread_start_us":732296,"threads_started":1,"wal-append.queue_time_us":838948}
W20260709 13:13:49.610705  9192 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.137s	user 0.011s	sys 0.000s
W20260709 13:13:49.588723  9236 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:13:49.662132  7183 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:49.659911  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2015) took 1344 ms. Trace:
I20260709 13:13:49.613658  7332 rpcz_store.cc:276] 0709 13:13:48.215425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.359037 (+1143612us) service_pool.cc:224] Handling call
0709 13:13:49.359391 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.400093 (+ 40702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.440171 (+ 40078us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:49.667883  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:49.660020  7150 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:49.625813  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:49.590615  9111 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:49.668071  7261 rpcz_store.cc:276] 0709 13:13:48.315454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.069293 (+753839us) service_pool.cc:224] Handling call
0709 13:13:49.069678 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.070081 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:49.070120 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:49.070677 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:13:49.515579 (+444902us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:49.515623 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.515693 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:49.659689 (+143996us) raft_consensus.cc:1685] finished
0709 13:13:49.659710 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:49.659845 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3982,"raft.queue_time_us":149054,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":25694,"thread_start_us":444483,"threads_started":1,"wal-append.queue_time_us":572219}
I20260709 13:13:49.593590  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:49.700282  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:49.701151  7253 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:49.634681  9251 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:13:49.497000  8721 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.620843  9105 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:49.650595  9080 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:49.661952  8705 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:49.507747  8879 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.652652  9230 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:49.647377  9250 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:49.626240  9262 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:49.683426  9241 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:49.670233  9192 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.636339  8986 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.640669  9242 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.648361  9069 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:49.649626  8763 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:49.686585  8631 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.649910  9075 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:49.664356  9119 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:49.689834  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1090) took 1380 ms. Trace:
I20260709 13:13:49.640530  9202 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:49.655548  9225 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:49.646962  9253 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:49.733228  9189 log.cc:927] Time spent T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 2.170s	user 0.010s	sys 0.012s
I20260709 13:13:49.621503  9205 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.648919  9157 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:49.693991  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2016) took 1378 ms. Trace:
I20260709 13:13:49.764333  7254 rpcz_store.cc:276] 0709 13:13:48.315721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.088240 (+772519us) service_pool.cc:224] Handling call
0709 13:13:49.088538 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.088868 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:49.088894 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:49.092048 (+  3154us) log.cc:844] Serialized 26 byte log entry
0709 13:13:49.387491 (+295443us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:49.387530 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.387620 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:49.693784 (+306164us) raft_consensus.cc:1685] finished
0709 13:13:49.693803 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:49.693930 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33290,"raft.queue_time_us":141827,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":17449,"thread_start_us":175008,"threads_started":1,"wal-append.queue_time_us":573663}
I20260709 13:13:49.732141  9192 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:49.698971  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:49.517310  9159 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.370s	user 0.015s	sys 0.021s
I20260709 13:13:49.521977  7327 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
W20260709 13:13:49.639429  9226 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.148s	user 0.007s	sys 0.004s
I20260709 13:13:49.634593  9240 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.703832  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:49.709604  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83861.8us
I20260709 13:13:49.838675  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:49.710520  7152 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:49.714926  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:49.674568  9221 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:49.717401  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.680572  7328 raft_consensus.cc:2368] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6.
I20260709 13:13:49.715276  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:49.839550  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 129107us
I20260709 13:13:49.839968  7260 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:49.669425  9210 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:49.708827  8796 consensus_meta.cc:287] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.394s	user 0.006s	sys 0.006s
W20260709 13:13:49.721308  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 220758us
I20260709 13:13:49.747756  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1131) took 1909 ms. Trace:
I20260709 13:13:49.731469  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 236) took 1308 ms. Trace:
I20260709 13:13:49.750608  7262 rpcz_store.cc:276] 0709 13:13:48.309104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.065506 (+756402us) service_pool.cc:224] Handling call
0709 13:13:49.065836 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.066153 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:49.066184 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:49.072925 (+  6741us) log.cc:844] Serialized 26 byte log entry
0709 13:13:49.319395 (+246470us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:49.351619 (+ 32224us) log.cc:844] Serialized 14 byte log entry
0709 13:13:49.489254 (+137635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.489323 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:49.689608 (+200285us) raft_consensus.cc:1685] finished
0709 13:13:49.689627 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:49.689754 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86274,"prepare.queue_time_us":38887,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":340628,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":17325,"thread_start_us":228714,"threads_started":2,"wal-append.queue_time_us":598309}
I20260709 13:13:49.702929  9111 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:49.718704  9234 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:49.757640  7181 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:13:49.714311  7887 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:49.693353  9123 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.720732  8705 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:49.727818  8721 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.761936  7185 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:49.761921  7253 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:49.762598  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:49.723171  9105 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:49.727311  9241 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:49.696246  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69087.9us
I20260709 13:13:49.776356  9242 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.866377  7335 rpcz_store.cc:276] 0709 13:13:47.838770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.022165 (+183395us) service_pool.cc:224] Handling call
0709 13:13:48.022810 (+   645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.023335 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:48.023390 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.050878 (+ 27488us) log.cc:844] Serialized 26 byte log entry
0709 13:13:49.097673 (+1046795us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:49.097757 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.109576 (+ 11819us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:49.747426 (+637850us) raft_consensus.cc:1685] finished
0709 13:13:49.747458 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:49.747666 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1007530,"threads_started":1,"wal-append.queue_time_us":1189344}
I20260709 13:13:49.759763  9253 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:49.778460  9163 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.772236  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1188) took 1969 ms. Trace:
I20260709 13:13:49.931340  7329 rpcz_store.cc:276] 0709 13:13:47.803260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.809619 (+  6359us) service_pool.cc:224] Handling call
0709 13:13:47.837183 (+ 27564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.721657 (+884474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.771921 (+1050264us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b5400253354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:49.772164 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341404032}
W20260709 13:13:49.777845  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.754492  9202 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:49.757947  9230 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:49.830930  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 171039us
I20260709 13:13:49.778149  9225 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.835160  8512 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.842027  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.841531  7255 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:49.957355  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:49.958076  7255 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:49.846387  9240 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:49.954262  9195 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:49.963863  9240 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:49.964372  9240 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:49.964648  9105 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.966357  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:49.967329  8879 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:49.967680  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:49.924340  9241 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:49.968307  7888 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:49.847905  9265 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:49.848425  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 133557us
I20260709 13:13:49.849022  9267 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:49.836284  9150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.700s	user 0.007s	sys 0.010s
I20260709 13:13:49.974851  9267 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:49.975073  9150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.839s	user 0.007s	sys 0.011s
I20260709 13:13:49.975364  9267 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:49.977116  9210 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:49.978065  9210 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.978530  9210 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.981009  9245 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:49.981771  9245 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.949700  8721 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.982841  8879 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:49.983762  9258 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:49.984176  9258 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:49.984283  8721 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.985090  9258 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.831782  9197 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.866658  7187 rpcz_store.cc:276] 0709 13:13:48.422976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.423134 (+   158us) service_pool.cc:224] Handling call
0709 13:13:48.429419 (+  6285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:48.496596 (+ 67177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.496628 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:48.496671 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:48.496720 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.731115 (+1234395us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b540017e154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:49.731196 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:49.731380 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154035456}
I20260709 13:13:49.987833  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:49.988453  7187 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:49.989322  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:49.887559  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:49.918638  9192 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:49.990280  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 102813us
I20260709 13:13:49.990236  9192 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.886476  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:49.850260  7327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1191) took 2036 ms (client timeout 2203 ms). Trace:
W20260709 13:13:49.992015  7327 rpcz_store.cc:269] 0709 13:13:47.805545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.856737 (+ 51192us) service_pool.cc:224] Handling call
0709 13:13:49.842262 (+1985525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:49.992924  9171 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.884167  9111 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.993135  9265 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.994539  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:49.995044  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1199) took 1742 ms. Trace:
I20260709 13:13:49.995193  9111 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:49.995410  7333 rpcz_store.cc:276] 0709 13:13:48.252484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.359138 (+1106654us) service_pool.cc:224] Handling call
0709 13:13:49.359423 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.383424 (+ 24001us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:13:49.383460 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:49.399381 (+ 15921us) log.cc:844] Serialized 26 byte log entry
0709 13:13:49.630663 (+231282us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b48001bc258. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:13:49.759809 (+129146us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:49.759848 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.759912 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:49.994742 (+234830us) raft_consensus.cc:1685] finished
0709 13:13:49.994761 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:49.994971 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87874,"raft.queue_time_us":15324,"raft.run_cpu_time_us":2080,"raft.run_wall_time_us":244244,"spinlock_wait_cycles":95275008,"thread_start_us":270191,"threads_started":1,"wal-append.queue_time_us":396171}
I20260709 13:13:49.997364  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.851797  9226 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.930883  9253 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:49.998683  7256 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:49.911787  7261 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:49.915060  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:49.946846  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.992952  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:49.999464  7253 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:49.948074  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.949303  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:49.841403  9069 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:49.835980  9159 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:50.009915  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1183) took 2217 ms. Trace:
I20260709 13:13:49.953262  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:49.957986  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.012456  7253 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:13:49.846894  9270 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:49.960433  7150 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:49.960706  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:50.015291  7262 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:49.911909  9234 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.961591  9242 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:49.961796  9276 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:49.960214  9230 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:49.914458  8705 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.016637  9080 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:50.027436  9080 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.018610  9229 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.029762  9229 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.841727  8763 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:13:50.032266  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83067.6us
I20260709 13:13:50.033418  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:49.849738  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.982758  9221 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:50.003785  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.898849  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:49.927121  9211 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.849s	user 0.002s	sys 0.025s
I20260709 13:13:49.942569  7181 pending_rounds.cc:85] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 5
I20260709 13:13:50.044502  7181 pending_rounds.cc:107] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:13:50.044785  7181 raft_consensus.cc:2889] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:49.997952  7333 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:50.004511  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:50.010350  7334 rpcz_store.cc:276] 0709 13:13:47.786101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.786252 (+   151us) service_pool.cc:224] Handling call
0709 13:13:47.786525 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.055127 (+268602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.055165 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.063069 (+  7904us) log.cc:844] Serialized 26 byte log entry
0709 13:13:48.178862 (+115793us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:48.178910 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.971578 (+1792668us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b540013cc54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:49.971625 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:49.971668 (+    43us) raft_consensus.cc:1685] finished
0709 13:13:49.971681 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.003462 (+ 31781us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104072,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":13847,"spinlock_wait_cycles":110896000,"thread_start_us":305953,"threads_started":2,"wal-append.queue_time_us":139564}
I20260709 13:13:50.011467  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:49.865828  8796 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.019451  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:50.020568  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 60216.4us
I20260709 13:13:50.047456  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:50.022143  9242 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.030591  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:50.024267  7183 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:49.992837  9199 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:50.022972  9150 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:49.993263  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:49.999785  9258 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:49.983490  8879 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.040869  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.041844  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:50.046355  9119 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.076274  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:50.009519  9069 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.048064  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.025451  9234 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:50.049775  9210 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:50.049993  7334 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:50.097954  8796 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.099146  9218 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:50.100370  9272 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:13:50.102084  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.045468  9221 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.102885  7186 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 2: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:50.103850  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.104662  7186 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:50.055135  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.105741  9226 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.090448  9119 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:50.031255  9197 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:50.022786  9276 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:49.956734  7185 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:50.050333  9102 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:50.061030  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:50.062675  7255 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:50.066073  9075 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:50.044088  9076 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:50.038981  9195 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:50.095537  9046 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:50.044243  9163 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.090888  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:50.052317  9111 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.091866  7182 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:50.092656  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.104557  9221 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:50.053993  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 49573.8us
I20260709 13:13:50.056878  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:13:50.247071  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 190258us
I20260709 13:13:50.248319  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:50.024137  9270 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:50.113355  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52443us
I20260709 13:13:50.251929  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:50.252434  7328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1133) took 2182 ms (client timeout 1890 ms). Trace:
I20260709 13:13:50.252743  7182 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:50.253203  7179 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:50.067412  9150 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.032083  8763 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.093756  9069 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.120880  9102 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:50.191386  9217 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:50.222011  7262 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:50.091163  9192 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:50.191756  9076 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:50.237545  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.265836  7186 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:50.267230  7186 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:50.238576  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 147766us
I20260709 13:13:50.251623  7150 leader_election.cc:400] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4.
I20260709 13:13:50.269125  7150 leader_election.cc:403] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:50.270961  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:50.272344  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:50.253067  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:50.169564  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.110854  9265 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:50.252846  7328 rpcz_store.cc:269] 0709 13:13:48.070393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.178891 (+108498us) service_pool.cc:224] Handling call
0709 13:13:50.252244 (+2073353us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540031b5d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:50.252367 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3377612032}
I20260709 13:13:50.258795  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.112534  9205 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.276216  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:50.199822  9245 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:50.281684  7179 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:50.233892  9075 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:50.258914  8721 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:50.257488  9195 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:50.291880  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:50.258416  8631 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:50.107358  9159 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.283522  8796 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4.
I20260709 13:13:50.267239  9102 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:50.291287  9197 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:50.278808  9076 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:50.267306  9217 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:50.290932  9231 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.094760  9199 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.258184  9111 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.251458  9163 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.236213  8705 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.325737  9224 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:50.332612  9224 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:50.332840  7187 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:50.327251  9153 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.333902  9224 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.336807  8705 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:50.328083  9273 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:13:50.325824  9230 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:50.359546  9227 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:50.360114  9111 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.361199  8879 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:50.361665  9276 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.322992  9217 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:50.354386  9163 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.329985  8796 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:50.328688  9231 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.377341  9150 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:50.381774  9240 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.370141  8796 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:50.383038  8796 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:50.384115  9240 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.318384  9075 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.392292  7888 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:50.395437  7260 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:50.403584  9239 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:50.405148  9270 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:50.405984  9172 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.393196  9241 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.393214  9242 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.345144  9267 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.372536  9229 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:50.411069  9168 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:50.420496  8763 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:50.422240  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:50.428864  7182 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:13:50.426961  9168 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:50.416919  9199 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.430958  9076 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.431350  9168 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.435117  9165 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:50.435747  9165 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:50.445096  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.453047  9241 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.454255  9170 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:50.454880  9170 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.463136  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:50.464046  7257 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:13:50.475679  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:50.476410  7257 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:50.479255  9165 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.480643  9076 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:50.493551  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:50.517887  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:50.462237  9253 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.544272  9191 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:50.551064  9267 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:50.552270  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.553090  7335 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:50.553352  9150 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:50.553956  9150 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:50.555078  7260 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:50.554881  9150 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.482978  9069 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:50.490535  9119 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.482161  9234 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.551164  9191 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:50.586651  7184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.014s	sys 0.061s
W20260709 13:13:50.587200  7184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.014s	sys 0.061s
I20260709 13:13:50.574309  9267 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:13:50.589524  7178 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.018s	sys 0.042s
W20260709 13:13:50.589987  7178 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.019s	sys 0.042s
I20260709 13:13:50.584414  7257 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:13:50.591132  7261 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:50.558975  9217 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:50.591980  7332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.022s	sys 0.024s
I20260709 13:13:50.595826  9253 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:50.601537  9194 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.586781  8796 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.603082  9170 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:50.619122  7332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.022s	sys 0.025s
W20260709 13:13:50.621217  7151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.015s	sys 0.025s
I20260709 13:13:50.594494  9069 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:50.630688  7151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.015s	sys 0.025s
I20260709 13:13:50.594512  9234 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.627784  9194 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.591216  9267 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:50.638512  7258 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.022s	sys 0.041s
W20260709 13:13:50.643448  7258 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.023s	sys 0.041s
I20260709 13:13:50.644495  7183 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:50.651902  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.652808  7187 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
W20260709 13:13:50.642037  9130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.508s	user 0.024s	sys 0.038s
I20260709 13:13:50.662135  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:50.664467  7891 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.002s	sys 0.025s
W20260709 13:13:50.664830  7891 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.003s	sys 0.025s
W20260709 13:13:50.645114  9225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.025s	sys 0.025s
I20260709 13:13:50.645712  9205 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:50.663070  9130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.532s	user 0.024s	sys 0.038s
I20260709 13:13:50.690716  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:50.669178  9225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.025s	sys 0.025s
W20260709 13:13:50.664129  9214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.444s	user 0.009s	sys 0.019s
W20260709 13:13:50.699934  7225 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.014s	sys 0.037s
W20260709 13:13:50.706966  7225 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.015s	sys 0.037s
W20260709 13:13:50.707315  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 732724us
I20260709 13:13:50.682883  9194 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.708894  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:50.702898  7893 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:50.709952  9102 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.711666  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 346) took 1213 ms. Trace:
I20260709 13:13:50.712893  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:50.712054  7893 rpcz_store.cc:276] 0709 13:13:49.498220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.498378 (+   158us) service_pool.cc:224] Handling call
0709 13:13:50.711463 (+1213085us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540068e7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:50.711609 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485445376}
I20260709 13:13:50.714318  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.715339  7187 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:50.716398  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:50.717213  7187 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:50.718760  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:50.719944  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:50.718232  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.646492  9191 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.696262  9165 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.723539  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.723281  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:50.732196  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:50.737357  7183 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:13:50.738731  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.739831  7183 raft_consensus.cc:2410] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:50.742343  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:50.707485  9214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.495s	user 0.010s	sys 0.020s
I20260709 13:13:50.689668  9205 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.743993  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:50.749341  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:50.730641  9270 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:50.729739  9234 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:50.682952  9266 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:13:50.730281  9239 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:50.766709  9285 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:13:50.763746  9234 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:50.767501  9234 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:50.773577  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 343) took 2352 ms. Trace:
I20260709 13:13:50.774024  7892 rpcz_store.cc:276] 0709 13:13:48.420935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.424596 (+  3661us) service_pool.cc:224] Handling call
0709 13:13:49.092823 (+668227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:49.293633 (+200810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.773362 (+1479729us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400690850. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:50.773502 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367643520}
I20260709 13:13:50.746537  9165 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.776526  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.777168  9165 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.778070  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1842) took 1151 ms. Trace:
I20260709 13:13:50.779388  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1175) took 3089 ms. Trace:
I20260709 13:13:50.779909  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1139) took 1063 ms. Trace:
I20260709 13:13:50.779793  7330 rpcz_store.cc:276] 0709 13:13:47.690195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.736488 (+ 46293us) service_pool.cc:224] Handling call
0709 13:13:48.904711 (+1168223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:48.944511 (+ 39800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.779202 (+1834691us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000e10d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:50.779331 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2674626816}
I20260709 13:13:50.781060  8796 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.741724  9258 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.780479  7332 rpcz_store.cc:276] 0709 13:13:49.716661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.716829 (+   168us) service_pool.cc:224] Handling call
0709 13:13:49.717252 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.722579 (+  5327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:49.722611 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:49.754652 (+ 32041us) log.cc:844] Serialized 26 byte log entry
0709 13:13:50.628431 (+873779us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:50.628469 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.628537 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:50.779682 (+151145us) raft_consensus.cc:1685] finished
0709 13:13:50.779703 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.779849 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4733,"raft.queue_time_us":32019,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":5875,"spinlock_wait_cycles":1501440,"thread_start_us":786211,"threads_started":1,"wal-append.queue_time_us":980431}
I20260709 13:13:50.782176  9258 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.778602  7184 rpcz_store.cc:276] 0709 13:13:49.626377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.831239 (+204862us) service_pool.cc:224] Handling call
0709 13:13:49.841368 (+ 10129us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:49.841701 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:49.841731 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:49.842196 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:13:50.587860 (+745664us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:50.587917 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.588022 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:50.777863 (+189841us) raft_consensus.cc:1685] finished
0709 13:13:50.777883 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.778009 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10536,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":18361,"thread_start_us":737418,"threads_started":1,"wal-append.queue_time_us":920967}
I20260709 13:13:50.784303  9258 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.761268  9230 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.785729  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:50.786969  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:50.787786  9076 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.788249  9076 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.790231  9076 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:50.790423  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.791278  7328 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:50.791844  9076 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:50.792534  9076 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:50.793002  9076 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:50.759557  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:50.795449  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:50.735749  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 452289us
I20260709 13:13:50.758889  9111 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:50.750260  9240 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:50.747817  9163 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:50.795701  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:50.805269  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.806098  7328 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 2.
I20260709 13:13:50.766062  9102 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:50.798363  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:50.765682  9282 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:13:50.803786  9258 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:50.804015  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:50.814641  7261 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:50.804283  9111 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:50.807898  7330 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:13:50.735287  9077 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.010s	sys 0.021s
I20260709 13:13:50.807597  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:50.780367  9267 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.809823  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.817402  7184 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:50.808728  9217 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:50.804878  9266 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:50.814349  9165 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:50.820341  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:50.808531  9240 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.814152  9258 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:50.829137  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:50.830520  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:50.818287  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.856205  7328 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.856633  7183 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:13:50.846200  7180 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.007s	sys 0.034s
I20260709 13:13:50.823266  7336 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:50.793898  9076 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.824937  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.825762  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:50.820930  9195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.016s	sys 0.007s
W20260709 13:13:50.828635  7150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.009s	sys 0.025s
W20260709 13:13:50.859211  7150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.009s	sys 0.026s
W20260709 13:13:50.859990  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 568145us
W20260709 13:13:50.860181  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63336.8us
I20260709 13:13:50.862262  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:50.862993  7184 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:50.813647  9005 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:13:50.851706  9198 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:50.853065  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.849036  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:50.874130  7261 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:13:50.818933  9111 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:50.816380  9102 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:50.821086  9077 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.010s	sys 0.021s
I20260709 13:13:50.864743  7150 leader_election.cc:400] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6.
I20260709 13:13:50.888501  7150 leader_election.cc:403] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:50.856205  9240 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:50.865278  7180 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.008s	sys 0.034s
I20260709 13:13:50.858839  9258 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:50.897385  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:50.845445  9266 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.821476  9292 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:50.852979  9165 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.909129  7328 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:50.881726  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.886044  9267 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:50.918947  9267 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.880241  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:50.864575  9195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.017s	sys 0.007s
I20260709 13:13:50.873168  7335 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:13:50.873775  9198 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:50.821298  7299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.014s	sys 0.022s
W20260709 13:13:50.951519  7299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.015s	sys 0.022s
W20260709 13:13:50.951902  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 683499us
I20260709 13:13:50.953663  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.899062  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:50.955602  7261 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:50.900236  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:50.959700  7894 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:13:50.960045  7894 pending_rounds.cc:85] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 4
I20260709 13:13:50.960246  7894 pending_rounds.cc:107] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:13:50.960456  7894 raft_consensus.cc:2889] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:50.960528  7333 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:50.875617  9217 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:13:50.901906  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:50.901997  9224 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.902608  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:50.913424  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.916112  9225 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:50.926146  9195 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:50.987109  9195 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.987649  9231 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:50.889798  9130 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:50.957619  7332 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:50.958228  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:50.958562  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.961623  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.873272  8879 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:13:50.901165  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:50.969995  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.910707  9266 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:50.973512  9005 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.974946  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:50.975495  7892 raft_consensus.cc:2376] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4. Re-sending same reply.
I20260709 13:13:50.958997  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:50.979082  9217 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:50.979936  9198 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:50.953577  9234 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:50.983767  7182 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:50.983860  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:50.921976  9165 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:50.891690  7184 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:50.951812  9230 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:50.992372  7333 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:13:50.984730  9225 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:50.896935  9102 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:51.006963  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1101) took 1308 ms. Trace:
I20260709 13:13:51.013856  7261 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:51.011957  7895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 386) took 2104 ms (client timeout 2223 ms). Trace:
I20260709 13:13:51.035677  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:51.053077  7336 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:51.053164  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:51.050661  7256 rpcz_store.cc:276] 0709 13:13:49.698092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.698674 (+   582us) service_pool.cc:224] Handling call
0709 13:13:51.006767 (+1308093us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400226fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:51.006896 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377657600}
W20260709 13:13:51.052343  7895 rpcz_store.cc:269] 0709 13:13:48.907131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.907350 (+   219us) service_pool.cc:224] Handling call
0709 13:13:51.011727 (+2104377us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54000bbb54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:51.011892 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4257757056}
I20260709 13:13:51.060942  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:51.019584  9093 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.014s	sys 0.051s
I20260709 13:13:50.991719  9224 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:51.083873  7261 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:13:51.086138  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:51.036158  9217 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:51.088984  7182 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:51.090139  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:51.091301  7256 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:51.093394  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:51.044718  9005 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:51.053900  9205 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:51.094830  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:51.100353  7256 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:51.101594  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:50.926885  9292 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:51.106364  7330 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:13:51.088727  9093 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.014s	sys 0.051s
W20260709 13:13:51.085434  9159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.006s	sys 0.050s
I20260709 13:13:51.090221  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:51.120230  7261 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:13:51.121752  7257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.022s	sys 0.032s
W20260709 13:13:51.122198  7257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.022s	sys 0.032s
W20260709 13:13:51.097975  9149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.951s	user 0.029s	sys 0.033s
W20260709 13:13:51.125020  7178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.003s	sys 0.022s
W20260709 13:13:51.141731  7178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.004s	sys 0.022s
I20260709 13:13:51.143790  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1356) took 1299 ms. Trace:
W20260709 13:13:51.119627  9159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.007s	sys 0.050s
W20260709 13:13:51.141711  9149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.997s	user 0.029s	sys 0.034s
I20260709 13:13:51.118039  9218 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:51.167196  7862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.028s
W20260709 13:13:51.163671  7260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.059s
W20260709 13:13:51.167817  7862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.000s	sys 0.028s
W20260709 13:13:51.167958  7260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.000s	sys 0.059s
W20260709 13:13:51.168305  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 525951us
I20260709 13:13:51.171979  7184 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:51.138751  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:51.145846  8986 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:51.146039  8721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.016s	sys 0.015s
I20260709 13:13:51.144531  7178 rpcz_store.cc:276] 0709 13:13:49.843994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.846730 (+  2736us) service_pool.cc:224] Handling call
0709 13:13:49.847116 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:49.847364 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:50.590486 (+743122us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.142870 (+552384us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.143056 (+   186us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:51.143188 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.143376 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.143652 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14852,"prepare.queue_time_us":514750,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":215,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6579,"thread_start_us":1275029,"threads_started":2}
I20260709 13:13:51.117641  9225 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:51.179208  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:51.193836  7261 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:13:51.195071  7262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.012s	sys 0.036s
W20260709 13:13:51.196384  7262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.012s	sys 0.036s
W20260709 13:13:51.202060  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:51.202845  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.137293  9217 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:51.174396  9210 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:51.191068  8721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.016s	sys 0.015s
I20260709 13:13:51.226961  9234 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:51.238346  9234 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:51.238885  9234 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.158334  9218 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:51.227087  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:51.228298  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:51.229892  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:51.230954  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:51.231281  9304 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:13:51.166563  9111 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:51.222002  9225 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:51.231535  9244 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:51.232314  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:51.196529  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:51.239360  9234 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:51.231658  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:51.248464  9217 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:51.244448  8721 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:51.249420  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:51.262354  7258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.020s	sys 0.013s
I20260709 13:13:51.190236  9297 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:13:51.264470  7253 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:51.295567  7258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.020s	sys 0.014s
I20260709 13:13:51.296705  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2024) took 1463 ms. Trace:
I20260709 13:13:51.297266  7258 rpcz_store.cc:276] 0709 13:13:49.832966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.851018 (+ 18052us) service_pool.cc:224] Handling call
0709 13:13:49.851394 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:49.851617 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:50.643948 (+792331us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.296206 (+652258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.296285 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:51.296353 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.296443 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.296628 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16669,"prepare.queue_time_us":73312,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"thread_start_us":1388852,"threads_started":2}
I20260709 13:13:51.328576  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:51.329814  7258 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 1.
W20260709 13:13:51.359469  7302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.003s	sys 0.010s
W20260709 13:13:51.359922  7302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.003s	sys 0.010s
I20260709 13:13:51.364351  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:51.365262  7183 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
W20260709 13:13:51.142011  9243 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.001s	sys 0.056s
I20260709 13:13:51.399019  9005 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:51.399791  9292 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:51.330996  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:51.411545  7258 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 2.
I20260709 13:13:51.412671  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:51.416401  7300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.037s	sys 0.079s
I20260709 13:13:51.405412  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:13:51.416962  7300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.037s	sys 0.079s
I20260709 13:13:51.358584  9248 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:51.349176  9265 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:51.367188  9224 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:51.422596  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:51.425292  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:51.427067  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:51.357470  9130 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6.
I20260709 13:13:51.429634  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:51.350041  9253 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:51.366402  9192 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.366182  9231 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.409148  9297 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:51.368572  8705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.004s	sys 0.008s
W20260709 13:13:51.402572  9243 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.001s	sys 0.058s
I20260709 13:13:51.382256  9102 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:51.485172  7259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.009s	sys 0.009s
I20260709 13:13:51.431180  9248 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:51.388341  9241 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:51.490180  7328 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.009s	sys 0.009s
I20260709 13:13:51.464627  7331 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
W20260709 13:13:51.490694  7328 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.009s	sys 0.009s
W20260709 13:13:51.409938  9191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.016s
W20260709 13:13:51.410842  9150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.007s	sys 0.006s
W20260709 13:13:51.442107  9270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.014s
I20260709 13:13:51.367067  7892 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:51.466954  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:51.403226  9300 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:51.463863  7336 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 2.
I20260709 13:13:51.386863  9199 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:13:51.474011  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:51.431357  9292 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:51.485637  7259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.009s	sys 0.009s
W20260709 13:13:51.468811  9307 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 13:13:51.442925  7891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.016s	sys 0.021s
I20260709 13:13:51.463992  7258 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:51.475520  9240 consensus_meta.cc:287] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.002s
W20260709 13:13:51.487634  7887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.014s
I20260709 13:13:51.471273  9224 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:51.476332  8705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.004s	sys 0.009s
W20260709 13:13:51.498891  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.509986  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:51.419662  9266 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:51.476861  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:51.494562  9191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.008s	sys 0.016s
I20260709 13:13:51.474593  9253 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:51.530123  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:51.529722  7891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.016s	sys 0.021s
I20260709 13:13:51.547748  7331 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:51.526885  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2032) took 1606 ms. Trace:
I20260709 13:13:51.478328  9192 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:51.478842  9297 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:51.485368  9231 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:51.512122  9241 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:51.484930  8721 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:51.586786  7262 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:13:51.585460  7185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1835) took 2470 ms (client timeout 2167 ms). Trace:
W20260709 13:13:51.601666  7185 rpcz_store.cc:269] 0709 13:13:49.107431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.229175 (+121744us) service_pool.cc:224] Handling call
0709 13:13:51.577750 (+2348575us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54000eddd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:51.577906 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076220288}
W20260709 13:13:51.527688  9077 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.015s	sys 0.005s
W20260709 13:13:51.578365  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 465090us
W20260709 13:13:51.546239  9305 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:13:51.526595  9123 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:51.607285  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 508) took 1668 ms. Trace:
W20260709 13:13:51.622458  7226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.013s	sys 0.026s
W20260709 13:13:51.623226  7226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.014s	sys 0.026s
W20260709 13:13:51.534341  9150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.007s	sys 0.007s
I20260709 13:13:51.609225  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:51.513283  9270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.001s	sys 0.014s
I20260709 13:13:51.611315  7258 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
W20260709 13:13:51.532742  9258 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.001s
I20260709 13:13:51.622366  7891 rpcz_store.cc:276] 0709 13:13:49.938530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.942810 (+  4280us) service_pool.cc:224] Handling call
0709 13:13:49.943195 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:49.943460 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:50.665259 (+721799us) log.cc:844] Serialized 14 byte log entry
0709 13:13:51.606824 (+941565us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.606907 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:51.606977 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.607061 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.607206 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":920782,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":1724,"thread_start_us":1659944,"threads_started":2}
I20260709 13:13:51.625970  7150 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:51.576725  7259 rpcz_store.cc:276] 0709 13:13:49.920139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.030899 (+110760us) service_pool.cc:224] Handling call
0709 13:13:50.035741 (+  4842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.035980 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:50.042942 (+  6962us) log.cc:844] Serialized 14 byte log entry
0709 13:13:50.691764 (+648822us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18003a3fc0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a 00007fece9246a2a
0709 13:13:51.526290 (+834526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:51.526365 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:51.526436 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.526620 (+   184us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.526807 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2274,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"spinlock_wait_cycles":3172608,"thread_start_us":834248,"threads_started":1}
W20260709 13:13:51.605142  9077 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.018s	sys 0.009s
I20260709 13:13:51.601399  9111 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:51.535928  7887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.003s	sys 0.015s
I20260709 13:13:51.626305  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:51.527796  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 474687us
I20260709 13:13:51.577251  9310 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.577265  7329 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:51.518862  9244 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:51.602802  9218 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:51.621691  9076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.007s	sys 0.037s
I20260709 13:13:51.621821  9171 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:51.632269  7185 pending_rounds.cc:85] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 5
W20260709 13:13:51.624383  7859 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.020s	sys 0.010s
I20260709 13:13:51.658149  7185 pending_rounds.cc:107] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 3.6
W20260709 13:13:51.658448  7859 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.020s	sys 0.010s
I20260709 13:13:51.658761  7185 raft_consensus.cc:2889] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:51.658883  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 730640us
I20260709 13:13:51.576542  9224 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:51.526036  9300 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:51.546808  9240 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:51.644711  7331 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:51.666821  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:51.632602  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:51.641659  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 239) took 2141 ms. Trace:
I20260709 13:13:51.639256  7334 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:51.533529  9292 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:51.668529  7181 rpcz_store.cc:276] 0709 13:13:49.500588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.687220 (+186632us) service_pool.cc:224] Handling call
0709 13:13:49.687598 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.045348 (+357750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.641323 (+1595975us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b5400248454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:51.641566 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150300416}
I20260709 13:13:51.645474  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:51.669751  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:51.654081  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.004s	sys 0.015s
W20260709 13:13:51.674014  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.004s	sys 0.015s
I20260709 13:13:51.675892  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:51.676610  7183 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:51.673359  7331 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:51.678431  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:51.679318  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 799066us
I20260709 13:13:51.680294  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:13:51.629956  9195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.003s	sys 0.016s
W20260709 13:13:51.670053  7301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.016s	sys 0.005s
W20260709 13:13:51.682017  7301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.016s	sys 0.005s
I20260709 13:13:51.553972  9248 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:51.681922  9195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.004s	sys 0.016s
I20260709 13:13:51.643262  9258 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:51.652228  9303 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:13:51.675606  9308 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:13:51.630079  9123 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:51.655051  9076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.007s	sys 0.037s
I20260709 13:13:51.997850  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2035) took 1657 ms. Trace:
I20260709 13:13:51.932598  7329 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:13:52.151687  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 2039) took 1368 ms. Trace:
I20260709 13:13:51.894186  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 192) took 1924 ms. Trace:
I20260709 13:13:52.155578  9119 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:52.156738  7333 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.007s
I20260709 13:13:52.157410  7333 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:52.155740  7255 rpcz_store.cc:276] 0709 13:13:49.970287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.287688 (+317401us) service_pool.cc:224] Handling call
0709 13:13:50.287955 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.294680 (+  6725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.294717 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:50.294757 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:50.294790 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.893834 (+1599044us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b5400124654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:51.893905 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.894101 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14934784}
I20260709 13:13:51.823226  8879 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.336s
I20260709 13:13:52.159164  7255 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:52.010560  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.642546  9298 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:52.155697  7262 rpcz_store.cc:276] 0709 13:13:50.783709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.197592 (+413883us) service_pool.cc:224] Handling call
0709 13:13:52.107887 (+910295us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54002f7454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:52.151601 (+ 43714us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779202304}
I20260709 13:13:51.692653  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:51.947149  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:51.730147  7183 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:52.186357  7895 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:13:52.168155  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.214129  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2037) took 1755 ms. Trace:
I20260709 13:13:52.214607  7255 rpcz_store.cc:276] 0709 13:13:50.459128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.158508 (+1699380us) service_pool.cc:224] Handling call
0709 13:13:52.158926 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.213838 (+ 54912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.214065 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:52.154544  7254 rpcz_store.cc:276] 0709 13:13:50.339982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.340907 (+   925us) service_pool.cc:224] Handling call
0709 13:13:50.341201 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.408293 (+ 67092us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:50.417348 (+  9055us) log.cc:844] Serialized 14 byte log entry
0709 13:13:50.417581 (+   233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:50.417647 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:50.417709 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.779971 (+362262us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b18003a3f60. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1
0709 13:13:50.781332 (+  1361us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b18003a3f60. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:13:51.997441 (+1216109us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b5400057b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:51.997514 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.997764 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8858,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1620,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4346,"spinlock_wait_cycles":159323520}
W20260709 13:13:52.017848  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 392555us
I20260709 13:13:51.933594  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:51.889101  7328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb0912958bd849238a8f104a7916c427"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:52.220080  7328 raft_consensus.cc:606] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:52.207685  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:51.932322  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2030) took 2066 ms. Trace:
W20260709 13:13:51.990705  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.221261  7253 rpcz_store.cc:276] 0709 13:13:49.865842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.019219 (+153377us) service_pool.cc:224] Handling call
0709 13:13:51.007561 (+988342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.295581 (+288020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.931145 (+635564us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400226fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:51.932051 (+   906us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400226fd0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:51.932229 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2862603392}
I20260709 13:13:52.220572  7328 raft_consensus.cc:614] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:51.784865  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:51.960866  9202 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:51.915725  9324 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:13:51.941732  9217 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.676s	user 0.004s	sys 0.004s
W20260709 13:13:51.937456  9165 consensus_meta.cc:287] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.874s	user 0.009s	sys 0.000s
I20260709 13:13:52.230784  7334 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:13:51.934516  9317 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.311s	user 0.001s	sys 0.001s
I20260709 13:13:52.231441  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:52.240065  7255 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:13:52.231755  7331 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:13:51.788691  9316 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:13:52.240716  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1111) took 1520 ms. Trace:
I20260709 13:13:52.232303  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1113) took 1511 ms. Trace:
I20260709 13:13:51.683329  9318 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:51.859903  9329 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:51.937806  9225 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.000s
I20260709 13:13:52.106297  9210 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:51.904196  9267 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:51.782961  9313 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.177s	user 0.003s	sys 0.000s
W20260709 13:13:51.939622  9234 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.677s	user 0.006s	sys 0.005s
W20260709 13:13:51.786966  9314 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:13:52.002735  9103 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:13:51.848749  9309 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
W20260709 13:13:52.231890  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 284861us
I20260709 13:13:52.215515  9243 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:51.942652  9224 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:51.852521  9315 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:13:52.242503  7262 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:51.701785  9248 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:51.942361  9241 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:52.243335  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.017s	sys 0.007s
I20260709 13:13:51.702975  9111 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:51.693418  9080 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:52.242959  7261 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:51.709460  9328 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.165863  9168 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:51.942916  9192 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:52.208613  9298 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:51.904870  9322 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:13:52.064347  9302 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:52.246076  7334 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:51.744292  9077 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:51.740437  9093 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:51.827042  9266 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.242671  7254 rpcz_store.cc:276] 0709 13:13:50.720736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.231288 (+1510552us) service_pool.cc:224] Handling call
0709 13:13:52.231663 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.231916 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.231945 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:52.231988 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:52.232015 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.232068 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.232227 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:52.293140  7254 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:51.915041  9171 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:52.241246  7255 rpcz_store.cc:276] 0709 13:13:50.720248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.238686 (+1518438us) service_pool.cc:224] Handling call
0709 13:13:52.239738 (+  1052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.240465 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.240661 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:52.230244  9202 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:52.268268  7228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.000s	sys 0.027s
I20260709 13:13:52.268491  7894 raft_consensus.cc:2410] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:13:52.269328  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:52.295655  7228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.000s	sys 0.027s
W20260709 13:13:51.786406  9320 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:13:51.656803  9310 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:52.247872  8909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.009s	sys 0.024s
I20260709 13:13:51.941283  9240 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:52.273914  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 581294us
W20260709 13:13:52.275023  7862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.027s	sys 0.026s
W20260709 13:13:52.304029  7862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.027s	sys 0.026s
W20260709 13:13:52.304800  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.275341  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:52.306442  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:52.306928  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.307551  7150 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:52.308655  7150 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:51.943192  9231 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:52.275995  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 199) took 1861 ms. Trace:
I20260709 13:13:52.315207  7257 rpcz_store.cc:276] 0709 13:13:50.414960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.592890 (+177930us) service_pool.cc:224] Handling call
0709 13:13:50.593322 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.593606 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.593643 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:50.594197 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.137297 (+543100us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:51.137360 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.137460 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.275768 (+1138308us) raft_consensus.cc:1685] finished
0709 13:13:52.275790 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.275934 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":542644,"threads_started":1,"wal-append.queue_time_us":670293}
I20260709 13:13:52.244730  9318 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:52.215143  9157 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:52.266443  9329 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:52.239043  8796 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:52.268225  9210 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:52.327105  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 79483.5us
I20260709 13:13:52.278687  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1106) took 1559 ms. Trace:
I20260709 13:13:52.276098  9234 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.329181  7262 rpcz_store.cc:276] 0709 13:13:50.718949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.232866 (+1513917us) service_pool.cc:224] Handling call
0709 13:13:52.242320 (+  9454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.278410 (+ 36090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.278596 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:52.313321  9205 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:52.279981  7859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.008s	sys 0.019s
W20260709 13:13:52.281339  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.017s	sys 0.007s
I20260709 13:13:52.313239  9310 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.275244  9292 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.273502  9103 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:52.276928  9069 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:52.293833  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2042) took 1509 ms. Trace:
I20260709 13:13:52.392902  7254 rpcz_store.cc:276] 0709 13:13:50.784517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.292600 (+1508083us) service_pool.cc:224] Handling call
0709 13:13:52.292921 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.293585 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.293780 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:52.285321  9218 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:52.282969  9253 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.296677  9171 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:52.246055  9165 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.291392  9149 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:52.318782  7259 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.029s	sys 0.048s
I20260709 13:13:52.320921  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 197) took 1909 ms. Trace:
W20260709 13:13:52.300051  8909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.012s	sys 0.024s
I20260709 13:13:52.291179  9298 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:52.327549  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.394857  9218 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.233951  9119 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:52.406562  9119 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.408915  9119 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.272069  9297 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:52.319537  9214 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.409848  9214 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.404408  9149 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.412091  9214 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.333484  9205 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.412422  9149 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.412782  9205 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:52.413359  9210 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:52.333580  7859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.009s	sys 0.019s
W20260709 13:13:52.414862  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 738804us
I20260709 13:13:52.415632  9234 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.401502  9258 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:52.416309  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:52.334044  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 653811us
I20260709 13:13:52.417889  9248 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:52.339032  7262 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:52.419369  9248 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.419864  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 205) took 1632 ms. Trace:
I20260709 13:13:52.420277  9123 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.420258  7262 rpcz_store.cc:276] 0709 13:13:50.787268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.330173 (+1542905us) service_pool.cc:224] Handling call
0709 13:13:52.338795 (+  8622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.419600 (+ 80805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.419803 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:52.339897  7336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:52.421443  7336 raft_consensus.cc:606] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:52.421819  7336 raft_consensus.cc:614] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:52.346423  9340 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:52.346727  9266 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.423750  9266 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.333209  9337 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.332638  9321 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.332983  9346 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:52.327087  9240 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:52.299831  9111 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:52.433327  9111 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.433993  9171 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.434578  9266 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.435218  9349 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:52.436100  9171 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.325649  9157 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.313146  8986 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:52.356743  7186 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:52.357143  9339 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:52.357456  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 242) took 2484 ms. Trace:
I20260709 13:13:52.359273  9318 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.386286  7258 raft_consensus.cc:2410] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:52.320339  9241 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:52.321807  8879 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:52.288329  9243 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.329562  8796 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.436800  9346 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.454360  8796 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:52.297520  9093 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.456123  7891 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:52.295112  9077 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.326105  9329 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:52.400398  7259 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.030s	sys 0.048s
I20260709 13:13:52.400650  7260 rpcz_store.cc:276] 0709 13:13:50.411834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.555882 (+144048us) service_pool.cc:224] Handling call
0709 13:13:50.556228 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.556436 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.556466 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:50.574282 (+ 17816us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.168484 (+594202us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:51.168529 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.168646 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.320713 (+1152067us) raft_consensus.cc:1685] finished
0709 13:13:52.320731 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.320848 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":592620,"threads_started":1,"wal-append.queue_time_us":898734}
I20260709 13:13:52.331326  9231 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:13:52.313087  9080 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.392838  9069 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:52.298529  9302 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.297228  9328 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.422912  7893 raft_consensus.cc:2368] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6.
I20260709 13:13:52.419394  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:52.472505  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 53192.8us
I20260709 13:13:52.473278  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:52.417665  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:52.424515  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:13:52.474092  7302 leader_election.cc:336] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.626s (SENT)
W20260709 13:13:52.474324  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56732.1us
I20260709 13:13:52.392117  9310 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 13:13:52.431830  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 116064us
I20260709 13:13:52.475315  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:52.475899  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:52.476538  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:52.430923  9337 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.469803  9080 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.480670  9328 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:52.480892  9337 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.446336  7179 rpcz_store.cc:276] 0709 13:13:49.872605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.286711 (+414106us) service_pool.cc:224] Handling call
0709 13:13:50.287042 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.329654 (+ 42612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.329687 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:51.640117 (+1310430us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b2c0001afe8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:13:51.650691 (+ 10574us) log.cc:844] Serialized 26 byte log entry
0709 13:13:52.057120 (+406429us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:52.057175 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.357117 (+299942us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b54000ed3d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:52.357176 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.357226 (+    50us) raft_consensus.cc:1685] finished
0709 13:13:52.357239 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.357394 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8259,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":99276288,"thread_start_us":383533,"threads_started":1,"wal-append.queue_time_us":637278}
I20260709 13:13:52.475553  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:52.439039  9240 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.457002  9318 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:52.468701  8909 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:52.493364  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:52.468803  9266 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.451733  8879 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.451090  9241 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:52.476773  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:52.425483  9218 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:52.478250  9105 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:52.478758  9231 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:52.437037  9321 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.415647  9165 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:52.536865  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:52.538736  9216 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:52.539223  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:52.478962  9349 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:52.478708  9248 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:52.478878  9157 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.483632  9292 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:52.529855  9310 consensus_queue.cc:1243] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:52.531865  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:52.532339  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:52.567310  7889 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:52.533607  9077 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.534662  9346 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.535120  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:52.491693  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:52.569886  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:52.570139  9354 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:52.570297  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 78751.4us
I20260709 13:13:52.495543  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:52.572697  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 77232.8us
I20260709 13:13:52.504896  9241 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:52.574765  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:52.542060  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:52.576249  7334 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:13:52.543382  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:52.504761  9123 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.545594  7179 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:52.545974  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:52.546159  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.547009  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:52.595041  7185 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:52.547626  7181 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:52.548811  7178 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:52.548364  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.552415  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:52.495321  9119 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:52.599901  9119 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:52.601202  9119 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.499035  9258 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:52.604051  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 212333us
I20260709 13:13:52.553632  9204 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.499598  8879 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:52.528136  9149 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:52.539322  9216 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.566571  9292 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:52.530495  9214 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:13:52.568616  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:52.543407  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:52.577842  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:52.540313  9231 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:52.578410  7893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 394) took 1683 ms (client timeout 1932 ms). Trace:
I20260709 13:13:52.580359  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:52.582801  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:52.594326  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.501003  9266 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.553201  9262 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:52.544919  9093 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:52.496910  9328 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:52.572460  9354 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:52.501096  8909 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.565362  9333 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.130s
I20260709 13:13:52.555016  9069 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.627400  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:52.776733  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.728739  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:52.777495  7260 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:13:52.742851  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:52.725034  7261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1118) took 1983 ms (client timeout 2226 ms). Trace:
I20260709 13:13:52.626958  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:52.778404  7893 rpcz_store.cc:269] 0709 13:13:50.895419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.902366 (+  6947us) service_pool.cc:224] Handling call
0709 13:13:52.578236 (+1675870us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54004c4854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:52.578353 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3299273600}
W20260709 13:13:52.708743  7894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 354) took 1477 ms (client timeout 1676 ms). Trace:
I20260709 13:13:52.679240  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 202) took 2241 ms. Trace:
I20260709 13:13:52.780378  7259 rpcz_store.cc:276] 0709 13:13:50.438285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.655976 (+1217691us) service_pool.cc:224] Handling call
0709 13:13:51.658873 (+  2897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.659358 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:52.458583 (+799225us) log.cc:844] Serialized 14 byte log entry
0709 13:13:52.678822 (+220239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:52.678884 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:52.678941 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.679032 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.679178 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":677625,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":46608,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":17214,"thread_start_us":964648,"threads_started":2}
I20260709 13:13:52.781445  7185 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:52.565057  9195 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:52.778921  7261 rpcz_store.cc:269] 0709 13:13:50.741989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.194467 (+452478us) service_pool.cc:224] Handling call
0709 13:13:52.724742 (+1530275us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b54001a2f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:52.724945 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2280007040}
I20260709 13:13:52.577804  9046 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.748548  7182 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:13:52.578853  9210 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:52.782961  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:52.695178  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:52.780092  7894 rpcz_store.cc:269] 0709 13:13:51.231012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.232084 (+  1072us) service_pool.cc:224] Handling call
0709 13:13:52.708420 (+1476336us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540043a154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:52.708647 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2339220224}
I20260709 13:13:52.784734  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:52.592584  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:52.769136  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:52.579046  8808 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:52.776611  7328 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:52.791898  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.799659  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:52.594008  9346 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:52.806492  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.824993  7182 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:13:52.806821  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:52.819772  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:52.779235  7262 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:52.800544  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:52.809329  8909 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:52.645097  9258 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:52.811390  9363 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:13:52.800876  9262 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:52.815527  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:52.776012  7187 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:52.815686  7253 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:52.815757  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.735553  9120 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:52.594383  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:52.709962  9005 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:52.856680  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:52.825685  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:52.783645  9231 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:52.828728  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.826495  9077 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:52.831108  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:52.865517  7331 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 3: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:52.806038  9069 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:52.832284  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:52.870028  7260 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:13:52.807157  9296 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.567s	user 0.012s	sys 0.007s
I20260709 13:13:52.832568  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:52.852660  9075 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:52.658315  9298 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.837777  8879 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.839659  9329 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.824235  7889 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:52.847153  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.848184  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1840) took 3223 ms. Trace:
I20260709 13:13:52.888746  7180 rpcz_store.cc:276] 0709 13:13:49.624425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.687350 (+ 62925us) service_pool.cc:224] Handling call
0709 13:13:49.687704 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:49.764014 (+ 76310us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:49.836960 (+ 72946us) log.cc:844] Serialized 14 byte log entry
0709 13:13:50.890965 (+1054005us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:50.891036 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:50.891101 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.847941 (+1956840us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b5400271ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:52.847986 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.848121 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":564188,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":40,"raft.queue_time_us":24008,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":26828,"spinlock_wait_cycles":174958848,"thread_start_us":1126160,"threads_started":3,"wal-append.queue_time_us":768943,"wal-append.run_cpu_time_us":2252,"wal-append.run_wall_time_us":1214985}
I20260709 13:13:52.848860  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1209) took 2075 ms. Trace:
I20260709 13:13:52.890556  7335 rpcz_store.cc:276] 0709 13:13:50.773687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.775714 (+  2027us) service_pool.cc:224] Handling call
0709 13:13:50.776085 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:50.951077 (+174992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.848597 (+1897520us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b54001f4fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:52.848802 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222370688}
I20260709 13:13:52.850718  7152 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:52.804122  9046 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.819363  9357 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:52.607502  9123 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.628187  9205 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:52.855465  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.713526  9244 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.857429  7333 raft_consensus.cc:2376] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5. Re-sending same reply.
W20260709 13:13:52.856665  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 174329us
I20260709 13:13:52.830296  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:52.862706  7150 leader_election.cc:400] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6.
I20260709 13:13:52.801600  9204 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.843519  9346 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:52.917981  7262 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:52.919253  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:52.919894  7262 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:52.868074  7187 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:52.868345  7331 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:52.857079  9005 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:52.801144  9224 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.930922  9224 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.933175  9224 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:52.935011  9298 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.935739  9204 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.936724  7329 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:52.941491  9241 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.943533  8879 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.943220  9346 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.944587  9266 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.904031  9216 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:52.904006  9244 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:52.952278  9205 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:52.956780  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.958213  9123 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:52.958794  9123 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.959244  9123 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.961385  9149 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:52.962440  9149 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:52.962834  9149 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:52.963676  9149 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:52.964830  9149 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:52.966216  9216 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:52.967327  9216 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.967722  9192 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:52.968109  9192 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:52.968302  9216 raft_consensus.cc:3055] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:52.968645  9216 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:52.968909  9192 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.969420  9216 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.970135  9192 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:52.974047  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:52.827250  8808 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.886708  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.887566  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.868868  9119 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:52.849494  9258 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.819875  9350 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:13:52.878968  9296 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.636s	user 0.012s	sys 0.007s
I20260709 13:13:52.896567  7328 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:52.892813  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:52.841180  9262 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.904306  7150 leader_election.cc:403] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:13:52.998245  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 135697us
W20260709 13:13:53.001039  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.001089  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.897801  9253 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:52.923295  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:52.900110  9321 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:52.966220  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 204) took 2179 ms. Trace:
I20260709 13:13:52.871917  7336 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:52.976104  7181 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:52.869485  9292 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:52.926828  7327 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:13:52.981387  8808 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:52.988305  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:52.992605  7260 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:52.903820  7259 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
W20260709 13:13:52.984400  9339 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:13:52.970566  9216 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:53.004045  9130 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:53.003639  9205 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:53.046950  9205 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.049278  9205 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:53.050082  9356 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:53.050503  9356 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:53.051345  9356 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:53.052335  9356 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:52.989988  9119 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:53.103596  9119 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:53.107060  9258 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:53.109880  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.014717  7262 raft_consensus.cc:2410] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:13:53.111876  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.112998  7262 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:53.113389  9300 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:52.927731  9357 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:13:53.113920  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.114553  7262 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
W20260709 13:13:52.980438  8796 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
W20260709 13:13:53.115316  7327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1147) took 3159 ms (client timeout 1722 ms). Trace:
I20260709 13:13:53.115576  8796 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:53.115813  7327 rpcz_store.cc:269] 0709 13:13:49.955987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.993015 (+ 37028us) service_pool.cc:224] Handling call
0709 13:13:53.115140 (+3122125us) spinlock_profiling.cc:243] Waited 2.84 s on lock 0x7b5400191ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:53.115246 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6528117120}
I20260709 13:13:53.117146  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:53.117702  7327 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:53.117934  8796 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:53.022645  9350 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.105763  9005 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.119095  9350 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.119902  9198 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:53.119980  9005 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:53.111810  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.121382  7261 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:53.121469  9350 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:53.122329  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.123023  7261 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:53.124138  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.018301  9123 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:53.125638  7225 connection.cc:256] RPC call timeout handler was delayed by -1.4829485089999253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260709 13:13:53.126451  9139 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.127831  9270 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:53.128242  9139 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:53.128372  9270 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.133183  9046 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:53.007169  9253 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:53.037568  9231 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.135428  9253 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:53.136853  9231 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:53.027243  9329 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:53.004225  7257 rpcz_store.cc:276] 0709 13:13:50.786995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.316928 (+1529933us) service_pool.cc:224] Handling call
0709 13:13:52.334093 (+ 17165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.482358 (+148265us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:52.483011 (+   653us) log.cc:844] Serialized 14 byte log entry
0709 13:13:52.627290 (+144279us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b18003a3f00. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a 00007fece9246a2a
0709 13:13:52.869075 (+241785us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:52.869136 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:52.869173 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.966003 (+ 96830us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54002260d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:52.966048 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.966163 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1788,"prepare.queue_time_us":224,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":23661,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":6916,"spinlock_wait_cycles":344320768,"thread_start_us":230423,"threads_started":1,"wal-append.queue_time_us":376251}
I20260709 13:13:53.139146  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:53.139621  9218 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
I20260709 13:13:53.140021  9218 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.140300  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.141373  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.056063  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.144866  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.146246  7328 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:53.057390  7331 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:53.059595  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.060742  9130 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6.
I20260709 13:13:53.065433  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.067595  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.149837  7335 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:13:53.071913  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 206) took 2276 ms. Trace:
I20260709 13:13:53.154901  7258 rpcz_store.cc:276] 0709 13:13:50.795509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.632299 (+836790us) service_pool.cc:224] Handling call
0709 13:13:53.071650 (+1439351us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54002f7954. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:53.071843 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649412352}
I20260709 13:13:53.155746  9270 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:53.157294  7258 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:53.154824  7225 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:53.074290  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2043) took 2289 ms. Trace:
I20260709 13:13:53.160181  9123 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:53.160045  7255 rpcz_store.cc:276] 0709 13:13:50.784763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.295148 (+1510385us) service_pool.cc:224] Handling call
0709 13:13:53.072386 (+777238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.072747 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:53.072772 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:53.072812 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:53.072841 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.072901 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.074089 (+  1188us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54002f7950. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:53.074222 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":1786727168}
I20260709 13:13:53.160998  9123 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:53.161473  9123 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.161998  7255 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:53.076159  9368 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:13:53.078706  9080 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:53.082826  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:53.164245  9231 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:53.084304  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1165) took 1601 ms. Trace:
I20260709 13:13:53.165714  9243 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:53.088732  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 370820us
I20260709 13:13:53.168288  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2041) took 2384 ms. Trace:
I20260709 13:13:53.168635  7253 rpcz_store.cc:276] 0709 13:13:50.784268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.222890 (+1438622us) service_pool.cc:224] Handling call
0709 13:13:52.223204 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.842878 (+619674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.167972 (+325094us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54001a2a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:53.168225 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361943424}
W20260709 13:13:53.170441  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.091383  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:53.171759  7259 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:53.098491  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:53.125531  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:52.812008  8721 consensus_queue.cc:1175] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:53.172436  7261 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:53.096352  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.172966  7259 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:53.172492  7888 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:53.181034  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:53.206734  7328 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:53.130378  9139 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:53.206090  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:53.212669  7335 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:53.148518  7336 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:13:53.204155  7259 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:53.213603  7261 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:13:53.210608  7302 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:53.165068  7330 rpcz_store.cc:276] 0709 13:13:51.483176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.234214 (+751038us) service_pool.cc:224] Handling call
0709 13:13:52.234573 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.482998 (+248425us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:52.499952 (+ 16954us) log.cc:844] Serialized 14 byte log entry
0709 13:13:52.563780 (+ 63828us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:52.563861 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:52.563906 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.084001 (+520095us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54001d29d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:53.084062 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.084232 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19079,"prepare.queue_time_us":18262,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":19201,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":14730,"spinlock_wait_cycles":570733824,"thread_start_us":44306,"threads_started":1,"wal-append.queue_time_us":111473}
I20260709 13:13:53.220109  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.221303  7262 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:53.222677  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:53.224388  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 141674us
I20260709 13:13:53.224666  7328 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:53.244539  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:53.205590  9302 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:53.244439  9159 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.211261  9218 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:53.252105  9341 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:53.268507  9123 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:53.237920  9192 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:13:53.225733  9244 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:53.174510  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 47856.2us
I20260709 13:13:53.204516  7254 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:13:53.253477  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:53.255252  7335 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:13:53.441099  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:53.272684  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:53.444566  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 171871us
I20260709 13:13:53.451327  9149 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:53.452205  9149 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.452739  9149 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:53.453230  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.407835  7181 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:53.382133  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:53.362845  7255 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
W20260709 13:13:53.356814  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:53.375607  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:53.457124  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.406291  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:53.425119  7330 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:53.355957  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:53.375259  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 164607us
I20260709 13:13:53.494598  9375 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:53.347673  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 453149us
I20260709 13:13:53.425050  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:53.503484  7327 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:13:53.506909  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:53.507826  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 125972us
I20260709 13:13:53.508438  7181 raft_consensus.cc:2376] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3. Re-sending same reply.
W20260709 13:13:53.509286  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.509898  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:53.509995  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:53.362644  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:53.408141  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:53.450472  9119 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.505295  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:53.518260  9192 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:53.534593  9192 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:53.535401  7255 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:53.536535  9192 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:53.283540  9241 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:53.525919  9244 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:53.525643  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:53.538774  9192 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:53.535106  7254 raft_consensus.cc:2410] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:53.541095  7892 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:13:53.541749  7254 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:53.542426  9075 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:53.543241  9075 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:53.544978  9075 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.526651  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:53.548853  7185 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:53.551715  9262 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.552572  9262 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:53.292449  9296 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:53.555169  9296 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:53.556134  7253 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:53.556516  9296 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:53.557904  9296 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:53.271180  9159 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.560271  7256 raft_consensus.cc:2410] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:53.561093  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:53.562829  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.563855  9198 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.564080  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.564565  9198 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.565385  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.566175  9318 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.566983  7255 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:53.566852  9318 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:53.567579  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1850) took 1021 ms. Trace:
I20260709 13:13:53.568081  7184 rpcz_store.cc:276] 0709 13:13:52.545753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.545928 (+   175us) service_pool.cc:224] Handling call
0709 13:13:53.567214 (+1021286us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54002706d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:53.567412 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600136576}
I20260709 13:13:53.570791  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:53.571152  7332 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
W20260709 13:13:53.572121  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.573433  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:53.573781  7889 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:53.574833  7890 raft_consensus.cc:2410] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:53.575350  7257 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:53.576748  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.577962  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:53.578266  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.588150  7895 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:53.588260  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:53.589342  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 196) took 1048 ms. Trace:
I20260709 13:13:53.589762  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:53.591535  7330 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:13:53.588337  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:53.591768  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:53.618355  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:53.620594  7330 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:13:53.621799  7179 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 4: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:53.588168  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:53.634888  7333 raft_consensus.cc:2410] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:53.636826  7895 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:53.589820  7329 rpcz_store.cc:276] 0709 13:13:52.540855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.543503 (+  2648us) service_pool.cc:224] Handling call
0709 13:13:53.588945 (+1045442us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540031a6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:53.589144 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271271168}
W20260709 13:13:53.616565  7256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 203) took 2824 ms (client timeout 2042 ms). Trace:
I20260709 13:13:53.644397  7184 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:13:53.648612  9258 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:53.643481  7256 rpcz_store.cc:269] 0709 13:13:50.786419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.101199 (+314780us) service_pool.cc:224] Handling call
0709 13:13:53.590670 (+2489471us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b5400058f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:53.611231 (+ 20561us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5650950912}
I20260709 13:13:53.659456  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.633139  7327 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:53.674181  9240 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:53.680632  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.692777  7183 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:53.686880  7328 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:13:53.694430  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.701455  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.653981  9103 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.702309  7180 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:53.707891  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.712925  9119 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:53.713650  9262 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:53.692438  9318 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:53.723627  9103 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:53.696868  9198 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:53.730717  7335 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:53.738684  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:53.728937  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:53.739513  7893 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
W20260709 13:13:53.745415  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 199005us
W20260709 13:13:53.760114  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 75616.5us
I20260709 13:13:53.760114  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.729908  9149 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:53.763857  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.766516  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:53.773504  9241 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:13:53.766430  8721 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:53.781693  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.777552  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:53.789964  7891 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:53.775938  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.780244  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:53.775033  9244 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:53.794328  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1389) took 1241 ms. Trace:
W20260709 13:13:53.774577  9341 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.007s
I20260709 13:13:53.790367  9262 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:53.802893  9077 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.799278  7180 rpcz_store.cc:276] 0709 13:13:52.553037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.750114 (+1197077us) service_pool.cc:224] Handling call
0709 13:13:53.794247 (+ 44133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:53.810649  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:53.809640  7225 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:53.823892  7187 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:53.825836  7184 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 4: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:53.775557  8721 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:53.828687  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.829273  7178 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:53.799153  9244 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:53.829878  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1857) took 1278 ms. Trace:
I20260709 13:13:53.832360  7178 rpcz_store.cc:276] 0709 13:13:52.551276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.777019 (+1225743us) service_pool.cc:224] Handling call
0709 13:13:53.829786 (+ 52767us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:53.830950  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 71009.2us
W20260709 13:13:53.834192  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.819006  9241 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.838269  9346 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:53.838742  9243 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:53.840024  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.836994  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:53.838287  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:53.825371  9341 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:53.833806  9244 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:53.846395  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:53.839298  9243 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:53.834462  9262 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:53.850737  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.854158  7327 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:53.860360  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:53.862268  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 100680us
I20260709 13:13:53.864113  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:53.870324  7892 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:53.864349  7180 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:53.875063  7187 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:53.852265  9243 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:53.857774  9119 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:53.875792  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:53.882413  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:53.884330  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:53.886278  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 64953.9us
I20260709 13:13:53.889600  9103 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:53.852586  9241 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:53.890067  9103 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.850829  9077 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:53.897270  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.893105  9346 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:53.896544  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:53.883571  9119 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:53.899448  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:53.888964  9198 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:53.897881  9103 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:53.910046  9387 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:53.899502  9346 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.910916  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:53.903093  9119 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:53.908002  9198 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.908167  9149 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:53.917332  7187 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
W20260709 13:13:53.920756  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61822.8us
I20260709 13:13:53.921284  9214 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:53.883880  9262 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:53.916167  9346 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:53.925964  7180 raft_consensus.cc:2368] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3.
I20260709 13:13:53.924417  9111 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:53.923002  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.924436  9270 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:53.923345  9198 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:53.931525  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 79261.9us
I20260709 13:13:53.931582  7331 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:53.930850  9270 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:53.923239  9077 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:53.932781  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:53.935598  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.935173  7186 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:53.938318  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1387) took 1385 ms. Trace:
I20260709 13:13:53.934402  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:53.938771  7186 rpcz_store.cc:276] 0709 13:13:52.552504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.922427 (+1369923us) service_pool.cc:224] Handling call
0709 13:13:53.938253 (+ 15826us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:53.932307  9005 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:53.941924  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 59725us
I20260709 13:13:53.944401  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.940687  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:53.947357  7180 raft_consensus.cc:2410] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:53.935307  9270 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:53.950543  9341 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:53.951710  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.955168  9240 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:53.948565  9357 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.956725  7186 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
I20260709 13:13:53.942538  9111 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:53.946434  7887 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 4. Ops: []
I20260709 13:13:53.954339  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:53.960726  9318 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:53.958490  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.969460  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.972769  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.974509  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:53.977100  9111 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:53.977681  9357 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:53.949048  9077 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:53.980959  9357 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:53.983637  9384 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.283s	user 0.004s	sys 0.001s
I20260709 13:13:53.979768  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:53.955888  9240 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:54.001080  7186 raft_consensus.cc:2410] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:54.001505  9240 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:54.002754  7184 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:54.003535  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1854) took 1454 ms. Trace:
I20260709 13:13:54.003943  7184 rpcz_store.cc:276] 0709 13:13:52.549197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.993541 (+1444344us) service_pool.cc:224] Handling call
0709 13:13:53.993990 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.003157 (+  9167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.003400 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:53.987911  7327 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:53.991082  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 266) took 1157 ms. Trace:
I20260709 13:13:53.991649  8721 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:53.992628  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.993222  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:54.019925  7181 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:13:53.995903  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 58452us
I20260709 13:13:53.997915  7185 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:13:53.953145  9075 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:53.998231  9069 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:53.999734  9241 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:54.002218  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:54.012097  7893 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:13:53.948140  9005 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:54.022040  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 80221us
I20260709 13:13:54.007686  7179 rpcz_store.cc:276] 0709 13:13:52.833224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.868796 (+ 35572us) service_pool.cc:224] Handling call
0709 13:13:53.990817 (+1122021us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b5400385c54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:53.990992 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394513792}
I20260709 13:13:53.972980  9159 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:54.025648  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1386) took 1469 ms. Trace:
I20260709 13:13:54.032907  7180 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:54.026933  7185 rpcz_store.cc:276] 0709 13:13:52.552262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.996954 (+1444692us) service_pool.cc:224] Handling call
0709 13:13:53.997505 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:54.020862 (+ 23357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.021160 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.033476  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1866) took 1222 ms. Trace:
I20260709 13:13:54.027920  7187 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:54.034068  7180 rpcz_store.cc:276] 0709 13:13:52.811027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.954700 (+1143673us) service_pool.cc:224] Handling call
0709 13:13:54.033411 (+ 78711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.037369  7150 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:54.038550  7150 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:54.019397  9077 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:54.047340  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 45261us
W20260709 13:13:54.047619  9388 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:13:54.047960  9374 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:54.048601  9374 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:54.048774  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:54.039635  7150 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:54.048965  9077 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:54.033381  7332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1157) took 2595 ms (client timeout 2026 ms). Trace:
I20260709 13:13:54.053259  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:54.054347  7893 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 4: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:13:54.059579  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 133732us
I20260709 13:13:54.059227  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:54.063726  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:54.065155  9192 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.002s
I20260709 13:13:54.065789  9192 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:54.066174  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:54.052294  7332 rpcz_store.cc:269] 0709 13:13:51.429840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.529757 (+ 99917us) service_pool.cc:224] Handling call
0709 13:13:54.020197 (+2490440us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54001b9254. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:54.025385 (+  5188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4526729984}
I20260709 13:13:54.067121  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:54.066188  9192 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:54.068276  9192 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.068370  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:54.068719  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:54.069178  7261 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.069706  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:54.070936  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 133651us
I20260709 13:13:54.071122  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:54.071785  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:54.072069  7254 raft_consensus.cc:2410] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:13:54.073025  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:54.073150  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:54.073685  7253 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:54.074600  9310 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:54.075078  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:54.075861  7258 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:13:54.076370  9077 raft_consensus.cc:2764] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:13:54.076309  9192 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.077203  9077 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:54.075171  9310 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:54.023777  9069 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:54.079695  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.074553  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:54.004216  9103 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.084921  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1865) took 1216 ms. Trace:
I20260709 13:13:54.055044  9374 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:54.085407  7182 rpcz_store.cc:276] 0709 13:13:52.810691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.901735 (+ 91044us) service_pool.cc:224] Handling call
0709 13:13:54.019161 (+1117426us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54002c5454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:54.026963 (+  7802us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789690240}
I20260709 13:13:54.086944  7179 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:54.087642  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1868) took 1276 ms. Trace:
I20260709 13:13:54.087952  7179 rpcz_store.cc:276] 0709 13:13:52.811545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.053260 (+1241715us) service_pool.cc:224] Handling call
0709 13:13:54.086720 (+ 33460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:54.087373 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.087565 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.089401  7179 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:54.089949  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1871) took 1277 ms. Trace:
I20260709 13:13:54.089759  9243 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:54.091221  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.090350  7179 rpcz_store.cc:276] 0709 13:13:52.812308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.088688 (+1276380us) service_pool.cc:224] Handling call
0709 13:13:54.089024 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.089715 (+   691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.089877 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.084468  7183 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
W20260709 13:13:54.094897  7183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1384) took 1543 ms (client timeout 1909 ms). Trace:
I20260709 13:13:54.097939  7187 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:54.060351  9241 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:54.108021  7891 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:54.095330  7183 rpcz_store.cc:269] 0709 13:13:52.551654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.566325 (+1014671us) service_pool.cc:224] Handling call
0709 13:13:54.094823 (+528498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.051105  9075 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.077726  9077 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:54.126883  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:54.187433  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:54.127617  7179 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:54.130579  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:54.150278  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 118918us
I20260709 13:13:54.129681  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:54.187929  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:54.142961  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:54.080245  9341 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:54.168768  7181 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:54.204005  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 267) took 1363 ms. Trace:
I20260709 13:13:54.237550  7327 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:54.222312  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:54.082764  9069 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:54.242878  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 194188us
I20260709 13:13:54.116531  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 262) took 1497 ms. Trace:
W20260709 13:13:54.131409  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 81855.1us
I20260709 13:13:54.127225  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:54.140839  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:54.128134  7333 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:54.131071  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:54.150278  7182 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:13:54.255275  7182 pending_rounds.cc:85] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 1
I20260709 13:13:54.238212  7179 rpcz_store.cc:276] 0709 13:13:52.840823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.093644 (+1252821us) service_pool.cc:224] Handling call
0709 13:13:54.127340 (+ 33696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:54.203706 (+ 76366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.203945 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.256057  7328 raft_consensus.cc:2368] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4.
I20260709 13:13:54.256642  7179 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:54.132427  7185 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:54.239869  7335 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 3.
W20260709 13:13:54.111017  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61148us
I20260709 13:13:54.258656  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:54.259153  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:54.252033  7187 rpcz_store.cc:276] 0709 13:13:52.607496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.034997 (+1427501us) service_pool.cc:224] Handling call
0709 13:13:54.097688 (+ 62691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.104703 (+  7015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.104911 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.262579  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1864) took 1443 ms. Trace:
I20260709 13:13:54.264097  7336 raft_consensus.cc:2368] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3.
I20260709 13:13:54.255589  7182 pending_rounds.cc:107] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:13:54.267933  7182 raft_consensus.cc:2889] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:54.268723  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1869) took 1456 ms. Trace:
I20260709 13:13:54.268904  9075 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:54.269129  7182 rpcz_store.cc:276] 0709 13:13:52.811804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.086297 (+1274493us) service_pool.cc:224] Handling call
0709 13:13:54.103181 (+ 16884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.268469 (+165288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.268659 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.271163  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:54.206842  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:54.205086  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:54.106117  9318 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:54.274660  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1861) took 1678 ms. Trace:
I20260709 13:13:54.272045  7179 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:54.263063  7181 rpcz_store.cc:276] 0709 13:13:52.810394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.050306 (+1239912us) service_pool.cc:224] Handling call
0709 13:13:54.112051 (+ 61745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.241879 (+129828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.254162 (+ 12283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.281831  7185 rpcz_store.cc:276] 0709 13:13:52.596025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.033717 (+1437692us) service_pool.cc:224] Handling call
0709 13:13:54.132224 (+ 98507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.265214 (+132990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.274447 (+  9233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.128826  9195 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:54.285112  7180 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:54.258141  9192 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:54.149784  9198 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:54.262863  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:54.287216  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:54.280371  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:54.297262  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 186927us
I20260709 13:13:54.261721  9241 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:54.301077  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:54.284520  9214 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:54.306093  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63514.2us
W20260709 13:13:54.297964  9296 consensus_meta.cc:287] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.004s
I20260709 13:13:54.281224  9318 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:13:54.287822  7329 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:54.315083  7331 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:54.302965  9341 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:54.318874  7261 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:54.320564  9111 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:54.326772  9341 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.326864  9111 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:54.327426  9341 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:54.325631  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:54.327510  9111 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:54.322778  9192 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:54.331431  9389 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
I20260709 13:13:54.315891  9077 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:54.333010  9103 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:54.287158  9310 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:54.335444  7892 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:54.336669  9005 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:54.337073  9111 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:54.337399  9198 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:54.337284  9241 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:54.338348  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:54.339401  7329 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:54.339681  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:54.331004  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:54.341442  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55487.2us
I20260709 13:13:54.315336  7081 catalog_manager.cc:5697] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.344779  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:54.345978  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.319437  9318 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:54.354962  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:54.347618  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1860) took 1731 ms. Trace:
I20260709 13:13:54.354506  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:54.356365  7893 raft_consensus.cc:2368] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4.
I20260709 13:13:54.361653  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:54.355613  7178 rpcz_store.cc:276] 0709 13:13:52.593074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.025581 (+1432507us) service_pool.cc:224] Handling call
0709 13:13:54.077061 (+ 51480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.077356 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:54.192601 (+115245us) log.cc:844] Serialized 14 byte log entry
0709 13:13:54.323643 (+131042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:54.323693 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:54.323735 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.323799 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.323904 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18280,"prepare.queue_time_us":235529,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":18612,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":111,"thread_start_us":178955,"threads_started":2}
W20260709 13:13:54.371351  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 112225us
I20260709 13:13:54.373981  9198 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:54.375250  9198 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:54.374614  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:54.375653  9198 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:54.376703  9198 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.378060  9198 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:54.378909  9192 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:54.378990  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:54.380982  9192 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:54.329824  9346 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:54.386833  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1858) took 1825 ms. Trace:
I20260709 13:13:54.353130  9243 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:54.392052  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:54.395195  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50508.7us
I20260709 13:13:54.381511  7888 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:54.406985  9111 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:54.412406  9375 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.896s	user 0.005s	sys 0.009s
I20260709 13:13:54.412889  9375 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:54.415217  9292 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:54.415700  9292 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.358335  9195 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:13:54.416057  9292 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.416656  9243 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:54.418726  9204 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.419092  9243 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:54.419453  9243 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:54.420415  9243 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.421687  9243 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:54.425797  9244 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.565s	user 0.004s	sys 0.004s
I20260709 13:13:54.426397  9244 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.430583  9270 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.387250  7186 rpcz_store.cc:276] 0709 13:13:52.561172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.001771 (+1440599us) service_pool.cc:224] Handling call
0709 13:13:54.002210 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.002437 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:54.108586 (+106149us) log.cc:844] Serialized 14 byte log entry
0709 13:13:54.386485 (+277899us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:54.386535 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:54.386576 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.386664 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.386776 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1863,"prepare.queue_time_us":281806,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"thread_start_us":294134,"threads_started":2}
W20260709 13:13:54.445153  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.397559  7081 catalog_manager.cc:5697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:54.447880  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 60809.3us
I20260709 13:13:54.387491  9149 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:54.460181  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:54.391466  9240 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:54.480754  7862 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.646s (SENT) [suppressed 32 similar messages]
I20260709 13:13:54.477123  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:54.480682  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:54.485620  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.492915  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:54.494959  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.493083  7258 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:54.500944  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 52399.8us
I20260709 13:13:54.501436  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1859) took 1935 ms. Trace:
W20260709 13:13:54.500236  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 425792us
I20260709 13:13:54.503873  7228 leader_election.cc:400] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3.
I20260709 13:13:54.504372  7228 leader_election.cc:403] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:13:54.482606  9240 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:54.507331  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 416046us
I20260709 13:13:54.483033  8721 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:54.501804  7184 rpcz_store.cc:276] 0709 13:13:52.565723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.005298 (+1439575us) service_pool.cc:224] Handling call
0709 13:13:54.005740 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.006117 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:13:54.256582 (+250465us) log.cc:844] Serialized 14 byte log entry
0709 13:13:54.501087 (+244505us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:54.501145 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:54.501189 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.501261 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.501383 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6489,"prepare.queue_time_us":296309,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"thread_start_us":447361,"threads_started":2}
W20260709 13:13:54.523025  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:54.560648  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 67733.7us
W20260709 13:13:54.570914  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 402644us
W20260709 13:13:54.570264  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 176793us
I20260709 13:13:54.493052  9149 raft_consensus.cc:697] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:13:54.561719  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 54007.6us
I20260709 13:13:54.562970  7081 catalog_manager.cc:5697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:54.576885  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 184560us
I20260709 13:13:54.510576  9240 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.580996  7187 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:54.481192  9341 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:54.510854  8721 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:54.592315  8986 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:54.593060  9005 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:54.593710  9005 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.578691  9192 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:54.582155  7081 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 2 to 3, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.603241  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:54.611987  7081 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:54.608191  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 127467us
I20260709 13:13:54.616628  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:54.589987  9262 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.588817  8721 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:54.673538  7331 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:54.675823  7335 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:54.676523  7330 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:54.616235  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:54.677358  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 62938.7us
I20260709 13:13:54.669242  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:54.589824  9111 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:54.612358  9346 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:54.766752  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:54.588297  9374 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.153s
W20260709 13:13:54.773507  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 156947us
I20260709 13:13:54.779773  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:54.751556  7081 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 2 to 3, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.798098  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:54.790982  9402 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.196s
I20260709 13:13:54.791221  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:54.799815  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:54.791411  7332 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:54.792941  7328 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:54.793964  7081 catalog_manager.cc:5697] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:54.766229  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:54.808701  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 205628us
I20260709 13:13:54.810940  7186 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:54.812647  7893 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:54.817402  7893 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:54.779263  9241 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.780421  9077 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:54.827831  7081 catalog_manager.cc:5697] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:54.837903  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.797900  9171 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:54.834766  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 237478us
I20260709 13:13:54.764005  9069 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:54.852928  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:54.854009  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:54.808756  9244 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:54.858258  7081 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 2 to 5, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 5 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.827416  9398 raft_consensus.cc:2764] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:54.861109  7081 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 2 to 3, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 3 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:13:54.863049  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 116188us
I20260709 13:13:54.863409  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:54.864034  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:54.866096  7178 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:54.800423  9111 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.873989  7259 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.869243  7893 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.887800  7225 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:54.865293  9417 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.865453  9270 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:54.902098  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:54.901748  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 306765us
I20260709 13:13:54.902371  7081 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 3, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 3 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:54.909412  7081 catalog_manager.cc:5697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 3, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 3 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:13:54.910836  7893 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:54.911412  7081 catalog_manager.cc:5697] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 5, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 5 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:13:54.915032  9005 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:54.913622  7081 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index -1 to 2, term changed from 1 to 3, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to <none>, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 3 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:13:54.883723  9077 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:54.915735  9077 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:54.915784  9069 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:54.916239  9077 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:54.916546  7081 catalog_manager.cc:5697] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 2, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.835182  9149 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.920158  9411 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:54.919466  9417 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:54.920099  9402 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 13:13:54.902364  9119 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.972s	user 0.009s	sys 0.004s
I20260709 13:13:54.971426  7258 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:13:54.945739  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:54.947878  9407 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:13:54.948305  9419 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:54.949572  9404 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:13:54.950174  9390 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.820s	user 0.001s	sys 0.002s
I20260709 13:13:54.916514  9069 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.947880  7081 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.027186  7081 catalog_manager.cc:5697] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 3, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:54.955859  9400 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 13:13:54.960538  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:55.035131  7330 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.961467  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:54.961838  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:54.962714  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:55.037120  7332 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.963670  9412 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:54.890343  9422 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:54.965708  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:54.855167  9241 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.966843  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:54.966958  9420 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:54.855278  9171 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:54.973827  7893 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:13:54.995255  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:54.999370  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.058687  7893 pending_rounds.cc:85] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 5
W20260709 13:13:55.059018  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:54.918565  9292 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.000s
I20260709 13:13:55.039425  7081 catalog_manager.cc:5697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 2, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:13:55.041828  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 139968us
I20260709 13:13:54.967557  9411 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:54.936646  9296 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 13:13:55.020401  9270 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:55.065714  9411 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.994892  9119 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.036510  9341 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:55.020272  9419 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:55.071472  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.101866  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:55.059372  7893 pending_rounds.cc:107] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:13:55.062269  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 114556us
I20260709 13:13:55.086542  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.086745  7186 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:55.066037  7081 catalog_manager.cc:5697] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:55.086949  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 226485us
I20260709 13:13:55.032626  9402 consensus_queue.cc:1243] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:55.089236  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:55.082531  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:55.102861  7893 raft_consensus.cc:2889] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:55.087019  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.115964  7330 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
W20260709 13:13:55.117513  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.061890  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 208926us
I20260709 13:13:55.041110  9069 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.082242  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:55.054553  9420 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:13:55.119854  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 345299us
I20260709 13:13:55.122782  7150 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:55.123804  7259 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:55.125042  7178 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:13:55.088874  7887 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 1 LEARNER]: Advancing to term 3
I20260709 13:13:55.126678  9396 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:55.127177  9396 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.127585  9396 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.127900  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:55.128713  9417 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.126718  9346 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.130090  9346 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.093076  9425 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:13:55.090366  9243 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.000s
W20260709 13:13:55.115360  9198 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.737s	user 0.006s	sys 0.007s
I20260709 13:13:55.091640  9171 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:55.074597  8721 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.136071  8721 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.136873  9420 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:55.137910  9396 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.092199  7329 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:13:55.139261  9119 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.140012  9103 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:55.115980  9192 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:55.140391  9396 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.140833  9005 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:55.141454  9005 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.141495  9192 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.143952  9005 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.084834  9241 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:55.145026  7152 leader_election.cc:336] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.512s (SENT)
I20260709 13:13:55.078188  9077 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:55.066951  9204 consensus_meta.cc:287] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.002s
I20260709 13:13:55.147308  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:55.145736  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:55.148563  7081 catalog_manager.cc:5697] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.152511  7332 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:55.094281  9341 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.162835  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:55.120357  9318 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.004s
I20260709 13:13:55.083168  8986 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:55.078280  9423 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:55.166443  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63239.8us
I20260709 13:13:55.171701  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:55.079008  9111 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:55.097891  9419 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.197763  8986 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.089249  9421 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:55.160646  9270 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:13:55.182667  9435 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:55.183182  7081 catalog_manager.cc:5697] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.188076  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:55.188808  9396 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:55.188934  9119 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.189543  9428 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:55.191045  9430 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:55.191149  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46190.8us
I20260709 13:13:55.191715  9005 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:55.193378  9411 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.195255  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:55.152138  9262 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3.
I20260709 13:13:55.196018  9069 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.196846  9431 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:55.196575  9425 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:55.201871  7258 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:13:55.150449  9103 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:55.063504  9292 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.227921  9431 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:55.160005  9204 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:55.077623  9240 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:55.233690  7152 leader_election.cc:336] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.628s (SENT)
I20260709 13:13:55.234205  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:55.233836  9431 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.235206  7328 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:55.212038  7081 catalog_manager.cc:5697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:55.216670  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 134529us
I20260709 13:13:55.236143  9103 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.202559  9417 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:55.237411  9417 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.239259  9434 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:13:55.240291  9396 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:55.240990  9410 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.404s	user 0.001s	sys 0.001s
I20260709 13:13:55.210438  9075 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:13:55.242738  9069 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:55.231065  7261 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:55.236581  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:55.200562  9423 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.244899  9423 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.232478  9005 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:55.249606  9408 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:55.250170  9408 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:55.250211  9005 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.250998  9270 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:55.202440  9341 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.251427  9262 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:55.251459  9426 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:55.210693  9432 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:55.239610  9417 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:55.252627  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:55.208156  9296 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:13:55.223490  9111 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:55.264204  9419 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:55.211437  9435 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.177717  9318 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:55.303702  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 175910us
W20260709 13:13:55.311765  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 78128.8us
W20260709 13:13:55.307278  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.319113  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 66589.7us
I20260709 13:13:55.286727  9434 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.326015  7894 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: [4.6-6.7]
W20260709 13:13:55.326678  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 74174us
I20260709 13:13:55.265619  9077 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:55.327329  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.223006  9402 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 13:13:55.311802  9270 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:55.311789  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:55.345894  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.311234  9432 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:55.268148  9198 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:13:55.345747  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:55.351373  7332 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:55.351495  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:55.352648  7178 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 4: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:55.303325  9192 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:13:55.320703  9111 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.349869  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:55.326426  9149 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:55.337273  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:55.304667  9420 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.356460  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:55.361368  7333 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:55.357528  7328 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:55.358300  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:55.362861  7183 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:13:55.344708  9431 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:55.371737  7152 leader_election.cc:336] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.683s (SENT)
W20260709 13:13:55.360496  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.361490  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:55.360321  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:55.364162  7330 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.368251  9411 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:55.364518  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 163536us
I20260709 13:13:55.364692  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:55.359758  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 160249us
I20260709 13:13:55.348739  9240 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.381227  9119 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:55.381829  9119 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.382266  9119 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:55.383939  7334 raft_consensus.cc:2368] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
W20260709 13:13:55.384404  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.336237  9214 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:55.286334  9433 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 13:13:55.327360  9417 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:13:55.394474  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.326988  9262 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.395035  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.396260  7183 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:55.353376  9432 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.444154  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.445087  7187 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:55.445806  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52103.9us
W20260709 13:13:55.446874  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 89758.1us
I20260709 13:13:55.398456  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:55.398787  7178 raft_consensus.cc:2376] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6. Re-sending same reply.
I20260709 13:13:55.360867  9149 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.360077  9111 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:55.400182  7336 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:55.453995  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:55.402657  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.366014  9296 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:55.451826  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49499.8us
W20260709 13:13:55.452219  9416 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.493s	user 0.000s	sys 0.005s
I20260709 13:13:55.354826  7892 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:55.457814  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:55.354671  9310 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:13:55.466096  9411 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:55.466192  9420 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.336664  9434 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:55.483625  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.484144  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 112462us
I20260709 13:13:55.399569  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:55.453858  9240 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:55.489374  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.491272  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.486728  7336 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:13:55.458070  9149 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:55.466776  9411 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:55.501850  7186 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:55.503276  7892 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:55.403443  9069 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:13:55.509713  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:55.511685  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:55.514078  9447 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:55.514741  9445 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.148s
I20260709 13:13:55.515648  9445 consensus_queue.cc:1243] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:13:55.515758  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.516180  9445 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:55.516559  9445 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:55.517663  7887 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEARNER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:55.517505  9445 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.518103  8986 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.518893  9448 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
I20260709 13:13:55.520287  8986 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:55.522529  7152 leader_election.cc:336] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.828s (SENT)
I20260709 13:13:55.522413  7862 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:55.526587  7327 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:55.455307  9425 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:13:55.544620  7330 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
W20260709 13:13:55.550391  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 50897us
I20260709 13:13:55.556394  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:55.563354  7332 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:55.565936  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:55.470279  9296 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.571429  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.572060  9435 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.572063  7185 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:55.574087  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 75523.4us
W20260709 13:13:55.574838  7152 leader_election.cc:336] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.932s (SENT)
W20260709 13:13:55.575771  7152 leader_election.cc:336] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.939s (SENT)
I20260709 13:13:55.576128  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:55.577155  7152 leader_election.cc:336] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.130s (SENT)
I20260709 13:13:55.577528  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:55.578604  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 56266us
W20260709 13:13:55.578754  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 84284.1us
I20260709 13:13:55.545962  9240 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:55.396870  9214 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.581730  7894 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:55.583164  7185 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:13:55.588856  7186 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:55.591214  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:55.565318  9445 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:55.607887  9103 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:55.460901  9270 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.568938  9419 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:55.633196  7893 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:55.649032  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 71906.5us
I20260709 13:13:55.628144  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:55.556083  9446 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:13:55.592015  9341 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:55.600679  8986 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.568104  9375 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:13:55.601487  9192 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.602267  9310 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:55.636636  9075 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:55.580041  9447 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.092s
W20260709 13:13:55.671144  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 114812us
I20260709 13:13:55.676944  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:55.674546  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49723.6us
W20260709 13:13:55.679157  7152 leader_election.cc:336] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.203s (SENT)
I20260709 13:13:55.679627  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:55.660370  9318 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:55.684080  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:55.673933  9447 consensus_queue.cc:1243] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:55.708238  7895 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: [4.6-6.7]
W20260709 13:13:55.689863  9394 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.005s	sys 0.034s
I20260709 13:13:55.687989  9262 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:55.740278  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 78862us
I20260709 13:13:55.648335  9411 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.670109  9192 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.669656  8986 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:55.726188  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 146809us
I20260709 13:13:55.705157  9270 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:55.706028  9103 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:55.690332  9171 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:55.688303  9449 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:55.740024  9394 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.016s	sys 0.034s
I20260709 13:13:55.709704  9430 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:55.769155  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 70968.9us
W20260709 13:13:55.795241  7152 leader_election.cc:336] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.634s (SENT)
I20260709 13:13:55.717060  9077 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:55.694125  9292 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.767241  9005 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:55.778131  9240 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.778476  9455 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.753710  9318 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:55.779310  9398 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:55.753883  9075 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:13:55.796092  9341 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.691007  9419 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.810101  7862 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:55.808223  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 124217us
W20260709 13:13:55.809948  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 181882us
I20260709 13:13:55.814280  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:55.802760  9318 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.814330  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:55.833974  9459 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:55.834597  9459 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.835052  9459 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:55.836112  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.836885  7185 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:55.831106  9398 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.841193  9398 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:55.842008  9453 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:55.842608  9453 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:55.842845  9214 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.843573  9453 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:55.845034  9426 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.002s
I20260709 13:13:55.845471  9426 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:55.849670  7186 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:55.809633  9375 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:55.841333  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.856832  7181 raft_consensus.cc:2368] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:13:55.858383  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:55.816004  9296 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:55.831712  9411 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.831462  9318 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:55.861090  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.863812  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.868444  7185 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:55.864953  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:55.865854  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:55.803481  9005 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.870925  9464 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:55.800545  9430 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.873672  9111 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.873931  9119 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.816064  9341 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.877125  9432 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.860646  9375 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:55.883356  9192 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:55.887305  7333 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
W20260709 13:13:55.888170  9421 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.000s
I20260709 13:13:55.889676  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:55.861949  9447 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:13:55.893230  7152 leader_election.cc:336] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.562s (SENT)
I20260709 13:13:55.929908  7184 raft_consensus.cc:2368] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5.
I20260709 13:13:55.893394  7228 leader_election.cc:400] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:13:55.893796  9270 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:55.933945  9270 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:55.934341  9270 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:55.934582  9341 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:55.935256  9270 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:55.936590  9270 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:55.936985  9396 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:55.937317  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44121.5us
I20260709 13:13:55.937606  9396 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:55.938511  7152 leader_election.cc:336] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.794s (SENT)
W20260709 13:13:55.894342  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 80077.4us
W20260709 13:13:55.895007  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 88280.8us
I20260709 13:13:55.895427  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:55.805840  9455 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:55.927129  9423 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.682s	user 0.005s	sys 0.008s
W20260709 13:13:55.924031  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 64926.2us
I20260709 13:13:55.923748  9469 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:55.958571  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63213.6us
I20260709 13:13:55.867460  9446 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:55.960016  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:55.930413  7228 leader_election.cc:403] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:13:55.963070  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69826.5us
I20260709 13:13:55.963541  9450 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:55.964747  9450 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:55.964865  9426 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:13:55.965153  9450 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.965603  9450 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:55.965698  9426 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.935209  9111 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:55.967268  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.968240  9402 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:55.969017  9402 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:55.969372  9402 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:55.969776  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:55.970382  7258 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.930821  7186 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.932981  9119 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:55.980229  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:55.981566  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:55.943436  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:55.944761  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:55.919382  7187 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:13:55.946669  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:55.949851  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 60245.7us
I20260709 13:13:55.921090  9449 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:55.944139  9445 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:55.932993  9412 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:55.957432  9434 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:55.946381  9103 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:55.986039  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:55.983359  7180 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:13:55.987824  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:55.991407  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:56.007411  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:55.937009  9375 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:55.942557  9421 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:55.996043  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 49497.9us
I20260709 13:13:55.996882  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:56.020738  7262 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:55.997022  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:55.997666  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:55.999732  7254 pending_rounds.cc:85] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 1
I20260709 13:13:56.022377  7254 pending_rounds.cc:107] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:13:56.022738  7254 raft_consensus.cc:2889] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:56.000198  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:56.002883  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:55.966275  9426 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.010763  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:56.019106  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:56.023824  7182 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:56.024094  7187 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:55.994884  9243 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:56.021481  7255 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:55.995643  9374 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.030807  8721 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:56.031250  8721 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:56.031862  9426 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.994661  9412 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:56.032102  8721 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.033041  9244 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:56.033149  8721 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:56.030357  7258 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:56.037631  7257 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:13:56.039012  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53067.8us
I20260709 13:13:56.036988  7255 pending_rounds.cc:85] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 4
I20260709 13:13:56.041698  7255 pending_rounds.cc:107] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:13:56.041992  7255 raft_consensus.cc:2889] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:56.042325  7255 pending_rounds.cc:107] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:13:56.042534  7255 raft_consensus.cc:2889] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:56.008155  9341 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:55.970242  9402 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:56.050191  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:56.052591  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 64903us
I20260709 13:13:56.018741  9455 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:55.981159  9423 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.053839  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:56.054229  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:56.055001  7258 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:56.060595  7260 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:56.136520  9005 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:56.136991  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:56.051599  9434 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:56.046929  9397 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:56.139083  9397 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:56.139669  9396 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:56.046381  9446 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:56.141901  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 82185.7us
I20260709 13:13:56.162025  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:56.167399  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:56.168258  7182 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:56.059595  9149 consensus_meta.cc:287] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 13:13:56.183673  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:56.189029  7259 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:56.055562  9430 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:56.195477  9296 consensus_queue.cc:1175] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 13:13:56.197299  7257 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:56.064111  9341 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:56.200337  9346 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:56.213773  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52029.6us
I20260709 13:13:56.215516  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:56.144033  9453 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.233918  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:56.234103  7258 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:56.169095  9467 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.276531  9467 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.256891  9195 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:56.279031  9195 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.281553  9195 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:56.283761  9423 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:56.032990  9412 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.285499  9412 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:56.282312  7262 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:13:56.052058  9374 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.219686  9421 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:56.261713  9103 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.271004  9198 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:56.275076  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:56.215612  9434 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:56.314729  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.259996  9341 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.295706  7186 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:56.298135  9426 raft_consensus.cc:2764] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:56.188524  9192 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.139974  9397 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:56.291460  9402 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:56.292266  9431 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.908s	user 0.000s	sys 0.011s
W20260709 13:13:56.300518  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 163590us
I20260709 13:13:56.202111  9149 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.333559  9198 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:56.307855  9453 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.247660  9449 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.342955  9432 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:56.343524  9397 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:56.343807  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:56.317716  9464 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.344552  9467 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:56.382275  7185 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:56.305822  9421 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.337755  7258 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:56.359900  7334 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:56.359146  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:56.384922  7178 raft_consensus.cc:2410] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:13:56.362007  9434 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.149385  9408 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.370704  9374 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:56.376576  9453 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:56.378914  9464 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.384111  7335 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:56.349705  9195 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:56.398715  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:56.400885  7330 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:13:56.401815  7331 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:56.403739  9466 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:56.404192  9466 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:56.405068  9466 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.406308  9466 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:56.407764  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:56.398263  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:56.413461  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.388365  9421 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:56.338729  9318 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:56.390136  9459 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.551s	user 0.005s	sys 0.006s
I20260709 13:13:56.334369  9192 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.380842  9198 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:56.425791  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:56.427803  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:56.429188  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:56.460165  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.406618  9244 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:56.419912  9411 consensus_meta.cc:287] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 13:13:56.407135  9195 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:56.487907  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 80247.5us
I20260709 13:13:56.558326  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:56.751297  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:56.705683  7182 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.001s
I20260709 13:13:56.754187  7182 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:13:56.759162  7182 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:56.772320  7182 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:13:56.478912  9423 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:56.477145  9431 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:56.778402  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:56.509032  9469 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:56.559887  8986 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:56.756582  9467 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:56.600109  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:56.788453  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:56.784370  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.433745  9459 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.774240  9425 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.805416  7225 leader_election.cc:400] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4.
I20260709 13:13:56.809142  7225 leader_election.cc:403] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:13:56.805392  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.807901  7182 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:56.787047  9431 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.816064  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:56.818157  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:56.818739  7183 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:56.795828  9270 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:56.826787  7896 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:56.820212  9431 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:56.834930  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:56.835886  7182 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
W20260709 13:13:56.830734  9450 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.865s	user 0.013s	sys 0.001s
I20260709 13:13:56.824715  9423 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4.
I20260709 13:13:56.845888  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1898) took 1030 ms. Trace:
I20260709 13:13:56.846323  7185 rpcz_store.cc:276] 0709 13:13:55.815062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.929223 (+114161us) service_pool.cc:224] Handling call
0709 13:13:56.845705 (+916482us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54001b3ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:56.845818 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919838592}
I20260709 13:13:56.847333  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:56.848071  7187 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
W20260709 13:13:56.851513  7152 leader_election.cc:336] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.050s (SENT)
W20260709 13:13:56.853206  7184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1892) took 1380 ms (client timeout 1631 ms). Trace:
W20260709 13:13:56.853598  7184 rpcz_store.cc:269] 0709 13:13:55.472640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.472790 (+   150us) service_pool.cc:224] Handling call
0709 13:13:56.853009 (+1380219us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54001b49d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:56.853146 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997842816}
I20260709 13:13:56.855372  9195 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:56.861135  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:13:56.862131  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.861982  9296 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:56.853968  9450 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.862922  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:56.863713  9477 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:56.864085  9477 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:56.864434  9477 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:56.865197  9214 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:56.865733  9450 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:56.869680  9426 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.872040  9477 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.872931  9318 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:56.874161  9477 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:56.879211  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:56.812099  9467 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.814950  9425 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.879669  7257 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:56.879832  7262 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
W20260709 13:13:56.880918  7256 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260709 13:13:56.885696  7256 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:13:56.870220  9426 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.883973  7183 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:56.889286  7302 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:56.890807  7302 leader_election.cc:400] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5.
I20260709 13:13:56.891875  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:56.895041  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:56.897295  7262 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:56.896082  7183 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:56.898211  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:56.899442  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:56.906895  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:56.887938  8721 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.840s	user 0.007s	sys 0.003s
I20260709 13:13:56.886440  9439 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:56.923601  7258 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:56.906605  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:56.925498  7180 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:56.908425  9446 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:56.906527  9318 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:56.937134  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:56.922019  9466 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:56.886802  9296 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:13:56.949996  7257 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:56.951972  7183 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:56.925472  9439 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.924994  9192 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:56.958168  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:56.959121  7257 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:13:56.943449  9446 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.960976  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:56.948644  9318 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.963282  7257 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:56.955366  9439 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:56.965797  9446 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:56.970175  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 169485us
W20260709 13:13:56.975965  9412 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.003s
I20260709 13:13:56.979110  9270 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:56.958940  9103 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:13:56.965632  9318 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:56.983448  9467 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:56.984102  9478 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.785s	user 0.006s	sys 0.006s
I20260709 13:13:56.985924  9484 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:13:56.988304  9487 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:13:56.989102  9318 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.990839  9243 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.991493  9243 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:56.992640  9431 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:56.994510  9318 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:56.994154  9243 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:56.998821  9149 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:56.999130  9214 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:56.999792  9481 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:13:56.999714  9214 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.002130  9214 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:57.002267  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:57.003124  7184 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:13:57.004009  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:57.004379  9103 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:57.004554  7184 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:57.004433  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2076) took 1022 ms. Trace:
I20260709 13:13:57.006278  7258 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:57.004030  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 2079) took 1021 ms. Trace:
I20260709 13:13:57.010496  7256 rpcz_store.cc:276] 0709 13:13:55.982732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.982963 (+   231us) service_pool.cc:224] Handling call
0709 13:13:57.003826 (+1020863us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54002170d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:57.003963 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762393856}
I20260709 13:13:56.996510  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:57.014751  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.015502  7257 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:56.966249  9485 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:56.961988  9466 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:57.025813  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:57.024551  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 171859us
I20260709 13:13:57.026479  7254 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:57.027676  7152 leader_election.cc:336] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.226s (SENT)
I20260709 13:13:57.028435  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.008957  7253 rpcz_store.cc:276] 0709 13:13:55.981801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.981944 (+   143us) service_pool.cc:224] Handling call
0709 13:13:56.003584 (+ 21640us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:56.011514 (+  7930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:56.011556 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:56.046934 (+ 35378us) log.cc:844] Serialized 52 byte log entry
0709 13:13:56.407251 (+360317us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:56.407296 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.407362 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:56.999193 (+591831us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:13:57.004104 (+  4911us) raft_consensus.cc:1685] finished
0709 13:13:57.004132 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.004368 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":1211,"raft.run_wall_time_us":31605,"spinlock_wait_cycles":13475200,"thread_start_us":271423,"threads_started":1,"wal-append.queue_time_us":723805}
I20260709 13:13:57.028837  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:57.028096  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:57.007287  9192 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.042412  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2074) took 1074 ms. Trace:
W20260709 13:13:57.040014  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 67692.1us
I20260709 13:13:57.044956  7330 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:57.012809  9171 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:57.016773  9459 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:57.045810  7259 rpcz_store.cc:276] 0709 13:13:55.968240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.984820 (+ 16580us) service_pool.cc:224] Handling call
0709 13:13:55.985162 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:56.189567 (+204405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.042051 (+852484us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540034a3d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:57.042320 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468062080}
I20260709 13:13:57.023509  9270 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:57.056360  7225 leader_election.cc:400] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 2 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 2. Current term is 3.
W20260709 13:13:57.027745  9462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.009s	sys 0.029s
I20260709 13:13:57.051620  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:57.029624  9485 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.013983  9484 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:13:57.071616  7184 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
W20260709 13:13:57.074082  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46441.9us
I20260709 13:13:57.075290  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:57.076170  7184 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:13:57.077641  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:57.078461  7184 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:13:57.081143  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:57.074189  7862 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:57.082949  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:57.058182  9462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.009s	sys 0.029s
I20260709 13:13:57.087944  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:57.057428  9431 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:57.054879  9423 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:57.056603  9270 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.093616  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:57.091490  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:57.079406  9402 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.003s
I20260709 13:13:57.055128  8721 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:57.113875  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.078817  9485 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.134189  7260 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:57.120186  9466 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.127148  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:57.132865  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1413) took 1279 ms. Trace:
I20260709 13:13:57.051330  9192 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.135632  7184 raft_consensus.cc:2410] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:57.135162  7186 rpcz_store.cc:276] 0709 13:13:55.852985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.734732 (+881747us) service_pool.cc:224] Handling call
0709 13:13:56.735393 (+   661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:56.770222 (+ 34829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:56.770268 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:56.775105 (+  4837us) log.cc:844] Serialized 26 byte log entry
0709 13:13:57.052827 (+277722us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:57.052865 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.052931 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.132601 (+ 79670us) raft_consensus.cc:1685] finished
0709 13:13:57.132628 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.132796 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34427,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":8583,"thread_start_us":235717,"threads_started":1,"wal-append.queue_time_us":325785}
W20260709 13:13:57.092219  9421 consensus_meta.cc:287] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.002s
W20260709 13:13:57.115741  9397 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.730s	user 0.009s	sys 0.002s
I20260709 13:13:57.144729  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:57.145536  7187 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:13:57.146003  7184 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:57.147603  7184 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:57.095449  9425 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:57.055882  9171 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:57.151288  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 99743.4us
I20260709 13:13:57.117503  9270 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:57.157965  7184 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:57.111685  9426 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:57.115139  9459 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:13:57.149534  9490 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:13:57.060930  9494 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:13:57.162276  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:57.157646  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:57.207894  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:57.208813  7331 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:57.137032  9149 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:57.180784  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:57.180032  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:57.181560  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:13:57.181627  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 100605us
I20260709 13:13:57.217603  7891 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:13:57.183360  7336 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:57.199805  9464 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:57.161397  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.208336  7894 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:13:57.211932  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.208250  7330 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:57.222978  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:57.232402  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:57.174130  8986 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.227898  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.237298  7259 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:57.240502  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.144793  9421 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.216662  9149 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.245970  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.256544  7259 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:13:57.238752  9482 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.263213  9482 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.266202  9482 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:57.267145  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.210005  9423 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:57.221532  9459 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:57.284003  9459 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.226877  9426 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:57.285300  9426 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:57.286648  9426 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.273373  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:57.270766  9464 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:57.291721  9464 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.294027  9464 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:57.295279  9498 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:13:57.299177  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2083) took 1314 ms. Trace:
I20260709 13:13:57.299695  7255 rpcz_store.cc:276] 0709 13:13:55.984266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.029786 (+ 45520us) service_pool.cc:224] Handling call
0709 13:13:56.036741 (+  6955us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:56.257856 (+221115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:56.257891 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:56.875419 (+617528us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:13:56.875895 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:13:57.073099 (+197204us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:57.073140 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.073218 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.298732 (+225514us) raft_consensus.cc:1685] finished
0709 13:13:57.298766 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.299089 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157089024,"thread_start_us":196761,"threads_started":1,"wal-append.queue_time_us":285733}
I20260709 13:13:57.301862  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.302865  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:57.303418  7185 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:57.237612  9119 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:57.310943  9119 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.243683  8986 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.252570  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:57.291234  7187 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:57.274039  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:57.315389  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 60869.7us
W20260709 13:13:57.317276  9493 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:13:57.227499  9467 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:13:57.228966  9431 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:13:57.318080  7179 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:57.238508  9318 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:57.230786  9422 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:13:57.254408  8721 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.318492  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1411) took 1466 ms. Trace:
I20260709 13:13:57.267218  9494 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:57.274333  9241 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:13:57.321480  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:57.281492  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.327112  7150 leader_election.cc:400] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
I20260709 13:13:57.329002  7257 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:57.336946  7185 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:13:57.337366  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.344974  7254 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:13:57.303763  9446 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:57.346326  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 61532.1us
I20260709 13:13:57.486754  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:57.486953  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:57.487694  7335 raft_consensus.cc:2410] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:57.488152  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1221) took 1056 ms. Trace:
I20260709 13:13:57.488487  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:57.488451  7335 rpcz_store.cc:276] 0709 13:13:56.431588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.489966 (+ 58378us) service_pool.cc:224] Handling call
0709 13:13:57.486551 (+996585us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b5800094b98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:13:57.488081 (+  1530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6634240}
I20260709 13:13:57.489722  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:57.490530  7331 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:57.491768  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.492463  9119 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:57.492743  9408 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.492981  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.493559  7262 raft_consensus.cc:2376] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7. Re-sending same reply.
I20260709 13:13:57.494333  9421 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:57.478865  7152 leader_election.cc:336] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.586s (SENT)
I20260709 13:13:57.495267  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:57.496726  9119 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:57.497300  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.475240  9477 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.497864  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.498147  9477 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.500046  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.500533  9477 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:57.500753  7253 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:57.501582  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.502357  7253 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:57.502461  9243 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:57.502867  9243 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:57.503758  9243 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.504815  7892 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:57.504890  9243 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:57.505360  9501 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:13:57.506454  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1903) took 1519 ms. Trace:
I20260709 13:13:57.503647  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.506865  7182 rpcz_store.cc:276] 0709 13:13:55.986795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.948066 (+961271us) service_pool.cc:224] Handling call
0709 13:13:56.956452 (+  8386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:56.956884 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:56.956924 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:56.957432 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:13:57.146571 (+189139us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:57.146642 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.146732 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.506248 (+359516us) raft_consensus.cc:1685] finished
0709 13:13:57.506269 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.506398 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1705,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":1475,"thread_start_us":111055,"threads_started":1,"wal-append.queue_time_us":163340}
I20260709 13:13:57.494376  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:57.352468  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 199855us
I20260709 13:13:57.511695  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:57.414278  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.270346  9149 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:57.498430  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.508994  7178 rpcz_store.cc:276] 0709 13:13:55.852467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.391387 (+538920us) service_pool.cc:224] Handling call
0709 13:13:56.391867 (+   480us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:56.396629 (+  4762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:56.396675 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:56.419557 (+ 22882us) log.cc:844] Serialized 52 byte log entry
0709 13:13:56.813897 (+394340us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:56.813925 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.814022 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.317638 (+503616us) raft_consensus.cc:1685] finished
0709 13:13:57.317657 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.318432 (+   775us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":689,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":17202,"thread_start_us":215462,"threads_started":1,"wal-append.queue_time_us":473881}
I20260709 13:13:57.515357  7329 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:57.525921  7257 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:57.516093  7150 leader_election.cc:403] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:13:57.523725  7187 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:57.526539  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:57.530203  7260 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:13:57.530735  7260 pending_rounds.cc:85] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 4
I20260709 13:13:57.531008  7260 pending_rounds.cc:107] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:13:57.531291  7260 raft_consensus.cc:2889] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:57.532734  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.540318  7260 raft_consensus.cc:2410] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:57.541685  7187 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:57.475057  9005 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.548499  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.550052  7259 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:57.547025  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:57.485926  9482 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:57.561007  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 234344us
I20260709 13:13:57.558838  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.551194  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.568419  7255 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:57.520283  9397 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.575737  7331 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:13:57.535235  9103 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:57.549043  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:13:57.637051  7152 leader_election.cc:336] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.744s (SENT)
I20260709 13:13:57.387390  9425 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.184s
W20260709 13:13:57.652350  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 103397us
I20260709 13:13:57.652434  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.509073  9270 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.544872  9241 consensus_queue.cc:1243] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:57.665918  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 536) took 1278 ms. Trace:
I20260709 13:13:57.534143  9318 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.674399  9427 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:57.664443  9467 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.675657  8986 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:57.590952  9198 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.534698  8721 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.682070  9449 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:13:57.690260  7256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.022s	sys 0.035s
W20260709 13:13:57.693193  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.684495  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1220) took 1253 ms. Trace:
I20260709 13:13:57.672287  7893 rpcz_store.cc:276] 0709 13:13:56.314013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.314293 (+   280us) service_pool.cc:224] Handling call
0709 13:13:56.350901 (+ 36608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:56.732130 (+381229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:56.732159 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:56.772733 (+ 40574us) log.cc:844] Serialized 26 byte log entry
0709 13:13:57.012566 (+239833us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:57.012626 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.012739 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.592018 (+579279us) raft_consensus.cc:1685] finished
0709 13:13:57.592047 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.592242 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11506,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":557127,"threads_started":2,"wal-append.queue_time_us":305615}
I20260709 13:13:57.579156  9482 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.569957  9005 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.734212  7260 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:57.591114  9408 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
W20260709 13:13:57.755185  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 435364us
W20260709 13:13:57.780987  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.591624  9397 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.588982  9103 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.733069  7262 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:13:57.759917  9192 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:57.693244  9439 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.003s
W20260709 13:13:57.799175  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 229032us
I20260709 13:13:57.772387  9433 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.670068  9494 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:57.765928  9412 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:57.803596  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.803738  9412 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.804754  7262 raft_consensus.cc:2368] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6.
W20260709 13:13:57.696347  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 59356.9us
I20260709 13:13:57.736951  9506 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.806368  9506 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.765632  9467 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.796348  9103 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.782472  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:57.768378  9198 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.783187  9005 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:57.736721  9504 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:13:57.591722  9505 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.190s
W20260709 13:13:57.784119  7334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 214) took 2379 ms (client timeout 1830 ms). Trace:
W20260709 13:13:57.814875  7334 rpcz_store.cc:269] 0709 13:13:55.404790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.453588 (+ 48798us) service_pool.cc:224] Handling call
0709 13:13:57.783954 (+2330366us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b540038d6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:57.784055 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081156480}
I20260709 13:13:57.794947  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:57.587894  9508 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.190s
I20260709 13:13:57.770223  7332 rpcz_store.cc:276] 0709 13:13:56.430745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.442091 (+ 11346us) service_pool.cc:224] Handling call
0709 13:13:57.683713 (+1241622us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b5800094b98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:13:57.683925 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.684124 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:57.684151 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:57.684191 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:57.684222 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.684277 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.684404 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5032320}
I20260709 13:13:57.769411  9449 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:57.771780  7256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.023s	sys 0.035s
I20260709 13:13:57.777033  9425 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.801784  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.810398  9494 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.831713  7260 raft_consensus.cc:2410] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:57.812358  7150 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:57.666833  9423 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.784106  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:57.812237  9192 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:57.832705  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:57.798969  9456 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:13:57.834501  8986 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:57.834901  9198 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:57.832741  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48710.6us
W20260709 13:13:57.845160  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 327431us
I20260709 13:13:57.846300  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:57.801458  9439 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.843737  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:13:57.831736  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 317673us
I20260709 13:13:57.838663  7262 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:57.840190  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1907) took 1034 ms. Trace:
I20260709 13:13:57.850067  7186 rpcz_store.cc:276] 0709 13:13:56.806008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.144307 (+338299us) service_pool.cc:224] Handling call
0709 13:13:57.144708 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:57.145081 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:13:57.145108 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:57.164209 (+ 19101us) log.cc:844] Serialized 26 byte log entry
0709 13:13:57.569374 (+405165us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:57.569463 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.569554 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.839901 (+270347us) raft_consensus.cc:1685] finished
0709 13:13:57.839927 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.840116 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4696,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":18209,"spinlock_wait_cycles":28032,"thread_start_us":335415,"threads_started":1,"wal-append.queue_time_us":537488}
I20260709 13:13:57.853091  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.814033  9433 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.833053  9494 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:57.813928  9469 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:13:57.842109  9241 raft_consensus.cc:2764] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:13:57.862746  9005 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:57.855208  9198 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:57.856992  8721 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:57.835834  9425 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:57.881326  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.882169  7254 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 3.
I20260709 13:13:57.883284  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.883487  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.883983  7254 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:57.884353  7262 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:57.886448  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:57.887596  7186 raft_consensus.cc:2410] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:13:57.889400  7152 leader_election.cc:336] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.792s (SENT)
I20260709 13:13:57.889928  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.893040  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:57.893862  7187 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:57.898142  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:57.902310  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:57.904296  7152 leader_election.cc:336] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.816s (SENT)
I20260709 13:13:57.904742  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:57.905651  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:57.906252  7187 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:57.908960  7259 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:57.912591  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:57.902714  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 92877.3us
I20260709 13:13:57.915657  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:57.915995  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:57.916499  7182 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:57.916905  7181 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:57.918239  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.918753  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:57.919131  7260 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:13:57.927878  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.927857  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.929160  7328 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:57.936645  7259 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:13:57.937923  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 91715.5us
I20260709 13:13:57.896263  9241 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:57.942003  7894 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:57.942773  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.871158  9521 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.071s
W20260709 13:13:57.958127  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.901510  8721 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:13:57.868646  9449 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.959694  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:57.879072  9520 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:13:57.961604  7254 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:57.963573  7335 raft_consensus.cc:2410] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:13:57.963837  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.975888  7262 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:57.928077  9522 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:57.965158  7260 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:57.977780  7181 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:13:57.942921  8986 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:57.970000  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:57.976117  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:57.990485  7332 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:57.992039  8986 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:57.995759  7182 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:13:57.997629  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 202760us
I20260709 13:13:57.998435  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:57.996560  9318 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:58.003203  9524 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:57.963156  9506 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:13:58.005169  7152 leader_election.cc:336] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.915s (SENT)
I20260709 13:13:57.978672  9198 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:57.960577  9422 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:13:58.017596  7260 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:58.005051  9241 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:58.008306  9318 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:58.019825  7180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 286) took 1829 ms (client timeout 2230 ms). Trace:
I20260709 13:13:58.019721  9198 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.020365  9449 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.021934  9482 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:58.008020  9514 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:13:58.020414  9456 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:13:58.025349  9341 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:58.008913  9531 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:58.044615  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:58.041783  7180 rpcz_store.cc:269] 0709 13:13:56.190235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.220574 (+ 30339us) service_pool.cc:224] Handling call
0709 13:13:58.019607 (+1799033us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54000ee2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:58.019750 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1411980672}
I20260709 13:13:58.050127  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 249) took 1041 ms. Trace:
W20260709 13:13:58.055150  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 206811us
I20260709 13:13:58.027514  9439 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:58.059209  7185 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:58.060181  7185 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:13:58.053929  7256 rpcz_store.cc:276] 0709 13:13:57.008450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.114881 (+106431us) service_pool.cc:224] Handling call
0709 13:13:57.142071 (+ 27190us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:57.829490 (+687419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:57.829546 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:57.836857 (+  7311us) log.cc:844] Serialized 52 byte log entry
0709 13:13:57.939636 (+102779us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:58.047801 (+108165us) log.cc:844] Serialized 14 byte log entry
0709 13:13:58.049789 (+  1988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.049871 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:58.049913 (+    42us) raft_consensus.cc:1685] finished
0709 13:13:58.049927 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:58.050068 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1587,"prepare.queue_time_us":64795,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3111,"raft.queue_time_us":397569,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":13685,"thread_start_us":829877,"threads_started":3,"wal-append.queue_time_us":167010}
I20260709 13:13:58.063179  7260 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:58.042889  9318 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:58.061147  7185 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.069955  7862 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:58.049728  9341 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:58.055290  9537 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.076635  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.098192  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.066493  9318 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:58.096830  9103 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.074235  9433 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:58.074913  9525 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:58.099529  9531 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:13:58.099299  7254 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:58.114890  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:58.107049  9241 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.115744  7260 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:58.052261  9192 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:13:58.127880  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 251) took 1119 ms. Trace:
I20260709 13:13:58.127990  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.129020  7254 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:58.119081  7256 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:13:58.118963  7152 leader_election.cc:336] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.071s (SENT)
I20260709 13:13:58.112151  9425 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:58.096848  9520 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:58.134652  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.135402  7262 raft_consensus.cc:2368] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
W20260709 13:13:58.121929  9523 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:13:58.133597  7152 leader_election.cc:336] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.132s (SENT)
I20260709 13:13:58.124748  7255 raft_consensus.cc:1217] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 13:13:58.136590  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:58.128504  7258 rpcz_store.cc:276] 0709 13:13:57.008973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.100178 (+ 91205us) service_pool.cc:224] Handling call
0709 13:13:57.135338 (+ 35160us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:57.210345 (+ 75007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:57.210391 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:57.226141 (+ 15750us) log.cc:844] Serialized 52 byte log entry
0709 13:13:57.670679 (+444538us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:57.670730 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.670800 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.684810 (+ 14010us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b480033c3d8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:13:58.124387 (+439577us) raft_consensus.cc:1685] finished
0709 13:13:58.124408 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:58.127819 (+  3411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35165,"raft.queue_time_us":363200,"raft.run_cpu_time_us":1115,"raft.run_wall_time_us":186064,"spinlock_wait_cycles":28016512,"thread_start_us":475916,"threads_started":2,"wal-append.queue_time_us":608466}
I20260709 13:13:58.145213  7255 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:13:58.074123  9522 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:13:58.124202  9525 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:58.154968  7260 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:58.168023  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:58.168437  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 117257us
I20260709 13:13:58.175570  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:58.176623  9434 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:58.177305  9434 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:58.178519  9434 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.155525  7889 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:58.183341  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:58.160126  9485 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.010s	user 0.011s	sys 0.001s
I20260709 13:13:58.186468  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:13:58.152842  9149 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.000s
I20260709 13:13:58.189661  7254 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:58.189741  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:58.146809  9243 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.641s	user 0.015s	sys 0.000s
I20260709 13:13:58.157537  9525 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.195680  9494 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.196074  9525 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:58.198069  9494 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:58.199064  7257 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:58.202870  9149 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.154016  9198 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:58.205981  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.149629  9204 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:58.214380  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:58.126365  9537 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:13:58.215785  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:58.146617  9532 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:58.217341  9537 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:58.191766  9459 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:58.218573  9459 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.220508  9482 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:58.220928  9482 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:58.193090  9427 raft_consensus.cc:2764] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:58.222515  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1899) took 2273 ms. Trace:
I20260709 13:13:58.222911  7179 rpcz_store.cc:276] 0709 13:13:55.948981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.857744 (+908763us) service_pool.cc:224] Handling call
0709 13:13:57.317828 (+460084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:57.519942 (+202114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.222288 (+702346us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54002715d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:58.222429 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057048448}
I20260709 13:13:58.207839  9485 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.224682  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.225271  7258 raft_consensus.cc:2376] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3. Re-sending same reply.
I20260709 13:13:58.191985  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.226123  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.158864  9103 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:58.220971  9459 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:58.268801  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 297) took 1228 ms. Trace:
I20260709 13:13:58.269343  7178 rpcz_store.cc:276] 0709 13:13:57.040015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.541586 (+501571us) service_pool.cc:224] Handling call
0709 13:13:57.541893 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:57.791723 (+249830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:57.791752 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:57.802107 (+ 10355us) log.cc:844] Serialized 26 byte log entry
0709 13:13:57.858906 (+ 56799us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:57.858958 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.227055 (+368097us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400117e54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:13:58.227101 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:58.227141 (+    40us) raft_consensus.cc:1685] finished
0709 13:13:58.227153 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:58.268717 (+ 41564us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5249,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":13569,"spinlock_wait_cycles":573613440,"thread_start_us":22649,"threads_started":1,"wal-append.queue_time_us":110501}
W20260709 13:13:58.272179  7152 leader_election.cc:336] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.285s (SENT)
I20260709 13:13:58.221923  9482 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.207531  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.278756  7254 raft_consensus.cc:2376] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7. Re-sending same reply.
I20260709 13:13:58.228740  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:58.279878  7184 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:58.280252  7181 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:13:58.276558  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:58.281877  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:58.284189  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.284458  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:58.286093  7187 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:13:58.278870  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 207627us
I20260709 13:13:58.288523  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:58.290198  7260 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:13:58.291383  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.231176  9485 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:58.297840  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.295035  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.300087  7254 raft_consensus.cc:2410] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:13:58.300340  7184 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:13:58.296644  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.303139  7260 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:58.304150  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:58.304749  7335 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:13:58.297413  9516 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.001s	sys 0.025s
I20260709 13:13:58.160219  9341 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.324992  7258 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:13:58.294271  9103 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:58.335106  9103 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:58.335839  9103 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:58.341893  9318 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.310964  9482 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:58.344411  9318 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:58.346553  7262 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:13:58.347229  7260 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:58.350455  7262 pending_rounds.cc:85] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 2
I20260709 13:13:58.325482  7258 pending_rounds.cc:85] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 2
I20260709 13:13:58.351990  7262 pending_rounds.cc:107] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:13:58.352056  7258 pending_rounds.cc:107] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:13:58.352344  7262 raft_consensus.cc:2889] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:58.352388  7258 raft_consensus.cc:2889] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:58.308063  9149 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:58.366930  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:58.367871  7890 raft_consensus.cc:2368] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7.
I20260709 13:13:58.368348  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 541) took 1161 ms. Trace:
I20260709 13:13:58.368692  7890 rpcz_store.cc:276] 0709 13:13:57.206452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.208078 (+  1626us) service_pool.cc:224] Handling call
0709 13:13:58.366740 (+1158662us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:13:58.368263 (+  1523us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23061760}
I20260709 13:13:58.372696  9504 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.373574  9504 raft_consensus.cc:3055] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:58.373881  9504 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:58.371110  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:58.354846  9318 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.376868  7299 leader_election.cc:400] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7.
I20260709 13:13:58.377650  7299 leader_election.cc:403] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:58.355656  9449 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.381268  7335 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:13:58.382180  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1905) took 1583 ms. Trace:
I20260709 13:13:58.382206  9318 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.374687  9504 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:58.385207  7152 leader_election.cc:336] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.396s (SENT)
I20260709 13:13:58.385967  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:58.382937  7183 rpcz_store.cc:276] 0709 13:13:56.798777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.011703 (+212926us) service_pool.cc:224] Handling call
0709 13:13:57.011985 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.012206 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:13:57.177254 (+165048us) log.cc:844] Serialized 14 byte log entry
0709 13:13:57.352842 (+175588us) log.cc:844] Serialized 14 byte log entry
0709 13:13:58.359195 (+1006353us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b180035d8e0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:13:58.381707 (+ 22512us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:58.381806 (+    99us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:58.381912 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.381987 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:58.382122 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89449,"prepare.queue_time_us":985936,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":122852,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":66840,"spinlock_wait_cycles":27181312,"thread_start_us":314551,"threads_started":3,"wal-append.queue_time_us":562018}
I20260709 13:13:58.383201  9434 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7.
I20260709 13:13:58.387702  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 540) took 1181 ms. Trace:
I20260709 13:13:58.388129  7889 rpcz_store.cc:276] 0709 13:13:57.206105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.207164 (+  1059us) service_pool.cc:224] Handling call
0709 13:13:57.521528 (+314364us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:13:58.387462 (+865934us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b5400551ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:58.387644 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366403200}
I20260709 13:13:58.377341  9423 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:58.389783  9423 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:58.390726  9423 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.391819  9397 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:58.395632  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:58.397001  7889 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:13:58.397989  9494 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:58.398507  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:13:58.398520  9494 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:58.401700  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:58.401986  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:58.402132  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.384908  9341 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:58.403625  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.404649  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.406281  7260 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:58.407819  9103 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.409749  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.410413  7258 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:13:58.411194  9270 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:58.411441  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.412034  7258 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:13:58.412177  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:13:58.412513  9103 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:58.412966  7332 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 4: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:58.412914  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.413714  7258 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:58.385510  9449 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.416319  9449 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:58.416692  9412 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:13:58.418092  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.418227  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.424389  9494 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:58.424779  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:58.414520  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.428486  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:58.429314  7333 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:13:58.435456  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1230) took 1256 ms. Trace:
I20260709 13:13:58.435883  7329 rpcz_store.cc:276] 0709 13:13:57.179560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.179696 (+   136us) service_pool.cc:224] Handling call
0709 13:13:58.435229 (+1255533us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54003868d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:13:58.435382 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667471232}
I20260709 13:13:58.399796  9504 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.439414  7330 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:13:58.440045  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:58.440842  9525 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:58.440961  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:58.441871  9394 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:58.441969  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:58.442364  9394 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.442829  9394 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.443414  9525 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:58.443853  9525 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:58.445446  9431 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:58.445891  9431 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.446264  9431 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.449645  9423 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.454293  7260 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:58.455549  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:58.457195  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:58.458123  7332 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:13:58.450376  9423 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.465761  9423 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:58.435917  9449 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.477361  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.478324  7260 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:58.468871  9434 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:58.471674  9423 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:58.485929  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.489132  9318 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:58.499315  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.499995  7262 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:58.501849  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.495472  9434 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:58.504060  9434 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.475109  9449 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.501943  9402 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:58.520843  9402 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:58.520635  9394 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.521811  9402 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.523016  9394 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:58.523563  9402 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.495582  9423 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.556640  9423 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:13:58.565953  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.572705  9449 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:58.573305  9446 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:58.576174  9525 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.579838  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.580588  7256 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:58.582486  9431 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.583971  7185 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:58.584692  9431 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:58.584496  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:58.586282  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:58.601186  9525 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:58.604151  9171 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:58.606120  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.606848  7258 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:58.607703  9422 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:58.608587  9422 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:58.608647  9243 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:58.611773  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:58.612648  7302 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:58.613339  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:58.615586  7256 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:13:58.620020  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:58.628409  7185 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:58.629321  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 290) took 1630 ms. Trace:
I20260709 13:13:58.630123  7185 rpcz_store.cc:276] 0709 13:13:56.998967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.502560 (+503593us) service_pool.cc:224] Handling call
0709 13:13:57.502854 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:58.059083 (+556229us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54000fa8a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece923e1c0 00007fece923f231 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c
0709 13:13:58.583429 (+524346us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b58005b52d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91980aa 00007fece921a447 00007fece9232fe7 00007fece92347de 00007fece923eb49 00007fece923f416 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4
0709 13:13:58.629007 (+ 45578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.629260 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795146880}
I20260709 13:13:58.632949  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.633447  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:58.634349  7256 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:58.636286  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.636965  7256 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.640293  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:58.645668  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:58.659766  9446 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:58.663331  7258 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
W20260709 13:13:58.642676  9119 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:13:58.630551  9243 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:58.639377  9513 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.811s	user 0.002s	sys 0.004s
I20260709 13:13:58.642745  9171 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:58.666333  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:58.642976  9214 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:58.669631  7254 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:58.654173  7328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23e0840e609849f8bd379d43569463c8"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:58.688715  7259 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:58.692205  9482 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:58.692714  7259 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:58.680450  9214 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.693572  9467 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:58.693760  9214 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.695753  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:58.696627  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:58.697415  7894 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:58.697652  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:58.698926  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:58.699077  9149 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.699801  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:58.700248  9464 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:58.700325  9485 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:58.700874  9464 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:58.701018  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:58.701881  9464 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.703341  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:58.699601  9149 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.704905  7328 raft_consensus.cc:606] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:58.685151  7256 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:13:58.718464  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.660450  9456 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:58.709525  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:58.711968  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.733434  7254 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:58.720531  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.680235  9402 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:58.679422  9171 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:58.722080  7891 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEARNER]: Advancing to term 4
I20260709 13:13:58.680284  9103 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:58.724843  9214 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.728410  9149 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:58.729791  7255 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:58.737131  7259 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:58.753952  7259 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:13:58.692858  9482 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:58.706060  9446 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:58.722784  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:13:58.738170  7890 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:58.768240  7888 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
W20260709 13:13:58.768563  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 59137.2us
I20260709 13:13:58.764554  7893 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:13:58.773007  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:58.732802  9456 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.731786  9466 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:58.738170  9171 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:58.736210  9402 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.775507  7259 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.787300  7891 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:58.787796  7891 pending_rounds.cc:85] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 2
I20260709 13:13:58.788106  7891 pending_rounds.cc:107] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:58.788424  7891 raft_consensus.cc:2889] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:58.742476  9198 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:58.801923  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:58.764895  9412 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:58.749612  9103 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:13:58.803771  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:58.786252  7254 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:13:58.813799  7259 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:58.779129  9456 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:58.815629  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 252) took 1806 ms. Trace:
I20260709 13:13:58.779775  9466 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:58.793982  9402 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.817155  7261 rpcz_store.cc:276] 0709 13:13:57.009204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.122152 (+112948us) service_pool.cc:224] Handling call
0709 13:13:57.122513 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:57.215172 (+ 92659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:57.215219 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:57.226790 (+ 11571us) log.cc:844] Serialized 26 byte log entry
0709 13:13:57.544156 (+317366us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:57.544194 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.544257 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:58.600598 (+1056341us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:13:58.809490 (+208892us) raft_consensus.cc:1685] finished
0709 13:13:58.809522 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:58.815563 (+  6041us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":291165,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":44763,"spinlock_wait_cycles":4464896,"thread_start_us":391527,"threads_started":2,"wal-append.queue_time_us":545421}
I20260709 13:13:58.829814  7333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:58.830475  7333 raft_consensus.cc:606] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Received request to transfer leadership to TS 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:58.830825  7333 raft_consensus.cc:614] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:58.831844  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 134299us
I20260709 13:13:58.810127  9341 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:58.844411  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:58.842516  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.846122  7259 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:58.847649  7262 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:58.853588  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.854233  7253 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.808346  9434 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:13:58.864789  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:58.837813  9341 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:58.870504  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.810381  9198 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.867583  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:13:58.866423  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:58.900332  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.850147  9149 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:13:58.910840  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44515.8us
I20260709 13:13:58.905735  7253 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:13:58.912278  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44811.1us
I20260709 13:13:58.913808  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.901342  9469 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:58.916081  7329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:13:58.917868  9412 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:58.920756  9412 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:13:58.921095  9562 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:13:58.921193  9412 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.906206  9103 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:58.923262  9567 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:13:58.909952  9341 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:58.848274  9482 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.860064  9446 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:58.933255  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:58.942960  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.971765  7260 raft_consensus.cc:2368] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
I20260709 13:13:58.943854  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.973392  7253 raft_consensus.cc:2410] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:13:58.944095  9198 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:58.948935  9422 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:58.916306  9149 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:58.952705  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.954247  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.955860  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.981202  7259 raft_consensus.cc:2368] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
I20260709 13:13:58.956558  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.957046  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:58.982477  7254 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:58.918932  9469 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.978165  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:58.985716  9198 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:58.987545  9149 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:58.979063  9456 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:59.009646  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:58.978116  9431 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:59.007464  9552 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:13:59.021600  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:59.022574  7179 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:13:59.031466  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:59.047667  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:59.023030  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:13:59.048365  7183 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
W20260709 13:13:59.031684  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.033764  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 635280us
I20260709 13:13:59.040623  7185 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:13:59.051016  7185 pending_rounds.cc:85] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 2
W20260709 13:13:59.022209  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 636707us
I20260709 13:13:59.051306  7185 pending_rounds.cc:107] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:13:59.052234  7185 raft_consensus.cc:2889] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:59.035020  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:13:59.033874  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 120391us
I20260709 13:13:58.988842  9469 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:59.064759  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:59.069458  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46526.9us
I20260709 13:13:59.071539  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:59.074532  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.075107  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.075650  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.076078  7258 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:58.931416  9466 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:13:59.079536  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.082381  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:59.082129  7254 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:59.123034  7260 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:59.124907  7861 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:13:59.126097  9585 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 13:13:59.126720  9490 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:13:59.127629  9427 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:59.128050  9427 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.128414  9427 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:59.129472  9171 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:59.130896  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:59.131668  7257 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:59.015967  9548 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:59.135535  7253 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:59.142647  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:59.143704  7253 raft_consensus.cc:2368] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
W20260709 13:13:59.150929  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.151484  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:59.051290  9575 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:59.015060  9549 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:59.012291  9433 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:13:59.170331  9341 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:59.177208  9568 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:13:59.171779  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:59.079643  9421 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:59.154238  9571 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:13:59.189302  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:59.079823  9214 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:59.075562  9431 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:59.119463  9521 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:59.118911  9204 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:59.119239  9532 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:59.170711  9506 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.139022  9477 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:13:59.152853  9422 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:13:59.185810  9341 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:59.176045  9548 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:13:59.174088  9541 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:13:59.170583  9446 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:13:59.179768  9402 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:13:59.194387  9464 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:59.315271  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:59.236542  7187 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:59.317116  7254 raft_consensus.cc:2376] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4. Re-sending same reply.
I20260709 13:13:59.183663  9433 consensus_queue.cc:1243] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:13:59.276510  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:59.316473  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:59.234679  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:59.318394  7183 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 7: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:59.302474  7185 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:13:59.277016  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 226538us
I20260709 13:13:59.207347  9421 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:13:59.301990  9563 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:13:59.341832  7334 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:13:59.315912  9477 consensus_queue.cc:1243] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:59.339668  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:59.321465  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:59.344563  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:59.359345  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:59.344627  7150 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:59.365432  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:59.320752  9464 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:13:59.364805  7150 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:59.366226  7187 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:13:59.404181  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:59.214223  9204 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:59.214013  9532 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:59.339330  9456 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:13:59.417526  7183 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:59.216383  9506 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:59.435427  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:13:59.419754  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.420778  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:59.415097  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:13:59.421588  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 258131us
I20260709 13:13:59.438645  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:13:59.425832  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 274247us
I20260709 13:13:59.403623  9171 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:59.441890  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:13:59.451601  7254 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 4: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:13:59.410774  9464 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:59.405318  9589 raft_consensus.cc:2764] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:13:59.416968  9557 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:59.475708  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:59.466907  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:59.423331  9434 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:13:59.338335  9541 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:59.342659  9431 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:59.446820  9119 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:59.451377  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:13:59.498659  7152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.667s (SENT) [suppressed 24 similar messages]
I20260709 13:13:59.500517  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:59.501828  9594 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.503620  9402 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:13:59.504226  7330 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:13:59.506424  9204 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:59.478060  9557 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.477878  9421 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:59.501423  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.735838  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:13:59.738011  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.738157  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 273478us
I20260709 13:13:59.603596  7185 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:59.742559  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:13:59.743113  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:13:59.744590  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:59.739804  7327 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:13:59.740942  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:13:59.745839  7183 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
W20260709 13:13:59.552479  9581 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
W20260709 13:13:59.646265  9482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.000s	sys 0.012s
I20260709 13:13:59.758164  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:13:59.758489  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:13:59.759158  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:13:59.547698  9586 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:13:59.709753  9402 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:59.529688  9569 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.716s	user 0.000s	sys 0.008s
I20260709 13:13:59.490967  9548 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:59.754995  9593 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:13:59.708902  9422 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.678457  9456 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:13:59.578363  9532 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:59.529901  9477 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.530577  9318 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.764478  9485 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:59.578935  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:13:59.546571  9594 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:13:59.765452  9549 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:59.767675  9149 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:59.769696  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:13:59.775207  9587 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:13:59.776696  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1427) took 1552 ms. Trace:
I20260709 13:13:59.798651  7327 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:13:59.517320  7892 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:59.743832  9557 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:59.570176  9528 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.513031  9433 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:59.801883  7258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.010s	sys 0.018s
I20260709 13:13:59.804291  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:13:59.804857  7256 pending_rounds.cc:85] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 4
I20260709 13:13:59.512483  9434 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:13:59.833457  9513 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:13:59.832792  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:13:59.831607  9583 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:13:59.805105  9402 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:00.349538  7256 pending_rounds.cc:107] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:14:00.376224  7256 raft_consensus.cc:2889] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:00.349767  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 591638us
W20260709 13:14:00.350406  7258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.021s	sys 0.028s
W20260709 13:13:59.819963  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.875859  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.826912  7329 raft_consensus.cc:606] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:13:59.753716  8986 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:59.827646  9426 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:00.346908  9541 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:13:59.807106  9243 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:00.347986  7182 rpcz_store.cc:276] 0709 13:13:58.223819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.268187 (+ 44368us) service_pool.cc:224] Handling call
0709 13:13:58.288160 (+ 19973us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:59.033233 (+745073us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:13:59.033263 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:59.071452 (+ 38189us) log.cc:844] Serialized 26 byte log entry
0709 13:13:59.414571 (+343119us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:13:59.414613 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.414706 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:59.776414 (+361708us) raft_consensus.cc:1685] finished
0709 13:13:59.776442 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:59.776622 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":807497,"raft.queue_time_us":745150,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":14974,"thread_start_us":230549,"threads_started":1,"wal-append.queue_time_us":426762}
I20260709 13:14:00.097254  7179 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:14:00.009334  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:00.370175  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 600540us
I20260709 13:14:00.082093  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:00.369088  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:00.369282  9270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.007s	sys 0.024s
I20260709 13:13:59.797255  9521 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.432233  7181 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:00.385630  9005 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:00.416266  7890 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:00.352223  9506 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:00.416937  7889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.000s	sys 0.012s
I20260709 13:14:00.456296  9402 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:00.436882  7178 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:00.426146  9469 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.306s	user 0.012s	sys 0.000s
W20260709 13:14:00.470425  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 292927us
I20260709 13:14:00.476468  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:00.477345  7178 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
W20260709 13:14:00.478526  7228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.000s	sys 0.013s
W20260709 13:14:00.478847  7228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.000s	sys 0.013s
I20260709 13:14:00.479121  7178 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:14:00.479986  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.827172  9595 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:00.466354  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:00.484699  7180 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:00.006454  9581 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:14:00.366220  9533 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:00.428368  9532 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.448223  9270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.007s	sys 0.025s
W20260709 13:14:00.402729  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.465477  7181 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:14:00.310402  9103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.012s	sys 0.017s
W20260709 13:14:00.469833  7889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.000s	sys 0.012s
I20260709 13:13:59.900902  9482 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.504586  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.431136  8986 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:00.480798  9469 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:00.528921  9534 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.529522  9534 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:00.531703  9534 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:00.416026  9433 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:00.514396  9103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.019s	sys 0.019s
I20260709 13:14:00.375748  9477 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:00.536226  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 265) took 1691 ms. Trace:
I20260709 13:14:00.543732  7261 rpcz_store.cc:276] 0709 13:13:58.844699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.844907 (+   208us) service_pool.cc:224] Handling call
0709 13:13:58.859451 (+ 14544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:58.907645 (+ 48194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:58.907760 (+   115us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:58.917523 (+  9763us) log.cc:844] Serialized 26 byte log entry
0709 13:13:59.322230 (+404707us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:59.322280 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.322377 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:00.535922 (+1213545us) raft_consensus.cc:1685] finished
0709 13:14:00.535964 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.536150 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11669,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":6355,"thread_start_us":310266,"threads_started":1,"wal-append.queue_time_us":479126}
I20260709 13:14:00.375838  9422 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:00.547009  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 242) took 1745 ms. Trace:
I20260709 13:14:00.530336  9469 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:00.486596  9402 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:00.559521  7255 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:14:00.578990  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2132) took 1125 ms. Trace:
I20260709 13:14:00.579962  7255 rpcz_store.cc:276] 0709 13:13:59.453139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.453266 (+   127us) service_pool.cc:224] Handling call
0709 13:14:00.558052 (+1104786us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b5800003098. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:14:00.558335 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:00.578570 (+ 20235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.578910 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12836096}
I20260709 13:14:00.560693  7334 rpcz_store.cc:276] 0709 13:13:58.801621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.801722 (+   101us) service_pool.cc:224] Handling call
0709 13:14:00.546745 (+1745023us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54001928d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:00.546927 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231034112}
W20260709 13:14:00.580032  7253 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.008s	sys 0.019s
W20260709 13:14:00.583994  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.051s	sys 0.102s
W20260709 13:14:00.612895  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.051s	sys 0.102s
W20260709 13:14:00.612807  7253 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.009s	sys 0.019s
I20260709 13:14:00.472805  9521 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:00.415674  9528 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:00.478168  9318 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:00.607751  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.499758  9506 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.561039  9119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.018s	sys 0.012s
W20260709 13:14:00.849278  9119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.018s	sys 0.023s
I20260709 13:14:00.519644  9532 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:00.527838  8986 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:00.437366  9426 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:00.614483  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 272) took 1173 ms. Trace:
I20260709 13:14:00.542312  9595 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:00.613516  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 1.11297e+06us
W20260709 13:14:00.627269  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.500092  9533 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:00.527837  9482 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:00.860858  7328 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:00.853695  7253 rpcz_store.cc:276] 0709 13:13:59.440685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.442483 (+  1798us) service_pool.cc:224] Handling call
0709 13:13:59.442883 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:59.443150 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:59.731535 (+288385us) log.cc:844] Serialized 14 byte log entry
0709 13:14:00.614154 (+882619us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:00.614203 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:00.614248 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.614317 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.614428 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":293808,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":6199,"raft.queue_time_us":723231,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":878265,"threads_started":1}
I20260709 13:14:00.864578  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2136) took 1125 ms. Trace:
I20260709 13:14:00.865047  7253 rpcz_store.cc:276] 0709 13:13:59.739178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.863561 (+1124383us) service_pool.cc:224] Handling call
0709 13:14:00.863956 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:00.864173 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:00.864209 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:00.864265 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:00.864309 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.864376 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.864506 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:00.858315  9533 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:00.664894  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 263170us
I20260709 13:14:00.611233  9402 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:00.733964  9597 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 13:14:00.826704  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 266) took 1747 ms. Trace:
I20260709 13:14:00.827382  7892 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:00.827589  9456 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:00.827858  9412 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.906s	user 0.016s	sys 0.001s
I20260709 13:14:00.829797  9433 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:00.824764  9270 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.830751  9615 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.179s	user 0.003s	sys 0.000s
I20260709 13:14:00.833082  9318 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:00.833477  9611 log.cc:927] Time spent T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.220s	user 0.003s	sys 0.000s
I20260709 13:14:00.833945  9477 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:00.834177  7890 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:00.834836  9620 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.834874  9427 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.706s	user 0.014s	sys 0.001s
I20260709 13:14:00.836409  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:00.838829  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:00.839463  9449 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:01.087692  7336 raft_consensus.cc:2368] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
W20260709 13:14:00.842818  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 456711us
I20260709 13:14:00.851402  7180 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:14:00.827430  9610 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.165s	user 0.001s	sys 0.002s
I20260709 13:14:01.089113  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:01.088909  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 249753us
I20260709 13:14:01.091462  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 555) took 1676 ms. Trace:
I20260709 13:14:00.903620  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:01.089417  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1941) took 1282 ms. Trace:
I20260709 13:14:01.091861  7892 rpcz_store.cc:276] 0709 13:13:59.414611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.416625 (+  2014us) service_pool.cc:224] Handling call
0709 13:14:01.091394 (+1674769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:01.102774  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:01.094372  7258 rpcz_store.cc:276] 0709 13:13:59.079287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.079836 (+   549us) service_pool.cc:224] Handling call
0709 13:13:59.080123 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:59.080302 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:59.179113 (+ 98811us) log.cc:844] Serialized 14 byte log entry
0709 13:14:00.386290 (+1207177us) log.cc:844] Serialized 14 byte log entry
0709 13:14:00.826340 (+440050us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:00.826395 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:00.826441 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.826504 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.826616 (+   112us) inbound_call.cc:177] Queueing success response
0709 13:14:00.902565 (+ 75949us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
Metrics: {"mutex_wait_us":30374,"prepare.queue_time_us":206733,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":4107,"raft.queue_time_us":153702,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":112,"spinlock_wait_cycles":9607936,"thread_start_us":1628178,"threads_started":2,"wal-append.queue_time_us":1351792}
I20260709 13:14:01.098901  7187 rpcz_store.cc:276] 0709 13:13:59.806343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.834137 (+ 27794us) service_pool.cc:224] Handling call
0709 13:14:00.351889 (+517752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:00.352140 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:00.768639 (+416499us) log.cc:844] Serialized 14 byte log entry
0709 13:14:01.088292 (+319653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:01.088379 (+    87us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:01.088440 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.088534 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.088685 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17254,"prepare.queue_time_us":147233,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"thread_start_us":579342,"threads_started":2}
I20260709 13:14:01.111671  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:01.101992  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:01.050570  9557 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.001s
I20260709 13:14:01.106495  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1943) took 1182 ms. Trace:
W20260709 13:14:00.902026  9603 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.563s	user 0.001s	sys 0.000s
I20260709 13:14:01.116276  9639 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:01.117465  7258 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:14:01.043922  9548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.006s	sys 0.012s
W20260709 13:14:00.877154  9464 consensus_meta.cc:287] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.385s	user 0.013s	sys 0.000s
I20260709 13:14:00.853163  9630 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.843650  9005 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:14:00.901710  9623 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:14:01.124162  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2138) took 1377 ms. Trace:
I20260709 13:14:00.964044  9621 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:01.101080  9422 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:01.043455  9593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.006s	sys 0.010s
I20260709 13:14:01.052922  9426 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:01.090205  9466 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:01.127691  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2131) took 2053 ms. Trace:
I20260709 13:14:01.120915  7183 rpcz_store.cc:276] 0709 13:13:59.924280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.928775 (+  4495us) service_pool.cc:224] Handling call
0709 13:13:59.929193 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:59.929461 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:00.376279 (+446818us) log.cc:844] Serialized 14 byte log entry
0709 13:14:00.827170 (+450891us) log.cc:844] Serialized 14 byte log entry
0709 13:14:00.900840 (+ 73670us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:01.104392 (+203552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:01.104459 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:01.104526 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.104631 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.106416 (+  1785us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":671086,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":86,"raft.queue_time_us":182027,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":5902,"spinlock_wait_cycles":25122560,"thread_start_us":559927,"threads_started":2,"wal-append.queue_time_us":454993}
W20260709 13:14:01.130278  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 239335us
I20260709 13:14:01.147733  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:01.149909  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:01.150771  9613 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:01.151538  9613 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:01.152801  7225 leader_election.cc:400] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 3. Current term is 4.
I20260709 13:14:01.131690  7258 rpcz_store.cc:276] 0709 13:13:59.746855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.116858 (+1370003us) service_pool.cc:224] Handling call
0709 13:14:01.117163 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.123780 (+  6617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.124067 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:01.153908  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:01.133759  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.104048  9533 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.155977  9533 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.158669  9533 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:01.159857  9426 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:01.143811  7262 rpcz_store.cc:276] 0709 13:13:59.073873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.073996 (+   123us) service_pool.cc:224] Handling call
0709 13:13:59.136948 (+ 62952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:59.137375 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:59.137414 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:59.184535 (+ 47121us) log.cc:844] Serialized 26 byte log entry
0709 13:13:59.655404 (+470869us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:59.655457 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.655546 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:01.127406 (+1471860us) raft_consensus.cc:1685] finished
0709 13:14:01.127432 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.127620 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8487,"raft.queue_time_us":345,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":19891,"thread_start_us":422377,"threads_started":1,"wal-append.queue_time_us":1425932}
W20260709 13:14:01.135463  9421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.024s
I20260709 13:14:01.136745  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:01.106213  7890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 557) took 1553 ms (client timeout 2064 ms). Trace:
I20260709 13:14:00.978976  9627 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:01.132011  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 290559us
W20260709 13:14:01.126286  9548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.007s	sys 0.012s
I20260709 13:14:01.121243  9469 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:01.112690  9318 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:01.105846  9628 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:01.118410  9549 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:00.854127  9506 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.121661  9594 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:01.090440  9434 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:00.900799  9241 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.154551  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2139) took 1407 ms. Trace:
I20260709 13:14:01.126606  9482 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.103716  9620 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.105219  9412 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.105914  9270 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:01.140537  9593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.006s	sys 0.010s
I20260709 13:14:01.101922  9427 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.105783  9456 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.137414  9521 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:00.890646  9595 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.235289  9412 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:01.235976  9618 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:01.236832  9595 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:01.237370  9607 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.607s	user 0.000s	sys 0.003s
I20260709 13:14:01.130779  9619 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:14:01.174706  9421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.009s	sys 0.024s
I20260709 13:14:01.198387  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 278) took 1432 ms. Trace:
I20260709 13:14:01.142484  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.171448  9422 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:01.243530  7888 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
W20260709 13:14:01.197350  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83173.4us
I20260709 13:14:01.250555  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:01.197029  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83750.2us
I20260709 13:14:01.137509  9617 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:14:01.122834  9557 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.177058  9204 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:01.203660  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 190973us
I20260709 13:14:01.255774  7150 leader_election.cc:400] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
I20260709 13:14:01.256040  7150 leader_election.cc:403] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:14:01.223817  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 302) took 1945 ms. Trace:
I20260709 13:14:01.223919  7258 rpcz_store.cc:276] 0709 13:13:59.747184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.153556 (+1406372us) service_pool.cc:224] Handling call
0709 13:14:01.153925 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.154162 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.154197 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:01.154251 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:01.154285 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.154339 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.154483 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:01.134260  9464 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:01.197933  9623 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:14:01.200011  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 554) took 2195 ms. Trace:
I20260709 13:14:01.140770  9621 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.194795  9624 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:01.139067  9630 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.231055  7261 pending_rounds.cc:85] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 1
W20260709 13:14:01.187598  7890 rpcz_store.cc:269] 0709 13:13:59.548155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.552160 (+  4005us) service_pool.cc:224] Handling call
0709 13:14:01.101728 (+1549568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:01.203012  9426 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:01.236517  9618 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.137295  9532 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:01.193898  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 82309.4us
I20260709 13:14:01.198246  9627 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:01.239114  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.240044  7336 raft_consensus.cc:2410] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:14:01.241232  7262 rpcz_store.cc:276] 0709 13:13:59.766090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.172973 (+1406883us) service_pool.cc:224] Handling call
0709 13:14:01.197877 (+ 24904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.198067 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.198107 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:01.198149 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:01.198182 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.198235 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.198336 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:01.228868  9241 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.199960  7334 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:01.251869  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:01.263767  7893 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:01.293196  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:01.299436  7262 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:01.277849  9627 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.294716  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.267881  9426 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.273681  9422 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:01.266654  9621 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:01.267537  7261 pending_rounds.cc:107] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:14:01.306083  7261 raft_consensus.cc:2889] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:01.269490  9618 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.272403  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.266933  9624 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.274564  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:01.274345  9427 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.275168  9617 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:01.311431  9617 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:01.311872  9624 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.312033  9617 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:01.294325  9241 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:01.283731  9506 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:01.295333  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 43536.6us
I20260709 13:14:01.300782  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:01.314361  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:01.314710  7892 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:01.275442  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.262688  7184 rpcz_store.cc:276] 0709 13:13:59.278372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.278526 (+   154us) service_pool.cc:224] Handling call
0709 13:13:59.279005 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:59.289498 (+ 10493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:59.289544 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:59.346287 (+ 56743us) log.cc:844] Serialized 26 byte log entry
0709 13:13:59.753488 (+407201us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:59.753536 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.753616 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:00.901344 (+1147728us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:01.205491 (+304147us) raft_consensus.cc:1685] finished
0709 13:14:01.205510 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.223720 (+ 18210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"spinlock_wait_cycles":34286464,"thread_start_us":312578,"threads_started":1,"wal-append.queue_time_us":618503}
I20260709 13:14:01.317302  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:01.318059  9620 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.300028  9634 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:01.319212  9634 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.265038  7889 rpcz_store.cc:276] 0709 13:13:58.995686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.996136 (+   450us) service_pool.cc:224] Handling call
0709 13:13:59.064388 (+ 68252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:59.653552 (+589164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:59.662042 (+  8490us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:59.759486 (+ 97444us) log.cc:844] Serialized 26 byte log entry
0709 13:14:00.542032 (+782546us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:00.558434 (+ 16402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.584870 (+ 26436us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:01.142567 (+557697us) raft_consensus.cc:1685] finished
0709 13:14:01.142604 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.190740 (+ 48136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76385,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":38051,"thread_start_us":1122679,"threads_started":2,"wal-append.queue_time_us":780331}
I20260709 13:14:01.303328  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.321503  9634 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.271157  9204 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.279148  9270 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:01.324033  9204 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:01.324208  7892 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:01.205669  9318 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.312065  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:01.329253  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:01.333236  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.333828  7187 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:01.252173  9005 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:01.342124  9609 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.564s	user 0.006s	sys 0.008s
I20260709 13:14:01.318431  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:01.293393  9642 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:01.358099  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:01.272861  9557 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:01.359510  9402 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:01.355927  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.360837  7892 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:01.318655  9620 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:01.363186  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.300892  9643 raft_consensus.cc:2764] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:14:01.302834  9426 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.264894  9464 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:01.342911  9580 raft_consensus.cc:2764] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:14:01.268867  9630 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:01.367131  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56808 (request call id 21) took 2445 ms. Trace:
I20260709 13:14:01.382203  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.381930  7329 rpcz_store.cc:276] 0709 13:13:58.915590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.915954 (+   364us) service_pool.cc:224] Handling call
0709 13:14:01.360676 (+2444722us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54003868d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9236853 00007fecee20460a 00007fece778a7d4 00007fece778a762 00007fece778a691 00007fece778a60c 00007fece77898c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:01.360766 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092919552}
I20260709 13:14:01.384554  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.334982  9412 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:01.261940  9528 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:01.366357  7187 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
W20260709 13:14:01.398257  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.364240  9467 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:01.403165  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.367311  9620 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:01.360469  9198 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:01.302042  9422 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.414950  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:01.416108  7329 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:01.387526  9643 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:01.367064  9402 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:14:01.396361  9613 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:01.442032  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1241) took 2367 ms. Trace:
I20260709 13:14:01.442752  7332 rpcz_store.cc:276] 0709 13:13:59.050584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.050827 (+   243us) service_pool.cc:224] Handling call
0709 13:13:59.051192 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:59.119217 (+ 68025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:59.119249 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:59.149514 (+ 30265us) log.cc:844] Serialized 52 byte log entry
0709 13:13:59.735049 (+585535us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:13:59.800675 (+ 65626us) log.cc:844] Serialized 14 byte log entry
0709 13:13:59.809331 (+  8656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:59.809434 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:01.341417 (+1531983us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:01.412103 (+ 70686us) raft_consensus.cc:1685] finished
0709 13:14:01.417222 (+  5119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.417459 (+   237us) inbound_call.cc:177] Queueing success response
0709 13:14:01.425025 (+  7566us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b180038ef00. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
Metrics: {"mutex_wait_us":4548,"prepare.queue_time_us":59333,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":4365,"raft.queue_time_us":53708,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":40759,"spinlock_wait_cycles":61130496,"thread_start_us":492164,"threads_started":1,"wal-append.queue_time_us":583494}
I20260709 13:14:01.447474  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:01.406651  9456 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.459733  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.455557  7332 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:01.364367  7302 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:01.409654  9620 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:01.462487  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 98173.6us
I20260709 13:14:01.465394  7262 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:01.478888  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.479792  7262 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:14:01.473851  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.481590  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.483034  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.488865  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:01.490191  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.448794  9198 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:01.490206  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:01.489511  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:01.455045  9613 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.513756  9318 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.471271  9548 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:01.491017  7329 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:14:01.509989  9426 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:01.519892  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:01.520203  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:01.522341  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:01.524698  9204 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:01.525091  9204 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:01.525465  9204 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:01.526744  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.527993  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.529023  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.492049  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.530244  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.522359  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:01.533766  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.490268  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:01.492655  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:01.537292  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 47095.4us
I20260709 13:14:01.535933  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.538609  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.538785  7225 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:01.535311  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.540760  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:01.548213  7332 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:01.548792  7262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:35332
I20260709 13:14:01.549573  7262 raft_consensus.cc:606] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:01.548548  7862 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:01.549961  7262 raft_consensus.cc:614] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:01.559770  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:01.571503  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 273) took 2121 ms. Trace:
I20260709 13:14:01.547827  9548 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:01.574064  7257 rpcz_store.cc:276] 0709 13:13:59.441015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.443372 (+  2357us) service_pool.cc:224] Handling call
0709 13:14:01.561423 (+2118051us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b5800003098. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:14:01.561599 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.561770 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.561807 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:01.561845 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:01.561876 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.561926 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.562019 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10952960}
I20260709 13:14:01.551599  9270 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:01.450074  9643 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:01.554561  9606 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 1.776s	user 0.002s	sys 0.013s
I20260709 13:14:01.594065  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 274) took 2152 ms. Trace:
I20260709 13:14:01.551296  9506 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:01.580356  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:01.559151  9204 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.567183  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.595772  7889 raft_consensus.cc:2368] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:14:01.569923  9456 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:14:01.596990  9204 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.579219  9548 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.558028  9318 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:01.598512  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:14:01.585433  8986 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.697s	user 0.011s	sys 0.000s
I20260709 13:14:01.599466  8986 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.581038  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.603350  7183 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:14:01.588366  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 279) took 1060 ms. Trace:
I20260709 13:14:01.604102  7257 rpcz_store.cc:276] 0709 13:14:00.534016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.577045 (+1043029us) service_pool.cc:224] Handling call
0709 13:14:01.587750 (+ 10705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.587973 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.588009 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:01.588066 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:01.588111 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.588180 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.588297 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:01.589774  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:01.552318  9656 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:01.519152  9198 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.591882  9642 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
I20260709 13:14:01.591801  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.592689  7333 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:01.571002  9591 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:01.594550  7260 rpcz_store.cc:276] 0709 13:13:59.441386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.443491 (+  2105us) service_pool.cc:224] Handling call
0709 13:13:59.443887 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:59.647150 (+203263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:59.647194 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:59.658884 (+ 11690us) log.cc:844] Serialized 26 byte log entry
0709 13:14:01.250864 (+1591980us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b180033e380. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:14:01.387618 (+136754us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:01.387658 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.387725 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:01.593737 (+206012us) raft_consensus.cc:1685] finished
0709 13:14:01.593760 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:01.593994 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156348,"raft.queue_time_us":254629,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":40072,"spinlock_wait_cycles":3682688,"thread_start_us":136385,"threads_started":1,"wal-append.queue_time_us":1740855}
I20260709 13:14:01.598802  9318 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.618031  9318 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:01.619633  9456 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.620159  9456 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.622344  9456 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:01.603664  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 43969.1us
I20260709 13:14:01.583536  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.586895  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.612704  7180 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 3.
I20260709 13:14:01.573446  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.615669  7260 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:01.626866  7262 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:01.615783  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.628123  7183 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:01.560288  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:01.627826  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.629312  7178 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 4: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:01.615732  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:01.627835  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 280) took 1093 ms. Trace:
I20260709 13:14:01.598562  9548 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:01.631250  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.636757  7178 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
W20260709 13:14:01.637118  7186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1434) took 2135 ms (client timeout 1765 ms). Trace:
W20260709 13:14:01.637537  7186 rpcz_store.cc:269] 0709 13:13:59.523357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.636915 (+2113558us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:01.637043 (+   128us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:01.637666  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.611574  9656 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.642186  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.635221  7225 leader_election.cc:400] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:14:01.642942  7225 leader_election.cc:403] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:01.643138  7178 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 4: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:01.610747  9506 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:01.632858  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.640061  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:01.647670  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.640202  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.648348  7182 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:01.648483  7180 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:01.649534  7182 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:01.642269  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.609956  8986 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:01.614910  9591 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.644166  7178 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:01.660408  7178 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:01.640916  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.663089  7894 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:01.667425  7187 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:01.655853  7186 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:01.669785  7186 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:01.631740  7262 rpcz_store.cc:276] 0709 13:14:00.534367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.585936 (+1051569us) service_pool.cc:224] Handling call
0709 13:14:01.617139 (+ 31203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.627509 (+ 10370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.627765 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:01.633649  9630 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:01.633520  9412 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.672639  7186 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.674892  7186 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:01.675988  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:01.676870  7302 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:01.653975  7332 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:01.654608  9656 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:01.661219  7178 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.657769  9508 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:14:01.680042  7225 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:01.678563  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:01.663341  9591 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:01.685801  7178 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:01.694823  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.695230  7225 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:01.695621  7332 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:01.679145  9412 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.697701  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:01.681959  9456 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:01.702389  9469 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:01.712358  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.688010  9466 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:01.697314  9508 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:01.716899  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.719583  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.720713  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.680364  9630 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.721939  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.724888  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.723591  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.727311  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.736917  7178 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:01.744383  9630 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.702824  9506 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:01.705533  9594 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:01.703842  9456 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:01.746472  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.746340  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.748010  7260 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:01.808573  7332 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:14:01.749298  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.749882  7262 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:14:01.750765  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.809523  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.811388  7184 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:01.753368  9548 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.760030  9412 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:01.761282  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.762173  9643 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:01.771689  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 441) took 1991 ms. Trace:
I20260709 13:14:01.811199  9656 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.793040  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:01.793504  7152 connection.cc:256] RPC call timeout handler was delayed by -2.679821284000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 13:14:01.812120  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:01.831004  7152 leader_election.cc:336] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.549s (SENT)
I20260709 13:14:01.831205  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.832024  7260 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:01.832775  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.833825  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.815387  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.835124  7332 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:01.810886  7262 pending_rounds.cc:85] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 3
I20260709 13:14:01.834515  7260 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:14:01.802526  9508 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:14:01.817835  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.827275  7893 rpcz_store.cc:276] 0709 13:13:59.780012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.780177 (+   165us) service_pool.cc:224] Handling call
0709 13:13:59.780483 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.297272 (+1516789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:01.766569 (+469297us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540049cd54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:01.771593 (+  5024us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3410793728}
I20260709 13:14:01.836503  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.835670  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:01.835829  7262 pending_rounds.cc:107] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:14:01.816526  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.703202  9318 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.837141  7262 raft_consensus.cc:2889] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:01.849150  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.854218  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:01.855010  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.855552  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.855865  7262 raft_consensus.cc:2410] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:14:01.855749  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.856401  7257 raft_consensus.cc:2410] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:14:01.857775  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.858880  9627 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:01.859795  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.860895  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:01.861202  7178 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:01.864583  9318 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:01.865707  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.866856  7332 raft_consensus.cc:2368] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:14:01.859086  9613 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.868644  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:01.869451  7260 raft_consensus.cc:2376] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4. Re-sending same reply.
I20260709 13:14:01.806579  9594 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.813710  9456 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:01.872473  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.874185  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.876946  7260 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
W20260709 13:14:01.878320  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 161966us
I20260709 13:14:01.834992  9506 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:01.852411  9270 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:01.890044  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:01.893206  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.893395  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:01.901378  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:01.903306  7181 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:01.904568  7327 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:14:01.875903  9594 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:01.911010  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:01.909566  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:01.906117  9613 raft_consensus.cc:2764] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:14:01.921506  7181 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:01.913609  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:01.930823  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:01.932683  7181 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
W20260709 13:14:01.934298  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 98723.3us
I20260709 13:14:01.938122  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:01.940146  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:01.947177  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 115194us
I20260709 13:14:01.947983  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:01.949725  7893 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:14:01.949478  7152 leader_election.cc:336] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.922s (SENT)
I20260709 13:14:01.950194  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:01.952462  7152 connection.cc:256] RPC call timeout handler was delayed by -2.4920148129999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 13:14:01.954407  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:01.952996  7152 leader_election.cc:336] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.048s (SENT)
I20260709 13:14:01.942481  9270 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:01.956645  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:01.949935  9548 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:01.949239  9508 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:01.915794  9506 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.948545  9422 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:01.975232  7152 connection.cc:256] RPC call timeout handler was delayed by -2.3364705210001375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
W20260709 13:14:01.960940  9629 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.129s	user 0.001s	sys 0.004s
I20260709 13:14:01.972708  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:01.987713  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:01.976212  9634 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.971760  9593 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:01.981678  9456 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:01.955605  8986 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:01.976198  9198 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:01.984642  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44584.7us
I20260709 13:14:01.990370  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:01.948666  9620 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:01.977552  9656 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:01.975857  7152 connection.cc:256] RPC call timeout handler was delayed by -2.1820040269999481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3009s for a response
W20260709 13:14:02.019853  7152 connection.cc:256] RPC call timeout handler was delayed by -2.1770148129999143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 13:14:02.000063  9673 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:14:02.020830  7152 connection.cc:256] RPC call timeout handler was delayed by -2.1716585520000535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
W20260709 13:14:02.021432  7152 connection.cc:256] RPC call timeout handler was delayed by -2.1320585519999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:14:02.021813  7152 connection.cc:256] RPC call timeout handler was delayed by -2.111358551999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:14:02.022163  7152 connection.cc:256] RPC call timeout handler was delayed by -1.9778178830001707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 13:14:02.022495  7152 connection.cc:256] RPC call timeout handler was delayed by -1.6777492410001287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:14:02.022876  7152 connection.cc:256] RPC call timeout handler was delayed by -1.5893679069999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 13:14:02.023213  7152 connection.cc:256] RPC call timeout handler was delayed by -1.4138585519999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2682s for a response
I20260709 13:14:02.023902  7329 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:14:02.020165  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2135) took 2281 ms. Trace:
I20260709 13:14:02.015661  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:02.023871  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 276) took 2287 ms. Trace:
I20260709 13:14:02.025660  7257 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.025384  7261 rpcz_store.cc:276] 0709 13:13:59.738937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.616491 (+877554us) service_pool.cc:224] Handling call
0709 13:14:00.616837 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:01.306789 (+689952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.306834 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:01.307402 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 13:14:01.396314 (+ 88912us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:01.396376 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.019696 (+623320us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b5400059454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:02.019747 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:02.019795 (+    48us) raft_consensus.cc:1685] finished
0709 13:14:02.019807 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.020062 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1697,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":1411976064,"thread_start_us":88524,"threads_started":1,"wal-append.queue_time_us":134412}
I20260709 13:14:02.025607  7256 rpcz_store.cc:276] 0709 13:13:59.736849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.804218 (+ 67369us) service_pool.cc:224] Handling call
0709 13:13:59.804619 (+   401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:00.377030 (+572411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:00.377072 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:00.377726 (+   654us) log.cc:844] Serialized 52 byte log entry
0709 13:14:00.755565 (+377839us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:00.828937 (+ 73372us) log.cc:844] Serialized 14 byte log entry
0709 13:14:00.831518 (+  2581us) log.cc:844] Serialized 14 byte log entry
0709 13:14:00.834539 (+  3021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.834656 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:01.871812 (+1037156us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:02.023641 (+151829us) raft_consensus.cc:1685] finished
0709 13:14:02.023664 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.023807 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":73985,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":85307,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":233,"spinlock_wait_cycles":36486528,"thread_start_us":292371,"threads_started":1,"wal-append.queue_time_us":413273}
I20260709 13:14:02.032245  9620 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:02.032964  7152 connection.cc:256] RPC call timeout handler was delayed by -1.0205494970000473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3004s for a response
I20260709 13:14:02.033360  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:02.020615  7260 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:14:02.036777  9557 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:02.037187  9642 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:02.037854  9642 consensus_queue.cc:1243] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:14:02.039808  9557 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:02.041015  9612 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.506s	user 0.002s	sys 0.000s
I20260709 13:14:02.041617  7257 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:14:02.042594  9674 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:14:02.043303  9557 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:02.045151  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:02.046288  9557 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:02.046521  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.048230  9557 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:02.048388  9672 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.048856  9482 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:02.058243  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.049522  9620 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:02.050530  9466 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.996533  9634 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.051421  7225 leader_election.cc:400] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:14:02.052464  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:02.061028  7225 leader_election.cc:403] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:02.055320  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:02.048991  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61373us
I20260709 13:14:02.025662  9469 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:02.059788  7152 leader_election.cc:400] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
I20260709 13:14:02.051154  7895 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 8: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:02.061691  7257 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:14:02.061111  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:02.063896  7254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1203) took 2601 ms (client timeout 2209 ms). Trace:
I20260709 13:14:02.060643  9466 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:02.070990  9618 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.071642  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.072813  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:02.033996  9673 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:02.073827  9466 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.074141  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.074873  7260 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:02.074601  9673 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.075762  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.076342  7260 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:02.077147  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.077798  9466 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:02.078150  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:02.078866  7260 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:02.055860  9431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.284s	user 0.004s	sys 0.027s
W20260709 13:14:02.064263  7254 rpcz_store.cc:269] 0709 13:13:59.462148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.468909 (+  6761us) service_pool.cc:224] Handling call
0709 13:14:02.060960 (+2592051us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b5800003098. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:14:02.063829 (+  2869us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10918784}
I20260709 13:14:02.063040  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.086414  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.087926  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.072952  9627 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:02.088531  7254 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:14:02.097602  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.098227  7254 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:02.083196  8986 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:02.054476  9467 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:02.020584  9594 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:02.085675  9431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.318s	user 0.004s	sys 0.028s
I20260709 13:14:02.099761  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:02.024034  9591 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:02.065305  9620 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.085832  9618 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5.
I20260709 13:14:02.109439  9634 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:02.109643  7890 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:02.110101  9634 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:02.110821  9642 consensus_queue.cc:1059] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:02.111959  9634 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:02.112325  9634 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:02.113131  9634 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:02.116232  9620 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.118682  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:02.119421  9602 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 1.595s	user 0.003s	sys 0.000s
I20260709 13:14:02.120337  7261 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:02.121649  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2137) took 2382 ms. Trace:
I20260709 13:14:02.121848  7893 raft_consensus.cc:2368] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5.
I20260709 13:14:02.122087  7253 rpcz_store.cc:276] 0709 13:13:59.739404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.866164 (+1126760us) service_pool.cc:224] Handling call
0709 13:14:00.866513 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.237524 (+371011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.237556 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:01.237629 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:01.237696 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.121410 (+883714us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400219dd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:02.121456 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.121577 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852748160}
I20260709 13:14:02.123423  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1248) took 1287 ms. Trace:
I20260709 13:14:02.123792  7334 rpcz_store.cc:276] 0709 13:14:00.835731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.835877 (+   146us) service_pool.cc:224] Handling call
0709 13:14:00.836205 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.294528 (+458323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.123207 (+828679us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5400278154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:02.123366 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836136832}
I20260709 13:14:02.124825  9456 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:02.124943  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.129393  7330 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:02.129405  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 255) took 1208 ms. Trace:
I20260709 13:14:02.130357  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:02.134227  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:02.135035  9482 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:02.135603  9482 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:02.136351  9618 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:02.136533  9434 raft_consensus.cc:1064] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:14:02.137912  9482 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:02.141049  7327 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:02.138185  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 270) took 2698 ms. Trace:
I20260709 13:14:02.130438  7336 rpcz_store.cc:276] 0709 13:14:00.920740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.121267 (+200527us) service_pool.cc:224] Handling call
0709 13:14:02.106466 (+985199us) spinlock_profiling.cc:243] Waited 64 ms on lock 0x7b540013e054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:02.129346 (+ 22880us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147088768}
I20260709 13:14:02.149658  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:02.150951  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:02.151546  7181 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:02.152132  7260 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:14:02.155342  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 64978.4us
I20260709 13:14:02.150484  7184 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 4: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:02.142308  7259 rpcz_store.cc:276] 0709 13:13:59.439966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.466729 (+ 26763us) service_pool.cc:224] Handling call
0709 13:14:02.061904 (+2595175us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b5800003098. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:14:02.062091 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.062302 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:02.062533 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 13:14:02.137848 (+ 75315us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:02.137906 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:02.137960 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.138020 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.138132 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":513,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":776,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":9329408,"thread_start_us":71766,"threads_started":1}
I20260709 13:14:02.130268  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1251) took 1291 ms. Trace:
W20260709 13:14:02.139187  9680 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
I20260709 13:14:02.065119  9672 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:02.166906  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:02.173403  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 110437us
I20260709 13:14:02.174093  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:02.174245  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:02.168879  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:02.174934  7183 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:02.175211  7184 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.175459  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.178542  7152 leader_election.cc:400] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5.
I20260709 13:14:02.179682  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.180853  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:02.181854  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.169042  7257 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:02.190923  9506 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.194831  7181 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:02.184567  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.146615  9548 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:02.205019  7299 leader_election.cc:400] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5.
I20260709 13:14:02.205363  7299 leader_election.cc:403] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:14:02.187319  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:02.207273  7259 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.208005  9591 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:02.208948  9506 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:02.210858  9645 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.211251  9506 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:02.212471  9548 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:02.213202  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.213403  9548 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.215077  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 558) took 1326 ms. Trace:
I20260709 13:14:02.215489  7891 rpcz_store.cc:276] 0709 13:14:00.888759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.888925 (+   166us) service_pool.cc:224] Handling call
0709 13:14:00.920665 (+ 31740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.265838 (+345173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.265871 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:01.265911 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:01.265943 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.214861 (+948918us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400661554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:02.214905 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.215021 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793341696}
I20260709 13:14:02.120366  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:02.191485  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.160758  7333 rpcz_store.cc:276] 0709 13:14:00.838413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.838539 (+   126us) service_pool.cc:224] Handling call
0709 13:14:02.130101 (+1291562us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54001b8d54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:02.130215 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158855936}
I20260709 13:14:02.103099  9467 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:02.220979  9467 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:02.172228  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.221707  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.221944  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1263) took 1029 ms. Trace:
I20260709 13:14:02.197057  7302 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:02.223289  7335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 245) took 3146 ms (client timeout 3010 ms). Trace:
W20260709 13:14:02.223735  7335 rpcz_store.cc:269] 0709 13:13:59.076461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.076687 (+   226us) service_pool.cc:224] Handling call
0709 13:14:02.223087 (+3146400us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b5400421654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:02.223219 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4811659520}
I20260709 13:14:02.224848  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:02.225319  9644 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:02.226094  9644 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:02.230607  7184 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:14:02.200539  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 119432us
I20260709 13:14:02.188036  9688 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:02.204617  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:02.146999  8986 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:02.222282  7336 rpcz_store.cc:276] 0709 13:14:01.193066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.171917 (+978851us) service_pool.cc:224] Handling call
0709 13:14:02.221885 (+ 49968us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.235281  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:02.236675  7180 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:02.234575  7259 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:14:02.314883  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 79684.6us
I20260709 13:14:02.238736  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:02.318734  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 80135.6us
I20260709 13:14:02.237964  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:02.320178  7182 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:02.269662  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:02.323691  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.354494  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 258) took 1037 ms. Trace:
I20260709 13:14:02.264211  7332 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:14:02.370986  7334 rpcz_store.cc:276] 0709 13:14:01.316781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.237081 (+920300us) service_pool.cc:224] Handling call
0709 13:14:02.354412 (+117331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.369623  7179 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:02.373186  7179 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:02.242350  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 251) took 1760 ms. Trace:
I20260709 13:14:02.203907  9204 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:02.374485  7328 rpcz_store.cc:276] 0709 13:14:00.482106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.482234 (+   128us) service_pool.cc:224] Handling call
0709 13:14:00.486703 (+  4469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:00.861325 (+374622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.242075 (+1380750us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b540013d154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:02.242290 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859340672}
I20260709 13:14:02.375903  7150 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:02.372074  9618 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:02.373997  7179 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.382926  7179 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:02.386152  7180 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:02.375591  7183 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
W20260709 13:14:02.235318  9664 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:02.237914  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:02.244484  9689 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:02.376368  9426 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.393285  9426 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.386823  9639 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:02.397924  9639 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:02.398358  9639 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.238354  9688 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:02.374173  9431 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:02.229283  9691 raft_consensus.cc:2764] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:14:02.402863  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:02.238955  9506 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.376571  9681 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:02.412786  7179 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:14:02.414399  7336 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:02.255072  9644 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.379262  9673 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:14:02.418915  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.422144  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1282) took 1086 ms. Trace:
I20260709 13:14:02.422591  7334 rpcz_store.cc:276] 0709 13:14:01.335825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.407620 (+1071795us) service_pool.cc:224] Handling call
0709 13:14:02.422082 (+ 14462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.420011  7179 pending_rounds.cc:85] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 1
W20260709 13:14:02.418320  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 233797us
I20260709 13:14:02.425805  7152 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.236651  9594 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:02.426496  7179 pending_rounds.cc:107] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:14:02.429167  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1252) took 1590 ms. Trace:
I20260709 13:14:02.433379  7179 raft_consensus.cc:2889] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:02.434149  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1951) took 2062 ms. Trace:
I20260709 13:14:02.432225  7331 rpcz_store.cc:276] 0709 13:14:00.838754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.847941 (+  9187us) service_pool.cc:224] Handling call
0709 13:14:00.848360 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:01.122666 (+274306us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:01.187230 (+ 64564us) log.cc:844] Serialized 14 byte log entry
0709 13:14:01.250198 (+ 62968us) log.cc:844] Serialized 14 byte log entry
0709 13:14:01.275605 (+ 25407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:01.275662 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:01.275700 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.428863 (+1153163us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400253354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:02.428928 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.429101 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1520958,"prepare.queue_time_us":130515,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":53479,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":1428807,"spinlock_wait_cycles":630236928,"thread_start_us":104248,"threads_started":2,"wal-append.queue_time_us":61715,"wal-append.run_cpu_time_us":1511,"wal-append.run_wall_time_us":1001829}
I20260709 13:14:02.436049  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.436655  7331 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:02.437573  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:02.438375  9541 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:14:02.439699  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.440367  7260 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:14:02.438416  7331 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:14:02.442217  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:02.417999  9431 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:02.428778  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.434485  7179 rpcz_store.cc:276] 0709 13:14:00.372220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.455962 (+ 83742us) service_pool.cc:224] Handling call
0709 13:14:00.456264 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.369478 (+1913214us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54001485a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece923e1c0 00007fece923f231 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c
0709 13:14:02.433893 (+ 64415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.434104 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786620288}
I20260709 13:14:02.445662  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.451818  9426 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:02.452277  9620 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.428622  8986 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:02.448053  9645 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5.
I20260709 13:14:02.417603  9681 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:02.463305  9687 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:14:02.465137  9681 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:02.475240  9672 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:02.476114  9685 log.cc:927] Time spent T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:14:02.476476  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1243) took 2696 ms. Trace:
I20260709 13:14:02.476866  7330 rpcz_store.cc:276] 0709 13:13:59.780359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.780501 (+   142us) service_pool.cc:224] Handling call
0709 13:13:59.780817 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.138899 (+2358082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.476223 (+337324us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b5400288cd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:02.476404 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5400717696}
I20260709 13:14:02.478097  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:02.484920  9422 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.000s
I20260709 13:14:02.485385  9422 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:02.487263  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:02.488047  7332 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:02.484936  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 257) took 1168 ms. Trace:
I20260709 13:14:02.490618  7329 rpcz_store.cc:276] 0709 13:14:01.316502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.535712 (+219210us) service_pool.cc:224] Handling call
0709 13:14:02.484748 (+949036us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b5400253854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:02.484875 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117118336}
I20260709 13:14:02.478613  7330 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:02.500417  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 71705us
I20260709 13:14:02.501830  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:02.507050  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.508411  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1262) took 1315 ms. Trace:
I20260709 13:14:02.509918  7336 rpcz_store.cc:276] 0709 13:14:01.192657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.426836 (+1234179us) service_pool.cc:224] Handling call
0709 13:14:02.508175 (+ 81339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.510447  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.511587  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.512197  7329 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:14:02.512506  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.433785  9624 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:02.514918  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.519366  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1281) took 1188 ms. Trace:
I20260709 13:14:02.519721  7329 rpcz_store.cc:276] 0709 13:14:01.330999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.512812 (+1181813us) service_pool.cc:224] Handling call
0709 13:14:02.519302 (+  6490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.522895  7335 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:02.515568  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.516693  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:02.533810  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:02.534188  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 368) took 1065 ms. Trace:
I20260709 13:14:02.534543  7892 rpcz_store.cc:276] 0709 13:14:01.468687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.468951 (+   264us) service_pool.cc:224] Handling call
0709 13:14:02.516530 (+1047579us) spinlock_profiling.cc:243] Waited 887 us on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:14:02.534126 (+ 17596us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2041216}
I20260709 13:14:02.542161  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:02.537765  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1256) took 1157 ms. Trace:
I20260709 13:14:02.543118  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1264) took 1349 ms. Trace:
I20260709 13:14:02.544781  7861 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:02.558516  7336 rpcz_store.cc:276] 0709 13:14:01.379895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.515060 (+1135165us) service_pool.cc:224] Handling call
0709 13:14:02.537591 (+ 22531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.419142  9506 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.559973  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.560745  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1278) took 1256 ms. Trace:
I20260709 13:14:02.561022  7336 rpcz_store.cc:276] 0709 13:14:01.304459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.559693 (+1255234us) service_pool.cc:224] Handling call
0709 13:14:02.560691 (+   998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.561631  9506 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:02.558650  7334 rpcz_store.cc:276] 0709 13:14:01.193494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.427620 (+1234126us) service_pool.cc:224] Handling call
0709 13:14:02.543055 (+115435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.513837  9642 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:02.563758  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:02.513254  9688 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:14:02.564839  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.518540  9241 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.561854  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:02.573278  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1272) took 1270 ms. Trace:
I20260709 13:14:02.573809  7336 rpcz_store.cc:276] 0709 13:14:01.302826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.561613 (+1258787us) service_pool.cc:224] Handling call
0709 13:14:02.573214 (+ 11601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.576278  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1262) took 1104 ms. Trace:
W20260709 13:14:02.558840  9614 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.726s	user 0.006s	sys 0.001s
I20260709 13:14:02.582098  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:02.583168  7181 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:02.586951  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.576665  7327 rpcz_store.cc:276] 0709 13:14:01.472416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.909223 (+436807us) service_pool.cc:224] Handling call
0709 13:14:02.576064 (+666841us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54001b9254. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:02.576223 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501249792}
W20260709 13:14:02.570430  9692 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:14:02.568827  9243 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:02.590840  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.536720  9422 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:14:02.590689  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.598042  7179 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:02.599509  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1264) took 1111 ms. Trace:
I20260709 13:14:02.599967  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1257) took 1425 ms. Trace:
I20260709 13:14:02.600102  7334 rpcz_store.cc:276] 0709 13:14:01.487718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.563452 (+1075734us) service_pool.cc:224] Handling call
0709 13:14:02.599422 (+ 35970us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.585250  9549 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:02.585896  9624 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:02.606273  9243 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:02.607353  9243 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:02.592522  9434 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:02.604398  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1265) took 1406 ms. Trace:
I20260709 13:14:02.613392  7336 rpcz_store.cc:276] 0709 13:14:01.198361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.590617 (+1392256us) service_pool.cc:224] Handling call
0709 13:14:02.604310 (+ 13693us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.605396  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:02.615877  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1261) took 1160 ms. Trace:
I20260709 13:14:02.616289  7335 rpcz_store.cc:276] 0709 13:14:01.455573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.224564 (+768991us) service_pool.cc:224] Handling call
0709 13:14:02.615709 (+391145us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540032aad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:02.615818 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599280000}
I20260709 13:14:02.616914  7334 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:02.617465  7335 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:02.617537  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1250) took 1453 ms. Trace:
I20260709 13:14:02.618158  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1252) took 1452 ms. Trace:
I20260709 13:14:02.619721  9639 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.619978  7335 rpcz_store.cc:276] 0709 13:14:01.166031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.617027 (+1450996us) service_pool.cc:224] Handling call
0709 13:14:02.617295 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.617937 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.618100 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.624367  7891 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:02.624688  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:02.625517  9591 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:02.626734  7892 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:02.627388  9591 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:02.627967  9591 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:02.628419  9591 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:02.628500  9634 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.635704  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:02.636371  7186 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.637292  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:02.605695  7332 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:02.569806  9467 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:14:02.638988  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.639249  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1267) took 1036 ms. Trace:
I20260709 13:14:02.639629  7332 rpcz_store.cc:276] 0709 13:14:01.602429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.486898 (+884469us) service_pool.cc:224] Handling call
0709 13:14:02.639188 (+152290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.640906  7332 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:14:02.618043  7334 rpcz_store.cc:276] 0709 13:14:01.164014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.616290 (+1452276us) service_pool.cc:224] Handling call
0709 13:14:02.616590 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.617302 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.617484 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.642872  7335 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:02.643210  7330 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:02.643764  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1260) took 1224 ms. Trace:
I20260709 13:14:02.644197  7330 rpcz_store.cc:276] 0709 13:14:01.419112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.477830 (+1058718us) service_pool.cc:224] Handling call
0709 13:14:02.643705 (+165875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.645404  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.645167  7334 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:02.646345  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1271) took 1344 ms. Trace:
I20260709 13:14:02.646683  7334 rpcz_store.cc:276] 0709 13:14:01.302462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.643051 (+1340589us) service_pool.cc:224] Handling call
0709 13:14:02.645011 (+  1960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.646126 (+  1115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.646296 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.641469  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1269) took 1402 ms. Trace:
I20260709 13:14:02.647769  7332 rpcz_store.cc:276] 0709 13:14:01.238724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.640382 (+1401658us) service_pool.cc:224] Handling call
0709 13:14:02.640695 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:02.641249 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.641425 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.600731  7327 rpcz_store.cc:276] 0709 13:14:01.174516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.590431 (+1415915us) service_pool.cc:224] Handling call
0709 13:14:02.599886 (+  9455us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.650238  7327 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:02.650871  9204 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:02.653007  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1254) took 1288 ms. Trace:
I20260709 13:14:02.652946  9204 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:02.653400  7327 rpcz_store.cc:276] 0709 13:14:01.364451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.649538 (+1285087us) service_pool.cc:224] Handling call
0709 13:14:02.649975 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.652739 (+  2764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.652952 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.654254  9204 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:02.654808  9591 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:02.655608  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:02.645220  7330 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:02.641785  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:02.640264  9625 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:02.659021  7327 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:02.650725  9639 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:02.658277  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1276) took 1354 ms. Trace:
I20260709 13:14:02.657768  9591 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:02.659667  7330 rpcz_store.cc:276] 0709 13:14:01.303889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.644827 (+1340938us) service_pool.cc:224] Handling call
0709 13:14:02.645061 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.658024 (+ 12963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.658223 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15232}
I20260709 13:14:02.659614  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1255) took 1290 ms. Trace:
I20260709 13:14:02.662029  7327 rpcz_store.cc:276] 0709 13:14:01.369207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.654282 (+1285075us) service_pool.cc:224] Handling call
0709 13:14:02.654624 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.659392 (+  4768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.659560 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.669852  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1258) took 1267 ms. Trace:
I20260709 13:14:02.671738  7327 rpcz_store.cc:276] 0709 13:14:01.402022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.664252 (+1262230us) service_pool.cc:224] Handling call
0709 13:14:02.664552 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.669527 (+  4975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:02.669556 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:02.669600 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:02.669633 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.669691 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.669797 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.603935  9549 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:02.677188  7334 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:02.589511  9431 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.664920  9624 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:02.691427  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 256) took 1375 ms. Trace:
I20260709 13:14:02.691987  7332 rpcz_store.cc:276] 0709 13:14:01.316227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.648759 (+1332532us) service_pool.cc:224] Handling call
0709 13:14:02.690969 (+ 42210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.691139 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:02.691161 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:02.691196 (+    35us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:02.691226 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.691280 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.691378 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.687839  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1277) took 1383 ms. Trace:
I20260709 13:14:02.699121  7334 rpcz_store.cc:276] 0709 13:14:01.304211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.647482 (+1343271us) service_pool.cc:224] Handling call
0709 13:14:02.676866 (+ 29384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.687571 (+ 10705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.687781 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.693912  7329 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:02.697549  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:02.703595  7150 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:02.681393  7186 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
W20260709 13:14:02.707043  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 143404us
I20260709 13:14:02.712739  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:02.713441  7327 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:02.688565  9549 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.730844  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:02.736182  9624 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:02.675966  9402 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:14:02.684058  9594 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:14:02.750087  7332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
W20260709 13:14:02.737906  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 82372us
I20260709 13:14:02.706707  9593 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:02.736445  8986 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:14:02.737010  9639 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:02.762032  9704 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:02.762318  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:02.765195  9703 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:02.767551  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 255097us
I20260709 13:14:02.743968  9534 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:02.775852  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.753163  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:02.772090  7327 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:02.799722  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:02.807238  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54211.8us
I20260709 13:14:02.809489  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.809540  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.784346  9534 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.811506  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:02.776790  9639 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:02.776046  9593 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:02.804219  9624 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.804661  9422 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:02.828963  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:02.829483  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 67181.9us
I20260709 13:14:02.814293  8986 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:02.821614  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:02.837766  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 254) took 1939 ms. Trace:
I20260709 13:14:02.838559  9639 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:02.858667  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 126310us
W20260709 13:14:02.861132  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44175.6us
I20260709 13:14:02.808988  9697 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:14:02.861913  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:14:02.846593  9699 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:14:02.847329  9696 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:14:02.859351  7336 rpcz_store.cc:276] 0709 13:14:00.898326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.614130 (+1715804us) service_pool.cc:224] Handling call
0709 13:14:02.614463 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:02.614804 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:02.614830 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:02.615324 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:14:02.741157 (+125833us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:02.741207 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.741274 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:02.837523 (+ 96249us) raft_consensus.cc:1685] finished
0709 13:14:02.837545 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.837703 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4126,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":123824,"threads_started":1,"wal-append.queue_time_us":193483}
I20260709 13:14:02.869822  7336 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:02.870241  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 259) took 1380 ms. Trace:
I20260709 13:14:02.870422  7336 rpcz_store.cc:276] 0709 13:14:01.489869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.869417 (+1379548us) service_pool.cc:224] Handling call
0709 13:14:02.869704 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.870073 (+   369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.870204 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.850917  9701 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:02.855506  9688 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:02.857255  7327 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:14:02.822139  9421 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:02.822328  9534 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.876377  8986 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:02.863101  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:02.857983  9241 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:02.871455  9594 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:02.866052  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.828029  9422 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:02.875092  9688 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:02.883302  9422 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.883896  9688 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.885162  9688 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.885082  9593 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.888350  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1257) took 1492 ms. Trace:
I20260709 13:14:02.889532  9620 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:02.888795  7330 rpcz_store.cc:276] 0709 13:14:01.395792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.660915 (+1265123us) service_pool.cc:224] Handling call
0709 13:14:02.661251 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:02.675895 (+ 14644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:02.675942 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:02.678070 (+  2128us) log.cc:844] Serialized 26 byte log entry
0709 13:14:02.808378 (+130308us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:02.808418 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.808487 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:02.888110 (+ 79623us) raft_consensus.cc:1685] finished
0709 13:14:02.888131 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.888287 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14184,"raft.queue_time_us":17795,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":129909,"threads_started":1,"wal-append.queue_time_us":171906}
W20260709 13:14:02.849745  9677 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.820s	user 0.017s	sys 0.000s
I20260709 13:14:02.872710  7257 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:02.898337  7334 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:02.869357  9402 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:02.830751  9702 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:02.875509  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1259) took 1469 ms. Trace:
I20260709 13:14:02.914920  7327 rpcz_store.cc:276] 0709 13:14:01.406395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.856664 (+1450269us) service_pool.cc:224] Handling call
0709 13:14:02.856998 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:02.875279 (+ 18281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.875423 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.916615  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1268) took 1202 ms. Trace:
I20260709 13:14:02.916970  7327 rpcz_store.cc:276] 0709 13:14:01.714047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.915786 (+1201739us) service_pool.cc:224] Handling call
0709 13:14:02.916104 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.916279 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:02.916307 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:02.916346 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:02.916378 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.916430 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.916549 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.918522  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1269) took 1162 ms. Trace:
I20260709 13:14:02.881150  9594 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:02.919008  7327 rpcz_store.cc:276] 0709 13:14:01.755730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.917890 (+1162160us) service_pool.cc:224] Handling call
0709 13:14:02.918168 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.918318 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:02.918333 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:02.918360 (+    27us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:02.918381 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.918412 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.918485 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.905612  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:02.920781  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.922081  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:02.923874  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:02.900655  7150 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:02.907280  7334 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:02.925436  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1283) took 1265 ms. Trace:
I20260709 13:14:02.925863  7334 rpcz_store.cc:276] 0709 13:14:01.660277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.901299 (+1241022us) service_pool.cc:224] Handling call
0709 13:14:02.907029 (+  5730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.925169 (+ 18140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.925379 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.874387  9701 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:02.872861  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 260) took 1322 ms. Trace:
I20260709 13:14:02.915540  9433 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:02.912340  9402 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:02.928346  7336 rpcz_store.cc:276] 0709 13:14:01.550199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.872095 (+1321896us) service_pool.cc:224] Handling call
0709 13:14:02.872405 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.872555 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:02.872578 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:02.872617 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:02.872646 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.872691 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.872812 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:02.920950  9594 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:02.924783  9456 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:14:02.934269  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 105362us
I20260709 13:14:02.929280  9701 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:02.932289  9644 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:02.929111  9645 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:02.920374  9421 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:14:02.932647  9402 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:02.946334  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1265) took 1385 ms. Trace:
I20260709 13:14:02.936656  9241 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:02.945899  7228 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:02.953092  7332 raft_consensus.cc:606] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:02.953766  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:02.954092  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.955535  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:02.955649  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:02.930310  9466 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:02.947242  9644 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.960512  7186 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:02.961778  9506 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:14:02.963498  7178 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:02.961042  9713 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.971709  9713 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:02.973402  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.973845  9713 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:02.958913  9426 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:02.945725  9456 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:02.958570  9241 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:02.974668  9426 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:02.975206  9426 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:02.975519  9241 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.979580  9506 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:02.975519  9456 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:02.978389  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1254) took 1810 ms. Trace:
I20260709 13:14:02.984174  7335 rpcz_store.cc:276] 0709 13:14:01.168227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.620773 (+1452546us) service_pool.cc:224] Handling call
0709 13:14:02.642708 (+ 21935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.643273 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.978173 (+334900us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b540038c7d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:02.978320 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49638272}
I20260709 13:14:02.985960  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:02.989338  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:02.991235  7257 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:14:02.992761  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:02.993058  7255 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:14:02.973863  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.997021  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:02.997303  7186 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:02.997711  7178 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:14:02.998762  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:03.001403  7181 pending_rounds.cc:85] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 2
I20260709 13:14:03.001735  7181 pending_rounds.cc:107] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:14:03.001986  7181 raft_consensus.cc:2889] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:03.003201  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:02.961119  9681 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:02.983574  9644 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:03.012835  7256 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:14:03.019315  9673 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:03.009594  7187 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:03.026218  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:03.007144  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:03.029521  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:03.037129  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:03.035778  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:03.046917  7255 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:03.048199  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:03.055332  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 48279.4us
I20260709 13:14:03.059434  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:03.054209  9673 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:03.061793  7335 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:03.004616  9422 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:03.051975  9506 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:03.096027  7888 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:03.096772  9402 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:03.097285  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:03.069547  9434 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:14:03.100805  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2140) took 2700 ms. Trace:
I20260709 13:14:03.071801  9433 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:02.950865  7330 rpcz_store.cc:276] 0709 13:14:01.561012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.890270 (+1329258us) service_pool.cc:224] Handling call
0709 13:14:02.890550 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.890780 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:02.891015 (+   235us) log.cc:844] Serialized 14 byte log entry
0709 13:14:02.945997 (+ 54982us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:02.946046 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:02.946095 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.946161 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.946279 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":534,"prepare.queue_time_us":1116,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":5728,"thread_start_us":53462,"threads_started":1}
I20260709 13:14:03.074962  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1267) took 1871 ms. Trace:
I20260709 13:14:03.103757  7331 rpcz_store.cc:276] 0709 13:14:01.203367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.441966 (+1238599us) service_pool.cc:224] Handling call
0709 13:14:03.074748 (+632782us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b540013d654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:03.074885 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175288064}
I20260709 13:14:03.082918  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:03.104779  7896 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:03.104992  7892 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:03.089375  7329 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:03.061396  9466 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:03.092370  9549 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:03.135483  7334 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:03.097121  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:03.069887  9642 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:03.091529  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:03.131170  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 175569us
W20260709 13:14:03.141281  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49828.8us
W20260709 13:14:03.146204  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49158.4us
I20260709 13:14:03.147033  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:03.101223  7258 rpcz_store.cc:276] 0709 13:14:00.400889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.262485 (+861596us) service_pool.cc:224] Handling call
0709 13:14:01.262927 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:01.296517 (+ 33590us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:01.491328 (+194811us) log.cc:844] Serialized 14 byte log entry
0709 13:14:01.566991 (+ 75663us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:02.499488 (+932497us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b180048b500. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a
0709 13:14:02.925886 (+426398us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:14:02.926332 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:14:03.057625 (+131293us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:03.057688 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:03.057768 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:03.100598 (+ 42830us) raft_consensus.cc:1685] finished
0709 13:14:03.100621 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:03.100747 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33170,"prepare.queue_time_us":177038,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":36447,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":3832,"spinlock_wait_cycles":24979456,"thread_start_us":287215,"threads_started":3,"wal-append.queue_time_us":282362,"wal-append.run_cpu_time_us":1451,"wal-append.run_wall_time_us":1056455}
I20260709 13:14:03.151271  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:03.082365  9426 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:03.170037  7891 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:03.134969  9681 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:03.141325  9642 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:03.148929  9466 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:03.149390  9591 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:14:03.186458  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 149406us
W20260709 13:14:03.187700  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.199723  7255 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:03.203752  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:03.168391  9689 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:03.173261  9198 raft_consensus.cc:1027] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: attempt to promote peer 9a54ecc9fb4541df915f9f8c01e19429: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:14:03.168166  9710 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:03.226024  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:03.178097  9628 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.255991  9628 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:03.148036  9243 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:14:03.260309  9243 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:03.270562  9628 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:03.271571  9628 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:03.272186  9628 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:03.168730  9204 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:14:03.181550  9712 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:14:03.293839  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 106190us
I20260709 13:14:03.224917  9689 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:03.318599  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 149317us
I20260709 13:14:03.185873  9534 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:03.316442  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 153893us
I20260709 13:14:03.193486  9681 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:03.297797  9710 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:03.327117  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:03.294593  9506 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:14:03.306236  9624 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:03.316422  9689 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:03.334388  9717 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:14:03.324118  9466 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:03.344746  7336 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:14:03.355360  9738 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:03.335036  9740 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:14:03.360291  9549 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:03.363361  9426 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:03.363695  9701 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:03.364328  9402 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:03.364856  7187 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:03.293071  9673 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:03.367110  9727 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:14:03.367225  9506 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:03.324215  9712 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:03.375998  9701 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:03.380518  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54453.6us
I20260709 13:14:03.326586  9688 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:14:03.399084  9712 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:03.373245  9681 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:03.385322  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:03.400910  7332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
W20260709 13:14:03.387765  9721 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:03.377151  9740 consensus_queue.cc:1243] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:14:03.388039  9594 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:03.392035  9644 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:03.393656  9426 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:03.396526  9710 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:03.418411  9534 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:03.401791  7332 raft_consensus.cc:606] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:03.412396  9628 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:03.400610  9506 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:14:03.421751  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 218102us
I20260709 13:14:03.438027  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:03.466169  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 139680us
I20260709 13:14:03.504350  7327 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
W20260709 13:14:03.508361  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69725.3us
I20260709 13:14:03.516098  7335 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:03.524829  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 87930.9us
W20260709 13:14:03.525305  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.526579  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:03.528136  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:03.422947  9720 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:03.512878  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:03.410823  9426 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:03.538409  9644 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:03.539783  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:03.435815  9506 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:03.579816  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 258946us
I20260709 13:14:03.593458  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:03.594702  7181 raft_consensus.cc:2410] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:14:03.601397  7181 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:03.549566  9628 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:03.623623  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:03.659430  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 441882us
I20260709 13:14:03.660550  7185 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:03.662170  7181 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:03.670194  9752 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:14:03.650326  9506 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:03.681591  9506 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:03.685901  7332 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:03.677630  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:03.686344  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:03.690595  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:03.691797  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:03.788823  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:03.652658  9469 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:03.674983  9724 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:03.827788  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:03.846148  7255 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:03.846798  9642 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:03.963653  7259 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:14:03.697806  9421 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.152s
I20260709 13:14:03.826048  9724 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.825953  9742 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:03.958801  9728 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:14:03.958417  8986 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.880257  9701 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:03.860373  9747 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:03.974066  9724 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:03.973595  9642 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:03.982420  9594 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:04.040184  9766 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 13:14:04.050060  9689 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.000s
I20260709 13:14:04.045480  9768 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:04.082351  7334 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:04.067011  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:04.068500  7330 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:03.987857  9701 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:03.996448  9506 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:03.988026  8986 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.110025  7331 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:04.060519  9750 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:04.132216  7332 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:04.134125  7328 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:04.082378  9469 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.050956  9768 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.133945  9506 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.176541  9506 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:04.179257  9469 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:04.180285  9628 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.006s
I20260709 13:14:04.181035  7892 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:04.050588  9689 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.185304  9768 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.144807  9748 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.186335  9748 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.188971  9748 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:04.199086  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 361579us
I20260709 13:14:04.190717  9469 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:04.220105  9689 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:04.222462  9701 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:04.257606  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.170989  8986 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:04.262337  7253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.007s	sys 0.014s
W20260709 13:14:04.267915  7253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.007s	sys 0.015s
W20260709 13:14:04.259114  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.259929  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2173) took 1056 ms. Trace:
I20260709 13:14:04.261528  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2171) took 1062 ms. Trace:
I20260709 13:14:04.278020  9506 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.274041  7257 rpcz_store.cc:276] 0709 13:14:03.202930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.380103 (+177173us) service_pool.cc:224] Handling call
0709 13:14:03.381798 (+  1695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:03.382004 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:03.382026 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:03.410228 (+ 28202us) log.cc:844] Serialized 26 byte log entry
0709 13:14:03.618904 (+208676us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:03.618958 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:03.619051 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.258941 (+639890us) raft_consensus.cc:1685] finished
0709 13:14:04.259026 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.259559 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":106575,"threads_started":1,"wal-append.queue_time_us":739735}
W20260709 13:14:04.263793  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.279857  9506 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.263938  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2172) took 1061 ms. Trace:
I20260709 13:14:04.265913  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 582) took 1170 ms. Trace:
I20260709 13:14:04.274221  7258 rpcz_store.cc:276] 0709 13:14:03.201735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.201955 (+   220us) service_pool.cc:224] Handling call
0709 13:14:03.202249 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:03.202469 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:03.202494 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:03.202966 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:14:03.297083 (+ 94117us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:03.297270 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:03.297449 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.260802 (+963353us) raft_consensus.cc:1685] finished
0709 13:14:04.260845 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.261237 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":75969,"threads_started":1,"wal-append.queue_time_us":952657}
I20260709 13:14:04.267259  8986 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:04.332463  7254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.002s	sys 0.009s
W20260709 13:14:04.333921  7254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.003s	sys 0.010s
W20260709 13:14:04.348026  7860 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.026s	sys 0.054s
W20260709 13:14:04.348620  7860 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.026s	sys 0.054s
W20260709 13:14:04.352201  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.003s	sys 0.010s
W20260709 13:14:04.352711  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.003s	sys 0.010s
I20260709 13:14:04.355150  8986 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.351999  9689 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.364264  9506 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.366242  7258 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:04.366864  7258 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:04.370100  7184 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:04.370585  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2169) took 1172 ms. Trace:
I20260709 13:14:04.371033  7253 rpcz_store.cc:276] 0709 13:14:03.198062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.199560 (+  1498us) service_pool.cc:224] Handling call
0709 13:14:03.199888 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:03.200163 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:14:03.673059 (+472896us) log.cc:844] Serialized 14 byte log entry
0709 13:14:04.369760 (+696701us) log.cc:844] Serialized 14 byte log entry
0709 13:14:04.370008 (+   248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:04.370080 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:04.370164 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.370299 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.370523 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26743,"prepare.queue_time_us":115143,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":19558,"raft.run_cpu_time_us":597,"raft.run_wall_time_us":45093,"thread_start_us":1032082,"threads_started":2,"wal-append.queue_time_us":674552}
I20260709 13:14:04.354055  7861 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:04.370405  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.370607  7184 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:04.376107  9733 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:04.358327  9701 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:04.376945  9775 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:04.377861  9701 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.377949  9775 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.296167  7262 rpcz_store.cc:276] 0709 13:14:03.202522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.254138 (+ 51616us) service_pool.cc:224] Handling call
0709 13:14:03.254596 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:03.620819 (+366223us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:03.654533 (+ 33714us) log.cc:844] Serialized 14 byte log entry
0709 13:14:04.059084 (+404551us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:04.059689 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 13:14:04.059853 (+   164us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:04.059901 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.059999 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.263270 (+203271us) raft_consensus.cc:1685] finished
0709 13:14:04.263322 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.263733 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6769,"prepare.queue_time_us":33173,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":118775,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":21345,"thread_start_us":601432,"threads_started":2,"wal-append.queue_time_us":442329}
I20260709 13:14:04.296648  7893 rpcz_store.cc:276] 0709 13:14:03.095374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.098138 (+  2764us) service_pool.cc:224] Handling call
0709 13:14:03.098439 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:03.099969 (+  1530us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:03.619119 (+519150us) log.cc:844] Serialized 14 byte log entry
0709 13:14:04.265060 (+645941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:04.265188 (+   128us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:04.265339 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.265456 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.265649 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1066040,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":260072,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":23943,"thread_start_us":1126087,"threads_started":3,"wal-append.queue_time_us":355751}
I20260709 13:14:04.368428  7258 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.392226  9689 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.397980  9689 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.398993  7184 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.401832  7184 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:04.402757  7260 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.006s	sys 0.032s
W20260709 13:14:04.403183  7260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.007s	sys 0.032s
I20260709 13:14:04.404443  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1225) took 1411 ms. Trace:
I20260709 13:14:04.414304  7258 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:04.417132  7262 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:14:04.421414  7182 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:04.421859  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:04.423207  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 886208us
I20260709 13:14:04.423630  9426 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.424865  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:04.425290  9426 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:04.426086  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.425428  7083 catalog_manager.cc:5697] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.427721  9701 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:04.402396  7895 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:04.403007  8986 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:04.441665  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 88095.7us
I20260709 13:14:04.442379  9625 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:04.398466  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 584) took 1302 ms. Trace:
I20260709 13:14:04.444835  7895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 585) took 1348 ms. Trace:
I20260709 13:14:04.451757  9749 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:04.452318  7083 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.456202  7083 catalog_manager.cc:5697] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 1 to 3, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 3 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:04.462473  9785 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:04.449246  7895 rpcz_store.cc:276] 0709 13:14:03.096314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.109458 (+ 13144us) service_pool.cc:224] Handling call
0709 13:14:04.400883 (+1291425us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:14:04.401405 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:04.429519 (+ 28114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.444736 (+ 15217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5822208}
I20260709 13:14:04.473954  9720 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:04.474840  9785 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.477566  9785 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:04.482764  9774 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:14:04.483312  7180 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:04.449187  7889 rpcz_store.cc:276] 0709 13:14:03.096033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.096157 (+   124us) service_pool.cc:224] Handling call
0709 13:14:03.096471 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:03.096829 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:03.096861 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:03.097387 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:14:04.397302 (+1299915us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b1800192d60. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1
0709 13:14:04.397683 (+   381us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:04.397763 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.397890 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.397969 (+    79us) raft_consensus.cc:1685] finished
0709 13:14:04.397983 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.398304 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":549,"raft.queue_time_us":1094,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5854,"spinlock_wait_cycles":6439680,"thread_start_us":47252,"threads_started":1,"wal-append.queue_time_us":485492}
I20260709 13:14:04.493988  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:04.495070  9775 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.495882  7891 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:04.497300  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 267) took 1829 ms. Trace:
I20260709 13:14:04.497408  9749 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:04.498330  9749 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:04.499501  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 74942.7us
I20260709 13:14:04.501413  9749 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:04.404948  7260 rpcz_store.cc:276] 0709 13:14:02.992875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.993436 (+   561us) service_pool.cc:224] Handling call
0709 13:14:02.993725 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:02.994108 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:03.035505 (+ 41397us) log.cc:844] Serialized 14 byte log entry
0709 13:14:03.156631 (+121126us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:03.173484 (+ 16853us) log.cc:844] Serialized 26 byte log entry
0709 13:14:03.181622 (+  8138us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:03.695212 (+513590us) log.cc:844] Serialized 14 byte log entry
0709 13:14:04.403824 (+708612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.403993 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.404092 (+    99us) raft_consensus.cc:1685] finished
0709 13:14:04.404116 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.404352 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181525,"prepare.queue_time_us":170862,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":3735,"raft.queue_time_us":334272,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":13526,"thread_start_us":1141379,"threads_started":3,"wal-append.queue_time_us":278065}
I20260709 13:14:04.497303  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:04.503556  7896 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:04.498410  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1274) took 1412 ms. Trace:
I20260709 13:14:04.508289  7335 rpcz_store.cc:276] 0709 13:14:03.086246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.099953 (+ 13707us) service_pool.cc:224] Handling call
0709 13:14:03.100265 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:03.516689 (+416424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.497936 (+981247us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54000e10d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:04.498242 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955721088}
I20260709 13:14:04.505648  9720 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:04.510203  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:04.497895  7336 rpcz_store.cc:276] 0709 13:14:02.668140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.939737 (+271597us) service_pool.cc:224] Handling call
0709 13:14:02.942920 (+  3183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:03.351019 (+408099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.496697 (+1145678us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b540013d154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:04.497097 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904298240}
I20260709 13:14:04.521800  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:04.502233  9749 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:14:04.525028  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:04.527787  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:04.532667  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:04.534159  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:04.535079  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:04.536315  9422 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:04.538681  7182 raft_consensus.cc:1217] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 5.3->[]
I20260709 13:14:04.539402  7182 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: [3.2-5.3]
W20260709 13:14:04.539572  9781 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.177s	user 0.002s	sys 0.000s
W20260709 13:14:04.543426  9779 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.195s	user 0.000s	sys 0.002s
I20260709 13:14:04.543721  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:04.551371  9681 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:14:04.551741  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49142.9us
I20260709 13:14:04.552054  9681 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:04.553660  9767 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:04.554005  9768 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:04.555078  9767 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:04.555878  9768 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:04.553609  9681 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.556459  9768 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:04.563831  9742 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:04.551409  9780 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:04.564766  8986 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:04.575363  8986 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.579766  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:04.579958  7888 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:14:04.583248  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1231) took 1546 ms. Trace:
I20260709 13:14:04.578300  8986 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.593760  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:04.595227  7258 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:14:04.595705  7258 pending_rounds.cc:85] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 3
I20260709 13:14:04.559700  9749 consensus_queue.cc:1243] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:14:04.601298  9681 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:04.605613  8986 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:04.606343  8986 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.606865  9557 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:04.607779  7178 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:04.607678  9557 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.608680  8986 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:04.609692  7152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.514s (SENT) [suppressed 9 similar messages]
I20260709 13:14:04.609952  9557 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.611852  9740 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:04.612658  9784 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:04.613703  9740 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:04.613417  9768 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.614288  9740 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:04.615828  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:04.615208  9768 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:04.599208  7258 pending_rounds.cc:107] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:14:04.616899  7258 raft_consensus.cc:2889] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:04.613561  9784 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.578300  9777 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:14:04.620036  9672 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:04.620116  9784 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.620548  9672 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:04.621097  9736 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:04.621838  9672 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.623206  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:04.623466  9672 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:04.624030  7179 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:04.625538  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:04.626525  9751 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:04.618834  9740 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.626966  9751 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:04.631250  9751 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:04.631511  9740 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:04.634922  9591 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:04.635895  9736 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:04.637059  9775 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:04.637449  9775 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:04.638587  9775 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.640321  9711 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:04.640769  9711 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:04.641989  9711 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.643348  9711 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:04.567711  9742 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:04.670686  7896 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:04.669828  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:04.584918  7254 rpcz_store.cc:276] 0709 13:14:03.036344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.036767 (+   423us) service_pool.cc:224] Handling call
0709 13:14:03.050283 (+ 13516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:03.054920 (+  4637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:03.054951 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:03.055448 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:14:03.619602 (+564154us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b180039bd40. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:14:04.449669 (+830067us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:04.469434 (+ 19765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.512665 (+ 43231us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.538663 (+ 25998us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:04.557383 (+ 18720us) raft_consensus.cc:1685] finished
0709 13:14:04.557409 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.583188 (+ 25779us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":943,"raft.queue_time_us":9159,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4154,"spinlock_wait_cycles":70061184,"thread_start_us":718793,"threads_started":1,"wal-append.queue_time_us":1292447}
W20260709 13:14:04.596505  7890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.303s	user 0.029s	sys 0.018s
I20260709 13:14:04.686892  9624 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:04.683656  7890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.392s	user 0.029s	sys 0.019s
I20260709 13:14:04.703132  7184 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:04.704435  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1457) took 1727 ms. Trace:
I20260709 13:14:04.691828  9624 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.705101  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:04.705271  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 266) took 1916 ms. Trace:
I20260709 13:14:04.705793  9422 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:04.729417  7185 rpcz_store.cc:276] 0709 13:14:02.960178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.960283 (+   105us) service_pool.cc:224] Handling call
0709 13:14:02.960505 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:03.661025 (+700520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.651450 (+990425us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54000eced4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:04.687873 (+ 36423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1609523072}
W20260709 13:14:04.742213  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 132537us
I20260709 13:14:04.707265  9742 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.708678  9701 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:04.713227  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2178) took 1507 ms. Trace:
I20260709 13:14:04.718014  9791 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.717661  9751 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.717411  7083 catalog_manager.cc:5697] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.722059  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 455) took 1376 ms. Trace:
I20260709 13:14:04.723544  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:04.727331  9642 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.010s
I20260709 13:14:04.734314  9557 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:04.734808  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.758073  7182 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:04.758327  9557 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.738382  9777 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:04.730909  7327 rpcz_store.cc:276] 0709 13:14:02.667911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.935228 (+267317us) service_pool.cc:224] Handling call
0709 13:14:02.935664 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:03.504930 (+569266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.581455 (+1076525us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b540038d6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:04.584740 (+  3285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307332352}
I20260709 13:14:04.756170  9742 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:04.755990  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:04.757311  9751 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:04.762518  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 89698.2us
I20260709 13:14:04.752418  7892 rpcz_store.cc:276] 0709 13:14:03.345634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.345867 (+   233us) service_pool.cc:224] Handling call
0709 13:14:03.346260 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:04.181408 (+835148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.721669 (+540261us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54006608d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:04.721902 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919047936}
I20260709 13:14:04.761322  9557 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.771793  7896 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:04.744488  7256 rpcz_store.cc:276] 0709 13:14:03.205613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.469225 (+263612us) service_pool.cc:224] Handling call
0709 13:14:03.469673 (+   448us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:14:03.836111 (+366438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:03.836153 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:14:04.489712 (+653559us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:14:04.529321 (+ 39609us) log.cc:844] Serialized 78 byte log entry
0709 13:14:04.673617 (+144296us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:04.673672 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.683344 (+  9672us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.712732 (+ 29388us) raft_consensus.cc:1685] finished
0709 13:14:04.712750 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.713050 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70936,"raft.queue_time_us":512256,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":29533,"spinlock_wait_cycles":47293824,"thread_start_us":397422,"threads_started":2,"wal-append.queue_time_us":140920}
I20260709 13:14:04.750451  9689 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:04.785343  9644 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:14:04.785867  9713 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:14:04.786545  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:04.787245  7225 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:04.788174  9768 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:04.788934  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:04.791026  9672 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:04.780591  9791 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:04.794021  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 89158.1us
I20260709 13:14:04.795024  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:04.794821  9689 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.795692  9456 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.796336  9456 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.797438  9689 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.788843  8986 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:04.799515  8986 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.801548  8986 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.802518  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:04.803157  9720 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.805436  9720 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.810592  9243 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:14:04.812367  9466 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:04.813112  9466 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.817210  7083 catalog_manager.cc:5697] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 1 to 2, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:04.819651  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1999) took 1818 ms. Trace:
I20260709 13:14:04.820053  7183 rpcz_store.cc:276] 0709 13:14:03.001072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.001239 (+   167us) service_pool.cc:224] Handling call
0709 13:14:03.001494 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:03.098442 (+ 96948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:03.098471 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:03.098511 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:03.098546 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.819223 (+1720677us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b54002b4dd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:04.819290 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.819485 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222498560}
W20260709 13:14:04.823800  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.833971  9785 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:04.837179  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46676.9us
I20260709 13:14:04.837307  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:04.781327  9777 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.798468  9456 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:04.856295  7253 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:04.848619  7083 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 3 to 1, leader changed from <none> to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 1 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.802397  9681 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:04.835897  9785 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.868229  7083 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 1 to 2, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 2 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:14:04.869184  9724 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.843s	user 0.007s	sys 0.011s
I20260709 13:14:04.869712  9724 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:04.871497  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 76646.5us
I20260709 13:14:04.870162  7083 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 2 to 4, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 4 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:04.876614  9624 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:04.878010  9466 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:04.878227  9785 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:04.879556  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:04.881343  9777 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:04.883543  7081 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47556 (request call id 253) took 13780 ms (client timeout 15000 ms). Trace:
I20260709 13:14:04.883590  9681 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:04.884375  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:04.886291  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:04.910831  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.893455  9681 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:04.922649  9534 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:14:04.923692  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 70308.3us
I20260709 13:14:04.925221  7083 catalog_manager.cc:5697] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.904274  9777 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:14:04.928074  7083 catalog_manager.cc:5697] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 1 to 2, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 2 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.934274  9740 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:04.935101  7262 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:14:04.934965  9740 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:04.935503  7262 pending_rounds.cc:85] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 3
I20260709 13:14:04.935751  7262 pending_rounds.cc:107] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:14:04.935988  7262 raft_consensus.cc:2889] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:04.936189  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:04.937203  9740 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:04.937114  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:04.938310  7262 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:04.938361  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:04.939298  7253 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:04.940058  9775 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:04.940363  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:04.945720  9422 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:04.947026  9791 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.947144  9724 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:04.950670  9785 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:04.954720  9720 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.955413  9720 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:04.957851  9720 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.904340  9768 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:04.959899  7253 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:14:04.961035  9793 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
I20260709 13:14:04.961333  7262 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
W20260709 13:14:04.962998  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 43554.4us
W20260709 13:14:04.965514  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.966243  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:04.967048  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:04.967293  7329 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:04.968359  7261 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:04.968238  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:04.968922  7185 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:04.968988  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:04.969982  7330 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:14:04.970181  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 2189) took 1350 ms. Trace:
I20260709 13:14:04.934315  9750 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:04.971009  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:04.971390  7255 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:14:04.971832  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 56105.9us
I20260709 13:14:04.973621  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 297) took 1380 ms. Trace:
I20260709 13:14:04.913861  9456 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:14:04.971388  9750 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:04.976414  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 90261.6us
I20260709 13:14:04.977825  9750 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:04.978746  7259 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:04.979208  7332 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:04.974318  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:04.980393  7254 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:04.974099  7255 rpcz_store.cc:276] 0709 13:14:03.593460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.879422 (+285962us) service_pool.cc:224] Handling call
0709 13:14:04.970919 (+1091497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:04.971938 (+  1019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.973387 (+  1449us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540034b2d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:04.973546 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2509049216}
I20260709 13:14:04.970594  7261 rpcz_store.cc:276] 0709 13:14:03.619722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.691544 (+ 71822us) service_pool.cc:224] Handling call
0709 13:14:04.969908 (+1278364us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540034b2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:04.970085 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2748259584}
W20260709 13:14:04.991783  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 66784.3us
I20260709 13:14:04.946357  9422 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:04.999393  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.009783  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:05.007932  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:14:05.015276  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 106825us
I20260709 13:14:04.986994  9791 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:14:05.030175  7896 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
W20260709 13:14:04.884189  7081 rpcz_store.cc:269] 0709 13:13:51.139049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.159613 (+ 20564us) service_pool.cc:224] Handling call
0709 13:14:04.883274 (+13723661us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:55.607776 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:55.608513 (+   737us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:55.608568 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:13:55.608615 (+    47us) tablet.cc:662] Decoding operations
0709 13:13:55.775692 (+167077us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:55.801415 (+ 25723us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:55.803306 (+  1891us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:13:56.289093 (+485787us) tablet.cc:701] Row locks acquired
0709 13:13:56.289149 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:13:56.289358 (+   209us) write_op.cc:270] Start()
0709 13:13:56.289523 (+   165us) write_op.cc:276] Timestamp: P: 1783602836289288 usec, L: 0
0709 13:13:56.289557 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:13:56.297229 (+  7672us) log.cc:844] Serialized 8669 byte log entry
0709 13:13:56.868750 (+571521us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece61320ac 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b
0709 13:13:57.740968 (+872218us) op_driver.cc:464] REPLICATION: finished
0709 13:13:58.204411 (+463443us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece61320ac 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fececc72ef0
0709 13:13:58.381861 (+177450us) write_op.cc:301] APPLY: starting
0709 13:13:58.383862 (+  2001us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:58.384358 (+   496us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:58.384397 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:58.398442 (+ 14045us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:58.398916 (+   474us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:13:58.398968 (+    52us) write_op.cc:312] APPLY: finished
0709 13:13:58.402050 (+  3082us) log.cc:844] Serialized 152 byte log entry
0709 13:13:58.402265 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:58.402435 (+   170us) write_op.cc:454] Released schema lock
0709 13:13:58.402508 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:58.402931 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:58.405546 (+  2615us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33023,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":620279,"apply.run_cpu_time_us":5882,"apply.run_wall_time_us":37661,"num_ops":22,"prepare.queue_time_us":33084,"prepare.run_cpu_time_us":57937,"prepare.run_wall_time_us":1525829,"raft.queue_time_us":470771,"raft.run_cpu_time_us":26711,"raft.run_wall_time_us":568395,"replication_time_us":1451242,"spinlock_wait_cycles":30359936,"thread_start_us":1709882,"threads_started":4,"wal-append.queue_time_us":839226,"wal-append.run_cpu_time_us":48263,"wal-append.run_wall_time_us":2273574}]]}
I20260709 13:14:05.043533  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:05.033485  7256 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:05.048100  7895 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:14:05.000633  9713 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:05.050836  7257 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:14:05.053825  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 61230.3us
I20260709 13:14:05.025697  9768 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:05.061143  7152 leader_election.cc:336] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.640s (SENT)
I20260709 13:14:05.061746  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:05.074741  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:05.057811  8986 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.076963  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:14:05.078708  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 64170.7us
I20260709 13:14:05.048341  9689 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.078514  7083 catalog_manager.cc:5697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.069526  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:05.084417  9624 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:05.084606  9791 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:05.058287  9713 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.100617  9799 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:14:05.102109  9802 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.107638  9466 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:05.107743  9644 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:05.111729  7182 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:14:05.074162  9768 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.189236  7183 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:14:05.198431  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 92130.1us
I20260709 13:14:05.080853  9557 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:14:05.216864  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 142226us
I20260709 13:14:05.220780  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:05.077944  9422 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.098575  9752 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.183s
W20260709 13:14:05.230320  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 153449us
W20260709 13:14:05.225359  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 164282us
I20260709 13:14:05.231981  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:05.233608  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:05.233567  9456 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:05.236660  9456 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:05.237116  9456 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.237493  9456 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:05.239976  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:05.240245  9644 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.241001  9644 consensus_queue.cc:1243] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:14:05.241580  9434 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:05.242094  9434 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:05.215729  9624 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:05.243610  9624 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.248817  9456 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.250867  9806 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:05.252743  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:05.255649  7187 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:14:05.254979  9456 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:05.256799  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.258133  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:05.259081  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:05.259943  9768 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.260236  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.260844  7179 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:05.261662  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.262176  9747 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.262662  9747 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:05.266153  9795 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.300s	user 0.000s	sys 0.004s
I20260709 13:14:05.222549  9802 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.268513  9802 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.230155  9737 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:14:05.119678  8986 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.273074  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.261703  9713 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.277333  7185 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:05.208674  9701 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.283582  7256 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:05.286192  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.229295  9791 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:14:05.286602  9434 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.228688  9689 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.290403  9469 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:14:05.230801  9784 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:05.291486  9466 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.291893  9784 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.292382  9466 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:05.292589  9777 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:05.292949  9466 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:05.293498  9777 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:05.293883  9777 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:05.293949  9466 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.294899  9777 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.295248  9466 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:05.296139  9777 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:05.279481  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:05.297452  9747 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.297713  9768 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:05.298385  9768 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:05.300653  9768 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.306404  9743 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:05.292364  9784 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:05.290318  9689 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.278964  9799 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:05.313843  7179 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:05.318522  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.281211  9456 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.325354  7178 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:05.353505  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:05.315023  9752 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:05.355794  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.360639  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:05.360670  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.369391  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.370407  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.367938  7180 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:05.371065  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:05.374765  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.401804  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.365818  9713 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:05.372551  9689 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.371292  9752 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:05.409848  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.413911  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:05.315191  9701 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.419059  7187 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:05.368882  9456 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.423075  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:05.408320  9747 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:05.426290  7891 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:05.437829  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.436192  9713 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:05.440127  7180 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:14:05.431136  9747 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.450704  9713 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.451244  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:05.459479  9742 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:05.460186  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.460137  9742 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.460472  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:05.461730  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.462545  9752 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.462996  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.463089  9466 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:05.463778  9434 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.464543  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.465216  7254 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:05.465492  7253 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:05.466673  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.467288  7257 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:05.468777  9742 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.469357  9742 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:05.469940  9742 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.471010  7179 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:14:05.471920  7258 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:05.472590  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.474045  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.474174  9742 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:05.478966  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44821us
I20260709 13:14:05.482566  9557 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:14:05.483062  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.485648  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.443944  8986 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:05.486989  9813 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:14:05.449242  9747 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:05.463749  7255 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:05.428298  9689 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.493875  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.500561  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.501500  7257 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:05.508750  9642 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:05.509449  9642 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:05.517313  9713 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:05.524448  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:05.524736  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.462941  9431 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:14:05.526561  7179 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:05.528923  7185 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:05.537987  7184 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:05.543370  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 73026.7us
I20260709 13:14:05.504189  9799 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:05.492686  9802 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:14:05.550200  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 58771us
I20260709 13:14:05.554263  7259 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:14:05.554788  7259 pending_rounds.cc:85] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 2
I20260709 13:14:05.555071  7259 pending_rounds.cc:107] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:14:05.555352  7259 raft_consensus.cc:2889] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:05.561510  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.562135  7257 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:05.564392  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.565322  7179 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:05.568864  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:05.569556  7181 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:05.553391  9799 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:05.564792  9805 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.467s	user 0.000s	sys 0.004s
I20260709 13:14:05.574208  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:05.575666  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.510581  9642 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.577574  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:05.583709  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.567939  9784 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.591590  9689 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.598498  7184 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:05.579696  9768 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:14:05.604763  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.607699  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.608340  7259 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:14:05.612769  7184 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:14:05.613754  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:05.615303  7257 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:05.616586  9672 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:05.616967  9672 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:05.585309  9713 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:14:05.608685  9456 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:05.618929  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.604065  9768 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:05.614933  9434 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:05.617584  9689 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.621945  9768 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:05.643059  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.644447  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:05.657953  9800 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:05.656276  9784 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.658183  9742 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:05.660475  9742 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.661278  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:05.662092  9800 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:05.662364  9750 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:05.652261  7259 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:05.663911  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:05.655537  9456 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:14:05.664894  9750 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:05.640118  9821 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:14:05.638090  8986 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:05.676507  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:05.651037  9642 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:05.677145  9750 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.677428  7179 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:05.680680  9456 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:05.681123  9456 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:05.681502  9456 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:05.682984  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.682736  9689 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.683717  7254 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:05.684670  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.684938  9689 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:05.639621  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 583) took 2543 ms. Trace:
I20260709 13:14:05.685283  7258 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:14:05.686388  7255 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:05.626788  9747 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.687512  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:05.688313  9747 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:05.688732  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:05.690129  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:05.677152  7329 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:05.691864  7256 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 7. Ops: []
I20260709 13:14:05.662480  9742 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:05.694060  9713 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:05.692634  8986 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:05.704231  8986 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.705690  8986 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:05.667502  9800 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:05.695148  9814 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:05.707095  9814 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:05.706828  9800 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.707486  9814 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:05.709180  9800 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:05.645107  9466 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:14:05.711161  7329 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:05.712288  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:05.715525  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:05.713011  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:05.716781  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:05.717818  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.718469  7259 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:05.719841  9711 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:05.720065  9557 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:05.720537  9711 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:05.721704  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:05.724273  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.639477  9672 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.695312  9802 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:05.729573  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:05.729585  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.730541  9815 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:05.732590  9806 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:05.732501  9785 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:05.733132  9806 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.733517  9806 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:05.731572  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:05.735529  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:05.727296  9713 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:05.741456  9750 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:05.741710  9713 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:05.742158  9713 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:05.742522  9713 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:05.736152  9469 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:05.685526  7890 rpcz_store.cc:276] 0709 13:14:03.095712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.101822 (+  6110us) service_pool.cc:224] Handling call
0709 13:14:03.169384 (+ 67562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:04.534195 (+1364811us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece61320ac 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fece9234060
0709 13:14:04.774376 (+240181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:04.776172 (+  1796us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:04.862800 (+ 86628us) log.cc:844] Serialized 26 byte log entry
0709 13:14:05.059089 (+196289us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:05.059162 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.059486 (+   324us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:05.548750 (+489264us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b24002fd3f8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece5fd59c4 00007fece5fd3acb 00007fece618edc9 00007fece618ea55 00007fece618e09d 00007fece8dc010e 00007fece8dd788c 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221
0709 13:14:05.632214 (+ 83464us) raft_consensus.cc:1685] finished
0709 13:14:05.632238 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:05.639542 (+  7304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49006,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":8896128,"thread_start_us":1635943,"threads_started":2,"wal-append.queue_time_us":208421}
I20260709 13:14:05.746887  9456 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.736860  9747 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:05.748683  9747 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.750310  9799 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.754891  9644 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:05.755214  9645 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:05.755415  9644 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:05.755632  9799 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:05.755973  9644 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:05.756222  9431 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.759502  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.759495  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:05.695909  9689 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:14:05.731019  9802 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:05.783335  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 47883.3us
I20260709 13:14:05.784143  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:05.760422  7259 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:14:05.786075  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 56583.1us
I20260709 13:14:05.771934  9672 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:05.778784  9747 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:05.797514  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 60038.8us
I20260709 13:14:05.811430  9736 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:05.811911  9736 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:05.812865  9736 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.814112  9736 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:05.817198  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:05.817422  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:05.818356  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:05.820001  9832 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:05.820389  9832 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:05.820740  9832 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:05.823140  9456 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:05.783110  9431 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:05.755887  9645 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:05.779969  9802 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:05.789292  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:05.833227  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44419.5us
I20260709 13:14:05.826723  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 309) took 1002 ms. Trace:
W20260709 13:14:05.835511  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.838716  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:05.834235  7260 rpcz_store.cc:276] 0709 13:14:04.824547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.825662 (+  1115us) service_pool.cc:224] Handling call
0709 13:14:04.826080 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:04.834345 (+  8265us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:04.857380 (+ 23035us) log.cc:844] Serialized 14 byte log entry
0709 13:14:04.984733 (+127353us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:04.997291 (+ 12558us) log.cc:844] Serialized 52 byte log entry
0709 13:14:05.009326 (+ 12035us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:05.012029 (+  2703us) log.cc:844] Serialized 14 byte log entry
0709 13:14:05.644929 (+632900us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b180048a8a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:14:05.805234 (+160305us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b180048a8a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fececc343c7 00007fece92469a7 00007fece92560bf 00007fece9256038
0709 13:14:05.805434 (+   200us) log.cc:844] Serialized 14 byte log entry
0709 13:14:05.826400 (+ 20966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.826469 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:05.826509 (+    40us) raft_consensus.cc:1685] finished
0709 13:14:05.826519 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:05.826666 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":786790,"prepare.queue_time_us":815236,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":7632,"raft.queue_time_us":27462,"raft.run_cpu_time_us":566,"raft.run_wall_time_us":15275,"spinlock_wait_cycles":17681024,"thread_start_us":117345,"threads_started":1,"wal-append.queue_time_us":168767}
I20260709 13:14:05.842360  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:05.826153  9799 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:05.891840  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:05.839891  9835 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:05.851078  9815 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:05.844305  9431 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:05.895246  9557 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.912901  7262 pending_rounds.cc:85] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 1
I20260709 13:14:05.915336  7262 pending_rounds.cc:107] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:14:05.915779  7262 raft_consensus.cc:2889] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:05.895705  9747 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:05.923889  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:05.924886  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 86278.6us
I20260709 13:14:05.926395  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:05.842051  8986 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:14:05.901815  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:05.906433  9799 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:05.908038  9835 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:05.840130  9711 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.953043  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:05.894495  9814 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.956969  7259 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:05.959807  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.934412  9815 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:05.959645  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:05.936728  9776 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:05.968967  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:05.972361  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.967490  7152 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:05.974050  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:05.974875  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.975059  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.977708  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.978259  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.944787  9835 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:05.932842  9557 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:05.980938  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:05.981604  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:05.987627  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.988703  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.983165  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:05.959824  9738 raft_consensus.cc:3055] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:05.966403  9815 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:05.990788  9738 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:05.991230  7328 pending_rounds.cc:85] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 1
I20260709 13:14:05.991587  7328 pending_rounds.cc:107] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:14:05.991855  7328 raft_consensus.cc:2889] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:05.988722  9642 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:05.994342  9642 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.995394  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.991004  9815 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:05.987329  9689 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:05.972563  8986 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:06.004338  7333 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:06.004901  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:06.008270  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:05.978879  9644 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:05.996984  9642 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:06.007093  7331 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:06.009567  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:06.016433  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:06.026379  7259 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:05.965184  9799 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.027107  7891 raft_consensus.cc:2410] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:14:06.027587  7228 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:06.029666  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:06.000347  9845 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:06.030004  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:06.036391  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:06.029603  7335 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:06.037137  7260 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:05.949800  9645 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.019496  8986 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.043143  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:06.046723  7259 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:06.050834  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:06.057231  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:06.036659  9742 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:06.039072  9845 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:06.065152  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:06.048889  8986 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:06.019814  9431 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.062553  9742 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:06.083062  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:06.069180  9845 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:06.079532  7888 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:14:06.105474  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:06.082677  9742 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:06.122068  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:06.075126  9832 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.129686  9713 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.131047  9557 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:06.131351  9855 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:06.131402  9644 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:06.135124  9742 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.141217  7327 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
W20260709 13:14:06.120870  9844 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 13:14:06.162001  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:06.143388  9791 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.178766  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:06.144039  9747 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:06.144223  9849 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.181663  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:06.147979  9814 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.181600  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:06.191371  7181 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:06.155175  9750 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:06.186911  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:06.187330  7327 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:14:06.168254  9624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.005s	sys 0.005s
I20260709 13:14:06.123085  9806 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.169431  9776 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:06.201969  7893 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:06.216320  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:06.207049  9624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.005s	sys 0.005s
I20260709 13:14:06.222816  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:06.223614  7258 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:06.224922  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:06.180336  9791 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.221408  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:06.258450  7258 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:06.175410  9835 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:06.269701  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 48461.9us
I20260709 13:14:06.270196  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:06.277772  9852 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:14:06.218972  9776 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.283802  9867 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:06.282838  8986 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.284618  9776 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:06.212019  9747 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.205576  9849 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.292917  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:06.294265  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:06.285957  9806 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.257263  9866 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:06.275779  9689 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:06.302774  9422 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:06.304687  9791 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.307957  7255 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:06.309744  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 147853us
I20260709 13:14:06.309074  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:06.315928  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:06.326330  9713 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.326541  7890 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:06.327579  9849 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.308223  9689 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.329510  9689 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:06.331934  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:06.335599  9742 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.296082  9642 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.339148  9835 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.339702  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:06.339921  9747 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:06.340529  7261 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:06.340845  9642 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.342391  9815 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.343478  9799 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:06.345197  9815 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:06.345358  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:06.346112  7254 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:14:06.351541  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:06.346843  7183 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:14:06.353458  7892 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:06.346252  9832 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:06.346560  9861 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:14:06.355715  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:06.349001  9806 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:06.364470  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:06.364471  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:06.366144  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:06.346911  9768 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.653s	user 0.003s	sys 0.008s
I20260709 13:14:06.367003  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:06.379577  7332 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:06.367336  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:06.367848  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:06.364178  9806 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.368768  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:06.365406  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:06.369426  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:06.370954  9750 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:06.367043  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:06.383718  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:06.378428  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:06.384502  9768 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.384232  7896 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:06.387959  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:06.389465  7257 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:06.382033  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:06.385473  9806 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:06.397972  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:06.389366  9832 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:06.323747  9866 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.391517  9815 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:06.385298  9814 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:06.389617  9750 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:06.428262  9832 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:06.439250  9814 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.439999  9832 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:06.404040  9870 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:06.431676  9557 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:06.432950  9866 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.433660  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:06.433830  9710 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.434885  7187 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:14:06.373454  9845 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.435885  9747 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:06.436076  9768 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.404892  8986 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:06.433692  9869 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 13:14:06.448320  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:06.441475  9802 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.004s
I20260709 13:14:06.451730  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2014) took 1204 ms. Trace:
I20260709 13:14:06.445207  9870 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.459784  7332 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:14:06.457890  9802 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.458616  9870 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:06.457769  9747 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.471446  9747 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.455355  9710 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.474750  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:06.447799  9814 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:06.455737  7182 rpcz_store.cc:276] 0709 13:14:05.247316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.254035 (+  6719us) service_pool.cc:224] Handling call
0709 13:14:05.254461 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:05.307940 (+ 53479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:05.307989 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:05.324922 (+ 16933us) log.cc:844] Serialized 26 byte log entry
0709 13:14:05.432659 (+107737us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:14:05.432712 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.441066 (+1008354us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b5400256554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:06.441115 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:06.441160 (+    45us) raft_consensus.cc:1685] finished
0709 13:14:06.441173 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.451606 (+ 10433us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2014,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":19379,"spinlock_wait_cycles":45576448,"thread_start_us":37552,"threads_started":1,"wal-append.queue_time_us":133681}
I20260709 13:14:06.478737  9710 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.483862  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:06.486464  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:06.488431  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:06.489564  7333 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:06.499184  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:06.500111  7260 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:14:06.458086  9557 consensus_queue.cc:1243] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:06.499002  9768 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:06.507344  9768 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.507793  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:06.508481  7332 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:06.509667  9768 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:06.511960  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:06.512769  7182 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:06.513967  9845 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:06.476382  9747 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:06.515076  9747 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.514554  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:06.571676  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:06.490295  9689 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.757437  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2012) took 1540 ms. Trace:
I20260709 13:14:06.758783  7183 rpcz_store.cc:276] 0709 13:14:05.216930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.217595 (+   665us) service_pool.cc:224] Handling call
0709 13:14:05.229704 (+ 12109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.353629 (+1123925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.746416 (+392787us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000ee2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:06.757335 (+ 10919us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2568490368}
I20260709 13:14:06.635502  9742 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:06.832906  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:06.837262  7895 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:06.524190  9750 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.841325  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:06.842685  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:06.843398  9750 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:06.845468  9689 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:06.852672  9422 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:06.853390  9422 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.854969  9747 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:06.855521  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1250) took 1237 ms. Trace:
W20260709 13:14:06.856130  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.855922  7257 rpcz_store.cc:276] 0709 13:14:05.618439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.618672 (+   233us) service_pool.cc:224] Handling call
0709 13:14:06.855337 (+1236665us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54002170d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:06.855464 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1768248064}
I20260709 13:14:06.934386  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:06.899487  9422 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:06.907437  9866 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:06.899922  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:06.905360  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:06.880460  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:06.880416  9806 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:06.873052  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:06.904852  9850 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.780s	user 0.006s	sys 0.004s
I20260709 13:14:06.925752  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2036) took 1426 ms. Trace:
I20260709 13:14:06.995625  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:06.977015  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:07.046082  7256 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:06.996096  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:07.047147  7261 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:07.053498  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 119198us
I20260709 13:14:06.880064  9785 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.990384  9866 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:07.045533  7179 rpcz_store.cc:276] 0709 13:14:05.499174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.679931 (+180757us) service_pool.cc:224] Handling call
0709 13:14:05.807888 (+127957us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:05.808318 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:05.808343 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:05.809378 (+  1035us) log.cc:844] Serialized 564 byte log entry
0709 13:14:05.900814 (+ 91436us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:05.900849 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.900913 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:05.929617 (+ 28704us) raft_consensus.cc:1685] finished
0709 13:14:05.929642 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.925434 (+995792us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54002c5450. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:06.925677 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293112192,"thread_start_us":91050,"threads_started":1,"wal-append.queue_time_us":118206,"wal-append.run_cpu_time_us":2022,"wal-append.run_wall_time_us":1002026}
I20260709 13:14:06.853632  9815 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:07.061193  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:07.059264  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:07.073380  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 96442.4us
I20260709 13:14:06.870208  9750 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:07.027980  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 155297us
I20260709 13:14:07.058961  9845 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:07.109341  8986 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:07.138276  8986 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.143255  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:06.916484  9738 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:06.969801  9689 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.990864  9768 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:06.880563  9800 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.120522  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:07.180629  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:06.969990  9835 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:07.182210  8986 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:07.192111  8986 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.192589  8986 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.053105  9422 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:07.198474  7180 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:07.059801  7888 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:07.203368  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.204213  7332 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:07.065964  9799 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:06.867420  9742 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.191149  9738 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:07.227454  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:07.240034  8986 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:07.074340  9785 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:07.201959  9711 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:14:07.222159  9832 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.782s	user 0.013s	sys 0.000s
I20260709 13:14:07.260351  9422 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:07.263957  9422 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.264397  9422 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:07.267935  7333 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:07.270136  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.272536  7335 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:14:07.273658  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.274344  7333 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:07.286595  9747 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:07.287271  9747 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:07.291242  9747 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.292236  9747 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:07.293134  9747 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:07.296985  9747 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.222576  9867 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:07.164310  9750 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:07.308095  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:07.202550  9845 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.200652  9800 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.207247  9768 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.115950  9866 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.206480  9689 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:07.305863  9867 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:07.217800  9835 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:07.262996  9711 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.263165  9736 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:07.313773  9883 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 13:14:07.327883  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 192109us
I20260709 13:14:07.335088  7330 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
W20260709 13:14:07.338313  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 215374us
I20260709 13:14:07.332597  9867 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:07.319316  9870 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.854s	user 0.015s	sys 0.015s
I20260709 13:14:07.349228  9806 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.350773  9703 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:07.352263  9903 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.352367  9422 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:07.302842  9832 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:07.349309  9785 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:07.206234  9712 consensus_queue.cc:1175] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" responder_term: 7 status { last_received { term: 6 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:07.362107  9742 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:07.376082  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:07.381875  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:07.387467  7895 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 13:14:07.423066  7895 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
W20260709 13:14:07.422897  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46910.3us
I20260709 13:14:07.390398  7261 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:07.423867  7892 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:07.392550  9893 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:07.393429  9897 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:07.393993  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.375077  9711 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:07.422076  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 383) took 1596 ms. Trace:
I20260709 13:14:07.396634  9866 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:07.430915  7891 rpcz_store.cc:276] 0709 13:14:05.817044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.817158 (+   114us) service_pool.cc:224] Handling call
0709 13:14:07.399412 (+1582254us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400521f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:07.413157 (+ 13745us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480025472}
W20260709 13:14:07.469444  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 287583us
I20260709 13:14:07.471481  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:07.474386  8986 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:07.394812  9736 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.478259  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:07.478682  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 96932.2us
I20260709 13:14:07.480302  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:07.482879  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:07.483130  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 422003us
I20260709 13:14:07.429705  9791 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.398998  9870 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:07.473649  9883 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:14:07.505407  8986 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:07.518074  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.520551  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:07.521610  7329 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:07.477581  9742 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:07.488278  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:07.477288  9893 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.433152  9887 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:07.524109  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:07.422580  9703 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:07.483022  9784 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.008s	sys 0.010s
I20260709 13:14:07.499717  9747 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:14:07.428284  9645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.295s	user 0.029s	sys 0.046s
I20260709 13:14:07.484452  9624 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:07.414112  9903 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:07.560606  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 80351.3us
I20260709 13:14:07.535151  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:07.543196  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 257445us
I20260709 13:14:07.476419  9557 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:14:07.516251  9884 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.316s	user 0.002s	sys 0.004s
I20260709 13:14:07.570981  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:07.552579  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.567662  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:07.568408  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.553902  8986 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:07.548432  9784 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.009s	sys 0.011s
I20260709 13:14:07.574131  7891 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:14:07.530473  9887 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.574795  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.575762  8986 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:07.559845  9645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.427s	user 0.029s	sys 0.046s
I20260709 13:14:07.578708  7328 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
W20260709 13:14:07.584414  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49389us
I20260709 13:14:07.585457  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:07.587241  8986 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.588770  7333 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:07.589076  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:07.475994  9897 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.557971  9799 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:07.600276  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:07.600850  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.601569  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:07.610140  7182 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:07.602514  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:07.606923  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:07.570834  9742 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:07.520100  9791 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.577783  9777 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:07.621721  7179 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:07.609409  7335 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:07.587412  9806 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:07.626003  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 147856us
I20260709 13:14:07.582623  9887 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:07.629925  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:07.628252  7335 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:07.631147  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:07.634563  8986 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:14:07.628266  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.571087  9624 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:07.620791  9747 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:07.651224  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:07.647776  9768 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:07.581921  9899 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:14:07.668294  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:07.668675  8986 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:07.632179  9845 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:07.672086  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1309) took 1186 ms. Trace:
I20260709 13:14:07.640116  9750 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.646684  9800 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:07.677724  7327 rpcz_store.cc:276] 0709 13:14:06.485277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.486710 (+  1433us) service_pool.cc:224] Handling call
0709 13:14:06.487022 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:06.487270 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:06.487300 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:06.487758 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:14:06.760207 (+272449us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:06.760264 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.760364 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:07.515579 (+755215us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:07.656141 (+140562us) raft_consensus.cc:1685] finished
0709 13:14:07.656167 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:07.671989 (+ 15822us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241901824,"thread_start_us":272128,"threads_started":1,"wal-append.queue_time_us":621540}
I20260709 13:14:07.680454  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:07.650695  9689 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.684481  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:07.624723  9799 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.701979  9901 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:07.702237  9905 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:07.725841  9905 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:07.726274  9905 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:07.662998  9747 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:07.702455  7150 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:07.728142  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:07.702765  9906 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.704469  9703 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.705216  9624 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.706733  9802 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.716663  8986 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:07.670089  9742 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:07.668679  9557 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:14:07.718061  9870 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.668388  9835 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.671638  9422 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:07.649211  9738 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:14:07.723209  9736 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.724323  9799 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:07.725359  9911 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:14:07.671402  9832 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.707484  9845 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:07.729243  9689 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:07.773475  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:07.774516  7185 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:07.767609  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 190432us
I20260709 13:14:07.774281  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:07.776520  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:07.753361  9624 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:07.768339  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 182989us
W20260709 13:14:07.768852  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.728772  9747 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.776705  7179 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:14:07.778249  7182 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:07.781119  7183 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:14:07.781301  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.777807  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:07.784633  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:07.785365  7179 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:07.788625  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.789347  7335 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:07.790601  7185 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:07.791030  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.791847  7327 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:07.770663  9591 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:07.795140  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:07.791630  9922 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:07.795825  9918 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:07.772692  9870 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:07.800686  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:07.777498  9802 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:07.812034  7182 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:07.807322  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:07.814283  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:07.815546  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 86365.2us
I20260709 13:14:07.816749  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:07.794497  9893 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:07.817936  9891 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:14:07.818791  9899 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:07.819187  9899 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:07.735344  9901 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.820055  9899 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.821347  9899 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:07.821895  9901 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:07.803161  9925 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:07.829228  9752 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:07.829675  9909 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:07.828853  9738 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.831409  9738 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.832090  9703 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:07.833837  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:07.834378  9738 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:07.834704  7183 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:07.829603  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:07.837056  9777 raft_consensus.cc:2955] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:07.838033  9899 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:07.838846  9557 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:07.839412  9557 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:07.811518  9832 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:07.841625  9557 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:07.844244  9897 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:07.755398  9906 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.844640  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:07.844924  9738 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:07.845371  9738 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:07.846504  9906 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:07.846251  9738 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.849028  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:07.852697  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:07.866945  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52767.3us
W20260709 13:14:07.866947  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 59720.4us
I20260709 13:14:07.868060  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:07.869139  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:07.869392  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:07.871116  7255 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:07.870054  7258 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:14:07.872218  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 55552.6us
I20260709 13:14:07.874678  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:07.875358  7255 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:14:07.876243  9557 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:07.877374  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:07.877964  7260 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:07.882988  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.874624  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:07.783938  9624 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:07.964012  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 89448us
I20260709 13:14:07.847316  9738 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:07.981154  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:07.981788  7335 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:07.981951  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.982538  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:07.982945  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.963353  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:07.963562  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:07.883412  9903 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:07.984423  7332 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:14:07.964381  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:07.985956  7255 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:07.916994  7261 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:14:07.986825  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 118870us
I20260709 13:14:07.987534  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:07.987773  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:07.989174  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.990748  7332 pending_rounds.cc:85] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 6
I20260709 13:14:07.991145  7332 pending_rounds.cc:107] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:14:07.991434  7332 raft_consensus.cc:2889] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:07.994268  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:07.995848  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:07.809199  9922 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:07.880679  9891 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:08.004411  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.005296  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:07.880976  9742 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:07.805573  9591 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.007205  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:08.017375  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.022119  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.023471  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.020344  7254 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:14:08.031199  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:07.883601  9925 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:07.817195  9870 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.042939  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:07.978682  9897 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:08.000253  9901 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:08.010349  9752 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:08.073134  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:08.074890  7259 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:08.033946  9750 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:08.019497  9918 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:08.081264  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:07.998011  9785 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:14:08.036752  9422 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.076942  7894 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:08.037461  9747 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:08.104887  9924 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:08.105382  9924 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.105595  9624 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.105705  9924 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:08.106241  9624 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:08.106755  9624 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.108949  9624 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.109828  9624 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:08.069434  9897 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:08.111668  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 104602us
I20260709 13:14:08.112983  9897 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.113010  9799 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:08.115903  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:08.116072  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 2.38087e+06us
I20260709 13:14:08.118091  9905 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.060956  9916 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:08.085160  9867 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.002s
I20260709 13:14:08.123059  7254 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:08.071391  9901 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.083122  9802 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:08.084275  9750 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.151050  7185 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:14:08.137653  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:08.122877  7888 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.882s	user 0.004s	sys 0.008s
I20260709 13:14:08.181473  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:08.181473  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.185611  7178 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:08.058528  9925 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.097349  9891 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:08.187686  7181 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:08.135089  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:08.189136  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54161.2us
I20260709 13:14:08.101760  9747 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:08.185283  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.158295  7335 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:08.190970  7333 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
W20260709 13:14:08.138170  9856 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.993s	user 0.012s	sys 0.017s
I20260709 13:14:08.193645  7228 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:08.191130  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49393.5us
I20260709 13:14:08.158318  9901 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:08.196681  9891 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.140282  9926 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:08.197708  9925 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.126214  9422 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:08.199819  9806 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.001s
I20260709 13:14:08.144496  9870 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:08.200122  9851 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 2.067s	user 0.000s	sys 0.009s
I20260709 13:14:08.125221  9922 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.200889  9924 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.202566  7179 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:14:08.185370  9750 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:08.203459  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:08.234661  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.207382  9905 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:08.195135  9747 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:08.208565  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:08.209213  9711 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.000s
I20260709 13:14:08.186445  9802 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.210973  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2214) took 2313 ms. Trace:
I20260709 13:14:08.225682  9624 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.212009  9832 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:14:08.213807  9887 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.565s	user 0.002s	sys 0.006s
I20260709 13:14:08.144704  9916 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.214278  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:08.142979  9904 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:14:08.249485  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:08.184890  7888 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
W20260709 13:14:08.136917  9880 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.004s	user 0.008s	sys 0.006s
I20260709 13:14:08.221801  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:08.224912  7260 raft_consensus.cc:2410] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:08.334239  7185 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:14:08.231678  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:08.156702  9867 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.192809  9923 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:08.193037  9918 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:08.138019  9645 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:14:08.237226  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:08.238876  7262 rpcz_store.cc:276] 0709 13:14:05.897823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.898011 (+   188us) service_pool.cc:224] Handling call
0709 13:14:05.912688 (+ 14677us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:14:05.944450 (+ 31762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:05.944497 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:14:05.957002 (+ 12505us) log.cc:844] Serialized 78 byte log entry
0709 13:14:06.051694 (+ 94692us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:06.065711 (+ 14017us) log.cc:844] Serialized 14 byte log entry
0709 13:14:06.073600 (+  7889us) log.cc:844] Serialized 14 byte log entry
0709 13:14:06.080980 (+  7380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:06.081092 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:07.670670 (+1589578us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b180048a720. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:14:08.124418 (+453748us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:08.210699 (+ 86281us) raft_consensus.cc:1685] finished
0709 13:14:08.210721 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.210877 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39033,"prepare.queue_time_us":51330,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":67132,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":17875,"spinlock_wait_cycles":57398400,"thread_start_us":25094,"threads_started":1,"wal-append.queue_time_us":155384}
I20260709 13:14:08.230993  9806 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:08.250505  7178 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
W20260709 13:14:08.282948  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:08.213855  9866 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.743s	user 0.002s	sys 0.010s
I20260709 13:14:08.346423  9923 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.352293  9835 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:08.245436  9642 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.229337  9926 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.370354  7178 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:14:08.241956  9711 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.340030  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 475) took 1471 ms. Trace:
I20260709 13:14:08.336802  7185 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:08.398139  7179 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:14:08.335142  7329 raft_consensus.cc:2376] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5. Re-sending same reply.
I20260709 13:14:08.432426  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:08.250731  9887 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.418020  7186 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:14:08.427255  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:08.249631  9624 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.438169  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.439178  9711 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.431594  7888 rpcz_store.cc:276] 0709 13:14:06.868419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.870566 (+  2147us) service_pool.cc:224] Handling call
0709 13:14:08.257295 (+1386729us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:08.441481  7179 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:08.442239  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.443145  7896 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:08.456349  9916 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.459952  7186 pending_rounds.cc:85] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 5
I20260709 13:14:08.465809  7186 pending_rounds.cc:107] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:14:08.466118  7186 raft_consensus.cc:2889] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:08.467988  9875 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.957s	user 0.001s	sys 0.009s
I20260709 13:14:08.469560  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:08.470255  9752 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:08.470607  7336 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:08.483091  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:08.486008  9924 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.471594  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:08.488564  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:08.489961  7178 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:08.474429  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 289) took 1204 ms. Trace:
I20260709 13:14:08.491026  7330 rpcz_store.cc:276] 0709 13:14:07.269746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.269889 (+   143us) service_pool.cc:224] Handling call
0709 13:14:08.474185 (+1204296us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b540038bdd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:08.474327 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147904256}
I20260709 13:14:08.492079  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2225) took 1528 ms. Trace:
I20260709 13:14:08.492419  7330 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:08.492507  9422 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.493044  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 606) took 1207 ms. Trace:
I20260709 13:14:08.463533  9799 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:08.493880  9799 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.492445  7257 rpcz_store.cc:276] 0709 13:14:06.963492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.963681 (+   189us) service_pool.cc:224] Handling call
0709 13:14:06.991053 (+ 27372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:07.319859 (+328806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:07.319901 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:07.319953 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:07.319998 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.491865 (+1171867us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400058554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:08.491911 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.492027 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755666816}
I20260709 13:14:08.475891  9591 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.480333  9926 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.408432  9923 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:08.496815  9701 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.498306  8986 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:08.498719  8986 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:08.499583  9887 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.499475  8986 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.493448  7893 rpcz_store.cc:276] 0709 13:14:07.285328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.285483 (+   155us) service_pool.cc:224] Handling call
0709 13:14:07.285780 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:07.523469 (+237689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:07.523515 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:07.523584 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:07.523631 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.492866 (+969235us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400690854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:08.492914 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:08.492998 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546085248}
I20260709 13:14:08.521284  7891 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:14:08.525279  9917 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.821s	user 0.016s	sys 0.015s
W20260709 13:14:08.526378  7187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1490) took 2157 ms (client timeout 1971 ms). Trace:
W20260709 13:14:08.526809  7187 rpcz_store.cc:269] 0709 13:14:06.364531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.364642 (+   111us) service_pool.cc:224] Handling call
0709 13:14:08.521309 (+2156667us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b54002b5cd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:08.521439 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116392704}
I20260709 13:14:08.522924  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:08.530397  9924 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:14:08.434854  9642 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.546469  9903 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:08.604461  7178 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:08.530586  9923 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.605365  9924 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:08.605762  9924 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:08.607052  9923 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.603507  8986 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:08.533404  7185 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:08.556761  9905 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:14:08.610519  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 416911us
I20260709 13:14:08.617782  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:08.618891  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:08.539412  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:08.606668  9924 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:08.628618  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 89338.6us
I20260709 13:14:08.607626  9887 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.607563  9791 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.635133  7302 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:08.632633  9912 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:08.637336  9785 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:08.638115  9905 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:08.639207  9785 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:08.639644  9785 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:08.639554  9750 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.640416  9925 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:08.640745  9785 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.641021  9925 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.641849  9750 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.625620  9926 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:08.641768  9870 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.642509  9906 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:08.645151  7332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.002s	sys 0.021s
W20260709 13:14:08.645632  7332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.002s	sys 0.021s
I20260709 13:14:08.629434  9642 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.651806  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:08.644455  9742 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:08.626873  9422 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:14:08.641958  9785 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:08.655548  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.643808  9750 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.644634  9926 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:08.635775  9887 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.668165  9926 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:08.649557  9870 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:08.671502  9815 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.023s	sys 0.039s
I20260709 13:14:08.650445  9906 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.667429  9750 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.664860  9905 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:14:08.663376  9742 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.668848  9747 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:08.682590  9815 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.024s	sys 0.040s
I20260709 13:14:08.684054  9891 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:14:08.684841  9925 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.674005  9901 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.681521  9912 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:14:08.687827  9943 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.709350  9947 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:08.719645  9925 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:08.733879  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 82112.8us
I20260709 13:14:08.734521  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:08.727658  9947 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:08.739322  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:08.732820  9925 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:08.721387  9943 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.762851  9712 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.763652  9712 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.767309  9887 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.769867  9901 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:08.778725  9947 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.780131  9947 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:08.782123  9913 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.079s	user 0.015s	sys 0.015s
I20260709 13:14:08.783094  9870 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.783686  9870 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:08.784162  9870 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:08.784968  9870 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.792861  9750 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.793493  9750 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:08.803872  9943 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.804119  9835 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:08.804656  9835 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:08.805275  9943 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:08.805683  9943 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:08.806057  9943 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:08.746115  9925 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:08.810851  9645 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:08.811316  9645 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:08.812186  9645 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.813370  9645 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:08.814291  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:08.814975  7179 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:08.816807  9832 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:08.817291  9784 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:08.817137  9926 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.817431  9832 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.817956  9784 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.819449  9777 raft_consensus.cc:3055] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:08.819901  9777 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:08.820258  9784 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.820726  9777 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.822144  9777 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:08.822044  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:08.824465  9832 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.825246  9802 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.827010  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.838166  9835 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.844167  9906 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.845258  9835 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.838218  9624 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.848058  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:08.849134  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 362) took 2468 ms. Trace:
I20260709 13:14:08.849540  7180 rpcz_store.cc:276] 0709 13:14:06.380277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:06.380733 (+   456us) service_pool.cc:224] Handling call
0709 13:14:06.392052 (+ 11319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:07.201905 (+809853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.848853 (+1646948us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b5400117e54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:08.849038 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854105856}
I20260709 13:14:08.851204  9922 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:08.851783  9922 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:08.852897  9922 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.854808  9799 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.855809  7182 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:08.856247  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 370) took 1080 ms. Trace:
I20260709 13:14:08.856703  7186 rpcz_store.cc:276] 0709 13:14:07.775864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.775998 (+   134us) service_pool.cc:224] Handling call
0709 13:14:07.782937 (+  6939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:08.481650 (+698713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:08.855985 (+374335us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b540036db54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:08.856185 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1428224256}
I20260709 13:14:08.846302  9747 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.859705  9905 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:08.860131  9905 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:08.860946  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:08.861653  7186 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:08.860911  9905 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.863195  9905 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:08.865103  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:08.868551  9867 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.872069  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:08.873443  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:08.874032  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:08.878264  9742 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:08.885632  7083 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47554 (request call id 233) took 14571 ms (client timeout 15000 ms). Trace:
I20260709 13:14:08.896062  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:08.911453  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:08.912675  7182 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:08.921937  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:08.893559  9747 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:08.922858  9747 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:08.923863  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 121701us
I20260709 13:14:08.924971  9747 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.925287  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:08.903680  9742 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:08.926007  9742 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.926910  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:08.927093  9902 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:08.927889  9867 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.928033  9742 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:08.928153  9902 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:08.928725  9891 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:08.928449  9867 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:08.929123  9891 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:08.929975  9891 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:08.932005  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:08.934209  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.935698  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.936976  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:08.937682  7329 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:08.938318  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:08.939967  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:08.942467  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 272294us
I20260709 13:14:08.944747  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:08.947264  7186 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:08.955008  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.955874  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:08.956537  7891 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:08.958932  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.904224  9924 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:08.960820  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.967923  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.961683  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.962543  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:08.959942  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:08.966076  7331 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:14:08.972213  7335 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:14:08.766484  9712 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:08.972390  7329 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:08.886256  7083 rpcz_store.cc:269] 0709 13:13:54.389193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.438884 (+ 49691us) service_pool.cc:224] Handling call
0709 13:14:08.885539 (+14446655us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:05.272665 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:05.273319 (+   654us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:05.273373 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:14:05.273397 (+    24us) tablet.cc:662] Decoding operations
0709 13:14:05.442657 (+169260us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:05.474948 (+ 32291us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:05.474998 (+    50us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:14:05.476608 (+  1610us) tablet.cc:701] Row locks acquired
0709 13:14:05.476669 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:14:05.476947 (+   278us) write_op.cc:270] Start()
0709 13:14:05.477155 (+   208us) write_op.cc:276] Timestamp: P: 1783602845476834 usec, L: 0
0709 13:14:05.477181 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:14:05.478148 (+   967us) log.cc:844] Serialized 4450 byte log entry
0709 13:14:05.681338 (+203190us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:05.917749 (+236411us) op_driver.cc:464] REPLICATION: finished
0709 13:14:06.256010 (+338261us) write_op.cc:301] APPLY: starting
0709 13:14:06.263108 (+  7098us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:06.322311 (+ 59203us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:06.329791 (+  7480us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:06.331301 (+  1510us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:06.331669 (+   368us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:14:06.331725 (+    56us) write_op.cc:312] APPLY: finished
0709 13:14:06.332116 (+   391us) log.cc:844] Serialized 83 byte log entry
0709 13:14:06.332309 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:06.332442 (+   133us) write_op.cc:454] Released schema lock
0709 13:14:06.332514 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:06.335729 (+  3215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:06.335760 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2120497,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":272261,"apply.run_cpu_time_us":4145,"apply.run_wall_time_us":119691,"num_ops":11,"prepare.queue_time_us":166755,"prepare.run_cpu_time_us":37708,"prepare.run_wall_time_us":333885,"raft.queue_time_us":164100,"raft.run_cpu_time_us":22616,"raft.run_wall_time_us":170210,"replication_time_us":440336,"spinlock_wait_cycles":12158336,"thread_start_us":463949,"threads_started":4,"wal-append.queue_time_us":147592,"wal-append.run_cpu_time_us":40330,"wal-append.run_wall_time_us":1716366}]]}
I20260709 13:14:08.967118  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:08.978489  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:08.931097  9922 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:09.001331  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 60158.6us
I20260709 13:14:09.001650  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:08.991935  7333 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:09.007288  7150 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:09.008612  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:09.009136  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 269905us
I20260709 13:14:08.938714  9867 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.012684  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.013578  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:09.015477  7893 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:08.961153  9742 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:09.033366  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:08.982234  9701 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:08.969019  9903 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.926949  9901 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:14:08.967399  9534 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:09.036973  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.002429  9891 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.001367  9624 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:09.039783  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.040920  7225 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:09.047880  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.043759  7893 raft_consensus.cc:2410] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:14:08.969497  9738 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:14:09.047216  7258 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:09.031673  9897 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:09.022119  9802 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:08.980163  9784 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:14:09.053040  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:09.064158  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:09.058714  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:14:09.064734  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.065256  7893 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:09.060883  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.038614  9642 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:09.062417  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.070169  9906 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:09.070598  9906 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.068053  9747 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:09.071038  9906 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:09.057399  9624 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:09.075217  7890 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:09.075990  9624 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.077172  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.077867  7895 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:09.067818  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.078877  7331 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:09.066259  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.079414  7150 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:09.045040  9870 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:09.031917  9814 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:14:09.065982  7333 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:09.051839  7082 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:09.067461  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:09.085152  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.057134  9926 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.063136  9802 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:09.056587  9956 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:09.040457  9742 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.063827  9957 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:09.046440  9903 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.081066  9750 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:09.050390  9854 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:14:09.103420  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.105914  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.086593  9848 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:09.080772  9897 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:09.107117  7082 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:09.109040  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.049877  9534 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.109923  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.119004  7893 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:09.091642  9893 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:09.115028  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.124061  9889 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:09.124254  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:09.124511  9889 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:09.125036  7331 raft_consensus.cc:2368] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7.
I20260709 13:14:09.109905  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.120090  9963 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:09.125881  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.126864  7082 catalog_manager.cc:5697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 3 to 7, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 7 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.128261  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.128885  7332 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:14:09.083637  9925 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.123198  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.131856  9925 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.135145  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1336) took 1117 ms. Trace:
I20260709 13:14:09.135361  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.135572  7336 rpcz_store.cc:276] 0709 13:14:08.018163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.483994 (+465831us) service_pool.cc:224] Handling call
0709 13:14:08.484339 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:08.484560 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:14:08.672436 (+187876us) log.cc:844] Serialized 14 byte log entry
0709 13:14:09.004520 (+332084us) log.cc:844] Serialized 14 byte log entry
0709 13:14:09.134608 (+130088us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18000a4da0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:14:09.134775 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:09.134823 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:09.134877 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.134956 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.135092 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50948,"prepare.queue_time_us":48451,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":30400,"spinlock_wait_cycles":31752832,"thread_start_us":494762,"threads_started":2,"wal-append.queue_time_us":396934}
I20260709 13:14:09.099807  9802 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:09.123174  9893 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.146930  9893 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.148150  9943 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.150177  7334 raft_consensus.cc:2410] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:14:09.125468  9889 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.121500  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.139202  7333 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:09.139379  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:09.152678  7328 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.128185  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.140727  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.128719  7082 catalog_manager.cc:5697] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 3, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 3 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.153872  7331 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:09.154464  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:09.156857  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.111411  9870 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:09.161514  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.157977  7331 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:09.164795  7336 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:09.152506  9906 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.177374  9906 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.178738  7258 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 8: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:09.179340  9897 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.186424  7259 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:09.116952  9772 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:09.187543  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.188575  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.195714  7261 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:09.189411  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.195273  7082 catalog_manager.cc:5697] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 3, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 3 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.196484  7257 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:09.200672  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 166167us
I20260709 13:14:09.203752  7253 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:09.204397  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.204834  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.205220  7261 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.202186  7082 catalog_manager.cc:5697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:09.209183  7259 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:09.211776  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.217407  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:09.220654  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:09.160567  7890 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:09.223798  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:09.201254  9889 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:09.222369  7082 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.226112  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:09.227741  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.228286  7253 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.228232  7186 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:09.229615  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:09.228856  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:09.230551  7178 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:09.229535  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:09.231068  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:09.233201  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:09.236034  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.235237  7180 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:14:09.237658  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 293015us
I20260709 13:14:09.240352  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.241071  7259 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:09.241101  7082 catalog_manager.cc:5697] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 5, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 5 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.242806  7082 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 3, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 3 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.243856  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:09.213884  9742 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.210525  9906 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:09.256693  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:09.260517  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 254399us
I20260709 13:14:09.237166  9701 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:09.235520  9943 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.262876  7261 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:09.201478  9772 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.263718  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:09.267165  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.255859  9956 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:09.265676  7082 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 5, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 5 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.272248  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.272365  7259 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:09.275121  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.275391  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.277446  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.278059  7261 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:09.277776  7255 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:09.288554  9772 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.289316  7328 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:09.290961  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.291394  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.292058  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.292511  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.293071  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.293645  7260 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:09.294624  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.293102  7262 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:09.296893  7257 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:09.297966  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.298543  7259 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:09.299779  9534 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.302570  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.258978  9906 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.303220  7262 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:09.303699  7082 catalog_manager.cc:5697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 3 to 7, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 7 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.309010  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.304497  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.310575  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.276302  9867 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.312157  7257 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:09.313716  7082 catalog_manager.cc:5697] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 4, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 4 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:09.315591  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.283910  9956 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:09.327132  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.326946  7082 catalog_manager.cc:5697] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 5 to 6, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 6 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.327957  7260 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:09.330437  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:09.333032  9967 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:14:09.265974  9870 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.336685  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.336867  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:09.338898  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.318933  9867 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:09.347144  9968 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:14:09.349843  9802 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.323144  9903 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:09.337479  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.341089  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.343735  7257 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:09.358770  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 294) took 1463 ms. Trace:
I20260709 13:14:09.359342  7327 rpcz_store.cc:276] 0709 13:14:07.895643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:07.896032 (+   389us) service_pool.cc:224] Handling call
0709 13:14:07.993169 (+ 97137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:08.002978 (+  9809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:08.003025 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:08.012845 (+  9820us) log.cc:844] Serialized 26 byte log entry
0709 13:14:08.888943 (+876098us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b18003f73c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:14:09.091554 (+202611us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:09.091598 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.091696 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:09.353250 (+261554us) raft_consensus.cc:1685] finished
0709 13:14:09.353276 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.358669 (+  5393us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19872,"raft.queue_time_us":10575,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":15938,"spinlock_wait_cycles":31437184,"thread_start_us":202407,"threads_started":1,"wal-append.queue_time_us":1210045}
I20260709 13:14:09.367390  7082 catalog_manager.cc:5697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.341010  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.377646  7179 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:09.380198  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.380635  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.381171  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:09.382061  7255 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:09.381258  7262 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:14:09.385231  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.385855  7260 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:09.386759  9910 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:09.387193  9910 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:09.387575  9910 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:09.384717  9742 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:09.391942  7225 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.400121  7255 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:09.402832  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.410238  7082 catalog_manager.cc:5697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.414005  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.417255  7260 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:09.401298  9957 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:09.420364  9957 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:09.421489  9893 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.415570  9925 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:09.415211  9926 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:09.423967  9799 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:09.424401  9799 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:09.425213  9799 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.425760  9742 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:09.427296  9893 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.429026  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:09.429726  7896 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.401683  9906 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.421430  9957 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.386718  9867 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.439828  9958 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:09.428100  9956 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:09.441546  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 377597us
W20260709 13:14:09.465263  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 81115.8us
I20260709 13:14:09.428907  9799 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:09.473835  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.479079  7328 raft_consensus.cc:2368] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:14:09.474076  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:09.475704  7331 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:14:09.476729  7225 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:09.472818  7150 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:09.482133  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:09.483096  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:09.467710  7861 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.480680  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.485759  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:09.486685  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:09.484984  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.487972  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.491690  7333 raft_consensus.cc:2368] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:14:09.496626  7896 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:09.498231  7150 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:09.498835  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:09.499609  7891 raft_consensus.cc:2368] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:14:09.459134  9742 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:09.500166  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:09.501875  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 238585us
I20260709 13:14:09.505076  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.510705  7225 leader_election.cc:400] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7.
I20260709 13:14:09.511225  7225 leader_election.cc:403] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:14:09.512481  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:09.477615  9897 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.482884  9906 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:09.488348  9866 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:09.513724  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:14:09.550715  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.516350  9962 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:09.546727  8986 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.501905  9908 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:09.496649  9712 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:09.550817  7896 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:09.500886  9963 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:09.553540  8986 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.502116  9784 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:09.549434  9742 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:09.543268  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:09.553128  9962 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:09.500765  9701 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:14:09.550238  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.550602  9866 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:09.491441  9943 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:09.599282  8986 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.502909  9814 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:09.519603  9534 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:09.599454  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56267.9us
I20260709 13:14:09.628420  7225 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:09.533591  7253 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:09.600852  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.517961  9904 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:14:09.604104  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:09.559229  9960 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:14:09.608867  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1338) took 1499 ms. Trace:
I20260709 13:14:09.556047  9908 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.610307  7896 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:09.554417  9738 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:09.606799  9802 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.612937  7336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:09.606326  9742 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.626026  9777 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:09.604545  9962 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:09.606127  9965 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:09.624382  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.624858  8986 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:09.599349  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 94401.5us
I20260709 13:14:09.625739  7257 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 5. Ops: []
W20260709 13:14:09.626351  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.626330  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.514788  9870 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7.
I20260709 13:14:09.638298  9750 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:09.633857  7225 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:09.676038  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.677177  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:09.556993  9712 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.551653  9897 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:09.629546  9924 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.001s
I20260709 13:14:09.599756  9784 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.630282  9866 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:09.691529  9972 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:14:09.704725  9534 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:09.705255  9534 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.706581  9963 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:09.707191  9963 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:09.707442  9534 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.707693  9963 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.708268  7182 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:09.709285  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:09.709849  7182 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:09.683200  9712 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.638059  7330 rpcz_store.cc:276] 0709 13:14:08.109129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.493179 (+384050us) service_pool.cc:224] Handling call
0709 13:14:08.493479 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:08.493681 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:08.673785 (+180104us) log.cc:844] Serialized 14 byte log entry
0709 13:14:09.011528 (+337743us) log.cc:844] Serialized 14 byte log entry
0709 13:14:09.428588 (+417060us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b180002dc40. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:14:09.487383 (+ 58795us) log.cc:844] Serialized 14 byte log entry
0709 13:14:09.602769 (+115386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:09.602817 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:09.602861 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:09.602922 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:09.608808 (+  5886us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":609145,"prepare.queue_time_us":38115,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":105,"raft.queue_time_us":705296,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":14407,"spinlock_wait_cycles":8377088,"thread_start_us":544088,"threads_started":3,"wal-append.queue_time_us":403197}
I20260709 13:14:09.673380  8986 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.636750  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:09.648350  7888 raft_consensus.cc:2368] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:14:09.678232  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:09.668862  7336 raft_consensus.cc:606] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:09.643895  9925 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.648047  9908 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.681203  9777 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.689926  9645 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:09.681437  9906 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:09.681185  9750 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:09.691141  9979 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:14:09.673758  9965 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:09.681326  9738 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:09.694797  9742 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.697011  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:09.668875  9903 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:14:09.786197  9972 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:09.699270  9970 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:09.702104  7181 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:09.713768  7183 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:09.789204  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.710615  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:09.791092  7182 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:09.791371  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:09.725171  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 88498.1us
I20260709 13:14:09.792616  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:09.792665  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:09.793161  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.725520  7336 raft_consensus.cc:614] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:09.794006  7333 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:09.715480  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:09.735267  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 247324us
I20260709 13:14:09.724926  9802 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.715461  9784 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:09.714828  9897 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:09.752071  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 74965.4us
I20260709 13:14:09.752625  7187 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:09.737394  9924 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:09.740160  9925 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.751387  9926 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:09.748131  9750 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:09.760864  9738 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.758129  9712 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.767841  8986 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.809590  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.809685  8986 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.810238  7896 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:09.810329  8986 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.767850  9962 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.771916  7184 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:09.752108  9965 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.783960  9777 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.739692  9854 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.647253  9814 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:09.812664  9645 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:09.823812  9814 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.824635  9645 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:09.807593  9867 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.826320  9962 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.826407  9867 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.827694  8986 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.828236  8986 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.828616  9867 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.828737  8986 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.825598  9645 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.801546  9799 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:09.831274  9799 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.833328  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.833994  7327 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:09.795347  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:09.840572  9815 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:09.796465  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:09.841843  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45457.2us
I20260709 13:14:09.841974  8986 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.843391  9957 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:09.806540  9802 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.844316  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:09.844611  9957 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:09.845065  9957 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:09.845470  9802 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.846030  9802 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:09.799414  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:09.847536  7330 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
W20260709 13:14:09.799981  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 84594.6us
I20260709 13:14:09.807876  7225 leader_election.cc:400] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
W20260709 13:14:09.848836  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46505.4us
I20260709 13:14:09.712670  9910 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:09.845932  9957 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.851040  9712 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.851209  9910 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.813474  7333 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:14:09.812263  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:09.853381  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:09.778060  9866 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.856873  9866 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.795998  9742 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:09.858174  9742 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:09.858805  9742 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:09.800387  9906 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:09.860380  9924 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:09.796231  9956 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:09.816563  9970 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:09.795382  9972 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:09.841029  9815 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:09.842350  9988 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:09.848011  7187 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:09.854688  9891 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:09.799003  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 308800us
W20260709 13:14:09.867808  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 72535.6us
I20260709 13:14:09.868988  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.861907  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:09.864755  9972 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.866613  7225 leader_election.cc:400] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:14:09.873196  7225 leader_election.cc:403] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:14:09.868620  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:09.877403  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 191436us
I20260709 13:14:09.878152  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.878844  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.846490  9802 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.885434  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.885748  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.886134  7891 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:09.881443  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:09.886929  7258 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:09.887792  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:09.886298  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.887791  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:09.892210  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:09.892868  7262 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.851078  9957 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:09.866600  9970 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.833364  9799 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:09.889631  9990 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:09.879309  9910 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:09.880179  9956 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:14:09.912719  9848 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:09.914292  7896 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:09.862471  9922 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:14:09.919564  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:09.919940  9925 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:09.923607  9972 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:09.889041  9802 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:09.861923  9854 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.927666  7254 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:09.908829  9906 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:14:09.928429  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46815.6us
W20260709 13:14:09.947538  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 59868.2us
I20260709 13:14:09.928455  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:09.969839  7253 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:09.969977  7225 leader_election.cc:400] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:14:09.896458  9891 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:09.935878  9534 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:09.936847  9905 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:14:09.944907  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53210us
I20260709 13:14:09.991350  7262 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:09.971210  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:09.930562  9970 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:09.945115  9990 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:09.993480  7152 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:09.926911  9815 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.973878  9906 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:09.999843  8986 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:10.000195  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:10.000243  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 121784us
I20260709 13:14:09.942061  9908 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.007189  7262 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:09.941329  9963 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:09.992405  9750 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.027339  9990 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.011906  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:09.999490  9925 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:10.025137  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.013748  9956 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:09.968928  9902 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:14:09.983466  9905 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:10.012953  9908 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.034945  9906 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.015405  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.012476  9924 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:10.013054  9891 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:10.083317  9891 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.012216  9904 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:10.084244  9904 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:10.085063  9904 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.085534  9742 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.022111  9867 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:10.020996  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.011227  9534 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:10.014926  9923 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:10.087671  9925 raft_consensus.cc:697] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:10.088222  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:10.088620  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 67723.1us
I20260709 13:14:10.089736  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.089917  9750 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.090040  9993 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:10.076589  9905 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.089742  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.036371  9784 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.067315  7260 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:10.095575  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 45917.4us
I20260709 13:14:10.081693  9947 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:10.055485  9943 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:10.097162  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 215815us
I20260709 13:14:10.099766  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:10.100510  7258 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:10.102319  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:10.106474  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:10.107409  7259 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:10.109959  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:10.072181  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47132.1us
I20260709 13:14:10.087157  7333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:10.113236  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.114625  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.116101  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.117861  9924 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:10.120731  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:10.121556  7180 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:10.122913  9534 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:10.127565  9777 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:10.128561  9993 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:10.129254  9993 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:10.130843  9867 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:10.131287  9867 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.131685  9867 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:10.132145  7225 leader_election.cc:400] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:14:10.132501  7225 leader_election.cc:403] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:10.133149  9750 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6.
I20260709 13:14:10.135277  9897 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:14:10.144261  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.086481  9904 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:10.154850  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.156942  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:10.162503  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.164330  7180 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:10.167301  7257 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:10.168516  7893 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:10.168776  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.111490  9947 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:10.063974  9994 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:14:10.194972  7258 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:10.096468  9999 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:10.153539  9866 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:14:10.207998  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:10.181149  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.174126  9992 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:10.185448  9993 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:10.225224  9962 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.226070  9962 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.227964  9784 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:10.175209  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 163359us
I20260709 13:14:10.175379  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.076542  9956 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.159991  9799 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:10.153859  9970 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.154043  9943 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.196271  9897 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:14:10.240664  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 84143.7us
I20260709 13:14:10.239239  9784 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.244889  9947 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.246572  9947 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:10.246987  9854 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.249384  9992 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:10.249972  9992 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:10.250413  9992 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.088620  9925 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.245232  9784 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.231814  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:14:10.244377  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 69099.2us
W20260709 13:14:10.264828  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 249493us
I20260709 13:14:10.266947  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.267575  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.268261  7332 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:10.268249  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.268993  7330 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:10.272276  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.272643  7896 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 6. Ops: []
I20260709 13:14:10.276408  7152 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.240998  9742 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.279179  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.279511  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.279989  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.281391  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.281903  7329 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.282024  7328 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:10.283376  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.283533  7334 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:10.283645  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.284296  7335 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:10.284653  7327 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:10.284808  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.285562  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.287052  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.287305  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.286254  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.288786  7328 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:10.290680  7327 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:10.297662  7329 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:10.265506  9800 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:10.241541  9905 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.299873  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.275656  9814 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:10.302146  9742 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:14:10.287958  9866 raft_consensus.cc:2764] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:14:10.332016  9742 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:10.332475  9742 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:10.334358  9777 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:10.336346  9970 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:10.318012  9784 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.322778  8986 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.342705  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.277915  9854 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:10.288393 10004 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:10.338603  8986 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.298486  9926 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:10.345700  7330 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:10.345644  7332 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:10.360169  7331 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:10.300393  9799 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:10.305751  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:10.304421  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.350905  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:10.362027  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:10.358603  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:10.347095  7259 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:10.367972  7187 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:10.303977 10007 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.365156  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:10.322170  9701 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:10.305805  9814 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:10.378404  9814 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.360929  9906 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.381824 10007 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.344705  7329 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:10.374539  9854 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:10.305223  9800 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:10.370653  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 64940.3us
I20260709 13:14:10.374318  8986 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:10.376993  9965 consensus_meta.cc:287] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 13:14:10.365939  9802 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.377923  7890 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:10.382247  9906 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:10.367921  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:10.358879  9963 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.392886  7178 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:10.386363  9962 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.407472  9867 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.420082  7180 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:10.420984  9981 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.398844  9712 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:10.421635  9981 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.423928  9897 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:10.424091  9814 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.399240  9926 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:10.371824  9986 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:10.399887  7888 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 8: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:10.369232  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 64900.4us
I20260709 13:14:10.360477 10004 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.426695  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.428192 10004 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:10.373914  9957 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:10.403106  9815 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:10.429286  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:10.403914  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.430377  7333 raft_consensus.cc:606] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:10.430840  7333 raft_consensus.cc:614] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:10.431779  9642 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:10.433348  9867 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.400909  9800 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:10.404832  9958 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:10.434851  9958 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:10.434916  9947 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:10.435878  9958 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.436757  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.436899  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:10.437398  7178 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:10.410012  7255 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:10.388432  9965 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.418800 10014 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:10.424525  9897 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:10.475160  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49540us
I20260709 13:14:10.437364  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.437764  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.429296  9957 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.437242  9958 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:10.408800 10007 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:10.400007  9802 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.441920  9534 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:10.442593  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.423930  9981 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:10.489315  7335 raft_consensus.cc:2410] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:10.442752  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.442930  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.443492  9994 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:10.488721  9534 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:10.444361  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.492189  9994 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.444765  9815 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:10.492666  9994 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:10.492682  9534 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.496450  9986 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:10.497552  9986 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.447559  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.451130  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:10.499262  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51786.2us
I20260709 13:14:10.499609  7186 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:10.500130  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.395052  7225 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:10.500948  9802 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:10.501078  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 108311us
I20260709 13:14:10.501618  9802 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:10.501681  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.453897  9814 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.503032  9814 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:10.502283  9802 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:10.454159  7187 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:10.404575  9905 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:10.454946  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:10.503381  9814 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.504829  9814 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:10.505400  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 55089.7us
I20260709 13:14:10.506103  9965 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.510090  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.459918  7256 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:10.510818  7330 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:10.465457  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:10.473239  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:10.512279  7257 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:10.474860  7262 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 4. Current term is 6. Ops: []
I20260709 13:14:10.478447  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:10.513245  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.479427  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:10.513790  9943 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.479472  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:10.515347  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:10.480392  7253 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:10.476843  7182 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:10.516863  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.490969  7328 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.517609  9927 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:10.517856  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:10.518188  9927 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:10.519227  9814 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.520291  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.521405  9814 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.523159  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.482750  9957 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.524097  9742 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.525333  9742 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:10.528000  9927 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.492678  7334 raft_consensus.cc:2410] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:10.458379  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:10.531769  7333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
W20260709 13:14:10.532025  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 73720.5us
I20260709 13:14:10.503437 10014 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:10.474694  9712 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:10.533206 10014 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:10.533635  9712 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.534089 10014 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.534917  9908 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:10.535338  9908 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.535689  9908 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:10.536870  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:10.537631  7888 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:10.504927  7184 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:10.540876 10010 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.541090  9534 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.541606 10010 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.545290  7184 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:10.546440  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:10.547286  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.547518  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.549069  7335 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:14:10.503477  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:10.552644  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 49261.6us
I20260709 13:14:10.554706  7179 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:10.554903  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.446035  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:10.557154  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 111185us
I20260709 13:14:10.557981  7893 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:10.558367  7150 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:10.457118  9992 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.548024  7183 raft_consensus.cc:2376] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6. Re-sending same reply.
I20260709 13:14:10.565496  7329 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:10.566062  7333 raft_consensus.cc:606] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:10.565323  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.566466  7333 raft_consensus.cc:614] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:10.575062  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:10.578552  7328 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
W20260709 13:14:10.592723  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 109028us
I20260709 13:14:10.593986  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:10.599502  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:10.586326  7861 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.602349  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.602355  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.602571  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:10.606984  7186 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:10.613677  7184 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:10.614172  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:10.614549  7334 raft_consensus.cc:2368] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7.
I20260709 13:14:10.618192  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:10.564589  9980 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:10.584707  9925 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:10.583343  9814 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:14:10.625581  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.624092  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:10.629199  9854 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:10.629909  9854 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:10.631196  9854 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.593386  9815 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:10.635083  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.639360  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.642103  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:10.613245  9943 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:10.659953  7225 leader_election.cc:400] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7.
I20260709 13:14:10.615564 10014 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:10.613677 10011 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:10.617522  9989 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:10.661908  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:10.662206  7187 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.660705  7225 leader_election.cc:403] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:14:10.623726 10004 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:10.615891  9867 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:14:10.635593  9901 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:10.673749  7186 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:10.644008  9981 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:10.616448  9957 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.641593  9815 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:10.689596  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 182805us
I20260709 13:14:10.698060  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.660532  9943 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:10.616359  9908 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.692727  9965 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.617049  9848 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:14:10.713538  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.717983  7187 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:10.719696  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.721158  7332 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.724436  9992 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.711238  9989 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:10.726380  9989 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.661337  9785 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:14:10.671077 10014 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:10.698887 10004 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:10.713236  9957 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.713924 10010 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:10.767104  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:10.767577  7186 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:10.767922  7180 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:10.768813  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:10.769001  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:10.769830  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.770143 10004 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.771032  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.771780  7179 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:10.771626  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.772644  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.772827  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.773406  7183 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:10.773563  7261 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:10.774085  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:10.774665  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:10.775593  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:10.776064  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:10.737495  9924 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:10.737689  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:10.789681  9925 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:10.790323  7888 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:14:10.796270  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 67524us
I20260709 13:14:10.800623  7334 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:10.800992  9925 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:10.801678  9925 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.801704  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.803475  7334 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:10.671453  9897 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.808243  9897 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.711158  9815 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.713654  9943 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:10.812943  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.814142  9925 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.814819  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.816005  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.816205  9701 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:10.816708  9701 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:10.816865  9992 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:10.817164  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.713492  9926 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:14:10.817615  9701 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.818267  9926 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:10.750074  9908 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:10.751506  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:10.788182  9963 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:10.755271  9947 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:10.819747  9992 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:10.822189  9802 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.822701  9802 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.735210  9981 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:10.824019  9981 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:10.824856  9802 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:10.776638  7260 raft_consensus.cc:2410] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:10.827039  9926 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:10.827644  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:10.828449  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:10.829079  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:10.752434  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:10.829710  7260 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:10.777124  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:10.830564  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.777570  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:10.777272  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46538.1us
I20260709 13:14:10.778230  7256 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:10.787319  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:10.787568  9962 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:10.838425  9970 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.838945  9970 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.839193  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.787992  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:10.840015  9645 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:10.840381  7257 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:10.788544  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:10.840528  9645 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.840979  9970 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:10.788601  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.841449  7259 raft_consensus.cc:2410] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:14:10.841965  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53453.7us
I20260709 13:14:10.789240  9988 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:10.789546  9906 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:10.819217  7178 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:10.819932  9947 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:10.760932  7255 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:10.828019  9926 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.788179  7890 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:10.842949  7183 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:10.788970 10014 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:10.845708  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.846380  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:10.758411 10026 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:14:10.872915  7258 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:10.848603  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.874459  7180 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 8. Ops: []
I20260709 13:14:10.876317  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.786561  7332 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:10.850683  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:10.851962  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.859449  7334 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:10.866583  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:10.867717  7257 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:14:10.842458  9924 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:10.879877  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.848479  9963 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:10.867530  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.883579  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:10.851610  9947 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:10.885846  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:10.851779  9800 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:10.895668  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.897935  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.900883  7260 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:10.906559  7861 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.909457  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:10.847725  9957 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:14:10.915243  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.879410  9897 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:10.882400  9906 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:10.886524  9645 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:10.864138  9901 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:14:10.876343  9899 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:14:10.894100  9992 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:10.855243  9907 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:14:10.933887  7182 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:10.921566  9986 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:10.886772  9926 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:10.918972  9925 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:10.893136  9903 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:14:10.903469 10011 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:14:10.917302  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:10.904313  9624 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:14:10.894601 10009 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:14:10.930785  9867 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:10.958575  7178 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
W20260709 13:14:10.945554  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 47731.6us
I20260709 13:14:10.939795  9814 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:10.929998  9777 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:14:10.965247  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.966336  9814 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:10.963442  9986 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:10.974068  9986 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:10.980026  7178 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:10.981783  7327 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:10.977626  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:10.944060 10029 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:10.992298  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56989.7us
I20260709 13:14:10.998258  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:10.959498  9925 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:11.002954  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:10.999800 10004 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:10.956243  9772 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:14:11.019073  7186 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:14:10.987824  7888 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:11.001490  9624 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:11.003659  9867 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:11.006456  9897 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:14:11.030596  9994 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.002s
I20260709 13:14:11.030812 10029 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:11.045526 10030 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:14:11.045902 10021 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:14:11.046305  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:11.049546  9981 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.045543  7186 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:11.041445  9956 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:11.120899  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 74689.3us
I20260709 13:14:11.041456  9624 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:11.123116 10004 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:11.122095  9925 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.040519  9927 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 13:14:11.140561  9993 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:11.042166  9994 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:11.167276 10033 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:14:11.102836 10029 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:11.169060  9993 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:11.243163 10039 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:14:11.208616  9802 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:11.251740  9943 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.277195  9943 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:11.279477  9906 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:11.281217  9965 consensus_meta.cc:287] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.004s
I20260709 13:14:11.281320  9534 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:11.281930  9965 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7.
I20260709 13:14:11.282081  9534 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:11.283372  9534 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.284927  9534 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:11.253702  7180 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:11.210706  9993 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:11.247457  9981 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:11.259972  7183 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:11.185105  9624 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.209666  9815 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.270848 10029 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:11.271219  9963 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:11.298966  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:11.302227  7257 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 8. Ops: []
I20260709 13:14:11.303380  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:11.302704  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:11.316891 10004 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:11.317023  9905 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:14:11.322804  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.327266  7260 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:11.324427  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:11.331388  7262 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:11.335870  7258 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:11.345906  7184 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:14:11.370918  9854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.020s	sys 0.020s
I20260709 13:14:11.372577  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:11.330293  9963 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:11.382704  7253 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:11.383242  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:11.387300 10019 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:14:11.393133  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:11.374312  9854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.021s	sys 0.021s
W20260709 13:14:11.395056  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 81828.5us
I20260709 13:14:11.397050 10004 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:11.379678  9903 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:14:11.396668 10009 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:11.421402 10009 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.427521 10009 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:11.420792  9963 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.483508  9922 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:11.484019  9922 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:11.484867  9922 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.485303 10004 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:11.488862  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:11.492563  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:11.493268  7254 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:11.495211  7184 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:11.495937  7256 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:11.497730  7178 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:11.498733  7183 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:11.479691  9901 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.497164  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:11.503957  7184 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:11.486116  9922 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:11.507339  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:11.514961  9901 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.503031  9943 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:11.504678  9980 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.492801  9963 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:11.506791  9957 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:11.530407  9906 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:11.526209  9980 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:11.519531  7335 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:11.538264  9901 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:11.524025 10048 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:11.540313 10009 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.541118  9947 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.542500  9947 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:11.544430  7185 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:11.544811 10009 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:11.543291  9993 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:11.547073  9925 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:14:11.547829  7186 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:11.527477  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:11.560667  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:11.563705  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:11.564380  7181 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:14:11.568055  7335 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:11.563941  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:11.586737  7183 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:11.565574  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:11.610239  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48653.5us
I20260709 13:14:11.611668  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:11.614781  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49291.3us
I20260709 13:14:11.616250 10009 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:11.616750 10009 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.617065 10009 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:11.617105 10054 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:14:11.614667  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55603.9us
W20260709 13:14:11.614790  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 56201.7us
I20260709 13:14:11.618072  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:11.620012  7893 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:11.618803  7861 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:11.550307  9993 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:11.610687  9958 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:11.617795 10054 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:11.659561  7893 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:11.673820  7178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "242a63190870450082200759c7f513ab"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50448
I20260709 13:14:11.674620  7178 raft_consensus.cc:606] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 13:14:11.675098  7178 raft_consensus.cc:614] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:11.655184  9908 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:11.737402  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:11.740949  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 122209us
W20260709 13:14:11.762789  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 143853us
I20260709 13:14:11.736626  9957 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:11.742451  9908 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:14:11.794036  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 56733us
I20260709 13:14:11.796702 10029 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:11.791339  9905 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:11.797700  9905 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:11.799924  9905 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:11.794260  9800 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.801065  9800 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.803315  9800 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:11.805727  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:11.806425  7181 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:11.796726 10072 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 13:14:11.808382 10069 log.cc:927] Time spent T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:11.809511  7302 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:11.813628 10031 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.785s	user 0.000s	sys 0.004s
I20260709 13:14:11.814365  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1320) took 1041 ms. Trace:
I20260709 13:14:11.781581  9908 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:11.819104  7253 rpcz_store.cc:276] 0709 13:14:10.772530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.828211 (+ 55681us) service_pool.cc:224] Handling call
0709 13:14:11.814190 (+985979us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b5400059454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:11.814297 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099932544}
W20260709 13:14:11.807665 10065 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:14:11.810359  9800 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:11.838610  9800 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.839139  9800 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:11.843624 10064 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:14:11.846006 10070 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:14:11.755620  9980 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.848574  9980 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:11.860198  9800 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.862886  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1380) took 1143 ms. Trace:
I20260709 13:14:11.869028  7336 rpcz_store.cc:276] 0709 13:14:10.719690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.719843 (+   153us) service_pool.cc:224] Handling call
0709 13:14:10.720163 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:10.794826 (+ 74663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:10.794861 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:10.795421 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 13:14:10.923118 (+127697us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:11.018138 (+ 95020us) log.cc:844] Serialized 14 byte log entry
0709 13:14:11.030459 (+ 12321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.030537 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:11.811483 (+780946us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b180034ac80. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db
0709 13:14:11.812959 (+  1476us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:11.862617 (+ 49658us) raft_consensus.cc:1685] finished
0709 13:14:11.862661 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.862823 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93552,"prepare.queue_time_us":45288,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":87472,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":3570,"spinlock_wait_cycles":8885504,"thread_start_us":199273,"threads_started":2,"wal-append.queue_time_us":196199}
I20260709 13:14:11.865867  9814 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:11.872131  9814 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.766865 10054 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:11.792981  9981 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:11.874929  9981 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.783730  9958 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:11.881335  9958 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:11.793531  9642 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:14:11.807242 10068 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:14:11.880817  9981 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:11.885646  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.889068  9642 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:11.892843  9924 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.893955  9642 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:11.781317  9957 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:11.896945  9957 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:11.897683  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 325) took 1099 ms. Trace:
I20260709 13:14:11.899696  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:11.912434  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 127408us
I20260709 13:14:11.898108  7331 rpcz_store.cc:276] 0709 13:14:10.798235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.835247 (+ 37012us) service_pool.cc:224] Handling call
0709 13:14:10.835517 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:10.835852 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:10.836409 (+   557us) log.cc:844] Serialized 14 byte log entry
0709 13:14:10.992186 (+155777us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:10.998295 (+  6109us) log.cc:844] Serialized 26 byte log entry
0709 13:14:10.998450 (+   155us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:10.998487 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.998554 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:11.894799 (+896245us) spinlock_profiling.cc:243] Waited 9.95 ms on lock 0x7b1800483fa0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:14:11.897330 (+  2531us) raft_consensus.cc:1685] finished
0709 13:14:11.897432 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.897606 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50597,"prepare.queue_time_us":171,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":37466,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":14288,"spinlock_wait_cycles":22890368,"thread_start_us":123286,"threads_started":1,"wal-append.queue_time_us":170395}
I20260709 13:14:11.945540 10009 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:11.913650  9814 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:11.950996  9994 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:11.950472 10067 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.303s	user 0.006s	sys 0.011s
I20260709 13:14:11.955478  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1358) took 1446 ms. Trace:
I20260709 13:14:11.957831  7327 rpcz_store.cc:276] 0709 13:14:10.509442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.516606 (+  7164us) service_pool.cc:224] Handling call
0709 13:14:11.955237 (+1438631us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54001f4fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:11.955398 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1027726592}
W20260709 13:14:11.960981  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 162908us
I20260709 13:14:11.966398  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:11.969400  7336 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:11.972095  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:11.972858  7888 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:11.961928  9981 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:11.978986  9965 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.988217  9815 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:11.976861  9957 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:11.994486  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:11.995882  7178 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:11.996024  7185 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:11.984761  9958 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.018433  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.010414  9815 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:14:12.024365  9800 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:12.026192  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.026237  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:12.027760  7328 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:12.028563 10009 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:12.029089  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.032779  9742 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.033294  9742 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.035668  9742 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.036773  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2101) took 1189 ms. Trace:
I20260709 13:14:12.037302  7182 rpcz_store.cc:276] 0709 13:14:10.847258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.851613 (+  4355us) service_pool.cc:224] Handling call
0709 13:14:12.036538 (+1184925us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b5400247054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:12.036675 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123013504}
I20260709 13:14:12.039609  7255 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:12.044502  7179 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:12.045271  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:12.045944  7184 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:12.047740  7182 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:11.993058  9981 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.011790  9905 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:14:11.999132  7133 auto_rebalancer.cc:893] Removing replace marker failed: Replica 2ecdd7dc4a144f5aa0f2f91c7b94434d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:14:12.056221  7133 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:14:12.056929  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:12.006373  7185 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:12.058740  7182 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:14:11.994967  7888 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:12.063099  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:12.064961 10056 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.646s	user 0.001s	sys 0.000s
I20260709 13:14:12.064990  9943 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:12.065948  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.066793  9981 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:12.058552  7133 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:14:11.994313  9965 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.076936  9785 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:12.077414  9785 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:12.078377  9785 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.079769  9785 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:12.057984  9922 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.001s
I20260709 13:14:12.088635  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.075537 10009 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:12.090745 10009 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:12.091596 10009 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.092396  7184 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:12.000770  9957 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.106081  7302 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:12.120294  7262 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:12.075376  9908 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.122272  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.126899  7262 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:12.128779  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:12.115080  9922 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:12.142732  7262 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:12.148838  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.192796  7256 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:12.142448  9980 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.196590  7185 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 8. Ops: []
I20260709 13:14:12.203042  7182 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:12.209352  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:12.210011  7256 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:12.226303  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.227162  7259 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:12.143754 10009 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:12.201939 10063 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:14:12.228981  7262 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:12.149564  9922 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:12.243535  9999 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:12.245283  7888 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:12.226368  9784 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:12.246169 10088 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:12.246462  9784 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.263020  7256 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:12.267166  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.277704  9908 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:12.278738  9965 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.278841  7888 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:12.279887  9922 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.234956 10009 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.233139  9981 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:12.246974 10047 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:12.243637 10087 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:14:12.211117  9980 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.343950 10079 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:14:12.348121  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.351454  7262 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:12.346683  9906 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:12.355162  7333 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:12.346870  9777 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.352283  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2110) took 1092 ms. Trace:
I20260709 13:14:12.246790 10088 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.355116  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:12.357008  7262 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 8. Ops: []
I20260709 13:14:12.358358  7186 rpcz_store.cc:276] 0709 13:14:11.259547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.264017 (+  4470us) service_pool.cc:224] Handling call
0709 13:14:11.264288 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.548188 (+283900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:12.323322 (+775134us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400385c54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:12.352228 (+ 28906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651717376}
I20260709 13:14:12.359609  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:12.360309  7256 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:12.361696  7335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:12.362254  7335 raft_consensus.cc:606] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:12.362581  7335 raft_consensus.cc:614] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:12.368022  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.368364  7256 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:12.354398  9905 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:12.360350  9965 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:12.379225  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:12.379868  7259 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:12.375470  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.381086  7256 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:12.355576  9957 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.331779  9981 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.367710  9943 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.333940 10047 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.383862  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:12.393940  7257 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:12.360175  9906 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.408478 10009 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.417518  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.410300 10099 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:12.412612  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.414004 10088 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:12.414826 10089 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.171s	user 0.003s	sys 0.000s
I20260709 13:14:12.363734  9777 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.379695  9772 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:14:12.436728  7335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:12.440821  7335 raft_consensus.cc:606] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:12.431584 10099 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.446382  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:12.450754 10099 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:12.438380  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.439808  9976 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:12.451443  9976 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:12.452280  9976 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.453511  9976 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:12.443259  9777 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.444154  7328 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:12.459807  9784 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.460475  7257 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:12.387553  9965 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.462131  7861 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:12.463981  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.464366  9976 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:12.399335  9943 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.437530  7259 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
W20260709 13:14:12.491564  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.483053 10007 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.467382 10047 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.469198  9976 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:12.469671  9906 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.481948 10102 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.494612 10102 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.496589  9943 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.497356  9906 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:12.498034  9906 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.483253  9777 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:12.499096  9777 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.500069  9906 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.437755  9981 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:12.501560  9777 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.463316  9965 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.493317 10007 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.505435  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.494298  9976 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.505616  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.505839 10007 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:12.506299  7186 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:12.506546 10047 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:12.507136 10047 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.484803  9901 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.510756  9901 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.512907  9901 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:12.513283  9924 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:12.514204  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.515717  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.472684  9980 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:12.386106  9905 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.516364  7187 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:12.525447  7259 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:14:12.525859  7259 pending_rounds.cc:85] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 7
I20260709 13:14:12.526080  7259 pending_rounds.cc:107] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:14:12.526295  7259 raft_consensus.cc:2889] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:12.498378 10102 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:12.514292 10047 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.471724  7333 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:14:12.540606  7333 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:12.545840  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.546833  7184 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:12.531543  9905 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.558807  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:12.544556  9989 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:14:12.563035  9965 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:12.563779  9965 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.565025  7888 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:12.566957  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:12.562696 10093 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.568856 10093 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.562736  9800 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.571422  9800 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:12.572597 10086 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
W20260709 13:14:12.576406 10062 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.911s	user 0.000s	sys 0.003s
I20260709 13:14:12.578079  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2292) took 1120 ms. Trace:
I20260709 13:14:12.569693  9965 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.578601  7258 rpcz_store.cc:276] 0709 13:14:11.457655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.457823 (+   168us) service_pool.cc:224] Handling call
0709 13:14:11.458219 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.458582 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.458645 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:11.463047 (+  4402us) log.cc:844] Serialized 26 byte log entry
0709 13:14:11.514266 (+ 51219us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b480033c3d8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:14:11.624385 (+110119us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:11.624434 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.624513 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:12.575697 (+951184us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:12.577817 (+  2120us) raft_consensus.cc:1685] finished
0709 13:14:12.577841 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:12.578009 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74,"raft.run_cpu_time_us":2014,"raft.run_wall_time_us":54417,"spinlock_wait_cycles":29931776,"thread_start_us":152978,"threads_started":1,"wal-append.queue_time_us":198053}
I20260709 13:14:12.582980  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:12.591984  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:12.598824  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.601045  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.604909  7336 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:12.605716  7333 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:12.620213  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:12.622226  7333 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:12.624058  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.624656  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:12.625552  7896 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:12.598004  9906 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.635967  7254 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:12.637297  7257 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:12.639118  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.641266  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.600093  9943 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.646971  9943 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.649204  9943 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.649781  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:12.651523  9902 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:12.652114  9902 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:12.652988  9902 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.654043  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:12.655144  9924 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:12.655545  9924 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:12.655925  9924 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:12.656993  7301 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:12.658166  9947 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:12.659379  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:12.658571  9947 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:12.660151  9906 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.661173  9534 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:12.660682  9947 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:12.662778 10053 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:14:12.665540  9534 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:12.665761  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:12.667194  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:12.666455  9534 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.668623  9742 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.669153  9815 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:12.669095  9742 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.669739  9815 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:12.670276  9815 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:12.671217  9742 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:12.673319  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.676623  9642 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:12.680039  9958 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.677291  9642 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.679673  9926 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:12.691653  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.684019  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.693252  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.693818  7333 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:12.694172  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.684952  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.695629  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.685827  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.688906  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.697237  7254 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:12.698801  7254 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:14:12.699164  7254 pending_rounds.cc:85] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 2
I20260709 13:14:12.699440  7254 pending_rounds.cc:107] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:14:12.699714  7254 raft_consensus.cc:2889] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:12.701328  7254 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:12.704640  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.705276  7333 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:12.687836  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.706179  7257 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:12.707484  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:12.662402  9906 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.712708  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:12.715754  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:12.717337  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.715148  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:12.721273  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.727836  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.728790  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.730973  7330 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:12.731451  7330 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:12.731937  7333 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:12.737212  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:12.739272  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.741827  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.732395  7330 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.744426  7330 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:12.744539  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:12.745875  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.745798  7893 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:12.733925  7890 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:12.703238  9958 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.730609  9905 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:12.727162 10099 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:12.747397  8986 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:12.725351  9976 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:12.714825  9926 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.790987 10099 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.791033  8986 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:12.791666 10099 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:12.792156  8986 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.793089  9926 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.752992  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.794134  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.755728 10103 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:12.791250  9976 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.740242  9963 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:12.796357  9963 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:12.797253  9963 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.757859  9642 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.744055  9947 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.718561  9924 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.801759  9947 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:12.726660 10102 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:14:12.802910  9924 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:12.761559  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:12.752074  9905 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.804445  9905 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:12.805140  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:12.751994 10075 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:14:12.766446  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:12.767455  7334 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:12.806802  9992 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:14:12.807263  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52193.8us
I20260709 13:14:12.807806  9943 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:12.808538  9943 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:14:12.809290 10090 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.610s	user 0.002s	sys 0.000s
I20260709 13:14:12.809871  9943 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:12.810647  9943 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:12.812589  9958 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:12.781961 10092 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.539s	user 0.002s	sys 0.000s
I20260709 13:14:12.785971  9906 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:14:12.786375 10091 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.576s	user 0.000s	sys 0.001s
I20260709 13:14:12.725121  9903 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:14:12.805578  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:12.771335  9784 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.816399  9784 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.817884 10093 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.818684  9784 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:12.815754  7334 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:12.813265  9943 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.826439  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:12.829850  7184 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:12.829883  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.831957  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:12.842032  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:12.847296  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:12.849709  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.850445  7254 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:12.860520  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:12.861248  7186 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:12.862700  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:12.863271  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:12.873987  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:12.881723  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49865.2us
I20260709 13:14:12.882309  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:12.861433  9899 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.860739  9802 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.882911  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:12.887084  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.862775  9902 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.888312  7253 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:12.888821  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:12.891532  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:12.895321  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:12.896170  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:12.897146  7330 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:14:12.897639  7330 pending_rounds.cc:85] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 8
I20260709 13:14:12.898070  7330 pending_rounds.cc:107] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:14:12.898367  7330 raft_consensus.cc:2889] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:12.873243  9800 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:12.897464  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:12.873397  9988 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:12.902299  7254 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:12.886432  9901 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.873616  9906 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:14:12.905596  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:12.890492  9965 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:12.908248  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:12.891888  9899 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.907203  9988 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:12.906450  9922 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:12.906572  9642 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:14:12.863552 10079 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:14:12.886066 10009 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:12.895713 10075 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.899956 10004 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:12.906229  9947 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:12.920205  9965 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:12.930204  9947 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:12.919885  9777 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:12.930773  9947 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:12.934136  9899 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.919780  9988 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:12.935489  9988 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:12.930291  9965 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:12.913929 10007 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:14:12.924000  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:12.920475  9815 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:12.944675  9815 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:12.895382  9802 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.946015  7181 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:12.946980  9802 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.947721 10075 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.949345  8986 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:12.949826 10075 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:12.919744  9922 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.899726  9902 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.950583  9922 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:12.953080  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:12.954602  7896 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:12.955518  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 186403us
I20260709 13:14:12.924938  9958 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:12.929288  9534 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:12.957535  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:12.957866  9777 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:12.972070  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48185.5us
I20260709 13:14:12.973405  7896 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:12.967201  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.971158  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:12.978345  7330 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:12.976756  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:12.977226  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:12.918082  9901 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.950358 10099 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:12.983074  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:13.023658  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46537.6us
W20260709 13:14:13.043046  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 60072.6us
I20260709 13:14:13.043560  8986 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:13.044376  8986 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.044772  8986 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:13.045763  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.054245  8986 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:13.059548  8986 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:13.060680  7895 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:13.062737  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:13.064913  7331 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:13.006619 10102 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.946019  9905 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:13.069994  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.070356  7329 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:13.074061  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.078588  7893 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:13.011257 10009 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:13.013476  9642 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:13.033977  9910 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:13.075107  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:12.966125  9784 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:14:13.034140  9906 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:13.033605  9958 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:13.089368  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.096962  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.011901 10072 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:14:13.101729  7330 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:14:13.102698  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 213973us
I20260709 13:14:13.104311  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1397) took 1141 ms. Trace:
I20260709 13:14:13.104941  7327 rpcz_store.cc:276] 0709 13:14:11.963214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.963429 (+   215us) service_pool.cc:224] Handling call
0709 13:14:11.964061 (+   632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:12.056358 (+ 92297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:12.056388 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:12.056425 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:12.056456 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.104019 (+1047563us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b54002896d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:13.104086 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:13.104238 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211774720}
I20260709 13:14:13.108774  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:13.063639  9738 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:14:13.116669  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:13.117604  7254 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:13.119014  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:13.124504  9902 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:13.125272  9902 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:13.128154  7330 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:13.099422  9642 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:13.082166 10102 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:13.104241  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.100332  9906 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:13.103196  9958 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:13.349635  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.360648  8986 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:13.132617  9899 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.221s
I20260709 13:14:13.365288  8986 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:13.351498 10007 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:13.416517  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 307800us
I20260709 13:14:13.438800  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:13.440214  7299 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:13.441587  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:13.442838 10093 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:13.116076  9777 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:13.445746  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 326830us
I20260709 13:14:13.354583  9965 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:13.448297  8986 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:13.349885  9957 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:14:13.346315  9947 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:13.472087  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:13.473006  7332 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:13.490345  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:13.475680  9981 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:13.517663 10114 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 13:14:13.520646 10119 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:14:13.513301 10125 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:13.461269 10007 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:13.510252 10099 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:13.527330  7891 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:13.531540  9906 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:13.511667  9901 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:13.515292  9924 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:13.560811  7254 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:13.519248  9981 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:13.558034 10113 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:13.547997  9905 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:13.580610  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:13.583508  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.490489  9642 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:13.591058  7331 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.007s
I20260709 13:14:13.592365  7331 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:13.559252  9906 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.594344  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:13.610843  8986 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:13.611469  8986 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:13.607445  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:13.584308  9981 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:13.614079 10126 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:14:13.615667  9958 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:13.622548  9981 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:13.577981 10113 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.624053 10113 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:13.623000  9947 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:13.585745 10099 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.625324 10099 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:13.627513  9965 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:13.628079 10099 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:13.594781  9902 raft_consensus.cc:2764] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:14:13.630951  9981 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:13.585104  9742 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:13.635270  9742 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:13.635825  9742 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:13.636837  9922 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.673s	user 0.012s	sys 0.000s
I20260709 13:14:13.637379  9922 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:13.637936 10102 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:13.639281  8986 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:13.643659  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:13.626427  9988 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.002s
I20260709 13:14:13.648313  7187 raft_consensus.cc:2410] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:14:13.648669  9906 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:13.659374  9922 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:13.666002 10007 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:13.669387  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:13.670028  7183 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:13.670951  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:13.671744  7185 raft_consensus.cc:2410] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:14:13.672297  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:13.672905  7180 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:14:13.682682  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:13.692919  7182 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:13.686936  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:13.693522  7179 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:13.673448  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:13.672283  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:13.700762  7184 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:13.702184  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:13.702994  7187 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:13.705130 10113 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:13.710265  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.714375  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:13.722244  7179 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:13.674114 10047 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:13.725770  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:13.683213  9976 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:13.683846  9742 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:13.764917  7330 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:14:13.768559  7896 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:13.770391  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:13.771662  7182 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:13.778311  7184 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:13.780277  7331 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:13.786665  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:13.667516  9988 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:13.753551  9957 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:13.783385  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.759033  9902 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:13.757020  9711 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:14:13.801996  9902 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.802484  9902 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:13.802677 10113 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:13.803598  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.804813  9988 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:13.783901  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:13.807956  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:13.810431  9980 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:13.761365 10099 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:13.759231  9925 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:13.763186  9976 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:13.753712  9981 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:14:13.756505 10047 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:13.824568  7254 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:13.824797  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:13.825570  7255 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:13.826069  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.792271  9742 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:13.828207  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:13.831087  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:13.833824  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:13.815656 10099 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.814749 10100 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:13.838858  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.840027  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:13.840684  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:13.841514  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:13.843024  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:13.846764  7892 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 8: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:13.834712  9980 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:13.824853  9976 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:13.822172  9925 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:13.837324  9742 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:13.852837  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2327) took 1003 ms. Trace:
I20260709 13:14:13.863716  7261 rpcz_store.cc:276] 0709 13:14:12.849618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.849715 (+    97us) service_pool.cc:224] Handling call
0709 13:14:12.866783 (+ 17068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:12.867132 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:14:13.116953 (+249821us) log.cc:844] Serialized 14 byte log entry
0709 13:14:13.836338 (+719385us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:13.838041 (+  1703us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.838192 (+   151us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:13.846049 (+  7857us) log.cc:844] Serialized 14 byte log entry
0709 13:14:13.852556 (+  6507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.852626 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:13.852662 (+    36us) raft_consensus.cc:1685] finished
0709 13:14:13.852676 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:13.852780 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6283,"prepare.queue_time_us":594667,"prepare.run_wall_time_us":13776,"raft.queue_time_us":158600,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":15849984,"thread_start_us":955392,"threads_started":3,"wal-append.queue_time_us":390858}
I20260709 13:14:13.858944  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:13.867060  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:13.869357  7254 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:13.815518  9957 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:13.868554  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:13.838706 10099 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:13.874538  7262 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:13.856563  7182 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:13.848613  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:13.879498  7253 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:13.884240  7896 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:13.895241  7262 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:13.906744  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1378) took 1153 ms. Trace:
I20260709 13:14:13.864821  9927 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:13.851918  9976 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:13.885470  9814 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.882555 10078 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:13.850442  9980 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:13.866753 10102 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:13.922417  7255 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:13.928845  7182 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:14:13.925979  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 68175.2us
I20260709 13:14:13.853843  9925 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:13.930327  7896 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:13.885406 10076 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:13.901640 10100 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:13.910219 10138 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:14:14.006192  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 206263us
I20260709 13:14:13.901777  9642 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:13.911933  9903 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:13.992360 10047 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:13.967703 10144 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:13.964342  9927 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.006209 10139 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:14.073957  7228 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.557s (SENT) [suppressed 7 similar messages]
I20260709 13:14:13.907366  7333 rpcz_store.cc:276] 0709 13:14:12.752947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.753579 (+   632us) service_pool.cc:224] Handling call
0709 13:14:12.753878 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:12.754113 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:14:13.083168 (+329055us) log.cc:844] Serialized 14 byte log entry
0709 13:14:13.906273 (+823105us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:13.906343 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:13.906400 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.906488 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:13.906666 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5555,"prepare.queue_time_us":278919,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":87967,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9655,"thread_start_us":1151395,"threads_started":3,"wal-append.queue_time_us":512663}
W20260709 13:14:14.062505  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 177087us
I20260709 13:14:13.981302 10078 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:14.094050  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 192728us
I20260709 13:14:13.971477  9814 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.038028  7183 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:14.117036  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2145) took 1294 ms. Trace:
I20260709 13:14:14.054582 10141 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:14.118045  7181 rpcz_store.cc:276] 0709 13:14:12.822440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.827325 (+  4885us) service_pool.cc:224] Handling call
0709 13:14:14.116740 (+1289415us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b54002715d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:14.116949 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189599104}
I20260709 13:14:14.061674  9925 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:13.999014 10102 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.044436  9905 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:14:14.096071 10047 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:14.000382 10076 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.098788 10150 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.039767 10142 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
W20260709 13:14:14.138219 10140 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:14:14.156711  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:14.158932  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 150847us
I20260709 13:14:14.159931  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:14.063409  9642 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.036774 10138 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.137898  9742 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.123159  9777 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:14:14.183692  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:14.184358  7255 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:14.188743  7262 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:14:14.189231  7255 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:14.163512  9992 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:14.191049  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:14.191814  7255 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:14.193153  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:14.169835 10136 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:14.195123  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:14.195796  7255 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
W20260709 13:14:14.195935  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 75377.6us
I20260709 13:14:14.170951 10157 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:14.201048  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:14.201879  7262 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:14.099273 10144 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.199038  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:14.145388  9925 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.207086  9925 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.200335  9992 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.203737  7255 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:14.210927  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:14.211964  7255 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:14.162420 10047 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.105454 10139 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.205030  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:14.208935  9992 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.182006  9957 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.143890 10141 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.136462 10100 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.179663 10159 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:14:14.161686 10150 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.362316  9742 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:14.381093  9742 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.381552  9742 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:14.368326  9992 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:14.384025  9992 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:14.369284 10147 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 13:14:14.370174 10154 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:14:14.369529  9957 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:14.370934 10151 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:14:14.371943 10148 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:14:14.372692  9814 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:14.373936 10144 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.374807 10165 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:14.375227  7921 heartbeater.cc:646] Failed to heartbeat to 127.5.227.190:45419 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.5.227.190:45419 timed out after 15.000s (SENT)
I20260709 13:14:14.375530  9926 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:14.376175 10162 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:14.374908 10167 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:14.190426 10146 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
I20260709 13:14:14.218348  7262 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:14:14.193950 10156 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.178s
I20260709 13:14:14.366699  9800 raft_consensus.cc:993] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:14:14.356186  9772 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:14.426548  9980 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:14.427218  9980 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.430027  9926 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.431070  9927 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:14.431309  9642 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.432296  9800 raft_consensus.cc:1081] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Signalling peer 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:14:14.432439  9926 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.425060 10165 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.212970 10136 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:14.424546 10162 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.433723 10136 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.379019 10078 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:14.426344  9772 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.280129 10160 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:14.357687 10142 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:14.440761 10102 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.440999  7262 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:14.441390 10142 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.442286 10047 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:14.444139 10142 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.436578 10167 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.434507 10165 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.446950  9980 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:14.213469 10157 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.471822 10167 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:14.455595 10144 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:14.472537 10162 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:14.474706 10141 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:14.476040 10138 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.476922 10076 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:14.484642 10120 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.971s	user 0.007s	sys 0.000s
I20260709 13:14:14.484551  9772 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:14.482342 10150 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.470358 10157 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:14.486130 10144 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:14.487700  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 385461us
I20260709 13:14:14.456779  9926 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:14.445305 10160 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:14.497035  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:14.556521  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:14.493301  9992 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:14.543128  9902 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.001s
I20260709 13:14:14.554252  9742 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:14.556740 10099 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 13:14:14.556015  9980 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.557178  9926 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:14.579744  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.580081  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 525) took 1745 ms. Trace:
I20260709 13:14:14.580515  7889 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 4.
I20260709 13:14:14.576957  9980 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.580622  7890 rpcz_store.cc:276] 0709 13:14:12.834254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.855147 (+ 20893us) service_pool.cc:224] Handling call
0709 13:14:12.881320 (+ 26173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:12.908490 (+ 27170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:12.915283 (+  6793us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:12.930412 (+ 15129us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.134182 (+203770us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:13.141358 (+  7176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.330892 (+189534us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:14.483943 (+1153051us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:14.577240 (+ 93297us) raft_consensus.cc:1685] finished
0709 13:14:14.578365 (+  1125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.580005 (+  1640us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2925,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3185,"spinlock_wait_cycles":5494144,"thread_start_us":191675,"threads_started":1,"wal-append.queue_time_us":506348}
I20260709 13:14:14.585042  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.588680  9980 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:14.581890 10098 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:14.572829  9902 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.574749 10099 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.591280 10048 raft_consensus.cc:2955] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:14:14.624352 10118 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.178s	user 0.004s	sys 0.000s
I20260709 13:14:14.624835 10160 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.577600 10144 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.626683 10139 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:14.627424 10144 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:14.627926 10123 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.112s	user 0.000s	sys 0.007s
I20260709 13:14:14.631078 10121 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:14.631493 10121 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:14.631876 10099 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:14.632282 10121 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:14.644265 10152 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.487s	user 0.000s	sys 0.003s
I20260709 13:14:14.654892 10128 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:14.655495 10128 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:14.656741 10128 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.658257 10128 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:14.235882  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 45947.8us
I20260709 13:14:14.704833  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2149) took 1750 ms. Trace:
W20260709 13:14:14.707010  7226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.016s
W20260709 13:14:14.707548  7226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.007s	sys 0.016s
I20260709 13:14:14.707660  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:14.712615  7228 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.018s	sys 0.005s
W20260709 13:14:14.713220  7228 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.018s	sys 0.005s
W20260709 13:14:14.713907  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 639909us
I20260709 13:14:14.715888  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:14.716514  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 142237us
I20260709 13:14:14.720638  7330 raft_consensus.cc:2368] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:14.722749  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1417) took 1889 ms. Trace:
W20260709 13:14:14.723899  7329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1376) took 1982 ms (client timeout 2121 ms). Trace:
I20260709 13:14:14.724810  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1419) took 1771 ms. Trace:
W20260709 13:14:14.727027  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:14.724575  7329 rpcz_store.cc:269] 0709 13:14:12.741395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.741527 (+   132us) service_pool.cc:224] Handling call
0709 13:14:14.723371 (+1981844us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400288cd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:14.723647 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753803008}
I20260709 13:14:14.730832  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:14.705605  7186 rpcz_store.cc:276] 0709 13:14:12.953786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.954670 (+   884us) service_pool.cc:224] Handling call
0709 13:14:12.954992 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:12.955374 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:12.955417 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:12.956021 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 13:14:13.341228 (+385207us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:13.547739 (+206511us) log.cc:844] Serialized 14 byte log entry
0709 13:14:13.548005 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.548100 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:14.627365 (+1079265us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:14.703983 (+ 76618us) raft_consensus.cc:1685] finished
0709 13:14:14.704213 (+   230us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.704579 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":367716,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":2094,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":20820,"spinlock_wait_cycles":14387072,"thread_start_us":487442,"threads_started":2,"wal-append.queue_time_us":505024}
I20260709 13:14:14.735607  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.737531  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.743461  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.745678  7890 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:14:14.747347  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.748186  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:14.720533  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 632) took 1660 ms. Trace:
I20260709 13:14:14.730131  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1423) took 1755 ms. Trace:
I20260709 13:14:14.752386  7891 rpcz_store.cc:276] 0709 13:14:13.059588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.059741 (+   153us) service_pool.cc:224] Handling call
0709 13:14:13.527139 (+467398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:13.532954 (+  5815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:14.719937 (+1186983us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b540043b2d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:14.720281 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074046848}
I20260709 13:14:14.723317  7334 rpcz_store.cc:276] 0709 13:14:12.833610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.833828 (+   218us) service_pool.cc:224] Handling call
0709 13:14:12.834261 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:12.867144 (+ 32883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:12.867176 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:12.867645 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.085462 (+217817us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:13.085520 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.085615 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:14.623771 (+1538156us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:14.721905 (+ 98134us) raft_consensus.cc:1685] finished
0709 13:14:14.721951 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.722422 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37282,"raft.queue_time_us":33396,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11274,"spinlock_wait_cycles":37481728,"thread_start_us":194693,"threads_started":1,"wal-append.queue_time_us":454030}
I20260709 13:14:14.725464  7335 rpcz_store.cc:276] 0709 13:14:12.953097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.953237 (+   140us) service_pool.cc:224] Handling call
0709 13:14:12.953543 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:12.953921 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:12.953948 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:12.954377 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.662116 (+707739us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b180048d900. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:14:13.886572 (+224456us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:13.886613 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.886696 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:14.643468 (+756772us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:14.724110 (+ 80642us) raft_consensus.cc:1685] finished
0709 13:14:14.724169 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.724562 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":363,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7461,"spinlock_wait_cycles":13325440,"thread_start_us":224270,"threads_started":1,"wal-append.queue_time_us":1145612}
W20260709 13:14:14.761476  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 43808.5us
I20260709 13:14:14.763662  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 338) took 1661 ms. Trace:
I20260709 13:14:14.764317  7328 rpcz_store.cc:276] 0709 13:14:13.101684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.101866 (+   182us) service_pool.cc:224] Handling call
0709 13:14:13.102130 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:13.436177 (+334047us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:13.436471 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:14:13.755755 (+319284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:13.755818 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:13.755881 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:14.762978 (+1007097us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400421b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:14.763074 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.763399 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16031,"prepare.queue_time_us":8934,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":45829,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2931,"spinlock_wait_cycles":763292928,"thread_start_us":274628,"threads_started":1,"wal-append.queue_time_us":414042}
I20260709 13:14:14.752806  7336 rpcz_store.cc:276] 0709 13:14:12.975043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:13.033680 (+ 58637us) service_pool.cc:224] Handling call
0709 13:14:13.034089 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:13.106536 (+ 72447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:13.106583 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:13.107167 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.490047 (+382880us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:13.490089 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:14.729094 (+1239005us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b540013cc54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:14.729210 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:14.729334 (+   124us) raft_consensus.cc:1685] finished
0709 13:14:14.729359 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.729896 (+   537us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3227,"raft.queue_time_us":4307,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8264,"spinlock_wait_cycles":158104960,"thread_start_us":356377,"threads_started":1,"wal-append.queue_time_us":464533,"wal-append.run_cpu_time_us":1781,"wal-append.run_wall_time_us":1030913}
I20260709 13:14:14.776988  7262 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:14.777858  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:14.779397  7255 raft_consensus.cc:2410] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:14:14.780927  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:14.782171  7256 raft_consensus.cc:2410] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:14:14.784222  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:14.786095  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.788285  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.790174  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.808874  9742 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:14.809904  9742 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.809935  9902 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:14.822592  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.610844  9926 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.812031  9742 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.841524 10004 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:14.843884  9999 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:14.844892  9999 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.847630 10170 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:14:14.842556 10004 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.851702 10004 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:14.844739 10116 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:14:14.836192 10103 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.861310  9926 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:14.863575  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2324) took 2014 ms. Trace:
I20260709 13:14:14.866330  9999 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:14.867401  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 296033us
I20260709 13:14:14.871285  7259 rpcz_store.cc:276] 0709 13:14:12.848669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.848843 (+   174us) service_pool.cc:224] Handling call
0709 13:14:12.849222 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:12.864649 (+ 15427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:12.864679 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:12.865173 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:14:13.576579 (+711406us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b1800489640. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1
0709 13:14:13.576778 (+   199us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:13.576829 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:13.576921 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:14.625752 (+1048831us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b1800489640. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:14:14.863088 (+237336us) raft_consensus.cc:1685] finished
0709 13:14:14.863139 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:14.863347 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15054,"raft.queue_time_us":17185,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":11375,"spinlock_wait_cycles":44075520,"thread_start_us":4962,"threads_started":1,"wal-append.queue_time_us":5345}
I20260709 13:14:14.877647  9906 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:14.877912  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:14.880779  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:14.842357 10007 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:14:14.836179 10169 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.895215  7181 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:14.896528 10103 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:14.910530  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:14.919222  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:14.921693  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:14.923012  7328 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:14:14.923179  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:14.934093  7259 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
W20260709 13:14:14.931257  7152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.002s	sys 0.002s
W20260709 13:14:14.939495  7152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.002s	sys 0.003s
I20260709 13:14:14.943153  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:14.944473  7336 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:14.950773  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.950989  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.952368  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:14.954408 10169 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:14.958442  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:14.987684  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 791063us
I20260709 13:14:15.005875  7328 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:14.997772 10103 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:15.008817  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:15.017083  7183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:14:15.017695  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:15.018992  7253 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:15.020115  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.021169  7330 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
I20260709 13:14:15.018051  7183 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.024684  7183 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.027171  9999 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:15.027565  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 69427.2us
I20260709 13:14:15.030689  9989 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:15.031773  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:15.034179 10177 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:15.037985  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.039077  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.039157  7329 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:15.040758  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.042928  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.045548  7332 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:15.048355  7225 leader_election.cc:400] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:15.048728  7225 leader_election.cc:403] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:15.049494  9943 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:14:15.054677  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.055081  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:15.055538  7328 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:15.055876  7890 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:15.056643 10103 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:15.057446 10103 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.058394 10169 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:15.059608  9943 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:15.060400 10103 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:15.060493  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:15.061575  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:15.063925 10007 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:15.066154  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:15.034240  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:15.070988  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:15.071280  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.072705  7181 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:15.073470  7186 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:15.073925  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.078706  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.079530  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:15.081329  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 47261.2us
I20260709 13:14:15.081627  7331 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:15.082609 10158 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:15.082713  7330 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:14:15.078534  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:15.089113 10183 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.466s	user 0.004s	sys 0.001s
I20260709 13:14:15.089711 10121 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.091424  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:15.093417  9993 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:15.093907  9993 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:15.094331  9993 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:15.095381 10184 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.472s	user 0.003s	sys 0.003s
I20260709 13:14:15.095548  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:15.096202  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:15.096426  7253 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:15.096993  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:15.099913  7261 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:14:15.103008  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:15.103842  7187 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:15.093291  7085 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.104954  7890 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:15.106467  9742 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:15.092202 10158 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:15.107040  7183 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.108392  7085 catalog_manager.cc:5697] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 3 to 6, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:15.110752  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.111232 10157 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:15.116766  7328 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:14:15.114282  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 97628.4us
I20260709 13:14:15.118376  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.118040  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:15.129069  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.152374  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.156284  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:15.159049  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46490us
I20260709 13:14:15.168251  7183 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:15.173379  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:15.184587  7184 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:15.151602 10007 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:15.196897  7261 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:14:15.197614  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.186573  9742 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:15.199719  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.200139  7182 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:15.215371  7334 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:15.216907  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.221635  7179 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:15.233798  7187 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:15.216958  7085 catalog_manager.cc:5697] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:15.246966  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 181037us
W20260709 13:14:15.252164  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 160888us
W20260709 13:14:15.260115  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.267019  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.269454  7179 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:15.204845 10157 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.245801  9742 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.298990  7256 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:15.302762 10100 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:15.302776  7150 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:15.306193  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:15.313835  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:15.307217  7328 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:15.326069  7336 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:15.327418  7332 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:14:15.322973  7082 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47542 (request call id 232) took 15400 ms (client timeout 15000 ms). Trace:
I20260709 13:14:15.336205 10179 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:15.331257  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.328002  7332 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:15.340947  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:15.355219  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 52735.1us
I20260709 13:14:15.357594  7085 catalog_manager.cc:5697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 1 to 4, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 4 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.329046  9993 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.356807 10162 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:15.385329 10162 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:15.404903  7332 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.362389 10100 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.422406  7180 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:15.381354 10144 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:15.421798  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:15.423015  7253 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:15.414053  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 139915us
I20260709 13:14:15.343374  7181 raft_consensus.cc:2955] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:14:15.422554  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 128614us
I20260709 13:14:15.425679  7257 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:15.434255 10076 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:14:15.435223  7085 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 2 to 3, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 3 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:15.437088 10157 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:15.438958 10100 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:15.439404  9800 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.440121  9800 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.443058  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:15.425769  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:15.445245  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.434860  7332 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.417522 10162 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.453809  7331 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:14:15.459194 10194 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:14:15.423676 10172 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:15.460965 10172 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.464612  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:15.464896 10201 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.166s	user 0.000s	sys 0.004s
I20260709 13:14:15.466101  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:15.467401  9963 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:15.467859  9645 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:15.468214 10143 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:15.468444 10144 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.468905  9926 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:15.468266  9988 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:15.471549 10197 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
I20260709 13:14:15.473516  9742 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:15.487286  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:15.445711  7254 raft_consensus.cc:2955] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:15.496765  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:15.497443  9993 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:15.498063  9777 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:15.499135  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:15.499665 10198 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:14:15.505825  7255 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:15.521502  9800 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:15.526678  9963 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:15.527382 10172 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:15.527806 10158 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:15.528306  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 81221us
I20260709 13:14:15.528988 10165 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:14:15.526702  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 83784.4us
W20260709 13:14:15.535311 10192 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.231s	user 0.000s	sys 0.003s
I20260709 13:14:15.545058 10177 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:15.550710 10196 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:14:15.582595  9976 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:15.550693  9988 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.583791  9976 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:15.584161  9976 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:15.585013  9988 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:15.553503 10143 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:15.586381  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 99288.3us
I20260709 13:14:15.556457 10144 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:15.558249  7888 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:15.543613  9926 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:15.510303  7261 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
W20260709 13:14:15.332636  7082 rpcz_store.cc:269] 0709 13:13:59.781004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.781310 (+   306us) service_pool.cc:224] Handling call
0709 13:14:15.165597 (+15384287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:09.815428 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:09.821127 (+  5699us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:09.821167 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:14:09.821190 (+    23us) tablet.cc:662] Decoding operations
0709 13:14:09.822505 (+  1315us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:09.822595 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:09.822643 (+    48us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:14:09.823742 (+  1099us) tablet.cc:701] Row locks acquired
0709 13:14:09.823762 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:14:09.823934 (+   172us) write_op.cc:270] Start()
0709 13:14:09.824043 (+   109us) write_op.cc:276] Timestamp: P: 1783602849823883 usec, L: 0
0709 13:14:09.824063 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:14:09.865540 (+ 41477us) log.cc:844] Serialized 5989 byte log entry
0709 13:14:10.516122 (+650582us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b54000aa354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9237e28 00007fececc72581 00007fececc71d58 00007fececc769f1 00007fececc769a9 00007fececc76939 00007fececc76901 00007fececc75b2d 000000000038f354 000000000038f199
0709 13:14:10.527121 (+ 10999us) op_driver.cc:464] REPLICATION: finished
0709 13:14:10.695903 (+168782us) write_op.cc:301] APPLY: starting
0709 13:14:10.695998 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:10.696338 (+   340us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:10.696364 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:10.710605 (+ 14241us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:10.710908 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:14:10.714359 (+  3451us) write_op.cc:312] APPLY: finished
0709 13:14:10.879722 (+165363us) log.cc:844] Serialized 107 byte log entry
0709 13:14:10.902090 (+ 22368us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:10.922517 (+ 20427us) write_op.cc:454] Released schema lock
0709 13:14:10.929849 (+  7332us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:10.959391 (+ 29542us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:10.963276 (+  3885us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1456675,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":155184,"apply.run_cpu_time_us":4953,"apply.run_wall_time_us":250266,"num_ops":15,"prepare.queue_time_us":185023,"prepare.run_cpu_time_us":32698,"prepare.run_wall_time_us":719786,"raft.queue_time_us":273236,"raft.run_cpu_time_us":22551,"raft.run_wall_time_us":99798,"replication_time_us":702903,"spinlock_wait_cycles":93779328,"thread_start_us":587427,"threads_started":4,"wal-append.queue_time_us":385534,"wal-append.run_cpu_time_us":23328,"wal-append.run_wall_time_us":1696285}]]}
I20260709 13:14:15.566042  7184 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:15.566919  7335 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:15.568051  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:15.568641  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 102649us
I20260709 13:14:15.565070 10158 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:15.573689  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:15.574923 10131 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:15.575390  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:15.602989  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.603348 10131 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:15.603874 10131 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.604430  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:15.606806 10169 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:15.607229 10169 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.607568 10169 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:15.576365 10157 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:14:15.577013  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49110.1us
I20260709 13:14:15.578079  9963 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.585006  9976 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.616582  9976 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.579380 10072 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:15.580191 10179 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:15.618350 10179 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:15.618752  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:15.619124  9990 consensus_queue.cc:1175] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" responder_term: 6 status { last_received { term: 6 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 6 index: 6 } }
I20260709 13:14:15.619664  9993 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:15.619351 10179 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.620069  9993 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:15.620508  9993 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.620942 10179 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.621702  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.623158  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.624009  7179 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:15.625102  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.581204  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.594688  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:15.580308 10177 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.600230 10158 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:15.600415 10143 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:15.601186  7150 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:15.601706 10165 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:15.613703  7332 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:15.593809  9926 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:15.625422 10172 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:15.627019  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.627209  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.631059  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:15.599645 10133 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:15.626296  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:15.638491  9910 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:15.642884  9910 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:15.637336  7335 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
W20260709 13:14:15.646589  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 45539.4us
I20260709 13:14:15.634449  9988 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:15.656764  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:15.658855  7179 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:15.662693  9922 raft_consensus.cc:2764] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:14:15.662994  7182 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:15.663820  9534 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:15.664283  9534 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:15.664645  9534 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.665912  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.666743  7179 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:15.667559  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:15.667498  9910 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.668833  9910 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:15.670353  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.638798 10165 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:15.672052 10165 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:15.671916 10162 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.672552  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.668781  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.674058  7182 raft_consensus.cc:2368] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:15.674096 10162 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:15.641304 10133 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:15.674940 10133 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:15.675176  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.677846  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.678956  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.680121  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.681255  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.658037 10157 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:15.689026  7185 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:15.694280  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.683225  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.655607  9988 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:15.700917  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:15.683156 10157 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:15.655287 10143 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:14:15.708086  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51426.2us
I20260709 13:14:15.716567  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.703508  9988 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:15.724267 10131 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.725790  7253 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:15.727067 10131 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:15.733707  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.700079 10144 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:14:15.738473  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 89694.8us
I20260709 13:14:15.706233 10157 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:15.743791  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.706875 10143 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:15.748992  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:15.737340  9910 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:15.749516 10143 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.766571  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:15.737534  9742 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:14:15.736707 10169 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.771258  9910 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:15.795680  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 46802.5us
I20260709 13:14:15.756990 10144 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:15.761284  9922 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:15.803613  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:15.798671  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:15.801362  9889 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:14:15.802089  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.814093  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:15.802995  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:15.803592  9988 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.803884  9910 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:15.803949  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.804431 10172 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:15.804706  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.800252  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.807694  7328 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.810588  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.806195  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:15.812083  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:15.819964  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:15.832893  7336 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:15.846149  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:15.850363 10007 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:15.812589  9800 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:15.851696  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.857950  7253 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
W20260709 13:14:15.845726  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50506.4us
I20260709 13:14:15.807569  9922 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:15.817706 10177 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:15.851083 10007 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:15.886528  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:15.873507  7334 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.025s	sys 0.027s
W20260709 13:14:15.905856  7334 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.025s	sys 0.027s
I20260709 13:14:15.857064  9800 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.870609  9922 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:15.933138  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 495520us
I20260709 13:14:15.907867  7335 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:15.873775  9976 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:15.903946 10121 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.904145 10153 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:15.932606  9800 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:15.933156  9742 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:15.957592  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 119667us
I20260709 13:14:15.901491 10172 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 13:14:15.957039  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 309148us
I20260709 13:14:15.937295 10131 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:15.963557  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:15.939924  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:15.977082  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:15.977605  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.910499  9926 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.980389  7183 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:15.959964  9777 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:15.942961  9534 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.999778  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:15.946223  9976 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.943949 10121 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:15.980110 10131 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:15.938282 10144 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:15.964728  9742 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.014009  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:15.960321 10133 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:16.036468  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.040033  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.048096  9777 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:16.048585  9777 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:16.048947  9777 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:16.050266 10152 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:16.053787  9534 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:16.055183 10113 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:16.055630 10113 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:16.056581 10113 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.057979 10113 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:15.983399 10153 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:16.044222  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 67252.4us
W20260709 13:14:16.063352  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 129293us
I20260709 13:14:16.064054  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:16.025202 10131 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:16.075179  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 215933us
I20260709 13:14:16.038867 10177 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:16.084673  7861 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:16.086154  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:16.081008  7255 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:16.054540  9534 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:16.091194  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.092180  7183 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:16.058729 10169 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:16.100090  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 213643us
I20260709 13:14:16.109994  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:16.112821  7259 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:16.093493  9988 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:16.123178  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.124049  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.136312  7184 raft_consensus.cc:2368] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:16.125043  9848 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:16.126325  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.137223  7332 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:16.127195  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:16.127628  9963 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.127921 10133 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.010603 10007 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:16.129092 10213 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:14:16.129427  9742 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:16.129547  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 65571.2us
I20260709 13:14:16.086853 10157 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.131624  9926 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:16.119498  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.163440  7301 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:14:16.131341 10215 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
W20260709 13:14:16.156706  9993 consensus_meta.cc:287] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 13:14:16.178779  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:16.183965  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 73062.9us
I20260709 13:14:16.141131  9848 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:16.191874  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:16.200429  7180 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:16.200687  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 186780us
I20260709 13:14:16.166374  9988 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.209964  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:16.183910 10177 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:16.203796  9926 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.163257  9963 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:16.235991  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.241345  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:16.187140  9645 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.641s	user 0.013s	sys 0.000s
W20260709 13:14:16.234089 10218 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:14:16.191824  9848 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:16.235692  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 459) took 1122 ms. Trace:
I20260709 13:14:16.184353  9534 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:16.164884 10158 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.263397  7181 rpcz_store.cc:276] 0709 13:14:15.112836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.113049 (+   213us) service_pool.cc:224] Handling call
0709 13:14:15.115333 (+  2284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:15.343110 (+227777us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:15.598677 (+255567us) log.cc:844] Serialized 14 byte log entry
0709 13:14:16.088433 (+489756us) log.cc:844] Serialized 14 byte log entry
0709 13:14:16.091740 (+  3307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:16.091787 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:16.091825 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.235459 (+143634us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002c5454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:16.235508 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:16.235634 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3087,"raft.queue_time_us":60972,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":4029,"spinlock_wait_cycles":484675712,"thread_start_us":402047,"threads_started":2,"wal-append.queue_time_us":475036}
I20260709 13:14:16.184573  9993 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:16.280267  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:16.250952 10179 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.007s
W20260709 13:14:16.304801  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 112914us
W20260709 13:14:16.305713  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 194494us
I20260709 13:14:16.264087  9926 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.312342  9800 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.312736  7184 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:16.312824  9926 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:16.313473 10223 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:14:16.314109 10222 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:16.314146  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.314790 10222 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.315766  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.316949 10222 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.317693  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.296638  9910 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:14:16.319548 10239 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:16.319909  7333 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:16.320014 10239 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.320508 10239 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:16.320973  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.321601  7333 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:16.323498  7336 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 13:14:16.322492  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.324620  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.324684  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.325871  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:16.325980  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:16.327112 10153 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.281870  9645 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:16.328064  7187 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:16.219002  9988 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:16.302263  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57740.1us
I20260709 13:14:16.326033  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:16.330768  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.330667  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.333266  7185 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:16.351925  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:16.298429  9534 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:16.375078  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:16.261394 10072 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:14:16.373109  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.373996  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:16.334805 10165 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.007s
W20260709 13:14:16.377271  7328 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.001s
I20260709 13:14:16.312836  9963 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:16.358871 10218 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:14:16.380695  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:16.328902  9800 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:16.382436  7328 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
W20260709 13:14:16.374835  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 51914.6us
I20260709 13:14:16.396026  7333 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:16.383919  7181 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:16.323549 10128 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:16.343092 10121 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.376448 10153 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:14:16.406517  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 243160us
I20260709 13:14:16.378170  9534 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:16.409303  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.413432  7179 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:14:16.486052  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.423982  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:16.560180  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 136319us
I20260709 13:14:16.562482  7328 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:16.566713  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.407910 10153 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:16.569319 10158 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:16.570528  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:16.571785  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:16.572813  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.575773  9988 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:16.559558 10224 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:16.578701 10157 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.579203 10224 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.580688  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:16.581089  9777 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.003s
I20260709 13:14:16.581748 10224 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.581532  9777 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.583389  9993 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:16.585237 10229 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:16.585863 10229 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.586745 10153 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:16.589695 10143 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.793s	user 0.011s	sys 0.001s
I20260709 13:14:16.567416  7179 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:16.387930 10165 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.599504  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.582288  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:16.556749 10144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.044s	sys 0.108s
I20260709 13:14:16.608815  7888 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:16.609516  7179 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:16.610491  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.611325  7186 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:16.590162 10143 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.610491  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:16.612519  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.613286  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.565578 10121 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:14:16.614928  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 223380us
W20260709 13:14:16.618116  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 189110us
W20260709 13:14:16.605692 10144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.044s	sys 0.109s
I20260709 13:14:16.623958  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.624171  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.588492 10229 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.624752  7182 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
W20260709 13:14:16.628270  7228 leader_election.cc:336] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.557s (SENT)
I20260709 13:14:16.406280 10177 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.631561  7262 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:16.630780  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.633921  7328 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:16.616168 10224 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.634338  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.632714  7253 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:16.630290  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:16.636715  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:16.595161 10131 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.636708  7150 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:16.639467 10072 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:16.640108  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:16.641394  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.642241  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:16.643715 10072 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:16.646030  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:16.646778 10179 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:16.647351 10179 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:16.647616 10072 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:16.648375 10179 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.642233  7261 raft_consensus.cc:2410] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:14:16.651233  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.653491  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.629024 10121 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:16.660794  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.665182  7891 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
W20260709 13:14:16.687304  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 59065us
I20260709 13:14:16.689162  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:16.647284  9777 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:16.633577  9990 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:14:16.685849 10224 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.711844 10048 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:16.712823 10224 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.712721 10048 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.656275 10239 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.715194  9990 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:16.715767  9990 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:16.716908  9990 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.718564  9990 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:16.668119  9848 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.719430 10143 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:16.721191  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.728695  7257 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:14:16.742290 10153 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.743376  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.743944  7254 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
W20260709 13:14:16.744544 10214 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.692s	user 0.001s	sys 0.002s
I20260709 13:14:16.715201 10239 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:16.740294  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.725049  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.744805  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:16.745806  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 470) took 1060 ms. Trace:
I20260709 13:14:16.719724  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:16.763993  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:16.721186  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.778226  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.779558  7259 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:16.721248  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.771693  7182 rpcz_store.cc:276] 0709 13:14:15.685086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.685258 (+   172us) service_pool.cc:224] Handling call
0709 13:14:15.697391 (+ 12133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:16.629644 (+932253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.745511 (+115867us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54000ed8d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:16.745733 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122590976}
I20260709 13:14:16.783080  7254 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:16.762861  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:16.786325  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 66679us
I20260709 13:14:16.787441  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:16.759188 10113 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.002s
W20260709 13:14:16.763572  9922 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.818s	user 0.009s	sys 0.002s
I20260709 13:14:16.746336 10048 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.744673 10153 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:16.802897  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:16.759280  9976 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:16.800565  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.755613 10131 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:16.733649 10144 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:16.747745  9848 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:16.756080 10165 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:16.801637  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:16.718614  9534 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.789691 10229 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:16.811317  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:16.829751  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:16.807193 10143 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:16.817101  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:16.801749 10158 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:16.834378  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:16.835700  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:16.840456  7254 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:16.816391 10224 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:16.841389  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:16.719130 10121 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.842610  7891 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:16.844033  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:16.844873  7887 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:16.845631  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:16.846256  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.846868  9534 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:16.847101  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:16.847549  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:16.848166  7261 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:16.848973  7894 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:16.833590 10165 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:16.849538 10165 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:16.849951 10165 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:16.805864  9922 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.851254  7330 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:16.852845  9922 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:16.855572  7261 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:16.833981  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:16.856395  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:16.859197  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:16.861057  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.861183  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:16.861163  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:16.862542  7261 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:16.862749  7254 raft_consensus.cc:2410] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:14:16.861756  7896 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:16.864243  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:16.867853  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:16.858079 10076 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:16.861511 10229 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:16.882182  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:16.885233 10224 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:16.885663  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:16.885807 10224 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.886814  9963 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:16.888042 10224 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.888175  9963 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:16.888607 10224 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:16.874446 10158 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:16.889743  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 426) took 1165 ms. Trace:
I20260709 13:14:16.890377  7262 rpcz_store.cc:276] 0709 13:14:15.724789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.724971 (+   182us) service_pool.cc:224] Handling call
0709 13:14:15.725306 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:16.631944 (+906638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.889428 (+257484us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54003499d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:16.889663 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083743488}
I20260709 13:14:16.895836  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:16.901607  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:16.910320  7258 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:16.888954 10224 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.913630  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:16.903133 10076 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:16.899492 10048 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.899678  9848 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:16.904848 10179 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:16.921113  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:16.909788 10235 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:16.936807  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:16.938434  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:16.920699 10121 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:16.935678 10007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.003s	sys 0.010s
I20260709 13:14:16.915221 10224 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:16.939739 10076 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:16.932793 10048 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.954365  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:16.942986 10177 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:16.933988 10179 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.967981 10133 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:16.968490 10133 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:16.969960 10179 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.971199  9889 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:16.971963  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1569) took 1319 ms. Trace:
I20260709 13:14:16.972311  7180 rpcz_store.cc:276] 0709 13:14:15.652213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.652437 (+   224us) service_pool.cc:224] Handling call
0709 13:14:15.652850 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:16.209112 (+556262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.962847 (+753735us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400271ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:16.971895 (+  9048us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240997248}
I20260709 13:14:16.973171 10232 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:16.973505  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:16.973750 10232 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.974480 10220 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:16.974870 10220 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:16.976016 10216 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:16.975713 10220 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.976804 10220 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:16.977710  7262 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:16.976598 10216 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:16.981333  7260 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:16.982164  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:16.983492 10048 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.984655 10216 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.985368 10232 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:16.977912  9848 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:16.987290  9848 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:16.988271  9848 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:16.989578  9848 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:16.990697  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:16.944553 10007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.003s	sys 0.010s
I20260709 13:14:16.992674  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:16.996205 10255 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
I20260709 13:14:16.940219  9988 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:14:16.950378 10076 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:16.941849 10153 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:14:16.998772  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 60381.1us
I20260709 13:14:17.056069  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:17.047380  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54765.8us
I20260709 13:14:17.058698  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:17.062996  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:17.065032  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:17.050365 10262 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:14:16.969323 10133 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:17.014076 10229 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:17.046779 10131 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:17.057832 10076 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:17.080986  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 471) took 1357 ms. Trace:
I20260709 13:14:17.081401  7187 rpcz_store.cc:276] 0709 13:14:15.723133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.727895 (+  4762us) service_pool.cc:224] Handling call
0709 13:14:15.729215 (+  1320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:16.334355 (+605140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.080743 (+746388us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54001b35d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:17.080929 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376749824}
W20260709 13:14:17.084841 10246 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.393s	user 0.000s	sys 0.003s
I20260709 13:14:17.075176  9889 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:14:17.078598 10179 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:17.090518 10179 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:17.090992 10179 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:17.098948  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:17.069578 10048 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:14:17.111135  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:17.074589 10165 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.113914  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:17.202406  7152 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:17.203843  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 475) took 1020 ms. Trace:
I20260709 13:14:17.203936  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:17.204775 10177 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:17.205868 10177 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:17.206322 10177 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:17.207536 10177 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:17.208503 10248 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.504s	user 0.002s	sys 0.007s
I20260709 13:14:17.210855  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:17.114334 10232 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:17.212299  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:17.204393  7185 rpcz_store.cc:276] 0709 13:14:16.183909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.184123 (+   214us) service_pool.cc:224] Handling call
0709 13:14:16.211457 (+ 27334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:16.351750 (+140293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.118569 (+766819us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400257954. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:17.203781 (+ 85212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279556864}
W20260709 13:14:17.201435 10262 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:14:17.216356  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 139317us
I20260709 13:14:17.220069 10072 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:17.216048 10226 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:17.226929 10226 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.227437 10226 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.229635 10226 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:17.232746  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1458) took 1111 ms. Trace:
I20260709 13:14:17.108397 10179 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.235829 10244 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:14:17.236248 10272 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:14:17.236871  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:17.202319 10169 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:17.240844  7330 rpcz_store.cc:276] 0709 13:14:16.120836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.122310 (+  1474us) service_pool.cc:224] Handling call
0709 13:14:16.122655 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:16.851598 (+728943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.232483 (+380885us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b540036b854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:17.232680 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675220736}
W20260709 13:14:17.244884  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:17.243521 10072 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:14:17.247938  9889 raft_consensus.cc:3055] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:17.249233  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:17.240223 10244 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:14:17.256531  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 197973us
I20260709 13:14:17.256603 10143 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:17.257160 10227 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:17.260123 10270 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:14:17.264755 10235 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:17.278244 10235 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:17.279003  7890 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:17.279101 10235 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.280512 10235 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:17.255045 10169 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:17.281569 10229 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:17.248364  9889 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:17.283730  9889 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:17.284374 10076 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.285079  9889 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:17.251142  9848 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:14:17.264058 10179 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:17.287585 10074 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:17.287966 10074 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:17.264612 10165 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:17.267503 10256 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.306s	user 0.000s	sys 0.002s
I20260709 13:14:17.288888 10074 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:17.290257 10074 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:17.256650  9963 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:17.245077 10216 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:17.291558 10219 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:17.291862 10172 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:17.291965 10224 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:17.292490 10220 consensus_queue.cc:1175] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" responder_term: 6 status { last_received { term: 6 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 6 index: 6 } }
I20260709 13:14:17.292557 10172 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.293318 10128 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:17.275142 10244 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:17.294556 10244 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:17.294431 10128 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.293637  9800 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:14:17.297739  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 886658us
I20260709 13:14:17.273283 10227 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.303159 10227 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:17.303735 10216 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:17.304857 10179 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:17.305234 10179 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:17.306289 10226 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:17.306185 10179 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.307225 10172 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:17.293272  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 921218us
I20260709 13:14:17.313630  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.314265  7332 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:17.275620  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:17.300915 10233 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:17.323465  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:17.307425 10179 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:17.309024  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 342) took 1087 ms. Trace:
W20260709 13:14:17.270473  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:17.314745  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.315825  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.333745  7333 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:17.305320  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:17.314173 10230 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:14:17.318080  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:17.318243  7179 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:17.286545 10076 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:17.339131  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:17.319530  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.340756  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:17.340471  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:17.350922  7183 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:17.339740  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:17.339743  7133 auto_rebalancer.cc:629] Failed to schedule move for tablet 71d8ccd854bc453397ebc79aefe1c520: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:17.339490  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:17.331936  7329 rpcz_store.cc:276] 0709 13:14:16.221529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.221703 (+   174us) service_pool.cc:224] Handling call
0709 13:14:16.236411 (+ 14708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:16.558423 (+322012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:16.558457 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:16.598208 (+ 39751us) log.cc:844] Serialized 26 byte log entry
0709 13:14:16.735455 (+137247us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:16.739274 (+  3819us) log.cc:844] Serialized 14 byte log entry
0709 13:14:17.308717 (+569443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.308786 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:17.308829 (+    43us) raft_consensus.cc:1685] finished
0709 13:14:17.308843 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:17.308966 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":605521,"prepare.queue_time_us":3574,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":660315,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":8452,"thread_start_us":281000,"threads_started":2,"wal-append.queue_time_us":154975}
I20260709 13:14:17.353307  7255 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:17.362833  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 87286.9us
I20260709 13:14:17.366154  7228 leader_election.cc:400] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:17.367040  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:17.371058  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 53049.8us
I20260709 13:14:17.372105  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:17.349436  9922 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.336315 10133 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:17.386749  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:17.387410  7254 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:17.388468  7331 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:17.389621  7228 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:17.377868 10243 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:14:17.367760  9963 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:17.365113 10131 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:17.335004  9777 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:14:17.395519  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:17.395901  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:17.405886  7253 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:17.334666 10143 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:14:17.362313 10227 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:17.410869  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:17.411424  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.412557  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.292155 10219 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:17.415030  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:17.410512  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:17.410172  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:17.418955  7258 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:17.409590  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:17.407860  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:17.419799  7256 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:17.417135  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:17.419165  7257 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:17.352506 10158 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:14:17.422801  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.424065  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:17.424888  7255 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:17.379076 10144 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:17.429448  7254 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:17.438833  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.441254  7329 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:17.403074 10153 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:17.448318  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.386163 10220 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:14:17.455662  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:17.457451  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.452554  7330 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:17.427520 10007 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:17.463897  7333 raft_consensus.cc:2368] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:17.392331 10121 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:14:17.461998  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:17.473382  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 111853us
I20260709 13:14:17.397316  9922 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:17.521899  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.551774  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.555502 10219 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:17.559500 10278 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:14:17.580302 10072 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:17.584167 10169 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:17.586597 10172 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:14:17.590957  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 129097us
W20260709 13:14:17.599603 10275 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:14:17.619078 10224 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:17.620522  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:17.640604 10232 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:17.523126 10227 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:17.645844  9922 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:17.647352 10249 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:14:17.461398 10212 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:17.684525  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:17.687436  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.688225 10235 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:17.689503  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:17.859915  7330 raft_consensus.cc:2368] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:17.698199  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:17.747578  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:17.861258  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 113798us
I20260709 13:14:17.755559  7183 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:17.478333  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:17.782313  7150 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:17.864979  7260 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:17.786561  7258 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:17.813027  7894 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:17.819562  7329 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:17.842708  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:17.867352  7179 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:17.848309  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:17.851783  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61747.7us
I20260709 13:14:17.853820  7256 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:17.855784  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:17.870231  7332 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:17.856730  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:17.783800 10072 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:17.787453 10169 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:17.874044  7335 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:17.897003  7181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.009s	sys 0.012s
W20260709 13:14:17.898752  7181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.009s	sys 0.012s
W20260709 13:14:17.908779  7226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.001s	sys 0.021s
W20260709 13:14:17.909380  7226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.002s	sys 0.021s
I20260709 13:14:17.893663  9988 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.899463 10131 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:14:17.913941  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 435652us
I20260709 13:14:17.914956  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:17.915283  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:17.917440  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 522637us
I20260709 13:14:17.918498  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:17.920382  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:17.922785  7260 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:14:17.924247  7260 pending_rounds.cc:85] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 4
I20260709 13:14:17.875834  7333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23e0840e609849f8bd379d43569463c8"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:17.893920 10007 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.925887  7333 raft_consensus.cc:606] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:17.929240  7254 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:17.937832  7331 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:17.941425  7327 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:17.941918  7327 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:17.946069  7335 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 4. Current term is 5. Ops: []
W20260709 13:14:17.962949 10263 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
I20260709 13:14:17.964653  7327 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.967275  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:17.971385  7258 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
W20260709 13:14:17.973650  7133 auto_rebalancer.cc:629] Failed to schedule move for tablet 75c50740d1144c09a074230835085663: Illegal state: Replica c85cf49c63cc4e66b4747d8c4fa14022 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:17.925323  9976 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:17.989311 10072 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:17.990828 10072 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:17.997198  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 78810.6us
W20260709 13:14:18.000171  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 76118.8us
I20260709 13:14:18.001111  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:17.847684 10232 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.848534 10172 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:17.998306  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:18.006476  9976 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:18.007444  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:18.009120  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:18.044909  7261 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:14:18.010730 10219 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:17.995748 10007 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:17.996182 10133 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.598s	user 0.006s	sys 0.005s
I20260709 13:14:18.013309  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:18.055305  7257 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:17.924621  7260 pending_rounds.cc:107] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:14:18.056151  7260 raft_consensus.cc:2889] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:18.014163  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:18.014439  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:18.015010  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:18.015373  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1407) took 1594 ms. Trace:
I20260709 13:14:18.057514  7336 rpcz_store.cc:276] 0709 13:14:16.421022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.421162 (+   140us) service_pool.cc:224] Handling call
0709 13:14:16.421583 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:17.295234 (+873651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:17.295262 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:17.295782 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:14:17.350877 (+ 55095us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:17.448278 (+ 97401us) log.cc:844] Serialized 14 byte log entry
0709 13:14:17.558663 (+110385us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b180048e2c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:14:17.558920 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.559033 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:18.015009 (+455976us) raft_consensus.cc:1685] finished
0709 13:14:18.015129 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:18.015302 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":772674,"prepare.queue_time_us":113203,"prepare.run_cpu_time_us":6866,"prepare.run_wall_time_us":52968,"raft.queue_time_us":853080,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"spinlock_wait_cycles":8098176,"thread_start_us":116805,"threads_started":2,"wal-append.queue_time_us":130680}
I20260709 13:14:18.016098 10169 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.017302 10291 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:14:18.003962  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:17.909528  9990 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:18.047128  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:17.991744 10074 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:18.073294  7261 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:18.062391  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:18.043582 10143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.019s	sys 0.058s
I20260709 13:14:17.877048 10212 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.032868 10076 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:17.930459  9988 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:18.043865  9976 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:14:18.182335  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 178476us
W20260709 13:14:18.183650  7262 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.030s	sys 0.083s
W20260709 13:14:18.183734  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 283945us
I20260709 13:14:18.193845 10153 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:18.185060 10219 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.052066 10131 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:14:18.076428 10143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.020s	sys 0.058s
I20260709 13:14:18.075646 10074 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:18.197784  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:18.198204  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:18.066453  9990 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:18.064314  9922 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:14:18.076386 10179 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.001s
W20260709 13:14:18.212826  7262 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.030s	sys 0.084s
W20260709 13:14:18.186856 10243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.088s	sys 0.117s
I20260709 13:14:18.179073  7327 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:18.260807  7888 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:18.191753  7260 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:18.190954 10245 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:14:18.273530  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69712.4us
W20260709 13:14:18.274361  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 62385.1us
I20260709 13:14:18.290786  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:18.291149  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 508977us
W20260709 13:14:18.267732  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 269509us
I20260709 13:14:18.291910  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.292060  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.197458  7258 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:14:18.207269  9976 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:18.197841 10121 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:18.279146  7261 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:18.294303  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:18.294723  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:18.282960  7332 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:18.274057  9990 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:18.316495  7225 leader_election.cc:400] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:18.267342 10074 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:18.275784 10169 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:18.323098  7225 leader_election.cc:403] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:14:18.283811 10243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.095s	sys 0.117s
I20260709 13:14:18.321835  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.316525 10162 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:18.330464  7150 leader_election.cc:400] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:18.330912  7150 leader_election.cc:403] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:14:18.290393 10100 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:18.279914  9922 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:18.340768  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.320955 10143 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:18.348280  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.341012  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:18.350644 10243 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:18.344641 10235 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:18.347040 10121 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:18.382449  7328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.029s	sys 0.045s
I20260709 13:14:18.382283  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.293867  9777 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:18.387528  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46600.9us
W20260709 13:14:18.388675  7328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.030s	sys 0.045s
W20260709 13:14:18.442327  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 147673us
I20260709 13:14:18.520383  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1467) took 1133 ms. Trace:
I20260709 13:14:18.351052 10282 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:18.392688  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:18.442842  7894 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.002s
I20260709 13:14:18.420428  7257 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:18.528175  7894 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
W20260709 13:14:18.529433  7185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.009s	sys 0.043s
I20260709 13:14:18.352285 10179 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:18.530616  7185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.009s	sys 0.043s
W20260709 13:14:18.521435  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 191081us
W20260709 13:14:18.394018 10276 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.395s	user 0.001s	sys 0.001s
I20260709 13:14:18.354604 10224 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:18.350696 10232 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:18.534458  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 240204us
I20260709 13:14:18.435279 10212 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:18.519698 10133 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:18.419112 10281 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.420s	user 0.000s	sys 0.001s
I20260709 13:14:18.381538 10076 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:18.392129 10153 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:14:18.534659  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 142021us
I20260709 13:14:18.391803 10143 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:18.356041 10239 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:18.529783  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:18.351794 10227 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.180s
W20260709 13:14:18.533696 10294 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:14:18.522248 10219 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:18.542440 10292 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:18.543484 10306 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:14:18.544238 10303 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:14:18.545099 10302 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:14:18.547189  9922 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:18.550772 10133 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.551477  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2208) took 1226 ms. Trace:
I20260709 13:14:18.551932 10238 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:18.537288  9988 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:18.563148 10243 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:18.533887 10296 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:18.535171 10179 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:18.555701  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:18.425748 10007 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:18.414007 10288 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:18.608973  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 53414.1us
I20260709 13:14:18.609949  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:18.559089  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.559192  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.612357  7334 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:18.613004  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:18.430619 10247 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.233s
W20260709 13:14:18.564559  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.532085  9777 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.617236  9777 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:18.355698 10100 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.572129  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 444) took 1288 ms. Trace:
I20260709 13:14:18.617785  7890 rpcz_store.cc:276] 0709 13:14:17.283864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.283977 (+   113us) service_pool.cc:224] Handling call
0709 13:14:17.284284 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:17.284998 (+   714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:17.285033 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:17.285481 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:14:17.447229 (+161748us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:17.447270 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.447340 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:18.571893 (+1124553us) raft_consensus.cc:1685] finished
0709 13:14:18.571913 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:18.572064 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":299,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":69,"thread_start_us":161405,"threads_started":1,"wal-append.queue_time_us":587085}
I20260709 13:14:18.533133 10282 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:18.620024 10100 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:18.558722 10153 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.582310  7180 rpcz_store.cc:276] 0709 13:14:17.324698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.326503 (+  1805us) service_pool.cc:224] Handling call
0709 13:14:17.326847 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:17.353773 (+ 26926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:17.353818 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:17.368457 (+ 14639us) log.cc:844] Serialized 26 byte log entry
0709 13:14:17.829525 (+461068us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:17.829583 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.829692 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:18.551169 (+721477us) raft_consensus.cc:1685] finished
0709 13:14:18.551198 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:18.551401 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2819,"raft.queue_time_us":21264,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":2031,"thread_start_us":448887,"threads_started":1,"wal-append.queue_time_us":965078}
I20260709 13:14:18.599177 10307 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:14:18.567241 10143 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:18.632364  7327 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:14:18.635579  7327 pending_rounds.cc:85] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 3
I20260709 13:14:18.635838  7327 pending_rounds.cc:107] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:14:18.636067  7327 raft_consensus.cc:2889] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:18.569144 10239 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:18.561354 10158 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:14:18.639262 10230 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:14:18.644013 10143 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.630954  9889 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:18.647809 10133 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:18.648017  9889 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.649806 10179 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:18.585772 10238 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:18.634507 10219 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:18.651103 10238 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.652172 10238 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:18.653522  9976 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.601900 10243 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.654891  7892 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 10: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:18.654955 10243 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:18.631192  9848 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.658927  9848 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.661056  9848 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:18.663949  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54101.5us
I20260709 13:14:18.664954  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:18.634754 10153 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:18.666365  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:18.633365 10245 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:18.648172 10172 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:18.685803  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:18.685654 10291 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:18.687318 10291 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:18.687960  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:18.689055 10291 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:18.689386  9990 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.691244 10172 raft_consensus.cc:993] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower efc9ee9e1d86480790fa83f6ad0c295c to start an election
I20260709 13:14:18.691726  9922 raft_consensus.cc:1081] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Signalling peer efc9ee9e1d86480790fa83f6ad0c295c to start an election
I20260709 13:14:18.693125 10291 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:18.694134  7896 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:18.672993 10308 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:14:18.697626  7180 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:18.700955  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:18.700263  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:18.665966 10290 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:18.705734  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:18.708281  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:18.709115  7187 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:18.712380  9976 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:18.705610 10239 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:18.713974 10212 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:18.714126 10074 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.718690  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:18.719401  7181 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:18.719969  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:18.718807  9534 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:18.668562  9777 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:18.723668  9534 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:18.695952  9990 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:18.725733  9534 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:18.728427  7180 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:14:18.734300 10243 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.736598 10243 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:18.737979  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 178962us
I20260709 13:14:18.738826  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.739955  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.741115  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.742769 10232 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:18.743189 10232 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:18.743600 10232 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:18.743901 10158 raft_consensus.cc:2764] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:14:18.744750 10158 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:18.745111 10158 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:18.745474 10158 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:18.746810 10165 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:18.746888 10179 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:18.747385 10165 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:18.747532 10074 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:18.747853 10165 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:18.748550  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:18.750252 10074 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:18.750803 10074 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.753772 10074 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:18.754274 10226 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:18.760052 10076 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:18.762259  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:18.762980  7335 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:14:18.764456  7260 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:14:18.773228  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:18.773876  7896 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:18.774019  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:18.774139  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:18.774897  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:18.777258  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:18.772946  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:18.775882  7890 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:18.781055  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:18.783527  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:18.786553  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.790330  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:18.791749  7327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:18.790424  7894 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:18.774295 10179 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:18.793175 10179 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:18.794431 10179 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:18.799288  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:18.800199  7334 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:18.803617  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.803066 10247 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:18.808408 10247 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:18.810863  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:18.811213  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:18.811507  7894 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:18.811726  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:18.815084  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:18.816978  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:18.817597  7181 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:14:18.819365  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:18.820145  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:18.820874  7888 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:18.824086  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:18.704602 10245 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.828962  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:18.808712  9889 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:18.829042  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:18.834578  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:18.753772 10299 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:14:18.810302 10247 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:18.839018  7888 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:18.838591  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:18.812563 10076 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:18.846848  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:18.848511  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:18.848934  7327 raft_consensus.cc:606] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:18.849380  7327 raft_consensus.cc:614] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:18.805317 10177 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:14:18.850041 10243 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:18.850428 10243 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:18.850801 10243 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:18.809644 10308 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:14:18.854118  7181 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:18.825924 10072 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:18.855665 10072 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.856025 10072 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:18.856954  7330 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:18.837352  9777 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:18.861629  9777 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:18.861519 10243 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.862257  9777 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:18.822836 10162 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:18.865701 10243 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:18.868626 10304 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.438s	user 0.011s	sys 0.000s
I20260709 13:14:18.870069  7336 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:18.873819  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.873569  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:18.875087  7180 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:18.872537 10169 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:18.875988 10317 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.876325 10169 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.876503 10317 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.844857 10282 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:18.878015 10282 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:18.878126 10162 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:14:18.874042 10318 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:14:18.878599 10317 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:18.846484 10233 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:18.883438  7894 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:18.886968  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.893724  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:18.895754  7862 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:18.895980  7888 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:18.847360 10307 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:18.901150  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:18.902333  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53871.4us
I20260709 13:14:18.903829  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:18.879654  9889 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.879294 10162 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:18.879714 10220 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.880496 10289 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.904546 10308 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:18.904801  9976 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:18.901994 10226 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:14:18.905102  9534 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:18.879208 10282 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:18.905705 10293 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:18.526961  7328 rpcz_store.cc:276] 0709 13:14:17.386484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.429802 (+ 43318us) service_pool.cc:224] Handling call
0709 13:14:17.430108 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:17.430343 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:14:17.847809 (+417466us) log.cc:844] Serialized 14 byte log entry
0709 13:14:18.520025 (+672216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:18.520086 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:18.520132 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:18.520206 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:18.520325 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18823,"prepare.queue_time_us":102513,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":20747,"thread_start_us":1048315,"threads_started":2,"wal-append.queue_time_us":581269}
I20260709 13:14:18.893721 10299 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:18.936721 10301 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:14:18.946940 10299 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:18.947762 10301 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:18.948158 10301 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:18.949309 10299 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:18.949018 10301 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.905489  7333 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:18.934034 10289 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.907629  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:18.953783 10289 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:18.893275 10233 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:18.934183 10220 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.954865 10233 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:18.956313 10220 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:18.923363  9889 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.956666 10072 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:18.906255 10169 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:18.902588 10317 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:18.867372 10158 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:18.918488 10309 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.950435 10301 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:18.901904  9990 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:18.941111  7888 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:18.937049 10282 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:18.942839 10286 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:18.936964 10245 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:18.958726  9889 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:18.870468 10076 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:18.969023  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:18.970517  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:18.939159  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:19.003799  7335 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:14:19.003929  7894 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:18.974612  7181 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:18.998308  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:18.969558 10072 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.005699  7332 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:19.003424  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 102306us
I20260709 13:14:19.003670  7328 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
W20260709 13:14:19.006491  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 447340us
I20260709 13:14:19.007079  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:19.007418  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:19.007718  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:19.007933  9889 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:19.008356  9889 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:19.008580 10220 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:19.008780  9889 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:19.009042 10220 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.009410 10220 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:19.017639  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:19.018539  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:18.973567 10238 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:18.973248 10288 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:18.974952 10308 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:19.020241  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:18.950462 10232 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.025744  7184 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:19.039361  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.015303 10292 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.023049 10224 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:19.047457  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:19.003396 10286 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.048597 10220 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.027348 10238 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.028623 10243 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:19.028652 10236 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:19.064617 10243 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:19.065102 10243 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:19.026873 10232 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.057951 10224 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.064050 10220 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.075716  7335 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
W20260709 13:14:19.048573 10323 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:14:19.084336 10076 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.088476 10238 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:19.092079 10243 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.092643 10153 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:19.066318 10320 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:14:19.080794 10224 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:19.068136  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:18.981469 10309 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.035871 10299 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.075250  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:19.107471  7328 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:19.031112  9988 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:19.106323  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:19.106222  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:19.028554 10288 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:19.111896 10321 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:14:19.061380 10292 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.113235 10072 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:14:19.128939  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 121649us
I20260709 13:14:19.094657 10243 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:19.129742  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:19.131036  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 109265us
I20260709 13:14:19.104266 10232 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.133054  7186 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:19.100387 10121 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:19.131443 10330 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.085983 10247 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.136080  7179 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:19.112749 10227 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:19.061405 10282 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.123764 10220 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:19.148800 10220 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:19.149693 10220 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.133502 10072 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.171923 10072 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:19.173489  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:19.146420 10153 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.146785 10317 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.147398 10247 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:19.147600 10227 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:19.133492  9963 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:19.146420 10286 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:19.153362 10233 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.076598 10308 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.144116 10330 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.157466  9777 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.207181  7255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23e0840e609849f8bd379d43569463c8"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:55506
I20260709 13:14:19.142496 10121 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.159443  9889 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.140621 10232 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.161340 10236 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:19.125773 10299 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:19.168901 10328 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:14:19.169672  7890 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:19.170979 10292 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:19.171468 10158 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.180387  7328 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:19.181133  7184 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:19.166354  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:19.137890 10332 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:19.187404  7253 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:19.188738  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.224264  7254 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:19.225283  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:19.178723  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:19.190287  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.177208  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.192407  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.226740  7181 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:19.226928  7257 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:19.194550  7261 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:14:19.196761  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.226994  7186 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:19.228540  7261 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:14:19.230055  7261 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:19.200829  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61093.8us
W20260709 13:14:19.201864  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 60582us
I20260709 13:14:19.231531  7254 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:19.232403  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:19.233566  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.234266  7254 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:19.203693  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.134482  9988 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.197732 10179 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.199736 10291 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:19.270713  7255 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:19.271286  7255 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:19.271875  9889 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.278514  7182 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:19.284996  7328 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:19.288190 10282 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:19.291819 10299 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:19.293923 10179 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.295611  7178 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:19.296702 10179 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.298426 10227 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.169724 10165 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.299613 10227 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.301023 10165 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.202355  9963 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:19.301752 10227 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:19.302209  9963 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.303298  9963 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:19.303939 10311 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:14:19.218674  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:19.305394  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:19.305660  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1382) took 1917 ms. Trace:
W20260709 13:14:19.306037  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 87464.3us
I20260709 13:14:19.306126  7262 rpcz_store.cc:276] 0709 13:14:17.388671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.388779 (+   108us) service_pool.cc:224] Handling call
0709 13:14:17.410019 (+ 21240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:18.277756 (+867737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:18.277790 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:18.288426 (+ 10636us) log.cc:844] Serialized 26 byte log entry
0709 13:14:18.556838 (+268412us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:18.570421 (+ 13583us) log.cc:844] Serialized 14 byte log entry
0709 13:14:18.942236 (+371815us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b1800490120. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:14:18.942403 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:18.942476 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:19.086220 (+143744us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b1800490120. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:14:19.303222 (+217002us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:19.305472 (+  2250us) raft_consensus.cc:1685] finished
0709 13:14:19.305492 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:19.305607 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54683,"prepare.queue_time_us":13336,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":447921,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":15133,"spinlock_wait_cycles":49702400,"thread_start_us":1041343,"threads_started":2,"wal-append.queue_time_us":234709}
I20260709 13:14:19.308488  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:19.235380  7258 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:19.311422  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:19.312677  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:19.313436  7329 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 5: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:19.308525  9889 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:19.314525  9889 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:19.316141  7187 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:19.316058  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.317672  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.236085  7180 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 4.
I20260709 13:14:19.240206  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:19.240466  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.321431  7260 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:19.322517  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.323266  7260 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:19.324276  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:19.325582  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.233811  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:19.247238  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:19.327375  7892 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:19.320981  7258 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:19.236071  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.251400  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:19.252432 10330 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.254034  9777 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:19.255061 10307 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:19.255645 10233 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:19.257134 10288 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.202848 10317 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:19.354566  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 123375us
I20260709 13:14:19.355990 10317 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:19.259809  7889 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:19.261868 10232 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.262338 10158 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:14:19.263962 10236 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.264843 10121 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:19.267208  9988 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:19.201305  9990 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:19.234998  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:19.319073  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:19.390231  7257 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:19.333943  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:19.370213 10072 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.249081  7261 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:19.336105  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:19.395824  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:19.341804  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 98942.5us
I20260709 13:14:19.343860  7253 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:19.397363  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:19.398188 10172 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:19.399750 10172 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:19.400236 10172 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:19.400641 10172 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:19.340792  7255 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.349150  7181 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:19.401973  7262 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:19.402263  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:19.403388  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:19.350965  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:19.404450  7894 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:19.351529  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.315472  9889 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:19.353109  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 108692us
I20260709 13:14:19.360100  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:19.360533  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.412061  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:19.362979  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.415074  7184 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:19.416141  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.363523 10330 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:19.363757 10179 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:19.363947 10292 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.367632  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.368361  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:19.369025  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:19.369688  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:19.371031  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:19.418411  7150 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:19.371564  7329 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:19.372062 10307 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:19.373427  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:19.373498  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.353089 10220 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.376940  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:19.424178  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 47338.6us
I20260709 13:14:19.409065  7258 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:19.392972  9990 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.381811 10333 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:19.427100 10333 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:19.408521 10286 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:14:19.427444 10333 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:19.428386 10247 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:19.428225 10333 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.429011 10247 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:19.429453 10333 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:19.429817 10230 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:19.430029 10247 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.430791 10162 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:19.382967  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:19.387724  7178 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:19.391578  7890 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:14:19.334347  7892 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:19.473879  7178 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:19.474581  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:19.475260  7178 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:19.477257  7150 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:19.380694  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:19.406926  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.407980  7332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:19.478585  7181 raft_consensus.cc:2368] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:19.478818  7332 raft_consensus.cc:606] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:19.479442  7332 raft_consensus.cc:614] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:19.409221  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:19.480619  7327 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:19.482538  7896 raft_consensus.cc:2368] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:19.421237  7334 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:19.371063  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.431501  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:19.382076  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:19.433139  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:19.426494  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:19.414448  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:19.443177  7893 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:19.485280  7184 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:19.487270  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.491634  7184 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:14:19.495519  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 64098.6us
I20260709 13:14:19.422143 10165 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:19.424559 10128 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:19.504463  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.505800  7334 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:19.496613  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:19.422576 10307 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:19.419803 10169 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:19.501618  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:19.498872  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 118326us
I20260709 13:14:19.513898  7186 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 4: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:19.546504  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.393429 10329 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:14:19.560954  7259 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
W20260709 13:14:19.487726 10226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.003s
I20260709 13:14:19.518769  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:19.518445  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.570178  7257 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
W20260709 13:14:19.529273  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 52074.8us
W20260709 13:14:19.562736  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 148370us
W20260709 13:14:19.566875  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 70373.9us
I20260709 13:14:19.567236  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:19.574829  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:19.575049  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 60546.5us
I20260709 13:14:19.431185 10179 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.431339 10292 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.576053  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:19.510285 10128 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:19.571833  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 145400us
I20260709 13:14:19.900485 10365 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.268927  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:20.268802 10365 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.269606 10143 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:20.270191  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:20.271066 10365 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.271600 10365 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:20.271867 10301 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:20.272145 10365 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.272593 10301 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:19.889698  7150 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:19.955585  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:20.277508  7181 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:20.278124 10365 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.960834  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:19.877470  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2234) took 1060 ms. Trace:
I20260709 13:14:19.881994  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:20.283265  7182 rpcz_store.cc:276] 0709 13:14:18.816983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.817114 (+   131us) service_pool.cc:224] Handling call
0709 13:14:18.817493 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:19.279800 (+462307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:19.877166 (+597366us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400246b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:19.877397 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994495872}
I20260709 13:14:19.978008  7255 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.345899 10301 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.346313  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:55506 (request call id 2390) took 1154 ms. Trace:
I20260709 13:14:19.936905  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:20.378929  7253 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:19.585384  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.770761  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:19.938954  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.389394  7083 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 6, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:19.577631  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.391556  7083 catalog_manager.cc:5697] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 5 to 6, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 6 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:19.883019  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 59719us
I20260709 13:14:20.394519  7083 catalog_manager.cc:5697] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 7 to 8, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 8 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:19.836865  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.397702  7182 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:20.396311  7083 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 6, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 6 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:19.954210  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:20.401602  7253 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
W20260709 13:14:20.401677  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 447516us
I20260709 13:14:19.725042  7887 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:19.576475  9534 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:19.594424  9645 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:19.878387  9800 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:19.562500  9922 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:19.510906  9963 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:19.546070  9976 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:19.573738  9988 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:19.875041  9990 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:19.859179 10072 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.586232 10121 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:19.838609 10153 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:19.510658 10165 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.569387 10169 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.869339 10172 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:19.798739 10179 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.595070 10219 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:14:19.460563 10220 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.402585  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:19.759624 10224 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.001s
I20260709 13:14:20.431551 10224 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:19.574529 10226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.006s	sys 0.003s
I20260709 13:14:19.799463 10227 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:19.558259 10233 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:20.440903 10233 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.442073 10224 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.597379 10238 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:14:19.576923 10286 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:19.756358 10288 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:19.663275 10290 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:20.451144 10219 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:20.451574 10219 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:20.451442 10290 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.452431 10219 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.453588 10290 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:20.453668 10247 consensus_queue.cc:1175] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" responder_term: 7 status { last_received { term: 7 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 7 index: 5 } }
I20260709 13:14:20.450582 10288 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:19.806481 10292 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.586457 10296 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:20.456900 10288 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:19.601626 10299 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:20.453608 10219 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.458103 10299 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.458498 10299 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:19.671928 10307 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.462304 10307 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:19.790478 10332 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:20.467686 10332 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.470021 10332 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:19.887905 10333 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.471427 10333 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.473592 10333 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:19.510789 10336 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:20.474813 10336 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.475229 10336 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:19.866225 10337 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:20.479527 10337 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:19.688097 10339 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
W20260709 13:14:19.722285 10342 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 13:14:19.845898 10344 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:14:19.719146 10128 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:19.723030 10345 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.150s
W20260709 13:14:20.486726 10230 consensus_queue.cc:1175] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 3 } }
I20260709 13:14:20.487092 10128 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.487596 10345 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:20.487982 10345 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:20.488895 10345 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.490264 10345 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:19.730952 10285 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.137s
I20260709 13:14:20.491847  7259 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:20.493255 10285 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:20.494006  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 467) took 1102 ms. Trace:
I20260709 13:14:20.493772 10285 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:19.732961 10347 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:14:20.494942 10236 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:20.495770 10236 consensus_queue.cc:1243] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:14:19.913851 10349 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.195s	user 0.003s	sys 0.000s
W20260709 13:14:19.843297 10350 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:14:19.696285 10352 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:19.825199 10357 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:20.207594  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 662) took 1101 ms. Trace:
I20260709 13:14:20.218307  9777 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:20.272871  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.503692  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.504045  9777 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.503496  7896 rpcz_store.cc:276] 0709 13:14:19.105799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.105976 (+   177us) service_pool.cc:224] Handling call
0709 13:14:20.207368 (+1101392us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b540001a9d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:20.207507 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757908736}
I20260709 13:14:20.506207  9777 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:20.275743  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 386111us
I20260709 13:14:20.506616 10337 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.506803 10288 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:20.507184 10337 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.507447 10288 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.509747 10288 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.510274 10288 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:20.270207 10143 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.510979 10226 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:20.278380 10158 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:19.577725  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:20.512847 10143 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:20.284390  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 402510us
I20260709 13:14:20.513540 10288 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.515703 10288 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.517118  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.517706 10332 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.285626 10365 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:20.309449  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 452) took 1006 ms. Trace:
I20260709 13:14:20.518910  7888 rpcz_store.cc:276] 0709 13:14:19.303480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.313029 (+  9549us) service_pool.cc:224] Handling call
0709 13:14:19.313292 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:19.431821 (+118529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:19.431851 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:19.431891 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:19.431920 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.309159 (+877239us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54004c4854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:20.309215 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.309378 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272152832}
I20260709 13:14:20.519575 10296 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:20.313552  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 507) took 1294 ms. Trace:
I20260709 13:14:20.520149 10296 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.320084 10367 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:20.320961  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:20.523041  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 945291us
I20260709 13:14:20.522912 10367 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.523739 10292 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:20.525135 10367 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.347422  7255 rpcz_store.cc:276] 0709 13:14:19.192332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.192862 (+   530us) service_pool.cc:224] Handling call
0709 13:14:19.976510 (+783648us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b54002265d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9233a3d 00007fecee203cd0 00007fece7788254 00007fece77881e2 00007fece7788111 00007fece778808c 00007fece7787342 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:20.346204 (+369694us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125878016}
I20260709 13:14:20.346478 10301 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.528131 10301 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:20.357082 10329 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.006s	sys 0.000s
W20260709 13:14:20.528743 10329 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.006s	sys 0.000s
I20260709 13:14:20.528901  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.526310  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.374611  7332 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:20.529943  7255 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:20.530642  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1391) took 1215 ms. Trace:
I20260709 13:14:20.530784  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.530962  7255 rpcz_store.cc:276] 0709 13:14:19.315084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.526061 (+1210977us) service_pool.cc:224] Handling call
0709 13:14:20.530568 (+  4507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.384130  7257 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:20.388389  7891 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:20.531953  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 460) took 1146 ms. Trace:
I20260709 13:14:19.892222  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:19.668669  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:20.534261 10310 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:20.534446  9963 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.534742 10310 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:20.532296  7257 rpcz_store.cc:276] 0709 13:14:19.385079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.585103 (+200024us) service_pool.cc:224] Handling call
0709 13:14:20.531898 (+946795us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:20.534863  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 866201us
I20260709 13:14:20.535813  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.535565 10310 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.536372  7257 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:20.536746 10310 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:20.537179  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:20.537743  7257 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:20.393639  7329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:20.518234 10332 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.538879  7329 raft_consensus.cc:606] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:20.539240  7329 raft_consensus.cc:614] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:20.540125  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.540450 10332 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.540663  7299 leader_election.cc:400] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:20.522437 10296 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.541078  7299 leader_election.cc:403] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:14:20.541482  9777 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:20.541863  9777 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:20.542210  9777 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:20.534971  9963 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.407718  9645 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:20.424047  7330 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:20.534864 10337 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.543820  9645 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:20.544525  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1506) took 1175 ms. Trace:
I20260709 13:14:20.544664  9963 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.544900  7330 rpcz_store.cc:276] 0709 13:14:19.368857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.369476 (+   619us) service_pool.cc:224] Handling call
0709 13:14:20.544352 (+1174876us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540038c7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:20.544441 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307013376}
I20260709 13:14:20.546064  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.418566 10121 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:20.546818 10121 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:20.547683 10333 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:20.538491  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.548444 10365 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:20.548290 10333 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.415750  9990 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:20.550836  9990 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.551249  9990 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:20.410691  9922 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:20.552897  7257 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:20.552771  9922 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.553457  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 469) took 1161 ms. Trace:
I20260709 13:14:20.553802  7257 rpcz_store.cc:276] 0709 13:14:19.392382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.536953 (+1144571us) service_pool.cc:224] Handling call
0709 13:14:20.553396 (+ 16443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.404376  7887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 664) took 1096 ms. Trace:
I20260709 13:14:20.554783  7887 rpcz_store.cc:276] 0709 13:14:19.308074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.308193 (+   119us) service_pool.cc:224] Handling call
0709 13:14:20.404294 (+1096101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.409521  9800 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:20.555500  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.556326  7330 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:20.556260  9800 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.556952 10357 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:20.557310  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:20.558025  7330 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:20.413450  9976 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.560149  9976 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.425980 10179 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.420562 10165 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.560699 10332 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.560879 10179 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.561242 10332 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.562165  7258 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:20.562980 10179 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.563256  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 468) took 1171 ms. Trace:
I20260709 13:14:20.557503  9800 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:20.563616  7258 rpcz_store.cc:276] 0709 13:14:19.392148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.770368 (+378220us) service_pool.cc:224] Handling call
0709 13:14:20.563099 (+792731us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54002260d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:20.563202 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378088192}
I20260709 13:14:20.564704  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:20.565397  7258 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:20.566215  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.402947  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.566541 10332 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.567055  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1395) took 1251 ms. Trace:
I20260709 13:14:20.567386  7253 rpcz_store.cc:276] 0709 13:14:19.316103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.402667 (+1086564us) service_pool.cc:224] Handling call
0709 13:14:20.566999 (+164332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.568313  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.568879  7253 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:20.569329  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 470) took 1176 ms. Trace:
I20260709 13:14:20.569628  7253 rpcz_store.cc:276] 0709 13:14:19.392600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.568066 (+1175466us) service_pool.cc:224] Handling call
0709 13:14:20.569280 (+  1214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.428298  7185 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:20.423771 10172 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:20.429628 10220 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.414242  9988 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:20.576095  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.423197 10169 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.419661 10153 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:20.439736  7256 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:14:20.577134 10072 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:20.577768  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2387) took 1387 ms. Trace:
I20260709 13:14:20.448361 10227 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.449837 10293 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:19.753103 10291 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:20.578616 10236 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:20.579695  7334 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:20.579566 10236 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.580096 10227 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.491062 10238 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:20.581215 10238 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:20.581732 10236 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:20.582041 10238 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.490278  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1435) took 1708 ms. Trace:
I20260709 13:14:20.582940 10172 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:20.582166 10121 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.583763 10238 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:20.583005  7331 rpcz_store.cc:276] 0709 13:14:18.781703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.781935 (+   232us) service_pool.cc:224] Handling call
0709 13:14:18.782215 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:18.801628 (+ 19413us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:18.820762 (+ 19134us) log.cc:844] Serialized 14 byte log entry
0709 13:14:19.156473 (+335711us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b48001bc258. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:14:19.172576 (+ 16103us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b180029c8c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a 00007fece9246a2a
0709 13:14:19.552208 (+379632us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:19.564615 (+ 12407us) log.cc:844] Serialized 26 byte log entry
0709 13:14:19.564800 (+   185us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:19.564849 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:19.564955 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:20.490022 (+925067us) raft_consensus.cc:1685] finished
0709 13:14:20.490044 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.490213 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66164,"prepare.queue_time_us":18958,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"raft.queue_time_us":93532,"raft.run_cpu_time_us":3763,"raft.run_wall_time_us":343762,"spinlock_wait_cycles":39969920,"thread_start_us":261267,"threads_started":1,"wal-append.queue_time_us":750282}
I20260709 13:14:20.586022 10165 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.499349 10285 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:20.500053  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2395) took 1305 ms. Trace:
I20260709 13:14:20.586426  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.501822 10352 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.587850  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.588107 10165 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.588227 10352 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.589051 10121 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.271610  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:20.558395  9990 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:20.590071  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 318506us
I20260709 13:14:20.587085  7254 rpcz_store.cc:276] 0709 13:14:19.194811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.248280 (+ 53469us) service_pool.cc:224] Handling call
0709 13:14:19.248697 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:19.314460 (+ 65763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:19.314491 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:19.315185 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 13:14:19.502988 (+187803us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:19.600561 (+ 97573us) log.cc:844] Serialized 14 byte log entry
0709 13:14:19.606103 (+  5542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:19.606552 (+   449us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:19.913161 (+306609us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:20.499722 (+586561us) raft_consensus.cc:1685] finished
0709 13:14:20.499852 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.499993 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64943,"prepare.queue_time_us":95864,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":68309,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":3952,"spinlock_wait_cycles":37988736,"thread_start_us":187324,"threads_started":1,"wal-append.queue_time_us":370918}
I20260709 13:14:20.273483  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:20.590895  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:20.591212  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 317816us
I20260709 13:14:20.591281  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:20.591581  9990 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:20.592010  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:20.592636 10169 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:20.593321 10169 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:20.593674 10169 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:20.594005 10169 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:20.582367  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 132666us
I20260709 13:14:20.316129  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.595733  7260 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:20.596225  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 465) took 1204 ms. Trace:
I20260709 13:14:20.596524  7260 rpcz_store.cc:276] 0709 13:14:19.391406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.315852 (+924446us) service_pool.cc:224] Handling call
0709 13:14:20.596165 (+280313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.596954  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:20.597404  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.523128  7335 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.345376  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2246) took 1169 ms. Trace:
I20260709 13:14:20.504391  7327 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
W20260709 13:14:20.368063  7085 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 151) took 21975 ms (client timeout 15000 ms). Trace:
I20260709 13:14:20.339915 10309 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.592199  9990 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:20.531950  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.532472  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.390141  7262 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 3.
I20260709 13:14:20.610944  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.611470  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1402) took 1035 ms. Trace:
I20260709 13:14:20.611908  7262 rpcz_store.cc:276] 0709 13:14:19.575763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.938686 (+362923us) service_pool.cc:224] Handling call
0709 13:14:20.611413 (+672727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.533957  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 466) took 1142 ms. Trace:
I20260709 13:14:20.540769  7329 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:20.399190  7083 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.429589 10289 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:20.546341  9963 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:20.571028  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.625399  7257 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:20.570472  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.558336  7330 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:20.576222  9988 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:20.629439  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:20.630304  7257 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:14:20.577293 10153 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.630556  7335 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:20.578138  7256 rpcz_store.cc:276] 0709 13:14:19.190116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.190942 (+   826us) service_pool.cc:224] Handling call
0709 13:14:19.204497 (+ 13555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:20.576983 (+1372486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.577547 (+   564us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002d3f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:20.577717 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2840217856}
I20260709 13:14:20.578655 10293 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:20.632429  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.580812  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1511) took 1158 ms. Trace:
I20260709 13:14:20.447674 10233 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.588985  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:20.591956  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:20.512679 10158 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.640998  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:20.520275  7179 rpcz_store.cc:276] 0709 13:14:19.019474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.019988 (+   514us) service_pool.cc:224] Handling call
0709 13:14:20.313253 (+1293265us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400257954. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:20.313426 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250378496}
I20260709 13:14:20.595118 10220 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:20.597945  9889 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:20.591957  7254 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.494364  7259 rpcz_store.cc:276] 0709 13:14:19.391925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.577377 (+185452us) service_pool.cc:224] Handling call
0709 13:14:20.493788 (+916411us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54002193d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:20.493921 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231301376}
I20260709 13:14:20.659340  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.627733  7330 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.661358  7330 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.607363  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:20.598397  7183 rpcz_store.cc:276] 0709 13:14:19.176298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.177708 (+  1410us) service_pool.cc:224] Handling call
0709 13:14:19.199062 (+ 21354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:19.199312 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:20.303095 (+1103783us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b18003d6cc0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fececc343c7 00007fece92469a7 00007fece92560bf
0709 13:14:20.303254 (+   159us) log.cc:844] Serialized 14 byte log entry
0709 13:14:20.344965 (+ 41711us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:20.345027 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:20.345079 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.345156 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.345300 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3120,"prepare.queue_time_us":14449,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":1819,"raft.queue_time_us":4248,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"spinlock_wait_cycles":305155968,"thread_start_us":69617,"threads_started":2,"wal-append.queue_time_us":51653}
I20260709 13:14:20.387292  7889 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:20.611692  7895 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:20.612676  7261 rpcz_store.cc:276] 0709 13:14:19.391655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.891981 (+500326us) service_pool.cc:224] Handling call
0709 13:14:20.533898 (+641917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.445966 10286 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:20.633191  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.633209  7334 rpcz_store.cc:276] 0709 13:14:19.422903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.555192 (+132289us) service_pool.cc:224] Handling call
0709 13:14:19.555619 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.580091 (+1024472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.580622 (+   531us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003868d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:20.580761 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2354717568}
I20260709 13:14:20.634284  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.637825  7327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
W20260709 13:14:20.640877  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48993.1us
I20260709 13:14:20.644819  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.691666  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:20.693154  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:20.636698 10236 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.654767  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:20.658052  7262 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:20.652956  7257 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:20.702669  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1393) took 1387 ms. Trace:
W20260709 13:14:20.599248  7085 rpcz_store.cc:269] 0709 13:13:58.392321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.392551 (+   230us) service_pool.cc:224] Handling call
0709 13:14:20.367945 (+21975394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:16.028734 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:16.304651 (+275917us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:16.343547 (+ 38896us) write_op.cc:435] Acquired schema lock
0709 13:14:16.359019 (+ 15472us) tablet.cc:662] Decoding operations
0709 13:14:16.576765 (+217746us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:16.576841 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:16.576882 (+    41us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:14:16.577619 (+   737us) tablet.cc:701] Row locks acquired
0709 13:14:16.577665 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:14:16.577852 (+   187us) write_op.cc:270] Start()
0709 13:14:16.578025 (+   173us) write_op.cc:276] Timestamp: P: 1783602856577794 usec, L: 0
0709 13:14:16.578056 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:14:16.618492 (+ 40436us) log.cc:844] Serialized 2069 byte log entry
0709 13:14:17.236846 (+618354us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:17.639474 (+402628us) op_driver.cc:464] REPLICATION: finished
0709 13:14:18.413957 (+774483us) write_op.cc:301] APPLY: starting
0709 13:14:18.414073 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:18.414270 (+   197us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:18.414314 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:18.428906 (+ 14592us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:18.521779 (+ 92873us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:14:18.529796 (+  8017us) write_op.cc:312] APPLY: finished
0709 13:14:18.536467 (+  6671us) log.cc:844] Serialized 47 byte log entry
0709 13:14:18.572747 (+ 36280us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:18.572866 (+   119us) write_op.cc:454] Released schema lock
0709 13:14:18.572937 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:18.573542 (+   605us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:18.573575 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":489822,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":772882,"apply.run_cpu_time_us":10395,"apply.run_wall_time_us":159587,"num_ops":5,"prepare.queue_time_us":527842,"prepare.run_cpu_time_us":26664,"prepare.run_wall_time_us":908141,"raft.queue_time_us":324269,"raft.run_cpu_time_us":53855,"raft.run_wall_time_us":271733,"replication_time_us":1061187,"spinlock_wait_cycles":4233856,"thread_start_us":1014568,"threads_started":5,"wal-append.queue_time_us":338559,"wal-append.run_cpu_time_us":27872,"wal-append.run_wall_time_us":2581133}]]}
I20260709 13:14:20.703048  7262 rpcz_store.cc:276] 0709 13:14:19.315594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.640678 (+1325084us) service_pool.cc:224] Handling call
0709 13:14:20.657584 (+ 16906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.702378 (+ 44794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.702591 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.703603  7182 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:20.659780 10158 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.670440  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1390) took 1355 ms. Trace:
I20260709 13:14:20.709353  7256 rpcz_store.cc:276] 0709 13:14:19.314839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.636063 (+1321224us) service_pool.cc:224] Handling call
0709 13:14:20.670027 (+ 33964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.670163 (+   136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:20.670183 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:20.670221 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:20.670249 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.670294 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.670386 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791936}
I20260709 13:14:20.670818  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.711728  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.622841 10128 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.695533  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:20.696208  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.698192  7327 raft_consensus.cc:606] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:20.706753  7083 catalog_manager.cc:5697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 5 to 6, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 6 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.696229  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:20.714875  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 194173us
I20260709 13:14:20.700098  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:20.715312  7890 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:20.715653  7893 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:20.666654 10309 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:20.603766  7258 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:20.660372  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:20.704734  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50113.1us
I20260709 13:14:20.670210  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.704999  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:20.720503  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:20.707391  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.721233  7186 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:20.708148  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1399) took 1391 ms. Trace:
I20260709 13:14:20.708621  7894 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:20.640794 10289 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:20.704526  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:20.713593  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:20.715035  7327 raft_consensus.cc:614] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:20.725557  7257 rpcz_store.cc:276] 0709 13:14:19.317031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.707109 (+1390078us) service_pool.cc:224] Handling call
0709 13:14:20.707496 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.707725 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:20.707762 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:20.707823 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:20.707867 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.707934 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.708074 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.636994 10291 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.657073 10233 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.658499  9889 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.696408  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.709561 10337 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.668215 10153 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.658691 10220 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:20.742300 10220 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.737152 10291 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.743669  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.744213 10291 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.739478  9889 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:20.723627 10293 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.745735 10293 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:20.745826 10169 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.739903 10233 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.752805 10233 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.752722  9645 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.710081 10236 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.753729  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.673907  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.724162  7299 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:20.725809  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:20.643105  9963 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.726960 10310 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:20.755600 10310 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:20.756011 10310 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:20.756806  9963 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.731583 10243 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:20.759138  7332 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:20.722298 10128 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.763479 10333 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:20.764514 10128 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:20.764644  9976 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.765216  9976 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.766026 10177 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:14:20.768453  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 43694.2us
I20260709 13:14:20.739632 10226 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:20.742542  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.771042  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:20.771885 10332 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:20.772630  7228 leader_election.cc:400] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:20.773895  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:20.774185  7259 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:20.718350  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:20.688647 10072 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.727694  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 459) took 1342 ms. Trace:
I20260709 13:14:20.776046  7256 rpcz_store.cc:276] 0709 13:14:19.384840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.710453 (+1325613us) service_pool.cc:224] Handling call
0709 13:14:20.727231 (+ 16778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.727405 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:20.727426 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:20.727462 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:20.727491 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.727549 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.727639 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:20.732875  7083 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 2 to 4, term changed from 3 to 4, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.704365  9989 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:20.732687  7254 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:20.734527  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:20.735751  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.736558  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:20.689106 10296 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:20.632603  9534 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:20.709003 10230 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:20.720041 10308 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:20.753914  7333 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:20.731124  7258 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:14:20.786113  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 62006.8us
I20260709 13:14:20.785599  7083 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.700557 10286 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.788686  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.789307  7256 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:20.779409  7893 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:20.779819  7330 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:20.780792  7257 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:14:20.791805  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:20.784771  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1404) took 1208 ms. Trace:
I20260709 13:14:20.792870  7255 rpcz_store.cc:276] 0709 13:14:19.576316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.721476 (+1145160us) service_pool.cc:224] Handling call
0709 13:14:20.783429 (+ 61953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:20.783588 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:20.783616 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:20.783685 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:20.783714 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.783765 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:20.784575 (+   810us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b54001a2f50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:20.784712 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141851392}
I20260709 13:14:20.790288  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:20.795185  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56453.7us
I20260709 13:14:20.794994  7083 catalog_manager.cc:5697] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.738058  9990 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:14:20.795004  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 187720us
W20260709 13:14:20.797129  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 60647.7us
I20260709 13:14:20.797592  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:20.798151  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:20.799899  7258 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:20.800822  7861 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:20.740264 10309 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:14:20.828040  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44544.8us
I20260709 13:14:20.833726  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:20.733290  9777 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.832048  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:20.781253  9989 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.785586 10296 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.798715 10212 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:20.785804 10308 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:20.824779 10172 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:14:20.829777  7083 catalog_manager.cc:5697] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 7, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 7 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.844341  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.844715  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.846683  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:20.891078  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44535.3us
I20260709 13:14:20.848268  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.849177  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:20.824218 10376 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:20.824254 10333 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:14:20.840657 10227 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:20.799713  9990 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.916558  9990 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.917695 10169 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.919348  7083 catalog_manager.cc:5697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 4, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 4 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:20.790251 10337 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:20.922781 10337 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.921808  7083 catalog_manager.cc:5697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 6, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 6 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.925105 10337 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.836437  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:20.927386  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 91064.5us
I20260709 13:14:20.824031 10332 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:20.928663  9990 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.841147 10121 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:20.930128 10121 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:20.777930 10290 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:14:20.930259 10224 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:20.824575 10243 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:20.931079 10224 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.931598 10243 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.932122  9777 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:20.932729  9777 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:20.933068  9777 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:20.933820  9777 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.854801  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:20.855687  9989 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:20.868422 10179 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:20.868073 10289 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.862192 10219 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:20.868852 10325 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:20.870114  9889 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.871379  9976 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.863104 10212 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:20.926185  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.872655 10296 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:20.830999 10372 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.839015 10239 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:20.877861 10158 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:20.879437  9645 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:20.882081 10236 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:20.837697 10329 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:14:20.862725 10291 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:14:20.883522  7253 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:20.884384 10220 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.788460 10230 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.887923 10308 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:20.851145  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.892634  7254 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:20.892843  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.785791 10072 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.911067  7329 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:20.914012  9988 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:20.929252 10332 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.795271 10330 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:20.944584  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:20.946208  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:21.012163  7333 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:21.012261  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.012620  7259 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
I20260709 13:14:21.013586  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:20.924480  7083 catalog_manager.cc:5697] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 6, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 6 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:21.013908  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:20.967144  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.015779  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.016193  7257 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.018235  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:21.020694  7332 raft_consensus.cc:2410] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:20.939671  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.028456  7185 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
W20260709 13:14:21.030381  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 204880us
I20260709 13:14:21.031014  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.033991  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.035013  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:21.035745  7183 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.036074  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.041042  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:21.041911  7259 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:21.034435  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:21.043933  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.045468  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:20.837989 10336 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.047166  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.051146  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.052212  7184 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:21.053241  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.057196  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.057626  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.032575 10372 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.058568  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.059610  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.059748 10158 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.060570  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:21.061335  7187 raft_consensus.cc:2368] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:21.061641 10158 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:21.062028 10158 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.062088  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.062369 10230 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:21.041782 10325 raft_consensus.cc:697] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:21.063856  9988 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:21.063550 10325 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.064213 10336 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:21.064553  7262 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:21.034787 10177 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.065639  7256 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:21.065543 10177 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.058190  7184 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:21.066949  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:20.934341 10224 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.078572  7083 catalog_manager.cc:5697] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 5 to 8, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 8 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:21.079819  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 344873us
W20260709 13:14:21.075304  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 248224us
I20260709 13:14:21.056568  7254 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:21.081840  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:21.060614 10220 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:21.070166  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.071554  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.077826  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:21.057114  7116 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb940 after lost signal to thread 6033
I20260709 13:14:21.096421  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.098032  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.098744  7180 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:21.099184  7187 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
W20260709 13:14:21.099990  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:21.102126  7116 debug-util.cc:398] Leaking SignalData structure 0x7b080003c480 after lost signal to thread 7119
I20260709 13:14:20.934963 10365 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:14:21.104240  7116 debug-util.cc:398] Leaking SignalData structure 0x7b0800385f80 after lost signal to thread 7133
I20260709 13:14:21.103751  7083 catalog_manager.cc:5697] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.032214 10332 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.019830 10212 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:20.966254 10371 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:21.017228 10219 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.096504  7895 raft_consensus.cc:2368] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11.
I20260709 13:14:20.997105 10290 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:14:21.138116  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 103743us
W20260709 13:14:21.105448  7116 debug-util.cc:398] Leaking SignalData structure 0x7b080035af80 after lost signal to thread 7211
W20260709 13:14:21.139642  7116 debug-util.cc:398] Leaking SignalData structure 0x7b08003bba20 after lost signal to thread 7286
W20260709 13:14:21.139983  7116 debug-util.cc:398] Leaking SignalData structure 0x7b0800332f20 after lost signal to thread 7287
W20260709 13:14:21.141079  7116 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2860 after lost signal to thread 7360
W20260709 13:14:21.141424  7116 debug-util.cc:398] Leaking SignalData structure 0x7b0800372560 after lost signal to thread 7361
I20260709 13:14:21.107129  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:21.143911  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.107465  7254 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:21.146734  7254 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:21.090032  7257 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:21.037937 10169 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.111545  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.033702 10239 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:21.028908 10374 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:21.113382  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:21.118599  7183 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:21.119962  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.153654  7184 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:21.115316  7260 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:21.046485 10345 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.049631 10236 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:21.105280  7083 catalog_manager.cc:5697] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 6, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 6 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:21.062469 10158 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:21.126715  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:20.939100 10288 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 13:14:21.132709  7256 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:14:21.155205  7116 debug-util.cc:398] Leaking SignalData structure 0x7b0800256fe0 after lost signal to thread 7920
I20260709 13:14:21.120679 10238 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:14:21.126888 10299 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.668s	user 0.006s	sys 0.004s
W20260709 13:14:21.161847  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 247855us
I20260709 13:14:21.032750 10179 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.124468 10371 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:21.134837 10219 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.195863  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.129144 10365 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:21.198567  7116 debug-util.cc:398] Leaking SignalData structure 0x7b0800042fa0 after lost signal to thread 7921
W20260709 13:14:21.196005  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 82741.5us
I20260709 13:14:21.204471  7083 catalog_manager.cc:5697] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.156036 10239 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:21.198058  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 116912us
W20260709 13:14:21.225493  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 68797.5us
I20260709 13:14:20.997604 10309 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.106079 10230 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:14:21.157943  9889 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:21.159646 10236 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.160898  9988 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:21.251413  7859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.013s	sys 0.046s
W20260709 13:14:21.167193 10352 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.578s	user 0.004s	sys 0.006s
I20260709 13:14:21.257272  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:21.273437  7859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.013s	sys 0.046s
I20260709 13:14:21.273715  7183 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 5.
W20260709 13:14:21.274031  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 582444us
W20260709 13:14:21.265051 10310 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 13:14:21.259771  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:21.260099  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.179742  9645 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:14:21.279039  7187 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:21.234215 10216 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:21.261626  9800 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:21.261686  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 65933.9us
I20260709 13:14:21.302493  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:21.263062  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:21.264117  7083 catalog_manager.cc:5697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.196137 10336 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:21.197649 10380 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.156054 10290 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.332453 10290 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:21.333454 10286 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 13:14:21.276317 10236 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:21.274617  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:21.359764  7183 raft_consensus.cc:2368] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:21.259197  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.274827  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:21.160652 10169 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.276688  7184 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:21.261445  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.282809 10177 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:21.287387 10378 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:14:21.291648  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:14:21.291992 10383 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:14:21.279862 10352 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.380818  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:21.381501  7181 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:21.383044 10352 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.254235 10238 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:21.384559 10238 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.387007  7179 raft_consensus.cc:2368] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:21.300640  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:21.231623 10386 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:21.161144 10374 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.311532 10372 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.312463  9990 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.313234 10325 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:21.389799  7330 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:21.315172 10380 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.315059  7083 catalog_manager.cc:5697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:21.391186  7083 catalog_manager.cc:5697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.391920 10380 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.392849  7083 catalog_manager.cc:5697] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:21.316531 10293 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.004s
I20260709 13:14:21.297610 10224 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:21.320111 10379 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:21.395222 10379 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:21.395663 10379 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.398136  7185 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:21.398409 10224 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:21.399048 10224 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.401258 10224 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.320705 10216 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:21.327008 10365 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.265439 10128 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:14:21.155551 10345 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.403898 10379 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.341912  7225 leader_election.cc:400] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11.
I20260709 13:14:21.404842  7225 leader_election.cc:403] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:21.352655  7892 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:21.405426  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 63718.9us
I20260709 13:14:21.360987  7182 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:21.407879  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.408293  7181 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:21.233856 10299 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.410740  7186 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:21.358263  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:21.370503  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:21.412600  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54469.4us
I20260709 13:14:21.410104  7083 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 5 to 6, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 6 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.414543  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:21.334048 10286 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.372385  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:21.375623  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 100875us
I20260709 13:14:21.376005  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.302604 10310 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:21.427834  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57581.4us
I20260709 13:14:21.428539  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:21.380505 10393 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:21.315068 10179 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.409045  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:21.435092  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:21.364641  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:21.436276  7178 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:21.405381  7260 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:21.420665  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:21.422523  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 121998us
I20260709 13:14:21.438160  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:21.418722  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 143331us
I20260709 13:14:21.422966  7180 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:21.380079  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:21.423666  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 464) took 2032 ms. Trace:
I20260709 13:14:21.444530  7262 rpcz_store.cc:276] 0709 13:14:19.391160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.715981 (+1324821us) service_pool.cc:224] Handling call
0709 13:14:20.718977 (+  2996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.064941 (+345964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.423430 (+358489us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54002e7054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:21.423606 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794293504}
I20260709 13:14:21.425246  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:21.429235  7083 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.310576  9800 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.432454  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:21.384562 10243 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:21.433023  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.312477  9989 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.451834  7302 leader_election.cc:400] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:21.448043  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.423043 10390 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:21.455165  7336 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:21.418365 10288 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:21.417398 10072 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.422257 10380 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:21.447993  7083 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:21.424500 10224 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:21.471904 10072 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:21.462270 10212 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.477731 10128 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:14:21.478173 10072 consensus_queue.cc:1059] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:21.479379 10072 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:21.479625 10212 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:21.479755 10072 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:21.480027  9800 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:21.480907 10385 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:14:21.457449  7890 raft_consensus.cc:2368] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:21.458947  7862 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:21.481925  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:21.483641 10392 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:14:21.483718  9889 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:21.484287  9889 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.432081 10345 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.467374  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.448961 10386 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:21.309171 10371 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.471225  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:21.452409 10227 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:21.453955 10230 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:21.472743  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.473227  7083 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 2 to 8, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 8 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:21.521418  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:21.521062  7083 catalog_manager.cc:5697] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 6, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 6 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.522047  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:21.522167  7179 raft_consensus.cc:2393] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:21.474941  7259 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:21.522183  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:21.523339  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.524170  7083 catalog_manager.cc:5697] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 5 to 7, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 7 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:21.476193  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 172509us
I20260709 13:14:21.424271 10397 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:14:21.484215 10158 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.484645  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:21.533203  7328 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:21.534236 10158 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:21.534312  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:21.487140 10379 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.489199  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1394) took 2173 ms. Trace:
I20260709 13:14:21.537087  7261 rpcz_store.cc:276] 0709 13:14:19.315836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.669318 (+1353482us) service_pool.cc:224] Handling call
0709 13:14:20.669713 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:20.670059 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:20.670084 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:20.695240 (+ 25156us) log.cc:844] Serialized 26 byte log entry
0709 13:14:20.888563 (+193323us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:20.888603 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:20.888666 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:21.488994 (+600328us) raft_consensus.cc:1685] finished
0709 13:14:21.489014 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:21.489142 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4104,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":11871,"spinlock_wait_cycles":12160,"thread_start_us":156644,"threads_started":1,"wal-append.queue_time_us":383644}
I20260709 13:14:21.491408  9989 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:21.492585  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:21.493620 10310 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.493697  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.540490  7329 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.540918  7258 raft_consensus.cc:2393] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:21.541091  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:21.455132 10357 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:21.459229 10390 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.460863 10172 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.430998 10285 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:21.513624  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.461352 10393 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:21.542927 10285 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.542876 10172 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.543488 10285 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:21.543725 10393 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.545096 10172 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:21.507500  7183 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:21.453632 10329 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:14:21.545967 10329 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:21.546300 10329 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:21.542508 10390 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:21.547106 10329 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.548286 10329 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.452548 10243 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:21.457930 10384 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:14:21.526350  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.526652  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:21.528105  7083 catalog_manager.cc:5697] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 1 to 4, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 4 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:21.528914  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:21.480808 10072 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.507565  9889 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.530333 10299 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:21.521276 10230 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:21.514232  9645 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.539515 10169 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:21.551265  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:21.568832  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:21.556216  7329 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:21.513797 10386 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:21.579324  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:21.519905 10227 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.561908  7083 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:21.525518 10220 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:21.564431  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:21.587471  7894 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:21.513032  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 80095.5us
I20260709 13:14:21.567023  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:21.592396  7892 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
W20260709 13:14:21.553783  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46502.6us
I20260709 13:14:21.598909  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.599797  7262 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.601449  7894 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:21.563964 10230 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:21.609181  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.604475  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:21.611761  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.522794 10239 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.578269  9989 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:21.607110  7334 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:21.571698  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:21.577487  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.538357 10219 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.559902 10224 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:14:21.525689 10389 consensus_queue.cc:1175] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9a54ecc9fb4541df915f9f8c01e19429" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 8 index: 9 } }
I20260709 13:14:21.578495  9645 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:21.625367  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.652637  7178 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:21.606266  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:21.609756 10169 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:21.653801  7327 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:21.622782 10397 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:21.632027 10179 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:21.660655 10169 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.631218  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:21.663866  7186 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:21.664094 10219 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:21.664865  7330 raft_consensus.cc:2368] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:21.604852  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:21.666579  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 61945.7us
I20260709 13:14:21.608183  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:21.560822 10398 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:14:21.587284 10227 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.587774 10386 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:21.603526 10379 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:21.524514  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:21.684159  7255 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:21.685356  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:21.586603 10299 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:21.667882  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:21.668315  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.691151  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:21.691529  7332 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:21.691599  7258 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.692132  7302 leader_election.cc:400] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:21.668586  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:21.692437  7302 leader_election.cc:403] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:14:21.692500  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:21.692834  7334 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:21.692991  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 183396us
I20260709 13:14:21.644989 10365 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:21.671033  7262 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:21.671175  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:21.640520  7329 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:21.693167  7332 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:21.697746  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:21.671928  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 94560.6us
I20260709 13:14:21.665920 10397 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:21.663158 10396 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.180s	user 0.003s	sys 0.000s
I20260709 13:14:21.614831 10290 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:14:21.579735 10407 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:14:21.699415  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.718255  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.679150 10286 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:21.701089  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:21.701628  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:21.703644  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:21.682039  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 73972.1us
I20260709 13:14:21.678292 10224 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:21.602567 10400 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:14:21.731382  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.719420  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.663125 10169 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:21.680477 10179 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:21.724362  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:21.690658 10177 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:21.734617  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.631192 10243 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.785094  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:21.785374  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:21.786717  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:21.786989  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:21.787433  7894 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 9: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:21.716073 10397 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:21.793704  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:21.794130  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 59564.7us
I20260709 13:14:21.706096 10299 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:21.789463  7892 raft_consensus.cc:2368] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:21.700009 10216 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:21.716271 10357 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:14:21.720745 10345 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:21.716073 10291 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:21.804854  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:21.740414 10301 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:21.795253  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:21.796420  7258 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:21.705101  9800 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:21.807330  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:21.807641 10409 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:14:21.808082  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.809167 10216 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.727324 10224 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:21.739992 10337 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:21.719983 10379 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:21.788364  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:21.817083  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:21.840155  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 97727us
I20260709 13:14:21.841018  7228 leader_election.cc:400] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:21.794687 10169 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:21.841681 10169 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:21.825438 10299 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.826169  9645 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:21.826570 10404 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:14:21.800705 10330 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:21.837327 10308 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.794s	user 0.006s	sys 0.009s
W20260709 13:14:21.797403 10247 consensus_queue.cc:1175] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9a54ecc9fb4541df915f9f8c01e19429" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 6 last_received_current_leader { term: 5 index: 7 } }
I20260709 13:14:21.817124  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:21.915150  7258 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:21.916340  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.917613  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:21.842706  7228 leader_election.cc:403] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:14:21.918799  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 77905.8us
I20260709 13:14:21.920994  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:21.815398 10301 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:21.811247 10291 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:21.798095 10286 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:14:21.828522 10332 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.699s	user 0.016s	sys 0.002s
I20260709 13:14:21.905849  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:21.839607 10121 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:21.913765  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:21.931296  7262 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 8: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:21.836280 10224 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:21.924289  7258 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:21.922425  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:21.926280 10401 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:14:21.903699 10393 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:14:21.926682 10288 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11.
W20260709 13:14:21.988504  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 146553us
W20260709 13:14:21.991534  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 85798.8us
I20260709 13:14:21.906581 10345 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:21.873356 10177 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:22.004887  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:22.005575  7262 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:21.991228 10352 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:21.931165 10236 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.008s
I20260709 13:14:21.917873 10293 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:21.932044 10291 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:22.082346  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.085783  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:22.031545  7259 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
W20260709 13:14:22.086920  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 164570us
I20260709 13:14:21.999881 10239 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:21.928202 10421 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:22.089936  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.990273 10286 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.930248 10333 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:21.930792 10301 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:22.010944 10153 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.011308 10329 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:22.114322  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:21.954964 10336 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:21.928819 10308 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.988605 10332 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:21.917088 10169 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:21.917305 10179 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.124053  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:22.088495  9800 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:22.132308  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:22.019047 10236 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.067196 10352 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.135795 10431 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:14:22.139991 10418 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:14:22.140502 10412 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:14:22.141824 10417 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:14:22.105593 10286 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:22.089109 10390 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.135057  7262 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:22.156845  7260 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 8: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:22.158022  7335 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:22.122582 10337 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:22.089756 10293 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.145099  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:22.156451 10431 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:22.220232  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45706.2us
W20260709 13:14:22.228068  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83042.6us
I20260709 13:14:22.221284  7331 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:22.143594 10333 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:22.041432 10379 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.155347 10153 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:22.215535  7334 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.001s
I20260709 13:14:22.228905  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:22.234925  7334 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:22.223105 10337 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:22.230199  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:22.230000  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 426801us
I20260709 13:14:22.233553  7181 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:22.232653  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:22.233788  9777 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:22.235888  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:22.227325 10418 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:22.237082  7187 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:22.142918 10177 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.223882 10384 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:22.241636  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.248026  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.238994  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:22.240010  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:22.245321 10408 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
W20260709 13:14:22.246049 10424 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 13:14:22.240594 10416 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:14:22.243434 10365 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:22.229753 10431 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:22.320644 10288 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:22.321233 10288 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:22.323330  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.239945 10337 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:22.278580 10422 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:22.283824  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1414) took 1441 ms. Trace:
I20260709 13:14:22.271837 10336 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:22.335536 10336 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:22.336033 10336 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:22.284789 10437 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:22.285537 10308 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:22.288522  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:22.289758 10230 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.004s
I20260709 13:14:22.339581 10437 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.340303 10288 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.295503  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.341763  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.342145 10437 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.299662 10293 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:22.300107  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:22.301630  7180 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
W20260709 13:14:22.303177  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 64240.6us
I20260709 13:14:22.349967  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:22.307281  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.308498 10330 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:22.294162 10374 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.309617  9989 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:22.309890 10390 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.315508 10301 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.361869 10301 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.319077 10352 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.333057  7257 rpcz_store.cc:276] 0709 13:14:20.845248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.149874 (+304626us) service_pool.cc:224] Handling call
0709 13:14:21.150227 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:21.195883 (+ 45656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.195932 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:21.196541 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 13:14:21.604395 (+407854us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:21.626993 (+ 22598us) log.cc:844] Serialized 14 byte log entry
0709 13:14:21.627194 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.627279 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:22.283576 (+656297us) raft_consensus.cc:1685] finished
0709 13:14:22.283600 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:22.283745 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10572,"prepare.queue_time_us":24508,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":44762,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":34586,"thread_start_us":336729,"threads_started":1,"wal-append.queue_time_us":469629}
I20260709 13:14:22.340123 10230 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.364740 10230 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:22.291931  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:22.365581  7181 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
W20260709 13:14:22.365720 10415 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
I20260709 13:14:22.241323 10345 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:22.366488 10345 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:22.366982 10345 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:22.367560 10236 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:22.369207  7890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 467) took 1647 ms (client timeout 2138 ms). Trace:
W20260709 13:14:22.369623  7890 rpcz_store.cc:269] 0709 13:14:20.722120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.725581 (+  3461us) service_pool.cc:224] Handling call
0709 13:14:22.369023 (+1643442us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54006c02d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:22.369151 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1614709632}
I20260709 13:14:22.342361  7187 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:22.308063 10224 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.355898 10432 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:22.253731 10384 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.386518  7225 leader_election.cc:400] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:22.387938  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1515) took 1876 ms. Trace:
I20260709 13:14:22.390444  7336 rpcz_store.cc:276] 0709 13:14:20.511301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.513067 (+  1766us) service_pool.cc:224] Handling call
0709 13:14:20.513372 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:21.462552 (+949180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:22.387617 (+925065us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b54002891d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:22.387846 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2161962752}
I20260709 13:14:22.333472 10291 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.395411  7183 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:22.379624 10432 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:22.388419 10332 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:22.391212 10226 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:22.399410 10432 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:22.403623 10226 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:14:22.404925  9889 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.836s	user 0.013s	sys 0.004s
I20260709 13:14:22.405364  9889 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.405413 10226 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.395560 10224 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.409086  7187 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:22.410111  9889 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:22.410308 10285 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.866s	user 0.011s	sys 0.000s
I20260709 13:14:22.411825  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.406443 10226 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:22.414147 10291 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:22.420259 10371 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:22.425000  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:22.434551 10285 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.442991  7333 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:22.414465 10336 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.437536 10440 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:22.442948 10285 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:22.452858 10440 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:14:22.453841  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.456239 10440 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.458065  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.458884  7187 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:22.459003  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:22.460330  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:22.461011  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1531) took 1036 ms. Trace:
I20260709 13:14:22.461357  7333 rpcz_store.cc:276] 0709 13:14:21.424784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.424950 (+   166us) service_pool.cc:224] Handling call
0709 13:14:22.460826 (+1035876us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b540036b854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:22.460943 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292628864}
I20260709 13:14:22.462152  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:22.446870 10380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.002s	sys 0.016s
I20260709 13:14:22.466671  7262 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:22.466920  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:22.479894  7257 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:22.467444  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:22.468273  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:22.469439  7890 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:22.471717 10332 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.472121 10384 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.473356  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:22.473678  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1520) took 1757 ms. Trace:
I20260709 13:14:22.483621  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:22.475225  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 483) took 1013 ms. Trace:
I20260709 13:14:22.483580  7335 rpcz_store.cc:276] 0709 13:14:20.716122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.754795 (+ 38673us) service_pool.cc:224] Handling call
0709 13:14:20.755095 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:22.163857 (+1408762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:22.473484 (+309627us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400253354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:22.473626 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3225952640}
I20260709 13:14:22.480882  7182 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:22.484944  7257 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:22.485088  7260 rpcz_store.cc:276] 0709 13:14:21.462110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.467120 (+  5010us) service_pool.cc:224] Handling call
0709 13:14:22.475056 (+1007936us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b540034b2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:22.475171 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490014976}
W20260709 13:14:22.478098 10380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.002s	sys 0.016s
I20260709 13:14:22.491515 10380 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:22.504452  7890 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:14:22.504033  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:22.508041  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.500530  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:22.515462  7184 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:22.515599  7257 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:22.503734  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:22.507319  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1533) took 1077 ms. Trace:
I20260709 13:14:22.503304  7892 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:22.516695  7331 rpcz_store.cc:276] 0709 13:14:21.431991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.432135 (+   144us) service_pool.cc:224] Handling call
0709 13:14:22.507128 (+1074993us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540020fdd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:22.507260 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675601664}
I20260709 13:14:22.519663  7895 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 9: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:22.520565  7186 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:22.521198  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:22.522915 10336 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.472148 10365 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:22.506394 10389 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.502192 10380 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.503682 10451 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:22.523202 10428 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.544349 10428 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.547186  7180 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:22.492137 10398 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:14:22.495750 10332 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.518371 10333 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 13:14:22.541340 10386 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.844s	user 0.012s	sys 0.000s
I20260709 13:14:22.554977 10428 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.541810 10365 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.543726 10389 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.564239 10345 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.564654 10389 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.564491  7260 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:22.568254  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:22.549762 10451 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:22.569824  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:22.569193  7260 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:22.571444  7261 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:22.573189  7258 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 8: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:22.496722 10286 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.578924  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:22.582562  7262 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:22.568711 10365 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.586807  7184 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:22.583535  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:22.592685 10345 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.596992 10384 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:22.596760 10451 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.597615 10384 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.598135 10384 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:22.600503 10397 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.003s
I20260709 13:14:22.600945 10397 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.596807 10332 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.606007  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:22.594444  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.606777  7183 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:14:22.571007 10390 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:14:22.581403 10336 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:22.628321  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.567576 10386 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:22.629623 10227 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.933s	user 0.003s	sys 0.008s
I20260709 13:14:22.617602 10429 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:14:22.629959 10336 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.649760  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:22.647120 10397 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:22.658771  7892 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:22.667937  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:22.660164  7181 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:22.678771 10390 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:22.679368 10390 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:22.680944 10391 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 1.246s	user 0.001s	sys 0.006s
I20260709 13:14:22.682030 10390 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.643170 10227 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.684123 10227 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.684859  7253 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:14:22.686617  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1424) took 1089 ms. Trace:
I20260709 13:14:22.686992  7253 rpcz_store.cc:276] 0709 13:14:21.597493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:22.017645 (+420152us) service_pool.cc:224] Handling call
0709 13:14:22.086428 (+ 68783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:22.685504 (+599076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:22.686346 (+   842us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54002d3554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:22.686553 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375591296}
I20260709 13:14:22.696655  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:22.698277  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:22.701910  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:22.671293 10336 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.715495  7255 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:22.718767  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.658349 10432 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.704252  9963 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:22.660679 10337 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.707108 10333 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:22.705312 10216 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:22.707499 10227 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:22.674898 10384 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:22.735625 10337 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.736693  7255 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:22.736363 10227 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.756774  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:22.758776  7150 leader_election.cc:400] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:22.760980  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:22.761546  7331 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:22.737478 10432 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.737972  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.772956  7184 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:22.739341 10333 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:22.775501 10333 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.676123 10431 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:22.743059  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:22.745878  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.746881  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:22.759933  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:22.779687  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:22.779896  7187 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:22.763942  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:22.781095  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:22.781397  7327 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:22.765064  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:22.784896  7327 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:22.765604  7331 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:22.733887  9963 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:22.787009 10230 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.786921 10398 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:22.787509 10247 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:22.787884 10379 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:22.777554 10459 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.004s
I20260709 13:14:22.788793 10431 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.771194 10177 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:14:22.791546  7331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:22.792062 10227 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:22.773309 10179 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:14:22.792620  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:22.793497  9800 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.794008 10386 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:22.794160  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:22.794879 10219 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.796842 10380 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:22.756668 10286 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:22.760237 10420 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:14:22.799541  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:22.799590 10285 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:14:22.804993  7336 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:23.335886  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:23.336233  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:22.977569  7299 leader_election.cc:400] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:23.336647 10219 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:23.337126  7299 leader_election.cc:403] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:14:22.876076  7179 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:23.337867  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:23.338822 10247 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.339406  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:23.340049  7258 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:23.340332  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:23.340901  7334 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:23.330490 10243 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:22.892112  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.914206  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:22.821285  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:23.072674  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:23.281445  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:22.878053  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 74684.7us
I20260709 13:14:22.800992  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:23.365440  7329 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:23.366354  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:23.367097  7329 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:22.913707  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:23.337877  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 360510us
I20260709 13:14:23.378865  7331 raft_consensus.cc:606] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:23.379364  7331 raft_consensus.cc:614] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:22.804845  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:23.388916  7333 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:22.978206  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 96219.8us
I20260709 13:14:23.392467  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:23.386814  7258 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
W20260709 13:14:23.394241  7892 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.713s	user 0.012s	sys 0.001s
I20260709 13:14:23.395584  7892 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:23.405382  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:23.410779  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:23.423101  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:23.132017 10464 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:14:23.425446  7327 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:14:23.080050 10465 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:14:23.430166  7256 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:23.438099  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:23.330102 10384 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:23.039520 10451 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:23.441767  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:22.911119 10429 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:22.907533 10236 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.875479 10432 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.338914 10219 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:23.438099  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:23.420789 10386 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:23.057547 10289 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:23.293555 10443 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.386873 10380 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:23.429180  7331 raft_consensus.cc:2368] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:23.457446  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:23.450994 10440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.008s	sys 0.020s
I20260709 13:14:23.462857  7334 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:23.471645  7256 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:23.434893 10330 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:23.434365 10337 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:23.512001 10337 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:23.513896 10285 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:23.460311 10429 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.514684 10285 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:23.517166 10429 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:23.472949 10236 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:23.521054 10379 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:23.522050 10379 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.430891 10227 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:23.460557  7329 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:23.524231  7327 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:23.524459  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:23.525492  7329 raft_consensus.cc:2368] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7.
I20260709 13:14:23.422600  9800 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:23.494867  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:23.496003  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:23.534044  7334 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:14:23.496567  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2288) took 1264 ms. Trace:
I20260709 13:14:23.425709 10230 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:23.495200 10440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.009s	sys 0.021s
I20260709 13:14:23.495466  9963 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:23.499043 10443 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.501726  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:23.549490  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:23.502415 10247 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:23.494102 10380 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:23.494877 10289 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.456009 10451 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.559106 10451 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:23.440588 10286 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:14:23.559381 10336 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:23.560075 10247 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:23.559979 10336 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:23.560549 10247 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:23.561460 10247 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.499351 10386 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:23.562299 10336 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:23.559130  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:23.477545 10432 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:23.564862 10432 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:23.425396 10423 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:14:23.565920 10423 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:23.566386 10423 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:23.567410 10423 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.569011 10423 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:23.572503 10289 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:23.532713 10431 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.575232 10431 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:23.577970 10431 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:23.534488  7185 rpcz_store.cc:276] 0709 13:14:22.231775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:22.231896 (+   121us) service_pool.cc:224] Handling call
0709 13:14:22.232189 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:22.232579 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:22.232614 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:22.560579 (+327965us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b2c0001afe8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:14:22.561164 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:14:22.603783 (+ 42619us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:22.603808 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:22.603861 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:22.776851 (+172990us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:23.496305 (+719454us) raft_consensus.cc:1685] finished
0709 13:14:23.496327 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:23.496493 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22265,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":17036,"spinlock_wait_cycles":19449600,"thread_start_us":42183,"threads_started":1,"wal-append.queue_time_us":81700}
I20260709 13:14:23.579622 10380 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.581753 10380 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:23.522660 10379 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.501935 10330 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:23.514386 10337 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:23.552659  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:23.608505  7331 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:23.546224 10285 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:23.556018 10443 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:23.578071 10236 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:23.583534  7330 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:23.545826  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:23.619709  7334 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:23.585940  7336 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:23.627763  7327 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:23.628496  7333 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:23.616050  7259 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:23.548045 10072 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:23.659768 10386 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:23.660295 10371 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:23.662956  9800 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:23.664395 10285 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.666332 10230 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:23.670133 10379 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:23.672297 10330 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:23.707780  7328 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:23.721169  7335 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:14:23.711419 10435 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:23.676535  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 290597us
I20260709 13:14:23.680640  7331 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:23.543864 10227 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.714721 10219 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:23.691720 10371 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.693928 10386 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.707037 10285 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:23.729238 10333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.017s	sys 0.031s
W20260709 13:14:23.748127  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 926840us
W20260709 13:14:23.741307  7859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.034s	sys 0.075s
W20260709 13:14:23.800674  7859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.034s	sys 0.075s
I20260709 13:14:23.737995 10390 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:23.800457  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 452231us
I20260709 13:14:23.803723  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:23.800469  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:23.804008  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:23.807761  7301 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:23.804579  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:23.806784  7331 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:23.807916  7327 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:23.805470  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:23.808132  7150 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:23.815801  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:23.815922  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:23.803049 10333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.017s	sys 0.032s
I20260709 13:14:23.797380 10243 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.826663  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:23.817800  7327 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:14:23.819063  7336 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:23.747184 10230 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.798130 10371 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:23.739816 10435 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.823257  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:23.817895  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:23.834887  7333 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:23.836321  7327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75c50740d1144c09a074230835085663"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:23.837338  7327 raft_consensus.cc:606] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:23.838128  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:23.825567 10220 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.815300 10380 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:23.839282 10451 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:23.839891 10451 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:23.840444 10451 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:23.839614 10380 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.839553 10220 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.820196 10286 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:23.820948 10247 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:23.828544 10428 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:23.816113 10390 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:23.873499  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:23.878386  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.848738 10179 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:23.846284 10230 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:23.841881 10325 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:14:23.888218  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 50183.4us
I20260709 13:14:23.833765 10243 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:23.870302 10379 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:23.890456 10177 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:14:23.888041 10179 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:24.001858  7302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.035s	sys 0.070s
W20260709 13:14:24.020659  7302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.035s	sys 0.074s
W20260709 13:14:24.005478  7226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.008s	sys 0.018s
W20260709 13:14:24.023298  7862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.003s	sys 0.025s
W20260709 13:14:24.024667  7862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.003s	sys 0.025s
W20260709 13:14:24.024734  7226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.009s	sys 0.019s
I20260709 13:14:23.897397 10397 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:14:24.019361 10398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.017s	sys 0.010s
W20260709 13:14:24.027807  7227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.007s	sys 0.020s
W20260709 13:14:24.024096  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 1.22451e+06us
W20260709 13:14:24.009634 10469 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:14:24.032214  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:24.033682  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:24.033926  7260 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:24.028155  7227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.007s	sys 0.020s
I20260709 13:14:23.984890 10216 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:24.037613  7256 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:23.985999 10386 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:24.039076 10478 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:24.035465  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:23.961014 10158 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:23.926502 10220 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:23.963250 10285 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:24.032214 10398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.017s	sys 0.010s
W20260709 13:14:24.046087  7228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.006s	sys 0.023s
W20260709 13:14:24.063830  7228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.006s	sys 0.023s
W20260709 13:14:24.062347  7152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.017s	sys 0.029s
W20260709 13:14:24.069248  7152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.017s	sys 0.029s
W20260709 13:14:24.042874  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.000s	sys 0.028s
I20260709 13:14:24.070196  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:23.928210 10227 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:24.070824  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.000s	sys 0.029s
I20260709 13:14:24.073915  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:24.074942  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:24.075232  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 682842us
I20260709 13:14:24.076299  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.042754 10216 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:24.081517  7257 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:24.093394  7260 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:14:24.093763  7225 leader_election.cc:400] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8.
I20260709 13:14:24.036818 10333 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:24.046686 10380 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.041698 10479 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:24.061232 10330 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:24.095167  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 61553.1us
I20260709 13:14:24.027077 10379 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.039922 10325 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:14:24.105373 10468 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:24.106307 10230 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:24.063827 10337 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:24.100621  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.069310 10397 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:24.060889 10158 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:24.081274 10478 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:24.110014  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:24.097004 10216 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:24.128909 10470 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:14:24.115720 10380 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:14:24.096001 10473 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:24.114245  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.115617  7257 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:24.079550 10431 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:24.116858 10485 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:24.119596 10243 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:24.123811 10179 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:24.108458 10333 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.115459 10337 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.125783 10435 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:24.132001  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 398) took 1340 ms. Trace:
I20260709 13:14:24.108688 10479 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.097402 10227 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:24.135427  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:24.097374  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:24.147377  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:24.147673  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:24.102561 10398 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:24.157822  7894 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:24.159255  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:24.161845  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 335306us
I20260709 13:14:24.153198  7332 rpcz_store.cc:276] 0709 13:14:22.791991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:22.794618 (+  2627us) service_pool.cc:224] Handling call
0709 13:14:22.800053 (+  5435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:22.800374 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:22.800404 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:23.330822 (+530418us) log.cc:844] Serialized 26 byte log entry
0709 13:14:23.713069 (+382247us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:23.713128 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:23.713228 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:24.130530 (+417302us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:24.131646 (+  1116us) raft_consensus.cc:1685] finished
0709 13:14:24.131675 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:24.131923 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":268,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":57502,"spinlock_wait_cycles":4915968,"thread_start_us":381773,"threads_started":1,"wal-append.queue_time_us":692308}
I20260709 13:14:24.161929  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:14:24.155668  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55153.7us
I20260709 13:14:24.170861  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:24.171069  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:24.172642  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:24.138561 10397 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:24.176811  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.113497 10330 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.177803  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:24.179894  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:24.135064 10468 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:24.209463  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:24.164650  9963 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.010s	sys 0.026s
I20260709 13:14:24.156648 10479 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:24.161703  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:24.161808 10475 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:24.145447 10431 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.137239 10473 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.162292 10286 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:24.161952 10227 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:24.216159  9963 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.011s	sys 0.026s
I20260709 13:14:24.237974  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.213387 10398 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:24.151067 10485 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.239279  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.216409 10220 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:24.244791  7861 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.246410  7258 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:24.239435  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.255414  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:24.243476  7228 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.707s (SENT) [suppressed 13 similar messages]
I20260709 13:14:24.206820 10243 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:14:24.230875 10486 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:24.245215 10481 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:24.242566 10482 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:24.280179  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 462324us
I20260709 13:14:24.246071 10483 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.283264  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:24.295259  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 266113us
I20260709 13:14:24.264040  9963 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:24.296635  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.215785 10478 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.240631 10474 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:14:24.239068 10380 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 13:14:24.315465  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 70750.8us
I20260709 13:14:24.273566 10475 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:24.279583 10072 consensus_meta.cc:287] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.589s	user 0.005s	sys 0.007s
I20260709 13:14:24.268507 10177 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:24.273316 10179 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:14:24.325251  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 115877us
I20260709 13:14:24.325820  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:24.224684 10158 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.253389 10220 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:24.339411  7257 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:24.335548  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 164950us
I20260709 13:14:24.312041 10471 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:24.311789 10487 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:24.310252 10486 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:24.345263  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:24.292454 10398 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:14:24.315917 10493 raft_consensus.cc:2764] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 13:14:24.331508 10466 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.625s	user 0.000s	sys 0.008s
I20260709 13:14:24.350994  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:24.351572  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 108118us
I20260709 13:14:24.346153  7254 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 8: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:24.352736  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 182365us
I20260709 13:14:24.348088  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:24.353598  7255 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:24.354549  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:24.355088  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:24.355777  7253 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:24.333730 10179 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.339124 10430 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:24.348501  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 62607.7us
I20260709 13:14:24.343382 10243 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:24.357883  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:24.369688  7258 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:24.332655  9963 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:24.372934  9963 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.349992  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:24.376034  7262 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:24.298272 10482 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:24.345780 10471 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:24.378674 10421 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:24.379129 10421 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:14:24.360098  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 262817us
I20260709 13:14:24.363183  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:24.342327 10435 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:24.355172  7261 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:24.313620 10483 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.380367  7225 leader_election.cc:400] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7.
I20260709 13:14:24.379951 10421 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.380709  7225 leader_election.cc:403] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:14:24.381274 10421 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:24.339479 10492 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:24.382884 10492 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.383352 10492 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:24.382222 10483 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.390961  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:24.352237 10379 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.299270 10397 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.343900 10072 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:14:24.339787 10177 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:24.417344  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.366359 10179 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:24.424353  7254 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
W20260709 13:14:24.417662  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 132528us
W20260709 13:14:24.425033  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44796us
I20260709 13:14:24.421098  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.369310 10243 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:24.331979 10286 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.357321 10477 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:14:24.389612 10491 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.382233 10476 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:24.316592 10468 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:24.456548  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 159973us
I20260709 13:14:24.457782 10491 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:24.458397 10488 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:14:24.427592  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:24.420493 10483 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:24.470319  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 105645us
I20260709 13:14:24.472047  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.430708 10481 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.349118 10486 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:24.559223  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.376821 10430 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:24.563395  7894 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:24.377818 10471 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:24.563778  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 91806.9us
I20260709 13:14:24.557627 10483 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:24.431371 10337 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.437704 10435 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:24.456440 10333 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.469789 10493 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:24.544015 10476 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.476924 10158 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:24.471730 10380 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:24.572402  7329 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:14:24.585191 10451 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.005s
I20260709 13:14:24.575201 10386 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:24.488354 10420 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:24.472071 10398 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.545651 10443 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:24.427552 10475 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 13:14:24.630421  7331 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:24.542270 10487 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:24.583739  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.474277 10390 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.589560  7179 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:14:24.590935  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:24.592124  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:24.593309  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:24.458410 10474 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:14:24.602945 10499 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7.
W20260709 13:14:24.576375 10504 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:14:24.558427 10330 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.470288 10219 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:24.633401 10398 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.565017 10481 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:24.612239  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 151318us
I20260709 13:14:24.575366 10508 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.576649 10243 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.573861  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:24.627295 10443 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:14:24.605122 10423 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.034s	user 0.018s	sys 0.000s
W20260709 13:14:24.627912  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 200428us
I20260709 13:14:24.696916  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:24.628548  7186 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:24.628203  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:24.698385  7187 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:24.605041 10476 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:24.597088 10431 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.600739 10337 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.599949 10301 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:14:24.635046  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 51425us
I20260709 13:14:24.602559 10513 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.620312  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:24.623822 10420 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:24.599998  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:24.592638  9800 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:14:24.727592  9800 consensus_queue.cc:1243] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:24.728166  9800 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:24.728677  9800 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:24.731775 10479 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:24.616575 10227 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.735999 10475 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:24.649631  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:24.606305 10236 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:14:24.626456 10473 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.665767  7183 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:24.633374 10333 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:24.621290  7178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:14:24.702412  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:24.703938  7334 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:14:24.710134  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:24.671535 10216 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.001s
I20260709 13:14:24.649853 10230 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:14:24.671113 10501 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:14:24.623997 10451 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:24.717028  7182 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:24.722317  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 115711us
I20260709 13:14:24.780542  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:24.678860 10220 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:24.725737  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:24.804849  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 256084us
I20260709 13:14:24.693712 10428 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:24.678655 10482 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:24.669612 10491 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.814790  7333 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:24.754320  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:24.754673  7178 raft_consensus.cc:606] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:24.754969  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:24.755761  7334 pending_rounds.cc:85] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 6
I20260709 13:14:24.816426  7334 pending_rounds.cc:107] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:14:24.721194 10301 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.666841 10484 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:24.788730  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:24.667157 10219 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.721854 10423 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.779765 10216 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.795346  7185 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:24.639407 10487 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:24.710891 10330 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:24.799167  7891 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:24.743302 10236 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:24.803397  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:24.808060  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:24.808377  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:24.811301  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 86921.8us
I20260709 13:14:24.759071 10479 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:24.881031  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:24.881526 10479 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:24.881811  7336 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
W20260709 13:14:24.804059  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 220494us
I20260709 13:14:24.883478  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:24.883834  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:24.884227  7336 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:14:24.884640 10531 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.884922  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:24.671343 10435 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.720757 10337 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:24.790720 10443 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.816622  7180 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:24.816713  7334 raft_consensus.cc:2889] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:24.724376 10513 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:24.818861  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.822023  7184 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:24.802354 10227 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:24.812176 10177 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:24.669459 10508 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.805609 10285 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:24.828044 10484 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.829459  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:24.831449 10301 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:24.926024  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:24.842125  7181 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:24.932986  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:24.794546  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:24.843444  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:24.722667 10480 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:14:24.864076  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:24.908245 10227 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:24.845647 10247 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.976s	user 0.003s	sys 0.010s
W20260709 13:14:24.879364  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.876312 10236 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:24.757175  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 54861.9us
I20260709 13:14:24.899346  7862 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:24.900532  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:24.841523  9800 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:24.882071 10479 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:24.904002  7895 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:24.832228  7183 raft_consensus.cc:2410] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:24.845603 10423 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:24.926143 10285 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:24.877417  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:24.908023 10072 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:14:24.826967 10420 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:24.940981  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:25.161912  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 681) took 1015 ms. Trace:
I20260709 13:14:25.197154  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.144444  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:24.969947  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.198295  7186 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:25.199247  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:25.199852  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:25.195293  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 310413us
I20260709 13:14:24.975489  7181 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.201611  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:25.202600  7255 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:25.141465  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.203400  7890 rpcz_store.cc:276] 0709 13:14:24.146661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.146827 (+   166us) service_pool.cc:224] Handling call
0709 13:14:25.161696 (+1014869us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54005a14d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:25.161847 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456840960}
I20260709 13:14:25.197245  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.204537  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.205046  7187 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:24.967844  7184 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:25.206203  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.207573  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.209249  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.205221  7180 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:24.902197 10503 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:24.908154 10230 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:24.901957 10500 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.923552 10495 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:24.928848 10443 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:25.248633  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:25.134157 10179 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.696s	user 0.007s	sys 0.003s
W20260709 13:14:25.250169  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 350885us
W20260709 13:14:25.251325  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49770.2us
I20260709 13:14:25.256011  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:25.257314  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:25.258114  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:25.251447  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:24.971526 10371 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.122s	user 0.011s	sys 0.003s
I20260709 13:14:24.902235 10286 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:14:24.955192 10492 consensus_meta.cc:287] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.004s
W20260709 13:14:25.242672 10158 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.625s	user 0.005s	sys 0.004s
I20260709 13:14:24.928404 10474 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:25.260005  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 359607us
I20260709 13:14:25.240767 10486 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:25.243852 10529 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.355s	user 0.002s	sys 0.000s
I20260709 13:14:25.136976 10380 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:25.243340 10227 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.016371 10483 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:24.974829 10530 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:25.004165 10301 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:25.246356 10230 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.255450  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:25.274744  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:24.983933 10519 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:25.260262 10524 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.466s	user 0.001s	sys 0.000s
I20260709 13:14:25.254117 10480 consensus_queue.cc:1243] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:25.252825 10495 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:25.296862  7336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:25.254987 10216 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:25.246001 10433 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:14:25.267534 10520 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.457s	user 0.000s	sys 0.001s
I20260709 13:14:25.259405 10247 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:25.262436 10451 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:25.264245 10531 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:25.266520 10478 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:25.264026 10286 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:25.266150  9800 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:14:25.298877 10543 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:25.309880 10337 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:25.293764 10474 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:25.263440 10482 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:25.308704  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:25.307034  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 51674.3us
I20260709 13:14:25.261211 10527 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:25.290506 10219 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:25.262899 10179 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.268560 10371 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.285020 10492 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:25.252923 10500 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:25.315553 10230 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.302574 10380 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:25.318795 10220 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:25.322774 10301 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.299547 10285 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.298365 10236 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.475324 10286 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.476442 10478 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:25.478368 10542 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:14:25.387431 10479 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:25.477175 10495 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:25.291900 10330 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:25.308768 10541 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:14:25.308990 10534 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:14:25.387436 10397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.019s	sys 0.013s
I20260709 13:14:25.316190 10530 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:25.430903 10535 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:14:25.402408 10511 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:25.491820 10487 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:25.479130 10484 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:25.483698 10485 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:25.485502 10471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.040s	sys 0.099s
I20260709 13:14:25.477332 10482 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.490800 10478 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:25.480825 10493 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:25.494882 10513 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:25.505467 10540 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:14:25.496346 10508 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:25.510983 10492 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:25.508468 10493 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.512921 10481 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:25.513607 10493 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:25.569473  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.249383  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.574892  7179 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:25.575238  7180 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:25.577903  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.580245  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.583503  7184 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:25.583973  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.584883  7185 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:25.585332  7180 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:25.586079  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:25.265982  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 69899.3us
I20260709 13:14:25.600611  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:25.587257  7187 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:25.609652  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:25.625130  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 350338us
I20260709 13:14:25.610909  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.625741  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:25.626871  7185 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
W20260709 13:14:25.627094  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 354228us
I20260709 13:14:25.622164  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:25.472214  7332 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:25.624367  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.644120 10158 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:25.645128 10158 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:25.648559  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:25.650673 10158 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:25.636411  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:25.651053  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:25.651620 10158 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:25.652004  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.652074  7258 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:25.652717 10158 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:25.638150  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.655203  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.655694 10158 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:25.664207 10158 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.657970  7180 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:25.588502  7181 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:25.659179  7186 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:25.656422  7185 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:25.671169  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:25.672492  7185 raft_consensus.cc:2410] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:25.677971  7327 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:25.491156 10220 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:14:25.687054  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.687999 10482 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:25.318454 10519 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.483284 10247 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:25.691571 10513 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:25.692234 10423 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:25.692736 10513 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:25.696259 10247 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.701988 10158 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.705082 10236 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.733304  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:25.735206  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:25.737850  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:25.504209 10471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.040s	sys 0.100s
I20260709 13:14:25.789988  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:25.823494  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:25.894220  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:25.894019  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.857116  7185 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:14:25.747633  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 76453us
W20260709 13:14:25.819170  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 138396us
I20260709 13:14:25.743032 10220 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:25.965483 10230 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.969758 10230 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:25.969934 10371 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:25.955777 10451 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:25.975167 10158 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:25.895630 10421 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.514s	user 0.015s	sys 0.006s
I20260709 13:14:25.955052 10477 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:25.987270 10451 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:25.987933 10477 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:25.988415 10477 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:25.988806  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:25.989763 10451 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:25.954788 10337 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:25.991261 10337 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:25.992870 10476 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.271s	user 0.011s	sys 0.003s
I20260709 13:14:25.992636 10337 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.993382 10476 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:25.994992  7894 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:25.997462 10537 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.990224  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:26.001546  7183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2309) took 1251 ms (client timeout 1580 ms). Trace:
I20260709 13:14:26.004036  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2318) took 1160 ms. Trace:
I20260709 13:14:26.004153  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:26.004696 10513 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:25.986934 10530 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:26.004856  7186 rpcz_store.cc:276] 0709 13:14:24.843195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.002809 (+1159614us) service_pool.cc:224] Handling call
0709 13:14:26.003332 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:26.003636 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:26.003660 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:26.003724 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:26.003762 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.003817 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:26.003912 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:26.006232 10530 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:26.006863 10530 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:26.007216 10301 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:25.857040 10474 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:26.007952 10530 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:25.822229 10435 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:25.738794  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:26.002099  7183 rpcz_store.cc:269] 0709 13:14:24.749636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.780315 (+ 30679us) service_pool.cc:224] Handling call
0709 13:14:26.001080 (+1220765us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b54001b3ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:26.001342 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63048960}
I20260709 13:14:26.010317  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.010200  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1661) took 1038 ms. Trace:
I20260709 13:14:26.015432  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2311) took 1167 ms. Trace:
I20260709 13:14:26.015766  7185 rpcz_store.cc:276] 0709 13:14:24.795402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.673197 (+877795us) service_pool.cc:224] Handling call
0709 13:14:25.681664 (+  8467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:25.962423 (+280759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:25.962675 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:26.012351 10435 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:26.014801  7187 rpcz_store.cc:276] 0709 13:14:24.972015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.205897 (+233882us) service_pool.cc:224] Handling call
0709 13:14:26.009969 (+804072us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54002b4dd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:26.010125 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873175296}
I20260709 13:14:25.788602 10486 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.998124 10537 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.031652  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:26.032629  7889 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:26.020148  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:26.033403 10486 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:26.021203  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1558) took 2690 ms. Trace:
I20260709 13:14:26.034613 10219 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:26.034564  7334 rpcz_store.cc:276] 0709 13:14:23.331139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.679210 (+348071us) service_pool.cc:224] Handling call
0709 13:14:23.679556 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:24.899015 (+1219459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.020686 (+1121671us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400253854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:26.021002 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2354918272}
I20260709 13:14:26.036597  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.037392  7334 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:26.039149  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.040776  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.027666  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.048017  7260 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:26.028317 10236 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:26.029646 10476 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:26.032663 10537 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:26.049511 10236 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:26.052444 10236 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:26.052888 10431 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:26.053737 10513 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:26.053570 10431 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.054255  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.054512 10513 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:26.055119  7334 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:26.056237  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.057225 10513 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:26.061931 10236 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.062590 10236 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.064810 10236 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:25.787950 10384 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.067018 10384 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:26.068497  7890 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 8: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:26.069257 10384 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:26.023500  7258 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:26.070916  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:26.035121 10219 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:26.071689  7257 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:26.010453 10247 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.072608 10219 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.073629 10247 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:26.074160 10219 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:26.038532 10486 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:26.023394 10495 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.001s
I20260709 13:14:26.075270  7185 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:26.075026 10495 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.075901  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1662) took 1103 ms. Trace:
I20260709 13:14:26.076246  7185 rpcz_store.cc:276] 0709 13:14:24.972369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.074639 (+1102270us) service_pool.cc:224] Handling call
0709 13:14:26.075034 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:26.075688 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.075838 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:26.077438 10495 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:26.078743  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.050226 10430 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:26.079774 10243 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:26.080080  7257 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:26.044775 10286 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:25.739246 10498 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.307s
I20260709 13:14:26.045558 10398 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:26.046216  7327 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:26.046360  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2321) took 1147 ms. Trace:
I20260709 13:14:26.042217 10285 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:26.022296  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1561) took 1446 ms. Trace:
I20260709 13:14:26.043931 10435 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:26.086766  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:26.128060  7179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2301) took 1418 ms (client timeout 1875 ms). Trace:
W20260709 13:14:26.135167  7179 rpcz_store.cc:269] 0709 13:14:24.709273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.709456 (+   183us) service_pool.cc:224] Handling call
0709 13:14:26.127697 (+1418241us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b5400247554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:26.127972 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743157632}
I20260709 13:14:26.136724  7262 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:26.136631  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:26.131385  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1674) took 1152 ms. Trace:
I20260709 13:14:26.137638  7184 rpcz_store.cc:276] 0709 13:14:24.978977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.208971 (+229994us) service_pool.cc:224] Handling call
0709 13:14:26.131162 (+922191us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54002c4f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:26.131308 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858000768}
I20260709 13:14:26.138800  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.140187  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1564) took 1568 ms. Trace:
I20260709 13:14:26.140446  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:26.141587  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:26.142249  7890 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:26.143679  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.140650  7333 rpcz_store.cc:276] 0709 13:14:24.571131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.571274 (+   143us) service_pool.cc:224] Handling call
0709 13:14:24.571605 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:24.815232 (+243627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.014171 (+1198939us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540013d654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:26.017881 (+  3710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558789376}
I20260709 13:14:26.144474  7328 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:26.145247  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.145468  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.146186  7333 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:26.146296  7328 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:26.140415  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:26.147215  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.147321  7262 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:26.147920  7333 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:26.148541  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2320) took 1268 ms. Trace:
I20260709 13:14:26.148860  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.148947  7181 rpcz_store.cc:276] 0709 13:14:24.880308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.932746 (+ 52438us) service_pool.cc:224] Handling call
0709 13:14:26.148341 (+1215595us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b5400270bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:26.148486 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96409984}
I20260709 13:14:26.143561  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:25.743161 10380 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:26.140602  7331 rpcz_store.cc:276] 0709 13:14:24.572149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.572272 (+   123us) service_pool.cc:224] Handling call
0709 13:14:24.572538 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:24.630872 (+ 58334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.139716 (+1508844us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b540013e554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:26.140011 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132711680}
I20260709 13:14:26.153455  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.154604  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.156250  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1568) took 1352 ms. Trace:
I20260709 13:14:26.156718  7332 rpcz_store.cc:276] 0709 13:14:24.803297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.881353 (+ 78056us) service_pool.cc:224] Handling call
0709 13:14:24.881641 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:25.642066 (+760425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.155882 (+513816us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54002891d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:26.156093 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353281792}
I20260709 13:14:26.157243  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.158043  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:26.159559  7895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 593) took 1566 ms (client timeout 1967 ms). Trace:
I20260709 13:14:26.159775 10179 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:26.160048  7895 rpcz_store.cc:269] 0709 13:14:24.592902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.593079 (+   177us) service_pool.cc:224] Handling call
0709 13:14:26.159179 (+1566100us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54004c4854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:26.159370 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612990848}
I20260709 13:14:26.161156  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:26.086081  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.162469  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.163130  7257 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:26.164523  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:26.165870  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.167587  7257 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:26.080391  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:26.169509  7262 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
W20260709 13:14:26.170503  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 90226.7us
I20260709 13:14:26.084420  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.170094 10480 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:26.097993  7894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 591) took 1524 ms (client timeout 1867 ms). Trace:
I20260709 13:14:26.171638 10480 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.172051 10480 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:26.172618 10519 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:26.171207  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 597) took 1134 ms. Trace:
W20260709 13:14:26.173254  7894 rpcz_store.cc:269] 0709 13:14:24.573509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.573678 (+   169us) service_pool.cc:224] Handling call
0709 13:14:26.097744 (+1524066us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400684f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:26.097923 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025083648}
I20260709 13:14:26.173962  7892 rpcz_store.cc:276] 0709 13:14:25.036870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.037288 (+   418us) service_pool.cc:224] Handling call
0709 13:14:25.037676 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:25.260810 (+223134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:25.260844 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:25.260887 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:25.260915 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.170738 (+909823us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54005631d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:26.170796 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:26.171023 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512753920}
I20260709 13:14:26.175448  7262 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:26.184309 10435 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.186842 10435 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:26.187167 10493 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.000s
I20260709 13:14:26.189342  7334 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:26.180944 10480 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.194454  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:26.169854 10420 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:26.195188  7186 rpcz_store.cc:276] 0709 13:14:24.899509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.006481 (+1106972us) service_pool.cc:224] Handling call
0709 13:14:26.018902 (+ 12421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:26.044566 (+ 25664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:26.044605 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:26.044691 (+    86us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:26.044734 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.046166 (+  1432us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:26.046283 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:26.163353  7332 raft_consensus.cc:2410] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:26.196481  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:26.196959  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:26.085850  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.184515 10478 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.080986  7259 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:14:26.094259  7891 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 686) took 1926 ms (client timeout 2202 ms). Trace:
I20260709 13:14:26.201511  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.098165 10500 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:26.206848  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:26.019642 10443 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.748s	user 0.008s	sys 0.004s
W20260709 13:14:26.209623  7891 rpcz_store.cc:269] 0709 13:14:24.167661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.170516 (+  2855us) service_pool.cc:224] Handling call
0709 13:14:26.093763 (+1923247us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540043a154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:26.094020 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442865920}
I20260709 13:14:26.203204  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:26.100435 10379 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:26.215566  7328 raft_consensus.cc:2410] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:14:25.858937 10484 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.340s
I20260709 13:14:25.696308 10397 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.508s
I20260709 13:14:25.494263 10330 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.217646  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:26.218250  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.093452 10431 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:26.221367  7180 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:26.226118  7333 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:26.226966  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.227144  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.227633  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.224485  7182 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:26.230888  7329 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:26.232254  7332 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:26.232287  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:26.226881  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:26.235780  7335 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:14:26.236346  7335 pending_rounds.cc:85] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 4
I20260709 13:14:26.236577  7335 pending_rounds.cc:107] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:14:26.236634  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:26.235885 10216 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.237639  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:26.236871  7335 raft_consensus.cc:2889] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:26.221050 10384 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:26.216037 10398 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.244436  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1664) took 1267 ms. Trace:
I20260709 13:14:26.241185  7331 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:14:26.243453  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 44552.6us
I20260709 13:14:26.241339  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.224635 10489 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:26.244112  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.215621 10379 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:26.244825  7187 rpcz_store.cc:276] 0709 13:14:24.972947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.024288 (+1051341us) service_pool.cc:224] Handling call
0709 13:14:26.223458 (+199170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:26.226905 (+  3447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:26.226930 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:26.233649 (+  6719us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:26.233690 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.233745 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:26.240143 (+  6398us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400117e50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:26.240221 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454308736}
I20260709 13:14:26.250263  7333 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:26.251080  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:26.254091  7255 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:26.212870 10493 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:26.253903  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1665) took 1280 ms. Trace:
I20260709 13:14:26.259704  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:26.260030  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:26.261907  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:26.239167 10486 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:26.266036  7329 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:26.265961  7259 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:26.270062  7327 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:26.244379 10384 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:26.245105 10243 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:26.259678  7182 rpcz_store.cc:276] 0709 13:14:24.973229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.248110 (+274881us) service_pool.cc:224] Handling call
0709 13:14:26.244325 (+996215us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400256554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:26.253839 (+  9514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225117184}
I20260709 13:14:26.274389  7262 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:26.277001  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:26.277464 10499 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:26.277994  7262 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:14:26.281653  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 522) took 1343 ms. Trace:
I20260709 13:14:26.294787  7333 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:26.295367  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:26.296717  7258 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:26.295560  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.297268  7150 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:26.284127  7328 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:26.300909 10483 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:26.301237  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.301725 10440 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:26.301950  7260 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:26.302182 10440 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:26.302587 10440 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:26.271173 10435 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:26.339998  7262 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:26.283500 10384 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:26.340230  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:26.340541  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 78730us
I20260709 13:14:26.341323  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.351202  7258 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:26.364369  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:26.273288 10495 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:14:26.262928 10477 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.374562  7262 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:26.307607 10443 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:26.307140 10243 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:26.364362  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:26.254302 10216 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.282008  7254 rpcz_store.cc:276] 0709 13:14:24.938415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.939327 (+   912us) service_pool.cc:224] Handling call
0709 13:14:24.939600 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:25.246608 (+307008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:25.246652 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:25.260830 (+ 14178us) log.cc:844] Serialized 26 byte log entry
0709 13:14:26.005757 (+744927us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b18000968e0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:14:26.277078 (+271321us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:26.277116 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.281266 (+  4150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:26.281304 (+    38us) raft_consensus.cc:1685] finished
0709 13:14:26.281319 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:26.281503 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":310177,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9413,"spinlock_wait_cycles":10664704,"thread_start_us":270922,"threads_started":1,"wal-append.queue_time_us":1016196}
W20260709 13:14:26.377590  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 112600us
I20260709 13:14:26.275695 10285 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:14:26.266377 10489 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:26.421998  7330 raft_consensus.cc:2368] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7.
I20260709 13:14:26.350307 10435 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:26.275118 10398 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.429142  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:26.366945 10502 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.430557  7891 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
W20260709 13:14:26.437830  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:26.380513 10443 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:26.442728 10552 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:26.443652  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 112339us
I20260709 13:14:26.444018  7259 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:26.384148 10518 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:26.363734 10486 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:26.520236  7258 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
W20260709 13:14:26.530364  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 107845us
W20260709 13:14:27.004714 10219 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.885s	user 0.008s	sys 0.002s
I20260709 13:14:27.098166  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:26.520789  9963 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:26.958000 10489 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.099416  9963 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:27.099870  9963 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:26.448342 10243 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.447793 10330 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.103296  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:26.445726  7187 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:27.107932 10523 raft_consensus.cc:2764] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:14:26.825546 10570 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:14:27.109249  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:26.766155 10556 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.242s	user 0.001s	sys 0.002s
W20260709 13:14:26.528633 10227 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.116s	user 0.001s	sys 0.013s
I20260709 13:14:27.158316 10523 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:27.158823 10523 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:27.159277 10523 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:26.773733 10435 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:27.157836  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 48722.6us
I20260709 13:14:26.706389 10379 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.114172  9963 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.163789  9963 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.164039 10337 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:27.164395  9963 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:27.164655 10337 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.165024  9963 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.166129 10227 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.168605 10227 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.169642  7256 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:14:26.771535  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:27.173759 10330 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:27.174433 10330 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.176352  9963 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:26.671759 10567 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
I20260709 13:14:27.179668 10523 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:26.733072  7255 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:27.182001 10523 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:27.183616 10420 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.965s	user 0.010s	sys 0.000s
I20260709 13:14:27.184270 10487 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.184880 10487 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.185585  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 573) took 1529 ms. Trace:
I20260709 13:14:27.186065  7185 rpcz_store.cc:276] 0709 13:14:25.656001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.076932 (+420931us) service_pool.cc:224] Handling call
0709 13:14:26.077291 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:26.099779 (+ 22488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:26.099813 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:26.100387 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:14:26.339467 (+239080us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:26.339529 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.339624 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:27.185332 (+845708us) raft_consensus.cc:1685] finished
0709 13:14:27.185351 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:27.185491 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23076,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":238586,"threads_started":1,"wal-append.queue_time_us":239759}
I20260709 13:14:27.191268 10500 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:27.191412 10489 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:27.192112 10500 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.192988 10548 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.501010  7336 raft_consensus.cc:606] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:27.196630  7336 raft_consensus.cc:614] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:26.448993 10493 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:26.533354 10502 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.145988 10518 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:27.202883  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 572) took 1558 ms. Trace:
I20260709 13:14:26.446976 10397 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:27.207948 10397 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.210465 10518 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:26.774691 10568 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:14:26.817458  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1560) took 2246 ms. Trace:
W20260709 13:14:26.670745  7893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.015s	sys 0.034s
I20260709 13:14:27.161823  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:27.171967 10337 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.176496 10330 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:26.734009  7262 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:26.940116 10433 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:27.179530  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:27.231099  7254 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:27.218953  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.231572  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:27.232939  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.233639  7262 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:27.233698  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:26.755795 10477 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.235500  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:26.772092  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 147663us
I20260709 13:14:27.235452  7185 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:27.237100  7262 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:27.238452  7262 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:14:27.238811  7893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.426s	user 0.015s	sys 0.042s
I20260709 13:14:27.239745  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 594) took 2635 ms. Trace:
W20260709 13:14:27.205088  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 71393us
I20260709 13:14:26.451622 10480 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:27.234056 10433 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.237933  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.243722  7335 rpcz_store.cc:276] 0709 13:14:24.570801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.572639 (+  1838us) service_pool.cc:224] Handling call
0709 13:14:24.572962 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:26.269056 (+1696094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.817081 (+548025us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b540031bfd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:26.817384 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3783361920}
I20260709 13:14:27.245223 10433 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.240129  7262 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:26.502360  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:27.212157 10443 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:27.246752  7185 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:27.229035  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.254304  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:27.259378  7185 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:27.263317 10548 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.201131 10552 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.273137  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:27.274410 10433 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:27.277125 10433 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:27.278174 10433 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:27.192376 10489 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.243670  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:27.273262  7187 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:26.641688 10478 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:27.288450 10433 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:26.444983  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.340394  7182 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 4.
W20260709 13:14:26.816593  7330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 421) took 1530 ms (client timeout 1533 ms). Trace:
W20260709 13:14:27.288537 10384 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.000s
I20260709 13:14:27.269148  7183 rpcz_store.cc:276] 0709 13:14:25.644328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.028881 (+384553us) service_pool.cc:224] Handling call
0709 13:14:26.029673 (+   792us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:26.030003 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:26.030027 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:26.030550 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:14:26.369539 (+338989us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:26.369580 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:26.369647 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:26.500745 (+131098us) raft_consensus.cc:1685] finished
0709 13:14:26.500764 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:27.202785 (+702021us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":338619,"threads_started":1,"wal-append.queue_time_us":420183}
W20260709 13:14:27.345145  7257 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.028s	sys 0.157s
W20260709 13:14:27.342428  7330 rpcz_store.cc:269] 0709 13:14:25.286275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.302453 (+ 16178us) service_pool.cc:224] Handling call
0709 13:14:26.775662 (+1473209us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b540031a6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:26.816448 (+ 40786us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882363776}
I20260709 13:14:26.624552 10431 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:27.370857 10431 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.370965  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.371567 10431 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:27.373814  7187 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:14:27.375129  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 132389us
I20260709 13:14:27.374285  7185 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:27.375975  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:27.376535 10486 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.377375 10486 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:27.377854 10486 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:26.670118 10532 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:27.383424  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:27.374902  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 213134us
W20260709 13:14:27.354775  7257 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.029s	sys 0.157s
I20260709 13:14:27.368635 10433 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:27.409196  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52692.4us
I20260709 13:14:27.409948  7861 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:27.408391  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:27.378324 10486 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:27.289772 10285 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:27.378511  7302 connection.cc:256] RPC call timeout handler was delayed by -1.1095134539998526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
I20260709 13:14:27.416935  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.417665  7258 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:27.422708  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:27.422847  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:27.283327 10489 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:27.423585  7259 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:27.423695  7262 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:27.424358  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1449) took 1216 ms. Trace:
I20260709 13:14:27.425318  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:27.426045  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:27.426281  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:26.528324 10216 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.306149 10548 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:27.431813  7257 rpcz_store.cc:276] 0709 13:14:26.208427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.208553 (+   126us) service_pool.cc:224] Handling call
0709 13:14:26.223369 (+ 14816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:26.249784 (+ 26415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:26.249818 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:26.260292 (+ 10474us) log.cc:844] Serialized 26 byte log entry
0709 13:14:26.382491 (+122199us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:27.408926 (+1026435us) log.cc:844] Serialized 14 byte log entry
0709 13:14:27.423931 (+ 15005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.424053 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:27.424110 (+    57us) raft_consensus.cc:1685] finished
0709 13:14:27.424142 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:27.424303 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14602,"prepare.queue_time_us":1004625,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":24809,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":17475,"thread_start_us":1108001,"threads_started":2,"wal-append.queue_time_us":268346}
I20260709 13:14:27.357497 10523 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.412983 10495 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:27.293704  7893 rpcz_store.cc:276] 0709 13:14:24.604449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:24.605660 (+  1211us) service_pool.cc:224] Handling call
0709 13:14:25.478207 (+872547us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:14:25.478432 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:25.478670 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:25.747405 (+268735us) log.cc:844] Serialized 14 byte log entry
0709 13:14:27.239291 (+1491886us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:27.239385 (+    94us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:27.239472 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.239538 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:27.239677 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":204863,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":78,"raft.queue_time_us":950,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":6236416,"thread_start_us":1458094,"threads_started":2,"wal-append.queue_time_us":631570}
W20260709 13:14:27.474030  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 376858us
W20260709 13:14:27.438730 10286 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.233s	user 0.013s	sys 0.000s
I20260709 13:14:27.413378 10477 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:27.481530  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:27.481663  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:27.454901 10440 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.152s	user 0.011s	sys 0.001s
I20260709 13:14:27.482561  7182 raft_consensus.cc:2410] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:14:26.670280  7084 catalog_manager.cc:5697] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 8, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 8 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:27.489537  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.408031 10384 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.467628 10433 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:27.388573 10518 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.468297 10480 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:27.507650 10480 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:27.508773 10480 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.491108 10219 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:27.491993 10568 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:14:27.430845 10285 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.507702 10286 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:27.472280 10489 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:27.482897 10398 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.515089  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:27.501035 10433 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.510241 10219 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.494143 10500 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.495780 10548 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.494660 10440 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:27.541633  7253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.002s	sys 0.010s
I20260709 13:14:27.541652 10227 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:14:27.542303  7253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.002s	sys 0.010s
I20260709 13:14:27.542670 10227 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:27.543502 10440 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.543991 10227 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.547051  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:27.547989  7180 raft_consensus.cc:2368] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7.
I20260709 13:14:27.548408  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1682) took 1103 ms. Trace:
I20260709 13:14:27.548738  7180 rpcz_store.cc:276] 0709 13:14:26.445267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.447139 (+  1872us) service_pool.cc:224] Handling call
0709 13:14:27.546882 (+1099743us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:14:27.548347 (+  1465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18275200}
I20260709 13:14:27.551504 10219 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:27.551640  7255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 2468) took 1904 ms (client timeout 2001 ms). Trace:
W20260709 13:14:27.552515  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 84216.3us
I20260709 13:14:27.533635  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.519529  7259 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:27.437745 10532 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.539319 10433 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:27.555567  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:27.552161  7255 rpcz_store.cc:269] 0709 13:14:25.647661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.647875 (+   214us) service_pool.cc:224] Handling call
0709 13:14:27.551421 (+1903546us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54002166d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:27.551550 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366012416}
I20260709 13:14:27.558501  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:27.497853 10477 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.560657  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.496312 10523 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.566175  7254 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:27.539680 10489 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:27.591238  7262 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:27.559340 10440 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:27.557152 10532 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.608268  7259 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:27.567554 10219 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:27.614413  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:27.622136  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 107194us
W20260709 13:14:27.620185  7261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.000s	sys 0.037s
I20260709 13:14:27.564515 10578 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:27.623782  7261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.000s	sys 0.038s
W20260709 13:14:27.625414  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 68566.5us
I20260709 13:14:27.625560  7259 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 4.
I20260709 13:14:27.561801 10548 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.631042  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:27.634265  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 1.13422e+06us
W20260709 13:14:27.637640  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 268288us
W20260709 13:14:27.638779  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 228891us
I20260709 13:14:27.619901 10397 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:27.632894  7299 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.012s	sys 0.030s
I20260709 13:14:27.636580  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.639879  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:27.624220 10219 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:27.633940  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:27.641068  7299 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.012s	sys 0.031s
W20260709 13:14:27.643801  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 1.27247e+06us
I20260709 13:14:27.639417  7257 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:27.645750  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.614727 10440 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.643940  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1447) took 1558 ms. Trace:
I20260709 13:14:27.652774  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1685) took 1206 ms. Trace:
I20260709 13:14:27.656297  7184 rpcz_store.cc:276] 0709 13:14:26.446308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.499845 (+ 53537us) service_pool.cc:224] Handling call
0709 13:14:27.631856 (+1132011us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:14:27.652701 (+ 20845us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18061568}
I20260709 13:14:27.664414  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:27.665640  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:27.661005 10220 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:27.641485 10532 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:14:27.667941  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.687744  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:27.688292  7327 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:14:27.668282  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.688879  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.689513  7178 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:27.690095  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1687) took 1190 ms. Trace:
I20260709 13:14:27.690423  7178 rpcz_store.cc:276] 0709 13:14:26.499824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.501442 (+  1618us) service_pool.cc:224] Handling call
0709 13:14:27.632246 (+1130804us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:14:27.690031 (+ 57785us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18656128}
I20260709 13:14:27.688491  7331 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:27.673014  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:27.692489 10578 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:27.693066 10578 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:27.694023 10578 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:27.697773  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:27.698900 10398 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:27.699150  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:27.699852  7333 raft_consensus.cc:2368] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10.
I20260709 13:14:27.699736  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:27.700341 10398 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:27.700788 10398 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:27.701011 10216 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:27.701181 10398 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:27.701426 10216 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:27.701838 10216 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:27.707201  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:27.709302 10398 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.674661 10330 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:27.715704 10330 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:27.716912 10398 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.674827 10489 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.655311  9963 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:27.719331  9963 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:27.719893  9963 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:27.675392 10219 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.642481 10420 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:14:27.675434 10577 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.723301 10577 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.725755 10577 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.680662 10518 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.711083  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:27.713749 10216 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.671826  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:27.732038  7335 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:27.716549 10330 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.727126  7333 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:27.712311  7331 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:27.679471  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:27.687466  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:27.689532  7257 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:27.735424  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:27.754742  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:27.737751  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:27.729365  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.735435  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:27.782608  7259 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:27.786559  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:27.791321  7329 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:27.671463 10477 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.793889  7185 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:27.682013 10285 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:27.796115  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:27.797295  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.791239 10337 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:27.799600  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.683135 10523 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.802111  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.733258 10384 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.804406  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.805564  7259 raft_consensus.cc:2393] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:27.811779  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:27.812623  7259 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:27.813521  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.795856 10495 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.797092 10397 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.819768  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.674183 10433 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.829273 10532 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:27.831542 10216 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.832718  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 532) took 1568 ms. Trace:
I20260709 13:14:27.833134  7260 rpcz_store.cc:276] 0709 13:14:26.264072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.302690 (+ 38618us) service_pool.cc:224] Handling call
0709 13:14:26.303014 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:27.346796 (+1043782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:27.346842 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:27.346903 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:27.346947 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.832454 (+485507us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003499d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:27.832510 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:27.832654 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340693888}
I20260709 13:14:27.647917  7261 rpcz_store.cc:276] 0709 13:14:26.085285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.085508 (+   223us) service_pool.cc:224] Handling call
0709 13:14:26.085897 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:26.086223 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:14:26.431289 (+345066us) log.cc:844] Serialized 14 byte log entry
0709 13:14:27.637191 (+1205902us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:27.637245 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:27.641701 (+  4456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.641788 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:27.643875 (+  2087us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9498,"prepare.queue_time_us":1009791,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":13046,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4881,"thread_start_us":1314250,"threads_started":2}
I20260709 13:14:27.837836 10477 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:27.838480 10477 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.839515  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1445) took 1755 ms. Trace:
I20260709 13:14:27.840969 10477 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.840029  7253 rpcz_store.cc:276] 0709 13:14:26.084391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.084642 (+   251us) service_pool.cc:224] Handling call
0709 13:14:26.085039 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:26.089518 (+  4479us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:26.377397 (+287879us) log.cc:844] Serialized 14 byte log entry
0709 13:14:27.542827 (+1165430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:27.542885 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:27.542934 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.839291 (+296357us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b54002e7554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:27.839336 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:27.839462 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1297320,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":574,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":9697920,"thread_start_us":1201844,"threads_started":2,"wal-append.queue_time_us":1045826}
I20260709 13:14:27.841928 10431 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.803504 10337 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:27.843847  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:27.849050 10337 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:27.850054 10443 consensus_meta.cc:287] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.003s
I20260709 13:14:27.850208  7258 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:27.783586 10371 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:14:27.794644 10486 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.845610 10243 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:27.868383  7184 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:27.859045  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1446) took 1774 ms. Trace:
I20260709 13:14:27.875474 10243 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.870266  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:27.824645 10285 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:27.876937 10486 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.877133 10285 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.867326  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:27.878060 10371 consensus_queue.cc:1243] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:27.868525  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:27.878558  7185 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:27.878883  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.864945  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.866189 10330 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:27.879654  7186 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:27.879752  7183 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:14:27.880143  7186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1683) took 1434 ms (client timeout 1896 ms). Trace:
W20260709 13:14:27.874107  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46332.7us
W20260709 13:14:27.880517  7186 rpcz_store.cc:269] 0709 13:14:26.445618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.447422 (+  1804us) service_pool.cc:224] Handling call
0709 13:14:27.864722 (+1417300us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:14:27.880088 (+ 15366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19080448}
I20260709 13:14:27.875980  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.857666 10440 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.882294  7184 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:27.882242 10493 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:27.881217  7187 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:27.875495  7256 rpcz_store.cc:276] 0709 13:14:26.084811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.085001 (+   190us) service_pool.cc:224] Handling call
0709 13:14:26.085479 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:27.170108 (+1084629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.858769 (+688661us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400226ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:27.858975 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492345088}
I20260709 13:14:27.883543 10477 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:27.855209 10495 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.864090 10548 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:27.872301  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:27.857872  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:27.873524  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.882957 10493 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.897027 10493 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:27.885447  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56988.4us
I20260709 13:14:27.884548 10577 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:27.899505 10577 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:27.900763 10487 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.900530 10577 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.901605 10577 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:27.891109 10398 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:27.909569  7185 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:27.893278  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56808 (request call id 36) took 2618 ms. Trace:
I20260709 13:14:27.883262  7187 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:27.858255 10552 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:27.851562 10397 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.818432 10523 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:27.909885  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:27.910944  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:27.911363  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:27.942142  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 155668us
I20260709 13:14:27.912616  7179 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:27.911022  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:27.913335  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:27.913513  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.850536 10443 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:27.944329  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:27.944985  7258 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:27.914222 10502 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:27.941960  7892 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:27.950868  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:27.951965  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:27.878509  9963 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.923214  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:27.925290  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.892594 10433 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:27.851365 10431 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.963814 10578 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:27.964021  7894 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:27.964452 10578 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:27.965408 10578 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.966094  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:27.898698 10220 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:27.966828 10285 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.967346 10285 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.967504 10286 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.967865 10285 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.968321  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:27.930449  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:27.929615  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:27.968904 10493 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:27.969498 10493 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:27.969586  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.969871  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:27.970220  7255 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:27.970511 10493 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.971052  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:27.971503 10495 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.971650  7255 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:27.971792 10243 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.941176 10476 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:14:27.973945  7181 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:27.948559  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.949342  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1686) took 1502 ms. Trace:
I20260709 13:14:27.955410  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.975317  7183 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:27.975086  7179 rpcz_store.cc:276] 0709 13:14:26.454550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.518787 (+ 64237us) service_pool.cc:224] Handling call
0709 13:14:27.912212 (+1393425us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:14:27.912410 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:27.949098 (+ 36688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.949272 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18658688}
I20260709 13:14:27.956569  7253 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:27.955003  7260 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:27.954584  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:27.956943  7254 raft_consensus.cc:2376] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9. Re-sending same reply.
I20260709 13:14:27.976689  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.977414  7179 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:27.957079  7262 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:27.946839 10523 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:27.960062  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:27.960964  7187 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.980228  7185 raft_consensus.cc:2376] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8. Re-sending same reply.
I20260709 13:14:27.980443  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.981196  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.961377 10443 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.963267  9963 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:27.968070 10286 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:27.921419  7336 rpcz_store.cc:276] 0709 13:14:25.275399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.275591 (+   192us) service_pool.cc:224] Handling call
0709 13:14:27.893018 (+2617427us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b540031a6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9236853 00007fecee20460a 00007fece778a7d4 00007fece778a762 00007fece778a691 00007fece778a60c 00007fece77898c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:27.893175 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244961664}
I20260709 13:14:27.964138  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.979036 10330 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:27.983804  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.979476  7186 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:27.985711  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:27.991642  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.992496  7178 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:27.986654  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.985785  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:27.967936 10397 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:27.995240  7185 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:27.979895 10523 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:27.996502  7180 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:27.998922  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:28.001837  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 340891us
I20260709 13:14:28.003533  7178 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:28.005075  7178 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:27.991385 10500 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:28.020696  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:28.005806  7179 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:28.022017  7179 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:28.007654  7187 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:28.023211  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:28.004451 10486 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:28.024200  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:28.034384  7255 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:28.025688  7181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1684) took 1579 ms (client timeout 1645 ms). Trace:
W20260709 13:14:28.036461  7181 rpcz_store.cc:269] 0709 13:14:26.445952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.446085 (+   133us) service_pool.cc:224] Handling call
0709 13:14:28.025532 (+1579447us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b540039cbd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:28.025634 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996357888}
I20260709 13:14:28.010255 10431 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:28.029610 10585 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.029320  7179 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:28.030421  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:28.045959  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 147964us
I20260709 13:14:27.967348 10220 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:28.004091  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 326917us
I20260709 13:14:28.045523  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:28.049257  7183 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:28.057258  7179 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.024035 10500 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:28.070961  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 86530.7us
I20260709 13:14:28.059284  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:28.010967 10502 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:14:28.061079  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:28.009460 10243 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:14:28.079191  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:28.076121  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:28.040654 10486 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:28.082614  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.085825  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:28.079814  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:28.080524  7186 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:28.077610  7178 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:28.081856  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 73544.8us
I20260709 13:14:28.095849  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:28.098199  7181 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:28.096069  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:28.078353 10500 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.075133 10435 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:28.092492  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.106340  7178 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:28.107141  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.107285  7890 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:28.107975  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 84849.3us
I20260709 13:14:28.112375  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:28.113531  7895 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:28.106181  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:28.117688  7225 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:28.117977  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:28.118724 10285 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:28.119172  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:28.115023 10552 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:28.121752 10552 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:28.122153 10552 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:28.122294  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:28.111924 10480 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:14:28.137092  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44672.5us
I20260709 13:14:28.096129  9963 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:28.091862 10495 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:28.139708  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.092329 10486 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.104938 10337 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:28.148882  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:28.152647  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 57639.1us
I20260709 13:14:28.153609  7228 leader_election.cc:400] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7.
I20260709 13:14:28.154960  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:28.115041 10219 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:28.104329 10227 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:14:28.166826  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:28.167081  7255 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:28.116031 10435 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:28.121073 10589 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:28.072422 10530 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:14:28.091455 10595 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:28.176908  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:28.123090 10548 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:14:28.143271 10495 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.167758  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:28.179075  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 70830us
I20260709 13:14:28.142412  9963 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:28.179142  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:28.091271 10585 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:28.144166 10243 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:28.143983 10337 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:28.180634  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:28.189092 10587 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:14:28.190820  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:28.191586  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.191982 10430 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:28.192562 10430 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:28.193552 10430 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:28.194954 10602 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:28.195716  7862 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.196602 10589 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:28.197074 10589 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:28.197490 10589 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:28.198060  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:28.198241 10595 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:28.199208 10443 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:28.201692  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:28.203096 10586 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:14:28.203608 10330 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:28.204052 10330 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:28.204185  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:28.204499 10330 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.204807  7335 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:28.178169 10435 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:28.213258 10548 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:28.213672 10548 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:28.207659  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:28.214983  7329 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:28.215235  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:28.215494  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 47830.5us
I20260709 13:14:28.157156 10216 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:28.185122 10495 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.207237  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:28.196028  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:28.202028  7083 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47556 (request call id 254) took 15817 ms (client timeout 15000 ms). Trace:
I20260709 13:14:28.168727 10219 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:28.092352 10591 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:14:28.212653  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:28.168310 10489 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:28.216367  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.225811  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:28.184906 10532 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:28.221879  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:28.221266  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.225729  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:28.229810  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:28.231685  7890 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 8: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:14:28.182183  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 64556.1us
I20260709 13:14:28.226981  7181 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:28.229142  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:28.217501  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:28.229782  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:28.233330  7335 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:28.187152  9963 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:28.221697  7084 catalog_manager.cc:5697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 7, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 7 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:28.184088 10592 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:28.207450 10337 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:14:28.292670  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 76383us
I20260709 13:14:28.293795  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.286844  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:28.234359  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 79472.1us
I20260709 13:14:28.181267 10502 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:14:28.291615  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:28.298261  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65462.4us
I20260709 13:14:28.299481  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:28.296108  7888 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:28.223804 10286 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:28.225841 10493 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:28.303093  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:28.314195  7890 raft_consensus.cc:2368] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
I20260709 13:14:28.230821 10440 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:28.312109  7084 catalog_manager.cc:5697] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 7, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 7 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.214454 10548 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:28.292160 10601 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:28.303879 10591 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:28.227411 10216 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:28.331241  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:28.328239  7084 catalog_manager.cc:5697] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:14:28.400218  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.400280  7890 raft_consensus.cc:2410] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:14:28.327759 10599 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:14:28.407164 10599 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:28.407511 10599 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:28.408342 10599 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:28.409209  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:28.409508 10599 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:28.409785  7182 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:28.335960 10601 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:28.323390 10583 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:14:28.338405 10593 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:14:28.413681 10179 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:28.414052 10179 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:28.414834  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:28.414932 10179 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:28.415511  7258 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:28.339148  7333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:28.304164 10489 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:14:28.347114 10285 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:28.352026 10478 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.355177 10398 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:28.362993 10532 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:28.363765 10219 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:28.370493 10585 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:28.441519  7182 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:28.373250 10523 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:28.375140 10548 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.377384 10286 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:28.318972 10493 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.397512  7187 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:14:28.503554  7187 pending_rounds.cc:85] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 4
I20260709 13:14:28.503953  7187 pending_rounds.cc:107] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:14:28.504274  7187 raft_consensus.cc:2889] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:28.402657 10595 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:28.402550  7084 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 4 to 5, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 5 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:28.403993 10216 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:28.404532  7186 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:28.350250 10486 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:28.425348  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 125952us
I20260709 13:14:28.438822 10398 consensus_queue.cc:1243] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:28.326874 10440 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:14:28.436381  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.496821  7179 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:14:28.529729  7179 pending_rounds.cc:85] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 4
I20260709 13:14:28.530205  7179 pending_rounds.cc:107] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:14:28.530516  7179 raft_consensus.cc:2889] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:28.393762 10591 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:28.431133 10285 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.320107 10598 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:28.525256  7258 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
W20260709 13:14:28.507562 10371 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:14:28.509537 10493 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:28.554612  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 228547us
I20260709 13:14:28.434942 10478 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:28.468887 10500 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:28.540822 10219 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:28.563278  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 234234us
I20260709 13:14:28.548388 10440 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.555737 10285 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.577917  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:28.578657  7335 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:28.578850  7334 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:28.566640  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 279477us
I20260709 13:14:28.551587  7084 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 7, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 7 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:28.567615  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:28.220490  7083 rpcz_store.cc:269] 0709 13:14:12.403194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.413041 (+  9847us) service_pool.cc:224] Handling call
0709 13:14:28.201814 (+15788773us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:21.927905 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:22.170156 (+242251us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:22.175627 (+  5471us) write_op.cc:435] Acquired schema lock
0709 13:14:22.219822 (+ 44195us) tablet.cc:662] Decoding operations
0709 13:14:22.476501 (+256679us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:22.476560 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:22.476584 (+    24us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:14:22.647733 (+171149us) tablet.cc:701] Row locks acquired
0709 13:14:22.659294 (+ 11561us) write_op.cc:260] PREPARE: finished
0709 13:14:22.674810 (+ 15516us) write_op.cc:270] Start()
0709 13:14:22.676638 (+  1828us) write_op.cc:276] Timestamp: P: 1783602862674100 usec, L: 0
0709 13:14:22.691394 (+ 14756us) op_driver.cc:348] REPLICATION: starting
0709 13:14:22.725292 (+ 33898us) log.cc:844] Serialized 11414 byte log entry
0709 13:14:24.132415 (+1407123us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:24.723219 (+590804us) op_driver.cc:464] REPLICATION: finished
0709 13:14:25.140041 (+416822us) write_op.cc:301] APPLY: starting
0709 13:14:25.241459 (+101418us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:25.310606 (+ 69147us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:25.310650 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:25.507315 (+196665us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:25.507568 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=29
0709 13:14:25.507599 (+    31us) write_op.cc:312] APPLY: finished
0709 13:14:25.507916 (+   317us) log.cc:844] Serialized 194 byte log entry
0709 13:14:25.508093 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:25.509232 (+  1139us) write_op.cc:454] Released schema lock
0709 13:14:25.509336 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:25.510359 (+  1023us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:25.510381 (+    22us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2329554,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":291462,"apply.run_cpu_time_us":6721,"apply.run_wall_time_us":459045,"num_ops":29,"prepare.queue_time_us":163279,"prepare.run_cpu_time_us":143092,"prepare.run_wall_time_us":1148599,"raft.queue_time_us":182059,"raft.run_cpu_time_us":78517,"raft.run_wall_time_us":279839,"replication_time_us":2005317,"spinlock_wait_cycles":3315456,"thread_start_us":528263,"threads_started":4,"wal-append.queue_time_us":950961,"wal-append.run_cpu_time_us":18107,"wal-append.run_wall_time_us":3023682}]]}
I20260709 13:14:28.565997  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.579578  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.580246  7336 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:28.561168 10610 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:14:28.566524  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 338302us
I20260709 13:14:28.509352 10286 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:28.572515  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 351301us
I20260709 13:14:28.586004  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.588263  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:28.591787  7257 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:28.592923  7150 leader_election.cc:400] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
I20260709 13:14:28.593537  7150 leader_election.cc:403] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:14:28.586576  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:28.595732  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:28.595716  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 166943us
I20260709 13:14:28.564251 10602 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:28.597597  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:28.551345 10431 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:14:28.601583  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:28.605983  7258 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
W20260709 13:14:28.588784 10577 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.006s
I20260709 13:14:28.602686  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:28.607101  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:28.601930  7084 catalog_manager.cc:5697] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:28.630654  7255 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:28.633736  7334 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:28.584000 10610 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:28.636657  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.638403  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:28.641431  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:28.607115 10591 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:28.639465 10216 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
I20260709 13:14:28.648458  7084 catalog_manager.cc:5697] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 8, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 8 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:28.655061  7084 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 8, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 8 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:28.658241  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:28.659096  7332 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:28.608107 10618 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:14:28.660866  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 154658us
I20260709 13:14:28.670668  7084 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 5 to 8, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 8 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:14:28.650120 10606 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:14:28.685706  7334 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:14:28.687255  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 125494us
I20260709 13:14:28.694039  7225 leader_election.cc:400] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10.
I20260709 13:14:28.694478  7225 leader_election.cc:403] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:14:28.696158  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 110698us
I20260709 13:14:28.688222  7084 catalog_manager.cc:5697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 10, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 10 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:28.700871  7862 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:28.679581 10552 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.001s
W20260709 13:14:28.702337  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 116389us
I20260709 13:14:28.708660  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:28.708927  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.670243 10618 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:28.631003 10598 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:14:28.695587  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:28.719476  7084 catalog_manager.cc:5697] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 3 to 4, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 4 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:14:28.706615  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 88307.6us
I20260709 13:14:28.722823  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:28.728143  7861 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:28.724844  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:28.730847  7334 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
W20260709 13:14:28.728616  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 133746us
I20260709 13:14:28.658717 10532 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:14:28.735011  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:28.737135  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:28.739028  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 159514us
W20260709 13:14:28.739197  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.740448  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:28.743727  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.706753 10608 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10.
I20260709 13:14:28.684861 10330 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:28.749264 10502 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:28.751729  7084 catalog_manager.cc:5697] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 7, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 7 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.724205 10618 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:28.760687  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.727466 10431 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:14:28.707823 10435 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:28.722796 10552 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:28.775635  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 74858.7us
I20260709 13:14:28.778681  7257 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:28.731917 10495 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:28.705787 10602 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:28.781611  7084 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 4 to 6, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:14:28.789268  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 80448.4us
I20260709 13:14:28.787850  7084 catalog_manager.cc:5697] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:28.771202 10502 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.767403 10523 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:28.812590 10616 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:28.812968 10435 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:28.813211 10616 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.813664 10616 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:28.814760 10614 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:28.815264 10614 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:28.815657 10614 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:28.815980 10502 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.816372 10330 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:28.819213 10621 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:28.819705 10621 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:28.820039 10621 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:28.814958  7084 catalog_manager.cc:5697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 2 to 7, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 7 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:28.773284 10500 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:28.823879  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:28.821177 10612 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:14:28.773733 10629 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:28.776494 10478 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:28.783120 10608 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:14:28.858788  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46805us
I20260709 13:14:28.865389  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:28.859597  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:28.859876  7329 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:28.789568 10486 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:28.826491  7084 catalog_manager.cc:5697] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 1 to 6, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 6 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:28.814522 10435 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:14:28.859078 10589 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.661s	user 0.015s	sys 0.001s
W20260709 13:14:28.870476  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 125021us
W20260709 13:14:28.867475  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 280929us
W20260709 13:14:28.869676  9963 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260709 13:14:28.864588 10476 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:28.740890 10610 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:28.885002  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.861892 10629 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.865552 10286 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:28.887784  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.872352 10478 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:28.866221 10628 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:28.864405 10608 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:28.906369 10608 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:28.906514 10619 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:14:28.879011 10589 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:28.910837  7256 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:28.910452  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:28.912536  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:28.913612  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:28.826742 10625 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:14:28.915187 10552 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:28.884250 10500 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:28.890316  9963 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:28.917882  7259 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:28.918016  9963 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:28.885044 10435 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:28.898413  7328 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:28.891644 10629 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:28.899142 10623 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:28.901242 10493 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:28.903064 10628 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:28.902244  7084 catalog_manager.cc:5697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 4 to 7, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 7 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:28.895555 10476 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:28.920219  7302 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.895653 10592 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:28.919476 10495 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:28.963732  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:28.964378  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:28.964818  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:28.957029 10599 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.547s	user 0.005s	sys 0.006s
I20260709 13:14:28.966568  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:28.966966  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46823.1us
I20260709 13:14:28.967561  7178 raft_consensus.cc:2368] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10.
I20260709 13:14:28.952407 10628 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:28.969419  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:28.975495  7178 raft_consensus.cc:2410] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:14:28.968827  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 238294us
I20260709 13:14:28.971537  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:28.954593 10592 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:28.978528  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 234956us
I20260709 13:14:28.973853  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:28.980294  7179 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:28.984483  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:28.985507  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:28.980095  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:28.986125  7179 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:28.977505  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:28.978436  7084 catalog_manager.cc:5697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 9, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 9 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.987316  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:28.987805  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:28.988382  7187 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:28.990775  7333 raft_consensus.cc:606] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:28.991551  7330 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:28.997025  7183 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:28.995434  7084 catalog_manager.cc:5697] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 3 to 6, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 6 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:28.997772  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:28.991976  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:28.998778  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:29.009436  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:28.973572 10638 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.009928  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:29.008810  7084 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 5 to 9, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 9 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:28.982800 10592 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:28.978681 10623 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:28.991953 10523 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:29.013789  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:29.075699  7181 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.068543  7254 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:28.981025 10628 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:29.020550  7179 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:29.024699  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:28.999853 10635 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:29.028563  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:29.030864 10489 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:29.030433 10379 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:29.093751  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:29.037779  7069 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 242a63190870450082200759c7f513ab with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c85cf49c63cc4e66b4747d8c4fa14022 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:29.038316 10591 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:29.190230  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:29.191203  7187 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:29.150492 10476 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:29.040635 10614 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.041707 10493 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:29.046033  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:28.999593 10286 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:14:29.047585  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:29.047747 10243 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.000s
W20260709 13:14:29.048208 10633 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:14:29.023387 10435 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.050998  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:29.017005 10589 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:29.053092 10616 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.054778 10502 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.057523  7328 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:29.058324  7084 catalog_manager.cc:5697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 8, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 8 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:29.059831 10337 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.746s	user 0.003s	sys 0.008s
I20260709 13:14:29.062794 10430 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:29.065214 10285 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.066078  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:29.068531  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.066507 10440 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.072852  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:14:29.079727  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 46357.2us
I20260709 13:14:29.079957  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:29.080876 10623 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.081770 10620 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:29.084553  7181 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
W20260709 13:14:29.087502  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 77636.7us
I20260709 13:14:29.087984  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:28.996824 10500 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:14:29.046396 10608 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.223922  7084 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 7, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 7 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.149225 10489 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:29.156665  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:14:29.234169  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 77639.5us
W20260709 13:14:29.089664  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 80210.9us
W20260709 13:14:29.148254  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:29.149135  7069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 111589us
I20260709 13:14:29.237133  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:29.039533 10643 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:14:29.158787 10635 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:29.200503  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:29.238615 10598 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.235196  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:29.239339 10598 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.238776 10635 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.093801 10618 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.240965 10634 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:29.241597 10634 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:29.242074 10634 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.244174 10493 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:29.244763 10493 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:29.245211 10493 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:29.250383 10500 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.251394 10500 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:29.252301 10285 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:29.257866  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:29.194293 10476 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:29.211155  7180 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.216950  7228 leader_election.cc:400] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10.
W20260709 13:14:29.281834  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 70091us
I20260709 13:14:29.282878  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:29.226039  7327 raft_consensus.cc:2368] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9.
I20260709 13:14:29.203694 10523 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.219336  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:29.226732  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:29.227246  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:29.284291  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65685.6us
I20260709 13:14:29.227252 10489 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:29.228852  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:29.285744  7183 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:29.230695  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:29.239651  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:29.287094  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47515.6us
W20260709 13:14:29.205444  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.288419  7256 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:14:29.288777  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.289510  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:29.235989  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:29.290810  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:29.290890  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:29.291230  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 55358.4us
I20260709 13:14:29.292068  7255 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:29.292497  7254 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:29.232404  7084 catalog_manager.cc:5697] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:29.293740  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.207252 10243 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:29.209802  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:29.261030  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.292430  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:29.298489  7187 raft_consensus.cc:2393] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 7: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:14:29.263914  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48331.5us
I20260709 13:14:29.301059  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:29.301707  7262 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.305948  7084 catalog_manager.cc:5697] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:29.313436  7150 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:29.320729  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:29.322427  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:29.323305  7259 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:29.326747  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 43982.4us
I20260709 13:14:29.327309  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:29.328457  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:29.327888  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:29.330802  7253 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:29.333421  7186 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:29.334355  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:29.334548  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:29.334477  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.336102  7181 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:29.335457  7084 catalog_manager.cc:5697] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 4 to 6, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 6 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:29.336248  7261 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:29.337320  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:29.295600 10476 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:29.337227  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:29.295360 10489 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.306284 10589 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:29.340934 10585 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:29.212785 10337 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.346406  7179 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:29.348739  7084 catalog_manager.cc:5697] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 5 to 7, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 7 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.350463  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:29.351266  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:29.299665 10618 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:29.307195 10285 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:29.355381  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 51325.6us
I20260709 13:14:29.352324  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:29.357560  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:29.320315 10478 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:29.374172 10478 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:29.374552 10478 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:29.375980 10227 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.376896  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:29.378320  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:29.361549  7262 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:29.364301  7186 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:14:29.380065  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.365929 10638 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.366925 10605 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.367923 10651 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:29.368409 10398 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:29.368860 10648 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:29.301596 10219 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:14:29.369845 10337 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:29.370700  7258 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:29.290520 10493 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.367910 10625 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:29.371831 10585 consensus_queue.cc:1243] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:14:29.372270 10502 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:29.373674 10618 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:29.389533  7259 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:29.384164  7187 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:29.386950  7183 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:29.404050  7186 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:29.404486  7183 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:14:29.370993 10548 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.000s
I20260709 13:14:29.338960 10603 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.307407 10523 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.394248  7261 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:14:29.395359  7185 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:14:29.398197  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 75879.6us
I20260709 13:14:29.399760  7180 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:29.488302  7185 pending_rounds.cc:85] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 4
I20260709 13:14:29.396546  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:29.402014  7262 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:29.384218 10227 raft_consensus.cc:2764] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:14:29.488660  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:29.379702  9963 raft_consensus.cc:2764] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:14:29.478286 10493 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:29.479806 10330 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:29.492846 10523 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:29.493724  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:29.384213 10628 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.495018  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:29.495486  7260 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:29.495589  7259 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.496295 10628 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:29.496592  7334 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:29.481907  7183 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:14:29.482767 10621 consensus_meta.cc:287] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.002s
W20260709 13:14:29.497068 10655 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.055s	user 0.004s	sys 0.000s
I20260709 13:14:29.497434 10621 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.498668  7178 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:14:29.483659 10653 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:14:29.499876 10652 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:29.395782 10625 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:29.383240 10431 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:29.488646  7185 pending_rounds.cc:107] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 7.5
W20260709 13:14:29.489231  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 92812.3us
I20260709 13:14:29.542810  7185 raft_consensus.cc:2889] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:29.543738  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:29.491742 10486 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:29.500098 10621 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:29.499058  7184 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:14:29.530257  7259 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
W20260709 13:14:29.535076  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46504.7us
I20260709 13:14:29.554507  7335 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:29.384423 10637 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.177s
W20260709 13:14:29.538640 10629 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.000s
I20260709 13:14:29.561703  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:29.380748 10649 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.415s
I20260709 13:14:29.399116 10589 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 13:14:29.568442  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:29.484542 10585 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:29.573685  7180 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:29.534241 10523 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.545186 10625 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:29.592440  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:29.593302  7329 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:29.547508 10398 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:29.553164 10397 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.568735  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:29.500645 10618 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.563488 10651 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:29.554030 10628 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:29.490461 10337 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.559154 10219 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.144s
I20260709 13:14:29.621471  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:29.580125 10431 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:29.492841 10330 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:29.588174  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:29.746196  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 158096us
I20260709 13:14:29.746873  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:29.569176 10638 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.140s
I20260709 13:14:29.728412 10337 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.732309  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:29.734828 10610 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:29.590605 10585 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:29.727298 10645 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.751142  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.763765  7259 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:29.763986  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.764667  7258 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:29.764739  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.765450  7259 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:29.578231 10629 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.766175  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.767237 10629 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:29.767993  7182 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:29.755439 10532 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:29.708083 10628 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:29.603797 10614 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:29.756158  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:29.757675  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:29.747337  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:29.789779  7329 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:29.790997  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:29.607604 10523 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.565089 10634 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.794813  7329 raft_consensus.cc:2410] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:29.705703 10647 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.773885  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.795810  7261 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 5: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:29.741919 10616 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:29.743722 10433 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:29.752153  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.765455  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.709611  9963 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:29.772029 10532 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.706787 10397 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.755208 10552 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:29.716800 10486 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:29.797617  7258 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:29.799238  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:29.810992  7254 raft_consensus.cc:2368] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
I20260709 13:14:29.706974 10398 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.748713 10637 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 13:14:29.778127 10592 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.000s
I20260709 13:14:29.826987  7888 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:29.802134  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.760525 10608 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:29.826691 10440 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:29.804939  7259 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:29.807333  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:29.792443 10628 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:29.762925 10435 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:14:29.816265 10658 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:14:29.834342  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:29.817025 10660 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:14:29.817906 10398 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:29.819319 10585 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.821593 10285 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:29.822240 10431 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.822165 10330 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.797026 10433 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:29.793838  7334 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:29.815734  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.837059 10216 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:29.837759 10605 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:14:29.831028 10591 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.001s
I20260709 13:14:29.846791  7329 raft_consensus.cc:2368] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9.
W20260709 13:14:29.848572  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 101778us
I20260709 13:14:29.902248  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:29.903613  7261 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:14:29.857383  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:29.829175 10552 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:29.890828  7256 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.006s	sys 0.014s
W20260709 13:14:29.906358  7256 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.006s	sys 0.014s
W20260709 13:14:29.892659  7150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.020s
I20260709 13:14:29.854511 10285 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:29.824719 10486 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.898373  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:29.900300 10585 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:29.907323  7150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.000s	sys 0.020s
W20260709 13:14:29.913610  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 521357us
I20260709 13:14:29.775301 10645 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.906239  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:29.907733  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:29.954243  7255 raft_consensus.cc:2410] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:14:29.943228  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:29.982966  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.909008 10227 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:30.055832  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 148166us
I20260709 13:14:30.060161  7329 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:29.967280  7331 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.003s
I20260709 13:14:29.908501 10638 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:14:29.934890 10330 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:29.929575 10433 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:29.898878 10620 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:29.957329 10634 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:29.909350 10219 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:14:29.947539 10285 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.955278 10552 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.911166 10286 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:14:29.830869 10592 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:29.899154 10605 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:29.862799 10435 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:30.034008  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.040633  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:30.044909  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:30.114822  7150 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.680s (SENT) [suppressed 31 similar messages]
W20260709 13:14:29.945719 10476 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.585s	user 0.004s	sys 0.007s
I20260709 13:14:30.061735  7331 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
W20260709 13:14:30.052644 10478 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.678s	user 0.007s	sys 0.002s
W20260709 13:14:30.049041 10489 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.000s
I20260709 13:14:30.132709  7258 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:30.061381  7329 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:30.088213  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:30.139871  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:30.157390  7330 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:14:30.064525 10676 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:30.150732 10219 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.164093 10219 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.149835 10616 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:30.165318 10616 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.150068 10478 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.167306 10219 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:30.162608  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:30.168942 10478 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:30.169751  7334 raft_consensus.cc:2368] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10.
I20260709 13:14:30.150454 10489 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.170037 10435 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.172504 10489 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:30.175133  7336 raft_consensus.cc:2368] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9.
I20260709 13:14:30.176291  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2371) took 1132 ms. Trace:
I20260709 13:14:30.176680  7187 rpcz_store.cc:276] 0709 13:14:29.043911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.405226 (+361315us) service_pool.cc:224] Handling call
0709 13:14:29.541821 (+136595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:29.542052 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:29.542082 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:29.555765 (+ 13683us) log.cc:844] Serialized 26 byte log entry
0709 13:14:30.057420 (+501655us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:30.057492 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.057585 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:30.176071 (+118486us) raft_consensus.cc:1685] finished
0709 13:14:30.176092 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:30.176232 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":351893,"threads_started":1,"wal-append.queue_time_us":575678}
I20260709 13:14:30.056921 10591 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.139700 10476 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.212218 10583 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:30.212848 10583 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:14:30.215963  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 101181us
I20260709 13:14:30.181990 10676 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:30.218349  7890 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:30.196007  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.059388 10674 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.147s
I20260709 13:14:30.065065 10227 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:30.224655  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.228358  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:30.228329  7336 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:30.224087  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:30.239096  7256 raft_consensus.cc:2368] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
I20260709 13:14:30.242267  7336 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:30.236194 10674 consensus_queue.cc:1243] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:14:30.244930  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:30.252554  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.239090 10397 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:30.238693 10431 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:30.219046 10591 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.256399  7892 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:30.227937 10628 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.261955  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:30.263222  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:30.263316  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:30.213943 10583 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.208287 10605 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.266149 10583 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:30.266458 10605 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:30.259161 10431 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.268826 10431 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:30.270993 10591 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:30.204576 10625 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.272152  7262 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:30.272387 10628 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:30.273126 10625 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:30.279167 10652 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.279680 10652 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:30.282694  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:30.283561  7888 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:30.287446 10476 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:30.287979  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 559) took 1220 ms. Trace:
I20260709 13:14:30.288499  7253 rpcz_store.cc:276] 0709 13:14:29.067720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.068665 (+   945us) service_pool.cc:224] Handling call
0709 13:14:29.068945 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:29.331120 (+262175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.287630 (+956510us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54001a2554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:30.287887 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580044160}
W20260709 13:14:30.290261 10610 consensus_meta.cc:287] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 13:14:30.291215  7261 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:30.291662  7329 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:30.292073 10676 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.293751  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:30.323381  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:30.326866  7892 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:30.322942  7895 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:30.328003 10616 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:30.326192  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:30.328812  7889 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 8: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:30.329587  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:30.330139  7255 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:30.330580 10673 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:30.331722 10673 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:30.332082 10673 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:30.332177 10227 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:30.326800  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:30.326943  7329 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:30.290374  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:30.335071  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 81724.8us
I20260709 13:14:30.340651  7255 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:30.342010  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:30.342800  7255 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:30.294327  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.344537  7895 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:30.347133  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:30.349025  7329 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:30.321497 10686 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:14:30.346131  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:30.364046  7892 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:30.367331  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.371414  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.378193 10179 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:30.463140  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:30.463816  7253 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:30.476393  7152 connection.cc:256] RPC call timeout handler was delayed by -1.176591450999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:14:30.491367  7152 connection.cc:256] RPC call timeout handler was delayed by -1.0604914509999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260709 13:14:30.466603  7888 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:30.481027  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:30.494787  7255 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:30.496059  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:30.482978  7253 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:30.496614  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:30.483793  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1698) took 1499 ms. Trace:
I20260709 13:14:30.497608  7259 raft_consensus.cc:2410] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:14:30.484750  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.486032  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:30.497684  7185 rpcz_store.cc:276] 0709 13:14:28.984696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.984853 (+   157us) service_pool.cc:224] Handling call
0709 13:14:28.985129 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:29.552994 (+567865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.483544 (+930550us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b5400246b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:30.483728 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942738816}
I20260709 13:14:30.499699  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.500247  7262 raft_consensus.cc:2368] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
I20260709 13:14:30.500857  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:30.470867  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:30.502444  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.502555  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:30.503006  7262 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:30.503289  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.503327  7334 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:30.503844  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.499115  7260 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:30.505752  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:30.508589  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.509538  7255 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:30.511157  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:30.550915  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.551260  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:30.551867  7255 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:30.552222  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:30.474686 10645 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:30.513712 10227 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:30.514791  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:30.515416  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.516001 10640 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:30.517339 10420 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.517587 10530 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.518254 10613 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.518574  7892 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:30.565145  7184 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:30.458927 10673 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.520998  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:30.522176  7327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1602) took 1657 ms (client timeout 2196 ms). Trace:
I20260709 13:14:30.530009  7256 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:30.530851  7260 raft_consensus.cc:2368] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:30.531457  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:30.571624  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50722.3us
I20260709 13:14:30.532385  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.540855  7183 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:30.572476  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:30.573227  7183 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:30.481650 10523 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:30.543829  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:30.545928  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:30.547086  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:30.483199 10626 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:30.549638  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2374) took 1260 ms. Trace:
I20260709 13:14:30.558336  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:30.571918 10640 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.559634  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.560041  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:30.560937  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:30.483528 10620 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:30.560645 10616 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:14:30.567332  7262 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:30.551900 10495 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:14:30.548761 10179 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.548981 10397 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:30.571338  7327 rpcz_store.cc:269] 0709 13:14:28.864984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.913394 (+ 48410us) service_pool.cc:224] Handling call
0709 13:14:30.521932 (+1608538us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540036ae54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:30.522105 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712394624}
I20260709 13:14:30.577661  7186 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:30.562742 10605 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:30.580529  7180 rpcz_store.cc:276] 0709 13:14:29.289385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.593777 (+304392us) service_pool.cc:224] Handling call
0709 13:14:29.707949 (+114172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:29.738574 (+ 30625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:29.738612 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:29.739077 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:14:29.891805 (+152728us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:29.892390 (+   585us) log.cc:844] Serialized 14 byte log entry
0709 13:14:29.893630 (+  1240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:29.893762 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:30.524648 (+630886us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b18003d79e0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:14:30.530952 (+  6304us) raft_consensus.cc:1685] finished
0709 13:14:30.549363 (+ 18411us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:30.549557 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":223,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":33146,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":14651,"spinlock_wait_cycles":22784512,"thread_start_us":120211,"threads_started":1,"wal-append.queue_time_us":129043}
I20260709 13:14:30.559134  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:30.603924  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:30.559949 10625 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:30.574513 10644 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:30.563938 10330 raft_consensus.cc:2764] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:14:30.612404  7259 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 13:14:30.612880 10433 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:30.613780 10674 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:30.614547  7331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1589) took 2042 ms (client timeout 1912 ms). Trace:
I20260709 13:14:30.614464 10673 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:30.620397  7187 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:30.625756 10620 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:30.632694  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:30.563637 10591 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:14:30.618445 10640 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:30.565907 10431 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:14:30.580400 10626 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:30.619656 10523 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.646091  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:30.713629  7180 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:30.639928 10179 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.644579 10397 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.648895  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:30.651242  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2361) took 1680 ms. Trace:
I20260709 13:14:30.722585  7182 rpcz_store.cc:276] 0709 13:14:28.971171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.971287 (+   116us) service_pool.cc:224] Handling call
0709 13:14:30.651002 (+1679715us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54002c4f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:30.651183 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818942208}
I20260709 13:14:30.723047  7184 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:30.653306  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 620) took 1266 ms. Trace:
I20260709 13:14:30.658939 10602 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:30.660424  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:30.745952  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 85586.7us
I20260709 13:14:30.566278 10420 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:30.662012  7331 rpcz_store.cc:269] 0709 13:14:28.572488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.577616 (+  5128us) service_pool.cc:224] Handling call
0709 13:14:30.614319 (+2036703us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540036b354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:30.614458 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764400512}
I20260709 13:14:30.672513 10330 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:30.643625 10693 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
I20260709 13:14:30.668901  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:30.669448  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:30.572387 10613 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.690336  7186 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 6.
I20260709 13:14:30.767843  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:30.692181  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:14:30.699832  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:30.768774  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.689081 10625 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:30.713016  7889 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:30.713918  7892 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:30.717375  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:30.720439  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:30.663199 10532 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:30.723569  7890 rpcz_store.cc:276] 0709 13:14:29.387390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.387748 (+   358us) service_pool.cc:224] Handling call
0709 13:14:29.402907 (+ 15159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:30.219572 (+816665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.653066 (+433494us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54005631d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:30.653239 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874868608}
I20260709 13:14:30.570111 10530 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:30.753057  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 150096us
I20260709 13:14:30.756711  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:30.789181  7178 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:30.674755 10480 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:14:30.766108  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1599) took 1999 ms. Trace:
I20260709 13:14:30.789395  7259 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:14:30.789937  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.770272  7180 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:30.772039  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:30.781142  7182 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:14:30.791320  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.720047 10618 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:30.784111  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:30.787827  7187 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:30.789820  7259 pending_rounds.cc:85] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 4
I20260709 13:14:30.793929  7186 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:30.794273  7259 pending_rounds.cc:107] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:14:30.794641  7259 raft_consensus.cc:2889] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:30.720073 10523 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.796694  7894 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:30.797113 10523 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:30.789697  7332 rpcz_store.cc:276] 0709 13:14:28.767038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.771628 (+  4590us) service_pool.cc:224] Handling call
0709 13:14:29.058058 (+286430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:29.058396 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:29.058426 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:29.058894 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:14:29.175507 (+116613us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:29.334161 (+158654us) log.cc:844] Serialized 14 byte log entry
0709 13:14:29.348078 (+ 13917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:29.348244 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:29.390383 (+ 42139us) raft_consensus.cc:1685] finished
0709 13:14:29.390407 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:30.765865 (+1375458us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b5400253850. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:30.766028 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13342,"prepare.queue_time_us":204511,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":17942,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":24164,"spinlock_wait_cycles":633008000,"thread_start_us":248778,"threads_started":2,"wal-append.queue_time_us":261530,"wal-append.run_cpu_time_us":2144,"wal-append.run_wall_time_us":1041088}
I20260709 13:14:30.717636 10640 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:14:30.793845  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 221440us
I20260709 13:14:30.762801 10489 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:30.812717  7895 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:30.815470  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:30.816203  7180 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:30.769730  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:30.818485  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:30.721984 10652 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.829193  7333 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:30.821882  7896 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:14:30.831779  7896 pending_rounds.cc:85] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 9
I20260709 13:14:30.793612 10605 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:30.832109  7896 pending_rounds.cc:107] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:14:30.823129  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:30.832495  7896 raft_consensus.cc:2889] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:30.832760 10605 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.834739  7187 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:14:30.825631  7069 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 242a63190870450082200759c7f513ab with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c85cf49c63cc4e66b4747d8c4fa14022 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:14:30.828725  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.804311  7181 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:30.764976 10330 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.852496  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:30.864919  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49563.6us
I20260709 13:14:30.802142 10591 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.840713  7299 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:30.865854  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:30.869052  7181 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:30.871493  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:30.830075 10523 raft_consensus.cc:3055] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:30.822721 10489 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.823622 10486 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:30.878880  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:30.884807  7889 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:30.762748 10602 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.889470  7256 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
W20260709 13:14:30.877182  7299 consensus_peers.cc:597] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c89d6774062049379248eca324d137c6. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:30.883589  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.898260  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:30.901113  7256 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:30.901289  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:30.874687 10676 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:30.869689 10286 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:30.996515  7186 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:30.868391 10702 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:30.874683 10640 consensus_queue.cc:1243] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:14:30.868156 10532 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:14:30.884667 10489 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:30.876888 10523 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:30.878937 10618 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:30.994437  7180 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:30.906206  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:31.058652  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 152667us
I20260709 13:14:30.876559 10610 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 13:14:30.874523 10591 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:30.885022 10705 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:31.059544  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:30.822373 10626 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:30.907073 10495 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:31.064940 10552 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:30.904187 10644 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:30.907450 10578 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:30.994050 10243 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.994084 10179 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:30.877489 10699 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.163s
W20260709 13:14:31.076217  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 288956us
I20260709 13:14:30.994831 10500 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:14:31.004959 10286 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.072606 10610 consensus_queue.cc:1243] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:31.093319  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:31.094022  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:31.075915 10435 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:14:31.098198  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 232433us
I20260709 13:14:31.099076  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:30.906592 10625 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.100081  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:31.083688 10397 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:31.113425  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:31.115368  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:31.098239 10699 consensus_queue.cc:1243] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:31.099677 10706 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:31.083974 10243 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.078843 10705 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.127193  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.128381  7186 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:31.128839  7186 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:31.094076 10495 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:14:31.105590 10420 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:31.115113 10697 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 13:14:31.107403 10435 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:31.117565 10532 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:31.117822 10486 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:31.137605  7186 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:31.129755 10700 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:14:31.121721 10638 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.121572 10708 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:31.117888  7225 leader_election.cc:400] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9.
I20260709 13:14:31.157661  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:31.125651 10530 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:31.163661  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 297485us
W20260709 13:14:31.164191  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46493.1us
I20260709 13:14:31.164664  7862 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.144120 10699 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:31.166373  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:31.188740 10530 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:31.166975 10638 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.189138 10530 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:31.189180  7150 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.189776 10530 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:31.190521  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:31.165792 10420 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:31.185108  7186 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:31.146452 10330 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:31.165139  7225 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:31.184233  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 111595us
W20260709 13:14:31.197992  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 70906.2us
I20260709 13:14:31.199591  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:31.200337  7333 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:31.163024 10652 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.200654  7332 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:31.165694 10715 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:31.209198  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:31.209903  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.211787  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:31.174937 10708 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:31.213762 10708 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.218732  7887 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 8: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:31.203518  7152 leader_election.cc:400] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
I20260709 13:14:31.221364  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.200701  7331 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:31.196102 10179 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:31.207473  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:31.227373  7333 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:31.228061 10330 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:31.229436 10532 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:31.229869 10532 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:31.207558 10640 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:31.231086 10640 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.231565  7225 leader_election.cc:400] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9.
I20260709 13:14:31.231935  7225 leader_election.cc:403] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:14:31.232678 10532 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.233661 10640 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.233875 10532 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:31.194701 10487 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:14:31.239171  7333 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:31.208343 10243 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:31.240453 10712 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:31.241922 10712 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9.
I20260709 13:14:31.242978 10713 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:31.243532 10713 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:31.244586 10713 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.246261 10713 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:31.205013 10486 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:31.187688 10598 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.248639 10704 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:31.251659 10705 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.252628 10435 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.249367 10285 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:31.187227 10673 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:31.250232 10712 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:31.251802 10704 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:31.259124 10704 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:31.258980  7183 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.260174  7183 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:31.259981 10704 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.261128 10704 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:31.261540 10433 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.000s
I20260709 13:14:31.262895  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.263746 10598 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:31.264269  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:31.267498 10610 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:31.267922 10523 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.268249 10610 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.269246 10523 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:31.273741 10709 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:14:31.183038 10518 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:14:31.275117 10518 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:31.275585 10518 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:31.204751 10641 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:14:31.132239 10706 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:31.278337  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 68522.8us
W20260709 13:14:31.284914  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.279127  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:14:31.285349  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.278766  7225 leader_election.cc:400] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10.
W20260709 13:14:31.228291 10710 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:14:31.205899  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:31.227263 10652 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:31.286788  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:31.194192 10397 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:31.288666  7332 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:31.293217  7893 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:31.294727  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:31.267392  7152 leader_election.cc:400] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
I20260709 13:14:31.286135  7225 leader_election.cc:403] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:14:31.303665  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.303633  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.197855 10602 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:31.306710  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.311666  7186 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:31.311780  7183 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:14:31.314575  7183 pending_rounds.cc:85] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 6
I20260709 13:14:31.315317  7183 pending_rounds.cc:107] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:14:31.316165  7183 raft_consensus.cc:2889] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:31.316851  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.192055 10583 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:14:31.282014 10487 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:31.331869  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 562) took 1592 ms. Trace:
I20260709 13:14:31.331929  7260 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:31.276692 10518 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.201470 10635 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:14:31.337491  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.290306 10598 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:31.331676  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:31.332512  7257 rpcz_store.cc:276] 0709 13:14:29.739336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.739913 (+   577us) service_pool.cc:224] Handling call
0709 13:14:29.740363 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:29.814131 (+ 73768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:29.814172 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:29.814736 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:14:29.897563 (+ 82827us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:29.897620 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:31.331489 (+1433869us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b54002198d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:31.331540 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:31.331581 (+    41us) raft_consensus.cc:1685] finished
0709 13:14:31.331593 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:31.331800 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4622,"raft.queue_time_us":5858,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4820,"spinlock_wait_cycles":157893376,"thread_start_us":82437,"threads_started":1,"wal-append.queue_time_us":375032,"wal-append.run_cpu_time_us":1900,"wal-append.run_wall_time_us":1029984}
I20260709 13:14:31.291472 10243 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:31.309171 10578 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:31.291064 10591 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.288244 10610 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:31.308706 10705 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10.
I20260709 13:14:31.322703 10645 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:31.347698  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.343676  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:31.290565 10616 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:14:31.305043 10614 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:14:31.343116 10620 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.005s
W20260709 13:14:31.345124  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 141600us
W20260709 13:14:31.352624  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 66814.4us
I20260709 13:14:31.340551 10602 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:14:31.357899  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 146744us
I20260709 13:14:31.340780 10500 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:31.366266  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.361258  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:31.341085 10552 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:31.347971 10286 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:31.379377  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2535) took 1319 ms. Trace:
I20260709 13:14:31.356710 10598 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:31.359678 10518 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:31.362803 10705 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:31.379891  7262 rpcz_store.cc:276] 0709 13:14:30.060423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.626737 (+566314us) service_pool.cc:224] Handling call
0709 13:14:30.640578 (+ 13841us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:30.691830 (+ 51252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:30.691872 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:30.693732 (+  1860us) log.cc:844] Serialized 26 byte log entry
0709 13:14:30.832265 (+138533us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:30.832309 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:30.832371 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:31.379137 (+546766us) raft_consensus.cc:1685] finished
0709 13:14:31.379168 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:31.379311 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9564,"raft.queue_time_us":128556,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":44078,"thread_start_us":163765,"threads_started":2,"wal-append.queue_time_us":345593}
I20260709 13:14:31.365429 10673 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:31.356777 10610 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:14:31.408924  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.372618 10435 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:31.363996 10487 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:14:31.396888 10591 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:31.436228  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 70031.1us
W20260709 13:14:31.436419  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 81023.4us
I20260709 13:14:31.439201  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.377177 10699 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:31.437613 10435 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:31.372841 10614 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:14:31.407748 10673 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:31.365134 10620 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.458431  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:31.459206  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 127293us
I20260709 13:14:31.405630 10720 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:31.467211  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.469601  7152 leader_election.cc:400] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7.
I20260709 13:14:31.470786  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.444478 10243 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:31.462126 10645 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:31.458032 10435 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:31.476904  7888 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:31.474360  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:31.433684 10583 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:14:31.475849  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.462368 10598 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:31.457026 10591 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:31.484185 10718 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:14:31.478443 10638 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:31.490128  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:31.497641  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:31.497989  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.499554  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:31.501204 10673 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.481212 10642 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:31.483430 10652 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:31.510605  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.502420 10673 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:31.503407  7332 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:31.483315 10644 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:31.516144 10715 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:31.499701 10443 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:31.524590  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:31.525300  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.497009 10578 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:31.517771 10722 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:14:31.529650 10243 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.530622  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2546) took 1055 ms. Trace:
I20260709 13:14:31.531019  7256 rpcz_store.cc:276] 0709 13:14:30.475049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.907420 (+432371us) service_pool.cc:224] Handling call
0709 13:14:30.995253 (+ 87833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:31.068499 (+ 73246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:31.068546 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:31.074707 (+  6161us) log.cc:844] Serialized 26 byte log entry
0709 13:14:31.201893 (+127186us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:31.201933 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:31.201993 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:31.530415 (+328422us) raft_consensus.cc:1685] finished
0709 13:14:31.530435 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:31.530565 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81983,"raft.queue_time_us":79090,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2680,"thread_start_us":103790,"threads_started":1,"wal-append.queue_time_us":255725}
I20260709 13:14:31.518738 10706 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.480196 10552 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:31.499614 10717 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:14:31.495926 10665 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:31.489475 10530 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.480371 10384 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:14:31.540814  7182 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:31.563669  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:31.524425 10443 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.528389 10720 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:31.527024 10704 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:31.524708  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:31.580404  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.552724  7152 leader_election.cc:400] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:31.521792 10598 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:31.582808  7152 leader_election.cc:403] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:14:31.562032 10216 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:31.542538 10732 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:14:31.584002  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.567821 10443 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:31.591199  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2539) took 1524 ms. Trace:
I20260709 13:14:31.592516  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:31.591585  7261 rpcz_store.cc:276] 0709 13:14:30.066752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.753977 (+687225us) service_pool.cc:224] Handling call
0709 13:14:30.754452 (+   475us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:30.866534 (+112082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:30.866574 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:30.906141 (+ 39567us) log.cc:844] Serialized 52 byte log entry
0709 13:14:31.283522 (+377381us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:31.283556 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:31.283628 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:31.590976 (+307348us) raft_consensus.cc:1685] finished
0709 13:14:31.590993 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:31.591141 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82239,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":26442,"thread_start_us":329530,"threads_started":2,"wal-append.queue_time_us":326780}
I20260709 13:14:31.536954 10591 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.569648 10665 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:31.586967 10487 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:31.587376 10592 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:31.576987 10704 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.588279 10598 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:31.596038 10720 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:31.612167 10443 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.613279  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:31.598451 10732 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:31.613965  7183 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:31.615096  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:31.619046  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:31.620081  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:31.616446  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:31.622767  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:31.600346 10652 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:31.627143  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:31.628005  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:31.627143  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:31.629676  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:31.630260  7186 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:31.623162  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:31.626113  7179 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:31.584129 10645 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.631218  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:31.666723  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:31.670264  7179 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:31.631088  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:31.671669  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:31.625799  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:31.615911 10598 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:31.613235 10578 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.629683  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:31.624534 10216 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:14:31.672502  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:31.670998 10489 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.605s	user 0.013s	sys 0.000s
I20260709 13:14:31.673802  7183 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 5: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:31.671445  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:31.674322  7180 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:31.674060  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:31.668370 10384 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.679224  7257 raft_consensus.cc:2410] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:31.632129  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:31.625010 10739 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:31.627251 10532 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:14:31.688709  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:31.670830 10706 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:31.672286 10665 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.675371 10330 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:31.693396  7178 raft_consensus.cc:2410] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:31.704209 10330 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.705276  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2542) took 1571 ms. Trace:
I20260709 13:14:31.706343  7183 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:14:31.697731  7180 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:31.704299  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2381) took 1159 ms. Trace:
I20260709 13:14:31.711249  7181 rpcz_store.cc:276] 0709 13:14:30.544819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.544959 (+   140us) service_pool.cc:224] Handling call
0709 13:14:31.704120 (+1159161us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540017cd54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:31.704232 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422702976}
I20260709 13:14:31.708912  7259 rpcz_store.cc:276] 0709 13:14:30.134092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.795475 (+661383us) service_pool.cc:224] Handling call
0709 13:14:30.795806 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:30.823658 (+ 27852us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:30.867585 (+ 43927us) log.cc:844] Serialized 14 byte log entry
0709 13:14:31.115621 (+248036us) log.cc:844] Serialized 14 byte log entry
0709 13:14:31.115869 (+   248us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:31.120304 (+  4435us) log.cc:844] Serialized 52 byte log entry
0709 13:14:31.120495 (+   191us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:31.120730 (+   235us) log.cc:844] Serialized 14 byte log entry
0709 13:14:31.120941 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:31.121036 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:31.263368 (+142332us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b180038f1a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:14:31.705065 (+441697us) raft_consensus.cc:1685] finished
0709 13:14:31.705089 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:31.705216 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31885,"prepare.queue_time_us":67984,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":2087,"raft.queue_time_us":80975,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":52700,"spinlock_wait_cycles":216852992,"thread_start_us":120398,"threads_started":1,"wal-append.queue_time_us":300953}
I20260709 13:14:31.712965  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:31.713596  7262 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:31.678512 10652 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.717934  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2549) took 1242 ms. Trace:
I20260709 13:14:31.725220  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:31.726061  7259 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:31.725309  7254 rpcz_store.cc:276] 0709 13:14:30.475906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.265198 (+789292us) service_pool.cc:224] Handling call
0709 13:14:31.265515 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:31.265862 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:31.265892 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:31.266338 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:14:31.588952 (+322614us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:31.588992 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:31.589054 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:31.717684 (+128630us) raft_consensus.cc:1685] finished
0709 13:14:31.717712 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:31.717864 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10790,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":311180,"threads_started":1,"wal-append.queue_time_us":366288}
I20260709 13:14:31.717186  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:31.707437  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:31.729159  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:31.694335 10742 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:14:31.700445 10703 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:14:31.734988  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.735962  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:31.724084 10702 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:14:31.699791 10443 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.743615 10337 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:31.695170 10384 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.746170 10486 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:31.713796 10523 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:31.734926 10703 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:31.759145 10625 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:14:31.759747 10703 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:31.734134 10708 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:31.769896 10737 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.267s	user 0.000s	sys 0.003s
I20260709 13:14:31.772610 10384 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.712838 10330 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:31.753114  7262 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:31.692873 10489 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.786614  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:31.758239  7254 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:31.701035 10598 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.695459 10739 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.796254 10440 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:31.804723 10598 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.806071 10583 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:31.730093 10652 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.789489 10670 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.794226 10384 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.778079 10435 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.804755 10626 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:31.801926 10530 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.824887 10440 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:31.827303 10583 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:14:31.865231 10616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.002s	sys 0.021s
I20260709 13:14:31.753392 10732 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:31.899958 10753 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:14:31.911959 10430 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:31.895234 10613 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.860978 10384 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.921305 10227 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:31.855360 10670 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.916603 10703 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.941416 10704 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:31.941795 10740 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.942386 10740 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.944667 10740 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:31.949179  7261 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:31.951865 10670 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.953682 10384 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:31.939071 10583 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:31.955356 10583 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:31.956049 10435 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:31.956995 10720 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:31.937635 10227 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:31.959609 10227 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.960570 10227 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:31.962118  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:31.964522 10652 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:31.964694  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.965234 10703 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:31.965975 10713 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.714s	user 0.004s	sys 0.007s
W20260709 13:14:31.967516  7069 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 242a63190870450082200759c7f513ab with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c85cf49c63cc4e66b4747d8c4fa14022 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:31.969030  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:31.970696  7327 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:31.971517  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:31.971964 10286 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.972114  7889 raft_consensus.cc:2376] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5. Re-sending same reply.
I20260709 13:14:31.971781 10738 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.973276  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:31.973169 10738 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.975268  7332 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:31.975359 10738 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:31.976109 10397 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.003s
I20260709 13:14:31.976503 10397 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:31.976785  7893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 700) took 1749 ms (client timeout 1963 ms). Trace:
W20260709 13:14:31.977504  7893 rpcz_store.cc:269] 0709 13:14:30.227786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.228045 (+   259us) service_pool.cc:224] Handling call
0709 13:14:31.976574 (+1748529us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400521f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:31.976702 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2375963520}
I20260709 13:14:31.982393  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:31.983366 10705 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.002s
I20260709 13:14:31.983775 10705 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:31.984268  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:31.954413 10523 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:31.985347  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.985627  7262 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:31.986346  7887 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:14:31.986658  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:31.987331  7257 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:31.988552  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:31.989101  7861 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:31.989344  7331 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:31.990041 10384 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:31.990433 10384 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.990811 10384 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:31.991618  7891 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:31.972458 10286 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:31.994463  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:31.983845  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:31.995334  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:31.999012  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.003940  7332 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
W20260709 13:14:32.004832  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.007191  7186 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:32.008706  7331 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:31.987290 10330 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.016302 10330 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:32.007596 10603 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:14:32.031172  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.032694 10523 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.033249 10523 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.035769  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:32.036669  7331 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:32.021082 10489 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:32.039395  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:32.046526  7332 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:32.046696  7331 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:32.055965  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.058069  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.058540  7333 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:32.059679  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.061648  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.063236  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:32.063851  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.064235 10523 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:32.066601 10696 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.300s	user 0.000s	sys 0.004s
I20260709 13:14:32.067734 10735 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:32.066756 10724 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.550s	user 0.002s	sys 0.000s
I20260709 13:14:32.065163  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.068298 10735 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.070147  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:32.070504  7332 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:32.073673  7327 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:14:32.074898  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:32.075626  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:32.076249  7335 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:32.078488  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.083632  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.084504  7332 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:32.085817  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:32.086445  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.086932  7334 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:32.088340 10676 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:32.088717 10676 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:32.089471 10676 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.092433  7335 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:32.094187  7333 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:32.103430 10715 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:32.103938 10715 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:32.104811 10715 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.109937  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 623) took 1595 ms. Trace:
I20260709 13:14:32.115025  7328 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:32.117571  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:32.120116  7259 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:32.121127  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:32.122419  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:32.048395 10739 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:32.110455  7888 rpcz_store.cc:276] 0709 13:14:30.514698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.515014 (+   316us) service_pool.cc:224] Handling call
0709 13:14:30.515386 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:31.477290 (+961904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:32.109603 (+632313us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b540002eed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:32.109859 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210863488}
I20260709 13:14:32.139189  7254 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:32.140106  7256 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:32.141963  7256 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:32.123091  7257 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:32.106382 10715 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:32.151477  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:32.156013  7261 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:32.073503 10286 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:32.151051 10227 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:14:32.150802 10523 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:32.164026 10523 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.164518 10523 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:32.157083 10330 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:32.154223 10712 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:14:32.166723 10703 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:32.102283 10384 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.170811 10384 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:32.090592 10676 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:32.175168  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:32.176293  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:32.176824  7261 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:32.177845  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:32.178731  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.181420 10705 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:32.181962 10705 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:32.183893  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 221843us
I20260709 13:14:32.185021  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:32.196463  7261 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
W20260709 13:14:32.197173  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.197777  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:32.198974  7253 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
W20260709 13:14:32.199365  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 211523us
I20260709 13:14:32.200047  7150 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.200562  7181 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:32.202767  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:32.205824  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:32.181983 10730 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.752s	user 0.005s	sys 0.000s
I20260709 13:14:32.208622  7259 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:32.207906  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:32.217934  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.214951 10712 consensus_queue.cc:1243] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:32.231704  7187 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:32.232852  7187 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:32.234181  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.234995  7187 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:32.236023  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.241842 10704 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.242434 10704 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.246165 10705 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:32.246243  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.237254 10652 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.170825 10591 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:32.251926  7150 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.252418  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.249923  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:32.214728 10603 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:32.253360  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.206100 10489 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:14:32.255210  7181 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:32.258512  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.253402  7187 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:32.257048  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:32.218233 10500 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:32.207072 10286 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:14:32.265789  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.261488  7261 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:32.248576 10330 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:32.207551 10530 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:32.249833 10704 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:32.273892  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.269641  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:32.270323  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:32.274704  7259 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:32.271478  7336 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:32.275040  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:32.214740 10642 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:14:32.218678 10552 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:14:32.219805 10644 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:14:32.278759  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:32.279202  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.279928  7181 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:32.281198  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:32.206884 10739 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:14:32.281893  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.282487  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 570) took 1765 ms. Trace:
I20260709 13:14:32.265640 10736 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:32.247215 10652 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.268659 10665 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:14:32.268817 10371 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:32.268960 10500 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.266732 10649 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.282876  7258 rpcz_store.cc:276] 0709 13:14:30.516883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.276014 (+759131us) service_pool.cc:224] Handling call
0709 13:14:31.276251 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:31.276564 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:31.276864 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:14:32.181658 (+904794us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b2400100d18. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece5fd59c4 00007fece5fd3acb 00007fece618edc9 00007fece618ea55 00007fece618e09d 00007fece8dc010e 00007fece8dd788c 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221
0709 13:14:32.275181 (+ 93523us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b18003f3580. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a
0709 13:14:32.282181 (+  7000us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:32.282234 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:32.282275 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:32.282338 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:32.282439 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4984,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":650,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"spinlock_wait_cycles":57151232,"thread_start_us":75966,"threads_started":1,"wal-append.queue_time_us":74055}
I20260709 13:14:32.273419 10618 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:32.310158  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:32.254235 10591 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.288951 10736 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.319926 10736 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:32.320040 10613 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:32.320813  7150 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.322201  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.312366 10720 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:32.322818 10701 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:32.323344 10701 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:32.324244 10701 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.326848 10644 consensus_queue.cc:1243] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:14:32.327494 10443 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:32.327917 10443 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:32.285878 10706 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:32.264349 10699 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:14:32.286502 10635 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:32.311712 10500 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:32.334224  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.346277  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:32.284613 10728 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:14:32.328740 10618 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:32.337036  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.311483 10552 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:32.338320  7259 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:32.329457  7184 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:32.297910 10530 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:32.351948  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.335635 10720 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:32.387836  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.315570  7181 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:32.347348 10330 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:32.352365 10763 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 13:14:32.359676 10765 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:14:32.360085 10618 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.362874  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 612) took 1208 ms. Trace:
I20260709 13:14:32.600873  7182 rpcz_store.cc:276] 0709 13:14:31.154192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.157142 (+  2950us) service_pool.cc:224] Handling call
0709 13:14:31.175553 (+ 18411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:31.563110 (+387557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:32.362599 (+799489us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54002b43d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:32.362815 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839451008}
I20260709 13:14:32.363284  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 565) took 2402 ms. Trace:
I20260709 13:14:32.601847  7253 rpcz_store.cc:276] 0709 13:14:29.961285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.629883 (+668598us) service_pool.cc:224] Handling call
0709 13:14:30.630162 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:32.199390 (+1569228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:32.363065 (+163675us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400058a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:32.363216 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3607430912}
I20260709 13:14:32.363407 10591 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:32.367823 10552 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.317092 10649 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.370206 10719 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:32.328735 10443 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.372967  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1495) took 2564 ms. Trace:
I20260709 13:14:32.614157  7260 rpcz_store.cc:276] 0709 13:14:29.808324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.618315 (+809991us) service_pool.cc:224] Handling call
0709 13:14:31.331743 (+713428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:31.336383 (+  4640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:32.372789 (+1036406us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54002198d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:32.372910 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639921536}
I20260709 13:14:32.373888 10227 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:32.377765 10532 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:32.377583 10523 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.354065  7861 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:32.383793 10699 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:32.385285 10652 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:32.384863 10440 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.329787  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.625176 10732 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:14:32.625598  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 295876us
I20260709 13:14:32.556243 10384 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:32.543648  7334 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: [9.7-10.8]
W20260709 13:14:32.401337  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49821.2us
I20260709 13:14:32.432883  7299 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.522876  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2376) took 1986 ms. Trace:
I20260709 13:14:32.628981  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.451793  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:32.478325  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:32.480906 10530 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.350653 10642 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:32.435066 10720 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:32.634789  7181 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:32.491041  7888 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:32.341189 10635 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.636627 10635 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:32.636675  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.638470 10720 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.432003 10704 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.431088 10702 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:14:32.445729  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.627946 10637 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:32.538060 10620 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:32.565577  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.556118 10736 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.439706  7184 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:32.476536 10500 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.430892  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:32.435158 10770 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:14:32.441464  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.566228  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:32.667264  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 101155us
I20260709 13:14:32.643553 10652 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.569928 10605 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:32.573364 10435 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:32.574159 10371 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:32.576033  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.677367  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:32.677542  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:32.677702  7186 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:32.378486 10647 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:32.443789  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.677999  7253 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:32.678031  7261 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:32.678524  7335 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:32.679587  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:32.680177  7258 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
W20260709 13:14:32.592028  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 68637.5us
I20260709 13:14:32.598094  7262 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:14:32.591351 10598 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:32.608919  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.622089 10443 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:32.611392 10719 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:32.623950  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.691998  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:32.624564 10699 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:14:32.626591  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 272619us
W20260709 13:14:32.629164  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 196353us
I20260709 13:14:32.628859  7185 rpcz_store.cc:276] 0709 13:14:30.536566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.542911 (+  6345us) service_pool.cc:224] Handling call
0709 13:14:30.543307 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:31.101826 (+558519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:31.101872 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:31.107614 (+  5742us) log.cc:844] Serialized 26 byte log entry
0709 13:14:31.300578 (+192964us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:31.300635 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:32.508468 (+1207833us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400259254. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:32.508538 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:32.508606 (+    68us) raft_consensus.cc:1685] finished
0709 13:14:32.508627 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:32.522777 (+ 14150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42457,"raft.queue_time_us":49952,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":8095,"spinlock_wait_cycles":646616320,"thread_start_us":417403,"threads_started":2,"wal-append.queue_time_us":239537,"wal-append.run_cpu_time_us":2717,"wal-append.run_wall_time_us":1127509}
I20260709 13:14:32.695401  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:32.696167  7185 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:32.697467  7253 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:32.624467 10523 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:32.635762  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.619483 10532 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:32.446913  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.667918 10431 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:32.718955  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:32.630609 10701 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:32.724475  7891 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:32.632002 10738 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:32.631698 10715 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:32.658798 10704 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.621163 10227 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.509500  7187 raft_consensus.cc:2410] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:14:32.670188 10644 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.670540  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:32.670953 10591 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:32.671320  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:32.749938  7336 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:32.667528 10398 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:32.665802 10637 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:32.670208 10705 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:14:32.665498 10603 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:32.673134 10552 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:32.674813 10500 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:32.675341 10736 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:32.589174  7259 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:32.682430  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:32.684943  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.685563  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:32.683280 10647 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:32.686966 10783 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:14:32.698722  7262 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:32.750586 10626 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.703454 10719 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.704546 10735 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:32.705502 10786 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:14:32.627978 10384 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:32.715837  7261 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
W20260709 13:14:32.715893  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 269092us
I20260709 13:14:32.717376  7185 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:32.683120 10371 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:32.719641  7895 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:32.722014  7896 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:32.677328 10435 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:32.732928  7887 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:32.689368 10605 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:32.719216 10431 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:32.734293 10781 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:14:32.664719  7179 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:32.761474 10398 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:32.757651  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.683447 10652 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:32.765697  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83341.8us
I20260709 13:14:32.783711 10719 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:32.784334  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.769971 10703 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:32.752759 10644 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.724861 10734 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:32.805243 10734 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:32.805430 10398 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:32.805667 10734 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:32.806646 10782 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:14:32.808863  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.809449  7183 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:32.775629 10626 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.810317  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:32.804030 10789 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:14:32.811355 10626 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:32.815047 10384 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.816078 10384 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:32.818161  7183 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:32.819779 10371 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.820640  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.821161 10371 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:32.822145  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:32.823522 10435 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.801349  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:32.699126  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:32.763185 10603 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.767572 10532 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.803974 10397 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:14:32.804853 10788 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:14:32.799187  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:32.860528  7179 raft_consensus.cc:2376] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10. Re-sending same reply.
I20260709 13:14:32.861572  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.825286 10704 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:32.784502 10649 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:32.864801  7181 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:32.827512  7334 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:32.799700 10431 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:32.809686  7896 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.822950 10706 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:32.847610  7185 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:32.850044  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:32.867411 10532 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:32.850044  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.844740 10793 ts_tablet_manager.cc:933] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:32.852361  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:32.853494  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52226.9us
I20260709 13:14:32.871304  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:32.855213 10705 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:32.845432 10398 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:14:32.883396  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:32.859032  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.862191  7179 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:32.852008 10598 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.872095  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.887567  7328 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:32.887888  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:32.888756  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:32.826681 10688 consensus_queue.cc:1175] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:32.870360 10706 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:32.795708 10699 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.837679 10637 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.879206 10227 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:32.880319 10652 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:32.867389  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:32.870428  7329 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:32.828157 10703 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:32.884766  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:32.796418 10647 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.886348  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:32.912891 10704 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:32.913208 10330 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:32.912575  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:32.857251 10397 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:32.920498  7179 raft_consensus.cc:2376] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8. Re-sending same reply.
I20260709 13:14:32.922914  7895 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:32.923887  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.924803  7334 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:32.920538  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:32.918712 10523 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:32.915567 10398 consensus_queue.cc:1243] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:14:32.886512 10583 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.927879  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.929680  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:32.890830 10705 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:32.932112 10523 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:32.964152  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:32.957640  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:32.914165 10598 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:32.963935  7179 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:32.922166 10703 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:32.967819  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:32.933758 10227 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:32.998994  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:33.000087  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:33.000165  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.000838  7179 raft_consensus.cc:2410] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:14:32.966997 10647 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:32.932720 10330 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:32.965878 10523 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:32.933485 10701 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:14:33.007351  7179 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:14:32.963713 10705 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:32.968532  7887 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:32.967489 10720 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:33.013414  7179 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:32.965071 10698 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:32.968468 10591 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:14:33.009495 10791 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:14:32.964987 10583 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:32.963063 10635 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:33.020978  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.010258 10705 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:33.004945 10330 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:33.031945  7336 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:33.035524 10440 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:33.029090 10227 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.029328 10644 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.020484 10720 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.046829  7889 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:14:33.023664 10591 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:33.096841  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.052024 10720 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.046591 10603 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.130403 10732 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.130995 10732 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.133085 10732 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:33.135108 10583 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:33.116266 10635 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.046015 10227 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.107378 10443 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:33.121209 10431 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.067703 10591 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.107807 10652 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.128049 10705 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.050658 10598 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:33.108587 10795 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:14:33.137228  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.052167 10644 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:33.139473 10790 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:14:33.146214  7258 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:33.141868 10704 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.151373  7186 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:33.146605 10698 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.142051 10443 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.143548 10652 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.159126 10793 tablet_copy_client.cc:323] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
W20260709 13:14:33.159626 10774 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.622s	user 0.002s	sys 0.004s
I20260709 13:14:33.149498 10644 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.285323  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1746) took 1008 ms. Trace:
I20260709 13:14:33.297508  7187 rpcz_store.cc:276] 0709 13:14:32.276666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.281600 (+  4934us) service_pool.cc:224] Handling call
0709 13:14:33.284542 (+1002942us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54002b5cd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:33.285262 (+   720us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521084800}
I20260709 13:14:33.300115  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1736) took 1066 ms. Trace:
I20260709 13:14:33.300714  7180 rpcz_store.cc:276] 0709 13:14:32.233359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.656548 (+423189us) service_pool.cc:224] Handling call
0709 13:14:32.656916 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:32.657940 (+  1024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:32.657958 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:32.658285 (+   327us) log.cc:844] Serialized 26 byte log entry
0709 13:14:32.800224 (+141939us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:32.931143 (+130919us) log.cc:844] Serialized 14 byte log entry
0709 13:14:32.931441 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:32.931539 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.299806 (+368267us) raft_consensus.cc:1685] finished
0709 13:14:33.299837 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.300030 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":612,"prepare.queue_time_us":215563,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1242,"raft.queue_time_us":9759,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":11905,"thread_start_us":229583,"threads_started":2,"wal-append.queue_time_us":227014}
I20260709 13:14:33.303982  7180 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:33.152184 10704 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.236001 10635 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.158963 10734 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.159958 10698 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:33.319336 10800 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:14:33.299145 10530 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.324178  7180 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:14:33.306582 10598 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.329358  7332 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:33.321259 10523 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.340807 10644 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.315861 10635 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.330157 10598 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.328917 10530 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.348276 10705 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.354540 10431 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.374452 10705 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.375093 10705 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.368289 10443 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.368695 10652 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.368364 10431 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.383033 10532 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.386994 10734 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:33.386422 10532 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.389508 10523 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.385001 10704 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.392491 10598 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.387306 10431 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.389658 10635 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.384845 10703 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.397027 10698 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:33.401983 10785 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.716s	user 0.000s	sys 0.015s
I20260709 13:14:33.399845 10705 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.409039  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 619) took 1202 ms. Trace:
I20260709 13:14:33.410449  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1744) took 1152 ms. Trace:
I20260709 13:14:33.409562  7178 rpcz_store.cc:276] 0709 13:14:32.206702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.208079 (+  1377us) service_pool.cc:224] Handling call
0709 13:14:32.208455 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:32.250591 (+ 42136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:32.250620 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:32.251122 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:14:32.554735 (+303613us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b180035a640. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:14:32.620743 (+ 66008us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:32.620787 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:32.620862 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.401391 (+780529us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:33.408728 (+  7337us) raft_consensus.cc:1685] finished
0709 13:14:33.408774 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.408970 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44168,"raft.queue_time_us":47072,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":7029,"spinlock_wait_cycles":18186880,"thread_start_us":65808,"threads_started":1,"wal-append.queue_time_us":420540}
I20260709 13:14:33.410894  7184 rpcz_store.cc:276] 0709 13:14:32.257636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.273613 (+ 15977us) service_pool.cc:224] Handling call
0709 13:14:33.410284 (+1136671us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b54002715d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:33.410388 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109597952}
I20260709 13:14:33.411283 10720 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.412293  7184 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:33.413486 10720 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.415582 10591 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.424443 10530 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.423218 10330 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.426494 10605 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.408620 10706 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:33.430424 10803 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.078s	user 0.001s	sys 0.001s
I20260709 13:14:33.430799 10635 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.431325 10635 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.432027 10706 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.432950 10397 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.433569 10635 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.434137 10397 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:33.437536 10706 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.438180 10706 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:33.439126 10798 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.467s	user 0.003s	sys 0.005s
I20260709 13:14:33.440652 10706 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.444051  7187 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:33.445824  7187 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:14:33.446292  7187 pending_rounds.cc:85] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 4
I20260709 13:14:33.446594  7187 pending_rounds.cc:107] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:14:33.449002  7187 raft_consensus.cc:2889] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:33.439164 10591 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.427134 10330 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.454512  7183 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:33.457029  7183 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:33.460516  7187 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:33.462308  7185 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:33.466758  7187 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:33.472772 10431 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:33.475312  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 789701us
I20260709 13:14:33.475481 10500 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:33.476177 10500 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:33.476357  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:33.476709  7181 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:14:33.476933 10736 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:33.477674  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:33.476974  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 692165us
W20260709 13:14:33.479925  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.482087 10736 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:33.482883 10736 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:33.484063 10736 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.486829 10703 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.491691  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:33.492949  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.493707  7183 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:33.476706 10500 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:33.478729 10435 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:33.486894 10740 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:14:33.498535  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 803812us
I20260709 13:14:33.498970 10532 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.499096 10740 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:33.500113 10740 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.502092 10618 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:33.502535 10618 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:33.502933 10618 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:33.504670 10227 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.504969 10610 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:33.505263  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:33.495882 10431 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:14:33.506840 10738 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:33.507388 10738 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:33.495229 10703 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:33.508253 10703 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:33.508430 10738 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.509155 10703 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.511513  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:33.512740  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:33.513463  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:33.514942  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:33.507421 10431 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:33.517524  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:33.519765  7254 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:33.520411  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:33.521311  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:33.524995  7258 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:33.515885 10602 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:33.534503  7332 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:14:33.541308  7332 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:33.542549  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:33.543704  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:33.552295  7330 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:14:33.552816  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:33.553661  7257 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:33.553476  7329 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:33.538120 10635 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:33.588033  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:33.588655  7258 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:33.588922  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 624) took 1340 ms. Trace:
I20260709 13:14:33.538318 10719 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:33.589250  7185 rpcz_store.cc:276] 0709 13:14:32.248097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.173625 (+925528us) service_pool.cc:224] Handling call
0709 13:14:33.453412 (+279787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:33.462888 (+  9476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.588738 (+125850us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54000ed8d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:33.588866 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642393984}
I20260709 13:14:33.593405  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:33.581851  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 623) took 1345 ms. Trace:
I20260709 13:14:33.595296  7179 rpcz_store.cc:276] 0709 13:14:32.236572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.015470 (+778898us) service_pool.cc:224] Handling call
0709 13:14:33.478784 (+463314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:33.478964 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:33.478986 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:33.479032 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:33.479065 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.479115 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.581679 (+102564us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54001b35d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:33.581788 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064811904}
I20260709 13:14:33.582957  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:33.583654  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:33.597254  7256 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:33.584304  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:33.598160  7261 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:33.585386  7259 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:14:33.598834  7259 pending_rounds.cc:85] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 7
I20260709 13:14:33.599079  7259 pending_rounds.cc:107] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:14:33.599287  7259 raft_consensus.cc:2889] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:33.586229  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:33.587168  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:33.534277 10431 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:33.607054  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 92174.1us
I20260709 13:14:33.612211  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:33.612201  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:33.613361  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:33.622053  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:33.625095  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:33.628221  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:33.628438  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:33.631995  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:33.625785  7179 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:33.577271 10616 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:33.636826  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:33.638818  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:33.639470  7178 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:33.639731  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:33.640532  7187 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:33.629061  7896 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:33.643327  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:33.644201  7181 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:33.644630  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:33.587919 10635 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.654652  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:33.611817 10719 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:33.655365  7187 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:33.652623  7150 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:33.658191 10644 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:33.658427  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:33.659130  7895 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:33.660377  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:33.651117 10739 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.661693 10739 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.626765 10330 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:14:33.663909 10739 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.641013 10591 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:33.635668 10732 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:14:33.649410  7183 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:33.667032  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet c89d6774062049379248eca324d137c6 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
I20260709 13:14:33.667439  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:33.667663  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet c89d6774062049379248eca324d137c6 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-c89d6774062049379248eca324d137c6
I20260709 13:14:33.668761  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:33.669795  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:33.670320  7183 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.663136 10665 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.671175 10665 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.624948 10699 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:33.672676  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 129650us
I20260709 13:14:33.674350  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2397) took 1003 ms. Trace:
I20260709 13:14:33.658595 10644 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.675601  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:33.678350  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:33.679216  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:33.679656  7185 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:33.680167  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:33.675619  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:14:33.682399  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.641860 10227 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:33.677120  7180 rpcz_store.cc:276] 0709 13:14:32.671354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.435965 (+764611us) service_pool.cc:224] Handling call
0709 13:14:33.436415 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:33.436902 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:33.436947 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:33.437587 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 13:14:33.518608 (+ 81021us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:33.518690 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:33.518782 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:33.674062 (+155280us) raft_consensus.cc:1685] finished
0709 13:14:33.674089 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.674271 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13252,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":80658,"threads_started":1,"wal-append.queue_time_us":221869}
I20260709 13:14:33.641480 10530 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.656291  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:33.695405  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61774.6us
I20260709 13:14:33.648217  7152 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:33.702706  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.708528  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:33.644327 10443 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:33.709254  7334 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:33.656248 10598 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:33.655431 10635 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:33.674083 10719 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.685381 10644 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:33.728410 10778 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.735s	user 0.005s	sys 0.005s
I20260709 13:14:33.724866  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:33.724794  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:33.760107  7185 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:33.656184 10652 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.727655 10443 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.672096 10431 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.739298  7183 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:33.710141  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:33.768816  7330 raft_consensus.cc:2410] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:14:33.770030 10286 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:33.771988 10286 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:33.772428 10286 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:33.772924 10286 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:33.780741  7182 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:14:33.755643  7178 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:33.728286 10371 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:33.732564 10227 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:33.786795 10371 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.732753  7887 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:33.787153 10756 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:33.787411 10227 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.686690 10699 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.788688  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:33.789269  7889 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.790161 10699 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.730736 10598 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:33.790972 10598 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:33.791096 10532 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.791658 10532 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.792970  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2536) took 3727 ms. Trace:
I20260709 13:14:33.793735 10532 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:33.787230 10371 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:33.796593 10443 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.798825  7181 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:33.798924 10637 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.799530 10637 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.801687 10637 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:33.793329  7255 rpcz_store.cc:276] 0709 13:14:30.065835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:30.635735 (+569900us) service_pool.cc:224] Handling call
0709 13:14:30.647128 (+ 11393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:30.714899 (+ 67771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:30.714983 (+    84us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:30.769193 (+ 54210us) log.cc:844] Serialized 532 byte log entry
0709 13:14:31.515963 (+746770us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b480033c3d8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:14:32.289029 (+773066us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b1800388ae0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:14:32.569734 (+280705us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:32.569785 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:32.569884 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:32.992606 (+422722us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b1800388ae0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:14:33.658588 (+665982us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:33.792735 (+134147us) raft_consensus.cc:1685] finished
0709 13:14:33.792756 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:33.792888 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5014,"raft.queue_time_us":151540,"raft.run_cpu_time_us":3299,"raft.run_wall_time_us":716897,"spinlock_wait_cycles":25960576,"thread_start_us":168382,"threads_started":2,"wal-append.queue_time_us":1698749}
I20260709 13:14:33.757936 10812 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:33.804118 10812 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:33.804886 10812 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:33.761030 10706 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:33.805922 10706 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.807955 10706 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.808188 10552 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.809099  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:33.809206  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:33.810542  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:33.814244 10665 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.811196  7259 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:33.809849  7256 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:33.817444  7254 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:14:33.819288  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 122826us
I20260709 13:14:33.820005  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:33.812196 10552 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.727183 10530 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.834474  7255 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:33.815318 10431 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:33.830413  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:33.768253 10701 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:33.819801 10602 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:33.847640  7179 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 5.
I20260709 13:14:33.833935 10330 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:33.767729 10652 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:33.876307  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45973.8us
I20260709 13:14:33.811903 10635 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:33.832185 10706 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:14:33.900691  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 238867us
W20260709 13:14:33.943464  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:33.944178  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:33.947875  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 324383us
I20260709 13:14:33.964722 10500 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:33.969844  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:33.970969  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:33.895697 10605 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:33.898166 10532 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:33.971674  7334 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:14:33.979184  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:33.903612 10330 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:33.863883 10598 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:33.984948  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 251569us
I20260709 13:14:33.895957 10719 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:33.989327  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 341228us
I20260709 13:14:33.991292  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:33.967846 10443 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.995821  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:33.998451  7862 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:33.999426  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 279747us
I20260709 13:14:33.997673  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:33.978292 10532 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:34.001624  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:34.010476  7261 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:34.010601  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 335035us
I20260709 13:14:33.981606 10819 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:34.014662  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:34.015468  7259 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:34.011734  7256 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:33.960654 10736 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:14:33.999779 10443 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.005002 10532 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:34.020577 10443 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.995043 10384 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:34.025122 10500 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:34.025018 10384 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:34.027460 10598 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:34.029181 10435 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.001s
I20260709 13:14:33.997663 10705 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.030893 10705 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.033023 10705 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.983719 10665 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:14:34.033845  7889 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:34.034354 10384 raft_consensus.cc:2764] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:14:34.037388 10618 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
I20260709 13:14:34.011793 10610 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:14:34.043491 10552 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:34.045948 10635 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:33.996569 10602 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.046804 10635 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:34.048895 10635 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:34.049376 10635 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:34.051538  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.058377  7257 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:33.984624 10605 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:34.061414  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 59846.6us
I20260709 13:14:34.064359  7256 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:34.050700  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:34.012938 10820 raft_consensus.cc:2764] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:14:33.997269 10371 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.074908 10443 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:34.072942 10817 raft_consensus.cc:2955] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:14:34.057390 10637 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:34.086413  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:34.037971 10618 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.060510 10635 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.042268 10286 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.116096  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:34.097513 10532 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.085529 10443 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:34.085650 10500 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:14:34.089262  7887 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:34.104269 10719 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:34.104458  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:34.021847 10676 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:14:34.112372  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:34.112946  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:34.185109  7889 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:34.116732  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:34.185698  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 72842us
I20260709 13:14:34.186561  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:34.117260  7257 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:14:34.088871 10435 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:14:34.083455 10823 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:14:34.123201  7331 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:14:34.123255  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.194669  7327 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:34.195874  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.195981  7228 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:34.196659  7327 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:34.197769  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.135700  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:34.199564  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.136020  7330 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:34.090448 10610 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:14:34.155294  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:34.197223  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:34.206736  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:34.162745  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.164880  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.115676 10530 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:34.211412  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.207214  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:34.213444  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.170022  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:34.170277  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:34.125236 10443 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:34.125058 10826 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:14:34.176826  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 179231us
W20260709 13:14:34.177096  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 178741us
I20260709 13:14:34.238094  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.240084  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:34.240656  7257 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:14:34.240854  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.111680 10644 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.181253  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:34.106416 10330 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.118237 10814 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 13:14:34.185178  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 80812.7us
I20260709 13:14:34.204295  7256 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:34.206058 10552 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:34.210471  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.257153  7327 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:14:34.258399  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:34.259066  7327 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:34.210551 10397 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:34.261556  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:34.216226  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.241673  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:34.238469  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.243888  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:34.244566  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:34.170727 10285 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:14:34.246387  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:34.188347 10665 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.247287  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:34.247646 10530 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:14:34.249259  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 225246us
I20260709 13:14:34.312287  7327 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:34.194743 10819 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.207170  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:34.251224  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:34.194559 10699 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:34.194365 10598 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:34.255173 10286 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:34.212327 10706 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:34.119407 10720 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:34.260159  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.261538  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:34.218303 10703 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:34.219686 10826 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:34.291818 10825 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:14:34.292662 10842 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:14:34.295606 10831 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
W20260709 13:14:34.289064 10828 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:14:34.291862 10397 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.294934  7184 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:34.207105 10616 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:14:34.249878 10227 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:34.299611  7185 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:34.301649  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:34.297636  7181 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:34.303289  7331 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.248143  7332 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:34.298894  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:34.308526  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:34.310011  7257 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:34.249275  7258 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:34.313066  7262 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
I20260709 13:14:34.259742 10552 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:34.302211  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:34.316637  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.472723  7330 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:34.259202 10591 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:34.472831  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:34.474165  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 175376us
I20260709 13:14:34.217737 10836 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:14:34.291903 10532 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:34.320436 10598 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:34.321096  7255 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:34.256547 10647 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 13:14:34.470916  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 220943us
I20260709 13:14:34.314164 10665 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.330585  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:34.353629  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:34.354272  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.290930  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:34.343062 10840 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:14:34.393489  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 112715us
I20260709 13:14:34.494004  7182 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 5.
I20260709 13:14:34.345953 10720 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.343027 10706 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.475028  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:34.475445  7185 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:34.475667  7259 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:34.477032  7332 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:34.408572  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 151251us
W20260709 13:14:34.395817 10804 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:14:34.317044 10530 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.481168 10829 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:34.484572  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 182419us
I20260709 13:14:34.505923  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:34.318184 10819 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.326958 10371 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:34.349493 10703 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.355604 10826 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:34.501611 10706 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.401449 10227 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.496966  7331 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
W20260709 13:14:34.497757  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 144260us
I20260709 13:14:34.484118 10846 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:14:34.345233 10699 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:14:34.516249  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 202906us
I20260709 13:14:34.398862 10635 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.498842 10720 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.502985 10532 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:34.495416  7329 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:34.526226 10598 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:34.501492  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:34.549290  7889 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:34.550530  7259 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:34.533290 10703 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.497300 10705 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:14:34.525367 10855 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:34.486668 10591 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.570521  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:34.516808 10740 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:14:34.569435 10371 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:34.548353  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.553833  7336 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
W20260709 13:14:34.577252  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 75986.6us
I20260709 13:14:34.534976 10431 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.534518 10823 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:34.548890 10831 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.556012 10227 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:34.603675  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:34.574986 10835 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 13:14:34.582430 10598 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:34.572228 10829 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:34.616641  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46256.2us
I20260709 13:14:34.620607  7329 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:14:34.629236 10861 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:14:34.586683 10855 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:34.622392 10823 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:34.671453 10823 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.672245 10854 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:34.672834 10823 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:34.674672 10871 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:34.675848 10644 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:34.635425  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:34.680876  7329 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:34.680738  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 77206.7us
I20260709 13:14:34.621754 10371 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.638842 10855 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.570856 10552 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.639580 10822 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:34.640362 10652 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:34.625247 10431 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.625464 10834 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:14:34.629758 10637 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 13:14:34.643731 10844 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:14:34.713517  7329 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:34.646171 10635 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:34.646294 10645 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:34.647202 10853 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:14:34.648279  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.651571 10397 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:34.625631 10831 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.653568 10865 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:34.617811 10869 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:34.658015 10598 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.659749  7333 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:34.649833 10699 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.669974 10665 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:34.685696  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:34.686385  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:34.687335  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:34.808574  7180 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:34.688189  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:34.696110  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 60772.5us
I20260709 13:14:34.607460 10862 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:34.704753  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1530) took 1089 ms. Trace:
I20260709 13:14:34.672854 10854 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:34.707741  7182 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:34.876683  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:34.699967 10705 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:34.708043 10440 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:34.809397  7183 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:34.852613  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.871308  7261 rpcz_store.cc:276] 0709 13:14:33.615309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.615466 (+   157us) service_pool.cc:224] Handling call
0709 13:14:33.615768 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:34.011003 (+395235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:34.704429 (+693426us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54002161d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:34.704663 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907203328}
I20260709 13:14:34.873411  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:34.716609 10645 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:34.919049 10645 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:34.721179 10853 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:34.923569 10853 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.924700 10853 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:34.927518 10868 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:14:34.929786  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:34.934947 10871 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.935642 10871 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:34.938405 10873 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:14:34.871265 10862 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.940368 10862 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.941960 10829 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:34.942677 10829 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.882403  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:34.894845  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 419866us
I20260709 13:14:34.948014 10647 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:34.948235  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:34.948724 10647 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:34.951467 10673 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:34.952054 10673 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:34.953091 10673 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.808082 10652 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.955515 10652 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:34.902774  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:34.957609  7181 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
W20260709 13:14:34.967550  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 89069.2us
I20260709 13:14:34.971961  7180 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:34.902722  7185 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.903992 10819 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:34.904590  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:34.905135 10858 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.905835  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:34.906675 10831 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:34.907215 10820 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:34.908854 10371 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:34.909350 10591 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:34.896600 10705 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.871661 10644 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:34.911787 10854 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.899791 10440 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:34.804523 10397 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:34.809584 10836 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:34.913149 10817 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.001s
I20260709 13:14:34.913661 10701 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:34.802253 10869 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.914939 10530 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:34.989868 10673 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.993911 10705 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:34.879844 10598 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:34.996760 10591 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:34.976199  7185 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:34.981984  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 76243.4us
I20260709 13:14:34.988653 10876 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:34.949885 10647 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.900566 10865 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:34.982450 10676 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:34.989535 10858 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:35.057886  7330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.021s	sys 0.084s
W20260709 13:14:35.109221  7330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.021s	sys 0.084s
W20260709 13:14:35.085068  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 455032us
I20260709 13:14:35.110935  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:35.109862  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.112756  7889 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 5.
W20260709 13:14:35.100397  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 130309us
I20260709 13:14:35.111994  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:34.996965  7183 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:35.051393  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:35.120440  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:35.121346  7261 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:35.122877  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:35.131240  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 79958.9us
W20260709 13:14:35.131563  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.132200  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:35.133594  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.117858  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:35.134575  7183 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:35.139005  7183 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:14:35.100252  7228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.004s	sys 0.008s
W20260709 13:14:35.143980  7228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.005s	sys 0.009s
W20260709 13:14:35.107481 10443 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.859s	user 0.014s	sys 0.001s
I20260709 13:14:35.009855 10652 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.000574 10877 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:35.148000  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 178165us
I20260709 13:14:35.121711 10583 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:35.009377 10871 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.098374 10882 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:35.003911 10869 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:35.034897 10591 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 13:14:35.014968 10530 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 13:14:35.122397 10865 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:35.130750 10834 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:35.146483 10676 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.166177  7330 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:35.210645  7330 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:35.122342 10431 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.003786 10397 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.170056  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:35.168926  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:35.185114  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:35.224388  7331 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:35.224437  7327 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:14:35.160665 10443 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.192890 10817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44970 (request call id 13) took 16977 ms. Trace:
I20260709 13:14:35.230824 10817 rpcz_store.cc:276] 0709 13:14:18.215945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:18.281508 (+ 65563us) service_pool.cc:224] Handling call
0709 13:14:18.888361 (+606853us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b5400187f20. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b9520 00007fece9242b42 00007fece9241800 00007fecee202d29 00007fece77811d4 00007fece7781162 00007fece7781091 00007fece778100c 00007fece77802c2 00007fece757748c
0709 13:14:18.952869 (+ 64508us) log.cc:844] Serialized 506 byte log entry
0709 13:14:19.157798 (+204929us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b180048e320. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9195b0b 00007fece921ab63 00007fece9242752 00007fecee202d29
0709 13:14:19.168238 (+ 10440us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:19.481821 (+313583us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b180048e320. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:14:19.948343 (+466522us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5800152cd0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a6090 00007fece919643c 00007fece919cd53 00007fece919ccd9 00007fece919cc69 00007fece919cc31 00007fece919bdfd 000000000038f354 000000000038f199 00007fece614f475 00007fece61517c1
0709 13:14:35.192744 (+15244401us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66952,"raft.queue_time_us":143057,"raft.run_cpu_time_us":6149,"raft.run_wall_time_us":539793,"spinlock_wait_cycles":1122545536,"thread_start_us":67600,"threads_started":1,"wal-append.queue_time_us":133831,"wal-append.run_cpu_time_us":6891,"wal-append.run_wall_time_us":1173447}
I20260709 13:14:35.236574 10443 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:35.195564 10720 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.021s
I20260709 13:14:35.195853  7336 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:14:35.195945  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63859.4us
I20260709 13:14:35.238145  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:35.238667  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:35.196517  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 81292.6us
I20260709 13:14:35.239740  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:35.240548  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:35.241302 10853 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:35.123170  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:35.242218  7259 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:35.199146  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:34.998795 10701 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.244854 10701 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.150413 10885 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:35.245514 10885 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.242316 10720 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:34.997924 10644 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:14:35.247272  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.249118 10644 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.247568  7187 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:35.010475 10440 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.239760  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:35.179430 10652 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.175184 10583 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.250829 10583 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:35.251212  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.252265 10853 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:35.003729 10836 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.256565 10836 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.163487 10867 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:35.223664  7185 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
W20260709 13:14:35.212718 10826 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.010s
I20260709 13:14:35.257381 10867 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:35.257534 10826 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.258683  7184 raft_consensus.cc:2410] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:35.250394 10652 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.259672 10826 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.260547  7335 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:35.183014 10881 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:35.260787 10652 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.261178 10881 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.247699 10885 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.228626  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:35.167055  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 865393us
I20260709 13:14:35.263756  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:35.227273 10883 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:35.264724 10883 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.248728 10720 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.266996 10883 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.267305 10583 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.267584 10883 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:35.269586 10881 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.246573  7331 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:35.258374 10867 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.269658 10583 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:35.274253  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:35.202019 10882 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.275942  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:35.277477  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:35.279162 10881 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:35.279989 10881 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:35.280522 10881 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:35.277534 10882 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.285239 10883 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:35.286554  7185 pending_rounds.cc:85] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 7
I20260709 13:14:35.287022  7185 pending_rounds.cc:107] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:14:35.287437  7185 raft_consensus.cc:2889] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:35.211452  7330 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.288352  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1772) took 1043 ms. Trace:
I20260709 13:14:35.106117 10876 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:35.304570  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 64080.5us
I20260709 13:14:35.288852  7185 rpcz_store.cc:276] 0709 13:14:34.244483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.244622 (+   139us) service_pool.cc:224] Handling call
0709 13:14:34.299489 (+ 54867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:34.902322 (+602833us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b4c00248640. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7508a20 00007fece7519a29 00007fece74df644 00007fece7506f2d 00007fece7506b93 00007fece923718b 00007fece9237cb5 00007fece9232f30 00007fece92347de 00007fece923eb49 00007fece923f416
0709 13:14:35.288017 (+385695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.288278 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13132160}
I20260709 13:14:35.291237  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:35.315119  7261 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:35.221371 10871 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:35.321116  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:35.270040 10855 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260709 13:14:35.225175 10834 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:35.304970 10431 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:35.310940 10443 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:35.314247 10644 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:14:35.314007 10701 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:35.338280  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:35.339505  7861 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:35.332623 10397 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.327560 10882 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:35.335542  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:35.345511  7261 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:35.348428  7259 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:35.225627 10676 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.350873 10676 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:35.333196 10530 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.354463  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:35.325131 10598 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:35.355639  7261 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:35.327850 10720 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:35.211079 10865 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.179245 10877 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.357072  7187 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:35.361467  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:35.376228  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:35.342811 10431 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:35.330217 10871 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.352658 10701 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:35.355650 10875 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:14:35.419477  7179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 636) took 1783 ms (client timeout 1937 ms). Trace:
W20260709 13:14:35.420209  7179 rpcz_store.cc:269] 0709 13:14:33.636464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.644313 (+  7849us) service_pool.cc:224] Handling call
0709 13:14:35.419189 (+1774876us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540041aad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:35.419395 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465216896}
I20260709 13:14:35.422159  7179 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:14:35.356770 10637 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:35.381911 10813 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:35.385993 10583 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:35.364230 10676 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:14:35.447610 10719 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:14:35.414462 10875 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.365399 10598 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.379558 10665 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:14:35.363756 10530 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.324640 10855 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:35.442319 10227 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.811s	user 0.006s	sys 0.010s
I20260709 13:14:35.355729 10882 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.470201  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:35.435395 10826 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:35.385648 10720 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.481822 10701 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.384723 10705 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.446177 10813 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.446450 10858 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.474754  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:35.472151  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:35.487813  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 317835us
I20260709 13:14:35.487975  7255 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:35.471306  7179 raft_consensus.cc:2955] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:14:35.480746 10865 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.468878 10583 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:35.504644 10865 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:14:35.481652 10823 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.808s	user 0.014s	sys 0.004s
I20260709 13:14:35.505045 10865 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:35.505481 10865 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:35.471103 10706 consensus_meta.cc:287] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.902s	user 0.012s	sys 0.014s
I20260709 13:14:35.469712 10602 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:35.505883 10855 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.505065 10583 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.507611 10855 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:35.495194 10530 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.498980 10720 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.508318 10855 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.505985 10706 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.511513 10871 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.512452 10706 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.519348 10720 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.519832 10877 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.519920 10720 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.521693 10882 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.521514 10855 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.521981 10720 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.522650 10876 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.476138 10227 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.523363  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:35.469224 10875 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:35.500540 10598 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:35.501638 10862 consensus_meta.cc:287] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.004s
I20260709 13:14:35.435824 10834 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.487531 10826 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.552052 10605 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.490239 10813 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:35.554970  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:35.555720  7331 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:35.526086  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 234935us
I20260709 13:14:35.562996  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:35.530930  7259 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:35.532336  7225 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.132:39125 timed out after 1.740s (SENT) [suppressed 13 similar messages]
I20260709 13:14:35.537289  7254 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:35.489207 10703 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.883s	user 0.010s	sys 0.007s
I20260709 13:14:35.525592  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:35.575482  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50027.6us
I20260709 13:14:35.518071 10869 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.564563  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:35.535807 10876 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:35.552928 10826 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.581605 10883 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:35.611121  7253 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:14:35.589354 10605 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:35.589444 10598 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:35.486328 10431 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.602065 10876 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.538255 10720 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:14:35.588871 10703 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.608014 10855 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:35.621740 10898 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:35.622087  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:35.641881 10637 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:35.644443  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:35.645269  7183 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:35.622345 10892 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.633535 10876 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:35.647009  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:35.646899 10892 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.618573 10598 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:35.647688  7180 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:35.647986 10598 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:35.648628  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:35.649222 10892 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.623167 10706 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:35.627460  7133 auto_rebalancer.cc:629] Failed to schedule move for tablet b0eff9774a9c435d955814f903cb2401: Illegal state: Replica efc9ee9e1d86480790fa83f6ad0c295c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:35.653923  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:35.627197 10875 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.627795 10705 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.615516 10881 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.639669  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:35.656688  7185 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:35.554773 10862 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:35.635928  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 171372us
I20260709 13:14:35.609556 10871 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:14:35.649747  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:35.634840 10371 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:35.672298  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:35.673106  7180 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:35.642422 10855 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:35.677745  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 211151us
I20260709 13:14:35.659937  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:35.674232  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:35.679840  7180 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:35.679921  7262 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:14:35.676378  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 370724us
I20260709 13:14:35.680650  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:35.665535  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:35.681277  7180 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:35.681382 10882 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:35.682186  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:35.700428  7185 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:35.682952  7262 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:14:35.701120  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:35.681641 10705 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:35.685355  7258 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:35.679113  7186 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:35.702561  7262 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:35.708225  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:35.657938 10897 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:35.709321  7262 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:35.715950  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:35.717059 10875 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.717320  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:35.718114  7262 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:35.706161  7895 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:35.711148  7258 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:35.711038  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.719180  7893 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
W20260709 13:14:35.719599 10895 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:14:35.719904  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:35.720441  7889 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:35.721014  7185 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:14:35.706979 10705 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.721652  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2442) took 1002 ms. Trace:
I20260709 13:14:35.722003 10705 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:35.723968  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.675518 10227 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.722071  7185 rpcz_store.cc:276] 0709 13:14:34.719157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.720432 (+1001275us) service_pool.cc:224] Handling call
0709 13:14:35.720769 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:35.721406 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.721597 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:35.645620 10637 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.683084 10855 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:35.733201  7183 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:35.733894  7889 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:35.736089  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.748432  7180 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:35.736238  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.749553  7893 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:14:35.735047  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69560.6us
I20260709 13:14:35.753530  7183 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:14:35.755476  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2443) took 1016 ms. Trace:
I20260709 13:14:35.756310  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:35.759511  7183 rpcz_store.cc:276] 0709 13:14:34.739224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.749800 (+1010576us) service_pool.cc:224] Handling call
0709 13:14:35.750437 (+   637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:35.755142 (+  4705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.755403 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:35.670241 10706 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.766448  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:35.676461 10740 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:14:35.656070 10898 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.769997  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.775991  7150 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:35.775990  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:35.784260  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.786171  7893 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:35.786777  7262 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:35.784010 10871 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:35.788828 10871 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:35.789271 10871 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:35.764665  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.791910  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.783171  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:35.771957 10720 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.797727  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:35.781268 10645 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.859s	user 0.011s	sys 0.000s
I20260709 13:14:35.800005  7262 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:35.801381  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.803195  7262 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:35.790534 10898 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.806766  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.782992 10605 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:35.783133 10892 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:35.810153  7889 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:35.812362  7895 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
W20260709 13:14:35.813242  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 280931us
I20260709 13:14:35.797952 10907 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.793509 10901 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:35.802675 10899 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:35.824566 10901 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:35.824949 10899 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:35.825062 10901 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:35.825277  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:35.825892 10899 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.828836  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:35.830057 10384 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:35.830468 10384 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.830834 10384 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:35.818110 10875 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:35.827118  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:35.827477  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:35.832082 10875 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.832930  7893 raft_consensus.cc:2368] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10.
I20260709 13:14:35.824566 10898 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:35.833777 10898 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.834695 10862 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:35.835543 10875 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.836270 10898 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.733326 10897 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.828477  7896 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 13:14:35.800375 10530 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:35.828296  7888 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:14:35.769560 10883 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.815088 10869 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.814666 10892 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.804447 10720 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.818336 10905 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:14:35.806020 10645 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.843850 10530 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.867492 10703 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.855840 10892 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:35.846835 10898 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:14:35.838459 10907 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:35.894016 10911 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:14:35.906018 10645 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:35.907541 10906 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:14:35.912740 10892 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.914470 10907 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:35.917565 10673 raft_consensus.cc:3055] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:35.918001 10673 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:35.920574 10876 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.921793 10813 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.923286 10673 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.924597 10821 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:35.925050 10821 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:35.924790 10901 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.935526 10829 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.934543 10821 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.943782 10821 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:35.945422 10855 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:35.959165 10884 raft_consensus.cc:3055] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:14:35.941720 10904 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:14:35.936844 10876 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:35.942396 10881 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:35.959659 10884 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:35.974498 10884 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.976766 10884 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:35.987689 10901 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.026281  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:36.029193  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:36.033954  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:14:36.039446  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.042243  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2439) took 1348 ms. Trace:
I20260709 13:14:36.042817  7179 rpcz_store.cc:276] 0709 13:14:34.693334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.467048 (+773714us) service_pool.cc:224] Handling call
0709 13:14:35.469836 (+  2788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:35.471186 (+  1350us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:35.660983 (+189797us) log.cc:844] Serialized 14 byte log entry
0709 13:14:36.040598 (+379615us) log.cc:844] Serialized 14 byte log entry
0709 13:14:36.041092 (+   494us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:36.041188 (+    96us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:36.041594 (+   406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.041732 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.042006 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":437,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4933,"thread_start_us":132835,"threads_started":1,"wal-append.queue_time_us":205924}
I20260709 13:14:36.048388  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2441) took 1343 ms. Trace:
I20260709 13:14:36.050020  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1770) took 1806 ms. Trace:
I20260709 13:14:36.050571  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:36.050940  7180 rpcz_store.cc:276] 0709 13:14:34.704424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.687734 (+983310us) service_pool.cc:224] Handling call
0709 13:14:35.748271 (+ 60537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:35.748820 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.047836 (+299016us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b540017cd50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:36.048174 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138514688}
I20260709 13:14:36.052203  7262 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:36.091939  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:36.090296  7254 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:14:36.052819  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:36.060855  7889 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:36.094085  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:36.062068  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.099260  7179 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:36.063239  7327 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:14:36.090384  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 484) took 1841 ms. Trace:
I20260709 13:14:36.103258  7332 rpcz_store.cc:276] 0709 13:14:34.249134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.504881 (+255747us) service_pool.cc:224] Handling call
0709 13:14:34.505283 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:34.539784 (+ 34501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.539817 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:34.540435 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 13:14:36.085427 (+1544992us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b180040d320. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1
0709 13:14:36.085938 (+   511us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:36.086037 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.086214 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:36.086297 (+    83us) raft_consensus.cc:1685] finished
0709 13:14:36.086314 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.090141 (+  3827us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39620,"raft.queue_time_us":78565,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":10712,"spinlock_wait_cycles":2922752,"thread_start_us":39157,"threads_started":1,"wal-append.queue_time_us":128911,"wal-append.run_cpu_time_us":2671,"wal-append.run_wall_time_us":1237891}
I20260709 13:14:36.106448  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:36.092633  7262 raft_consensus.cc:2955] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:14:36.115962  7182 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:14:36.116617  7182 pending_rounds.cc:85] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 5
I20260709 13:14:36.117049  7182 pending_rounds.cc:107] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:14:36.117499  7182 raft_consensus.cc:2889] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:36.118052 10397 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:36.118589 10397 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:36.119071 10397 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.120401  7186 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:14:36.121251  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2447) took 1070 ms. Trace:
I20260709 13:14:36.121593  7186 rpcz_store.cc:276] 0709 13:14:35.051041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.119391 (+1068350us) service_pool.cc:224] Handling call
0709 13:14:36.119954 (+   563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:36.120894 (+   940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.121153 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:36.067866  7335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1572) took 1950 ms (client timeout 2146 ms). Trace:
W20260709 13:14:36.057042  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 161627us
W20260709 13:14:36.123634  7335 rpcz_store.cc:269] 0709 13:14:34.117471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.121684 (+  4213us) service_pool.cc:224] Handling call
0709 13:14:36.067284 (+1945600us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540038bdd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:36.067588 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420712832}
I20260709 13:14:36.077592  7346 tablet_copy_source_session.cc:215] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:36.081763  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:36.051592  7178 rpcz_store.cc:276] 0709 13:14:34.243872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.243994 (+   122us) service_pool.cc:224] Handling call
0709 13:14:35.419418 (+1175424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:35.427984 (+  8566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:35.428031 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:35.435741 (+  7710us) log.cc:844] Serialized 26 byte log entry
0709 13:14:35.640549 (+204808us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:35.650654 (+ 10105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.650780 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:36.039420 (+388640us) raft_consensus.cc:1685] finished
0709 13:14:36.039506 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.049432 (+  9926us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540041aad0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:36.049803 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7978,"raft.queue_time_us":8134,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":13164,"spinlock_wait_cycles":2702353152,"thread_start_us":169797,"threads_started":1,"wal-append.queue_time_us":341632}
I20260709 13:14:36.109002  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2421) took 1424 ms. Trace:
I20260709 13:14:36.126912  7184 rpcz_store.cc:276] 0709 13:14:34.684235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.687035 (+  2800us) service_pool.cc:224] Handling call
0709 13:14:36.108514 (+1421479us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001b3ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:36.108784 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032919808}
I20260709 13:14:36.127548  7346 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:44980 (request call id 476) took 2565 ms. Trace:
W20260709 13:14:36.058393  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 229670us
I20260709 13:14:36.128331  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:36.129767  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:36.132014  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:36.133113  7178 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:36.136571  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:36.137995 10371 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:36.139098 10371 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:36.140972 10371 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:36.142006  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 1.63603e+06us
I20260709 13:14:36.128132  7346 rpcz_store.cc:276] 0709 13:14:33.640778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.666780 (+ 26002us) service_pool.cc:224] Handling call
0709 13:14:34.020781 (+354001us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b5400187f20. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece92464a5 00007fece92463ee 00007fecee1dc036 00007fecee1e5a3e 00007fece5aa927b 00007fecee1e59ba 00007fecee1e0acc 00007fecee1dbc7b 00007fecee1d08d1
0709 13:14:36.077160 (+2056379us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400191ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a6090 00007fece9244f3a 00007fecee1dc1bb 00007fecee1e5a3e 00007fece5aa927b 00007fecee1e59ba 00007fecee1e0acc 00007fecee1dbc7b 00007fecee1d08d1 00007feced2844b4 00007feced284442
0709 13:14:36.127382 (+ 50222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3432962176}
I20260709 13:14:36.143890  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2426) took 1458 ms. Trace:
I20260709 13:14:36.144374  7181 rpcz_store.cc:276] 0709 13:14:34.685827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.958256 (+272429us) service_pool.cc:224] Handling call
0709 13:14:34.958644 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:35.317958 (+359314us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:35.535612 (+217654us) log.cc:844] Serialized 14 byte log entry
0709 13:14:35.795534 (+259922us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:35.795597 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:35.798219 (+  2622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.110536 (+312317us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b18003d71a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419
0709 13:14:36.143437 (+ 32901us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b5400259254. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:36.143499 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.143710 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11967,"prepare.queue_time_us":389196,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":3271,"raft.queue_time_us":3212,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5700,"spinlock_wait_cycles":830840064,"thread_start_us":456624,"threads_started":2,"wal-append.queue_time_us":312052}
I20260709 13:14:36.146148  7330 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:36.148370  7183 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:14:36.143841  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:36.173270 10435 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:36.181007 10435 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:33.971328  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:35.935957 10865 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:35.966432 10867 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:36.188016  7257 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:36.187147  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 70638.5us
I20260709 13:14:36.206574  7179 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
W20260709 13:14:36.194453  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.182593 10435 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.207317 10879 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:36.196518 10916 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:36.221402  7258 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:36.238265  7186 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:14:36.239028  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.192091  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2446) took 1141 ms. Trace:
I20260709 13:14:36.243485  7180 rpcz_store.cc:276] 0709 13:14:35.050731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.168590 (+1117859us) service_pool.cc:224] Handling call
0709 13:14:36.187822 (+ 19232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:36.188281 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:36.188313 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:36.188379 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:36.188416 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.188479 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.191977 (+  3498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:36.189128 10819 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:36.218753 10867 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:36.240429 10916 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.210219 10552 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:36.203295 10647 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:36.212774 10530 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.197829 10841 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:36.197476 10926 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:36.183820 10618 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.215734 10676 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:36.216077 10813 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:36.208128 10602 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:36.276467 10699 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.271935 10916 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:36.266182 10819 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:36.283712 10907 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:36.348271 10819 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.348876 10907 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:36.349393 10907 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:36.284919  7330 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:14:36.208982 10673 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:36.350790  7330 pending_rounds.cc:85] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 6
I20260709 13:14:36.351140  7330 pending_rounds.cc:107] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:14:36.351402  7330 raft_consensus.cc:2889] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:36.352341  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 485) took 1186 ms. Trace:
I20260709 13:14:36.352741  7330 rpcz_store.cc:276] 0709 13:14:35.165525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.165702 (+   177us) service_pool.cc:224] Handling call
0709 13:14:35.166042 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:36.145549 (+979507us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b58007f4cd0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91980aa 00007fece921a447 00007fece9232fe7 00007fece92347de 00007fece923eb49 00007fece923f416 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4
0709 13:14:36.351989 (+206440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.352273 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1767316864}
I20260709 13:14:36.350512 10907 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.355327 10907 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:36.364683  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.025s	sys 0.022s
I20260709 13:14:36.364940 10826 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:36.365373 10826 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:36.367504  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2606) took 2013 ms. Trace:
I20260709 13:14:36.367965  7256 rpcz_store.cc:276] 0709 13:14:34.354141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.354752 (+   611us) service_pool.cc:224] Handling call
0709 13:14:34.355129 (+   377us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:14:36.053995 (+1698866us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b1800370120. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fece9234060 00007fece9234bfb 00007fece923f64b
0709 13:14:36.054590 (+   595us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:14:36.055246 (+   656us) log.cc:844] Serialized 14 byte log entry
0709 13:14:36.270616 (+215370us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:14:36.287335 (+ 16719us) log.cc:844] Serialized 78 byte log entry
0709 13:14:36.288172 (+   837us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:36.290395 (+  2223us) log.cc:844] Serialized 14 byte log entry
0709 13:14:36.291366 (+   971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.308046 (+ 16680us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:36.367064 (+ 59018us) raft_consensus.cc:1685] finished
0709 13:14:36.367093 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.367282 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":113244,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":89,"raft.queue_time_us":144398,"raft.run_cpu_time_us":601,"raft.run_wall_time_us":17769,"spinlock_wait_cycles":4395392,"thread_start_us":314430,"threads_started":2,"wal-append.queue_time_us":307578}
W20260709 13:14:36.372826 10384 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.014s
I20260709 13:14:36.373436 10384 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.297796 10919 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.304839 10867 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.309791 10892 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.311340 10908 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:14:36.312184 10855 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.315290 10440 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:36.320672  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2431) took 1629 ms. Trace:
I20260709 13:14:36.324163 10530 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.324963 10920 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:36.325626 10676 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.432152 10867 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:36.435011  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:36.436079  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 132545us
I20260709 13:14:36.438742 10552 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:36.440310 10907 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:36.445417 10865 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.366565 10826 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.447970  7150 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:36.448572 10826 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:36.449383  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:36.450886 10884 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:36.451447 10884 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.327046 10853 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:14:36.453734 10884 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.454298 10644 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:36.454888 10644 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:36.455277 10644 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:36.328821 10817 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.329937  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:36.330782  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 194450us
W20260709 13:14:36.331018 10705 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.608s	user 0.018s	sys 0.000s
I20260709 13:14:36.281163 10397 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.330817 10909 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:14:36.333357 10734 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:36.335649 10602 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:36.339291  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.326339 10706 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:36.343374  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:36.345088 10598 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.696s	user 0.007s	sys 0.007s
I20260709 13:14:36.345245 10720 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.345566 10699 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.226933 10871 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.346830 10701 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.381042  7184 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
W20260709 13:14:36.335793  7187 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.023s
W20260709 13:14:36.374949  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 558298us
I20260709 13:14:36.397235 10530 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.471973 10858 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:36.472967 10397 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.402827 10919 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.473694 10530 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.471200 10829 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:36.417436 10384 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.474968  7255 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:36.423208  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:36.475229 10919 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:36.392370  7182 rpcz_store.cc:276] 0709 13:14:34.691001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.995127 (+304126us) service_pool.cc:224] Handling call
0709 13:14:36.114903 (+1119776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:36.118284 (+  3381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.316872 (+198588us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001b3ad0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:36.320584 (+  3712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2573983488}
I20260709 13:14:36.475687  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:36.476266 10701 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.476670  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:36.476718  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:36.477234 10924 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:36.477582  7180 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:36.477885 10924 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:36.426852 10920 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.478323  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:36.430224 10676 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.439254 10552 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:36.465823  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:36.478591  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:36.454385 10884 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:14:36.464548 10705 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:36.471520  7187 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.001s	sys 0.023s
I20260709 13:14:36.471138 10598 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.474350 10871 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.474434 10706 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:14:36.458524  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:36.482196  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 152398us
I20260709 13:14:36.479717 10701 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.489255  7180 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:36.482249 10552 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:36.490136 10908 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:36.491571 10920 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.484336 10909 consensus_queue.cc:1243] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:14:36.507822 10705 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.501364 10532 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.500357 10908 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:36.511737 10879 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:36.512352 10879 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:36.512758 10908 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.513696 10384 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.514219 10908 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:36.514775 10440 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.514345 10384 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.515543  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:36.516527  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:14:36.517441  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.496289 10598 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.518481 10909 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:36.518724  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.466914 10817 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.531487 10909 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.510445 10532 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.529774  7889 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:36.532595 10440 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.535691  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2448) took 1472 ms. Trace:
I20260709 13:14:36.536164  7186 rpcz_store.cc:276] 0709 13:14:35.063061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.122426 (+1059365us) service_pool.cc:224] Handling call
0709 13:14:36.237953 (+115527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:36.244951 (+  6998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.535491 (+290540us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002c4f50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:36.535631 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234605952}
I20260709 13:14:36.537460 10440 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.538529  7887 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:36.539439 10817 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.539538  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2436) took 1847 ms. Trace:
I20260709 13:14:36.540407  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2449) took 1285 ms. Trace:
I20260709 13:14:36.505580 10919 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:36.539978  7187 rpcz_store.cc:276] 0709 13:14:34.692484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.376443 (+683959us) service_pool.cc:224] Handling call
0709 13:14:35.408022 (+ 31579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:35.412121 (+  4099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:35.412157 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:35.412653 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:14:35.750861 (+338208us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:36.484596 (+733735us) log.cc:844] Serialized 14 byte log entry
0709 13:14:36.534491 (+ 49895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.534597 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:36.539359 (+  4762us) raft_consensus.cc:1685] finished
0709 13:14:36.539374 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.539488 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26909,"prepare.queue_time_us":461912,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":27331,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":12586,"thread_start_us":965421,"threads_started":2,"wal-append.queue_time_us":343253}
I20260709 13:14:36.502063 10924 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.540930  7178 rpcz_store.cc:276] 0709 13:14:35.254756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.134049 (+879293us) service_pool.cc:224] Handling call
0709 13:14:36.134596 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:36.135269 (+   673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:36.135319 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:36.265497 (+130178us) log.cc:844] Serialized 26 byte log entry
0709 13:14:36.461576 (+196079us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:36.461632 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.461721 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:36.540210 (+ 78489us) raft_consensus.cc:1685] finished
0709 13:14:36.540228 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.540348 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54193,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":132,"thread_start_us":178133,"threads_started":1,"wal-append.queue_time_us":220082}
I20260709 13:14:36.542438  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:36.543241  7888 raft_consensus.cc:2368] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13.
I20260709 13:14:36.545001  7896 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:36.546533 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d6774062049379248eca324d137c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.547241 10384 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:36.553913  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.553785 10947 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:36.555277 10820 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:36.555738 10820 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:36.521904 10644 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.561571 10909 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:36.556628 10820 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.562865 10820 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.564801  7887 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:36.565320 10552 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.566777  7150 leader_election.cc:400] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13.
I20260709 13:14:36.609843  7150 leader_election.cc:403] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:14:36.559285 10919 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:36.570421  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:36.571488  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:36.614799  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.571926 10676 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:36.618968 10676 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.572510 10814 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.623099  7328 raft_consensus.cc:2955] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:36.573511 10532 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.574622 10637 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.575526  7184 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:36.578565  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:36.627065 10637 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.578945  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:36.628399 10532 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.628564  7887 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 9: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:36.579375 10910 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:36.630585 10910 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.631258 10910 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.579980 10909 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:36.580317 10699 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.580734  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:36.634884 10851 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:36.635390 10851 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:36.621942 10814 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.636493 10851 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.638411 10817 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:36.638898 10817 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:36.639750 10907 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:36.640257 10907 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.640663 10907 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:36.591777  7889 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
W20260709 13:14:36.652508  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 78001.7us
I20260709 13:14:36.587620  7334 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:36.584303  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:36.656747  7327 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:36.596700  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2445) took 1410 ms. Trace:
I20260709 13:14:36.558035  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:36.589519  7299 leader_election.cc:400] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10.
I20260709 13:14:36.664361 10532 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.664862  7299 leader_election.cc:403] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:14:36.665109 10532 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:36.560107  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 416453us
W20260709 13:14:36.611864  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53452.4us
I20260709 13:14:36.666764 10871 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:36.667461 10871 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:36.668323 10871 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:36.667235  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 140009us
W20260709 13:14:36.678027  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.684386 10740 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10.
I20260709 13:14:36.663120  7185 rpcz_store.cc:276] 0709 13:14:35.050386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.772572 (+722186us) service_pool.cc:224] Handling call
0709 13:14:36.131045 (+358473us) spinlock_profiling.cc:243] Waited 962 us on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:14:36.131540 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:36.132061 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:14:36.172537 (+ 40476us) log.cc:844] Serialized 14 byte log entry
0709 13:14:36.395637 (+223100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:36.395728 (+    91us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:36.395807 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.395899 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.460746 (+ 64847us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17961,"prepare.queue_time_us":81039,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":65,"raft.queue_time_us":7277,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"spinlock_wait_cycles":2211712,"thread_start_us":239229,"threads_started":2,"wal-append.queue_time_us":230210}
I20260709 13:14:36.701000  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:36.702008  7185 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:36.726792 10706 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:36.727625 10706 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.678364 10907 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.737067  7327 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:14:36.753719  7335 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:36.755929 10552 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.756127 10939 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:36.756675 10939 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:36.757373  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:36.757607 10939 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.758520  7256 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:36.760627  7260 raft_consensus.cc:2955] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:36.763425 10829 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.763931 10829 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:36.767846 10919 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.773115 10897 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.774451 10699 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.775213 10699 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.777165 10701 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:36.582625 10920 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 13:14:36.815029  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 218395us
I20260709 13:14:36.578613 10644 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.879792  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:36.885699 10602 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.500459 10916 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:36.887583 10949 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.327s	user 0.000s	sys 0.000s
W20260709 13:14:36.896260  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 315571us
I20260709 13:14:36.888019  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:36.902503  7254 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:36.896029 10814 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:36.905092 10673 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.000s
I20260709 13:14:36.910228  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:36.906230  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:36.912329  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:36.912985  7327 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
W20260709 13:14:36.908535  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 319264us
I20260709 13:14:36.914753  7184 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:36.916203  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:36.921003  7253 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:36.893306 10939 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.892761 10851 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.927229  7255 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:14:36.928892 10942 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 13:14:36.928771  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:36.929531  7887 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:36.930294  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:36.930536  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1777) took 1313 ms. Trace:
I20260709 13:14:36.931018  7889 raft_consensus.cc:2368] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14.
I20260709 13:14:36.930895  7183 rpcz_store.cc:276] 0709 13:14:35.616790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.161509 (+544719us) service_pool.cc:224] Handling call
0709 13:14:36.181978 (+ 20469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:36.190375 (+  8397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:36.190413 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:36.191383 (+   970us) log.cc:844] Serialized 52 byte log entry
0709 13:14:36.458051 (+266668us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:36.458105 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:36.458196 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:36.930305 (+472109us) raft_consensus.cc:1685] finished
0709 13:14:36.930324 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:36.930464 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7712,"raft.queue_time_us":7892,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":166,"thread_start_us":266193,"threads_started":1,"wal-append.queue_time_us":305355}
W20260709 13:14:36.935017  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 55374.2us
I20260709 13:14:36.935214  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:36.935856  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:36.936322  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:36.936950 10552 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:36.937505 10865 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:36.938535 10909 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:36.939159 10909 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:36.940124 10909 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.938540 10736 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.942273 10736 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.944425 10736 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.916932 10673 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:14:36.946961  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:36.950722 10865 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:36.948829  7896 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:36.945156  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:36.952070 10916 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.951210  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:36.952730 10435 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:36.953504 10736 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.953928 10793 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33196 (request call id 718) took 4275 ms. Trace:
I20260709 13:14:36.954933 10920 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.955030 10897 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:36.955467 10814 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:36.962008 10819 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.613s	user 0.006s	sys 0.004s
I20260709 13:14:36.956866 10884 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:36.957433  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:36.958989 10705 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:36.958674  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:36.962008 10826 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.004s
I20260709 13:14:36.963332  7262 raft_consensus.cc:2368] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14.
I20260709 13:14:36.963516 10532 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:36.963673 10602 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:36.904626 10871 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:36.966572  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.966162  7334 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:36.972110  7185 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:36.976781  7888 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:36.956069  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:36.978726  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:36.976066 10920 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.986899  7186 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:14:36.987033  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:36.988363  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:36.988540 10920 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:36.988626  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:36.989418  7180 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:36.989337 10814 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:36.985795  7335 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:36.987387 10834 raft_consensus.cc:2955] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:14:36.994612  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.995852  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:36.996484  7185 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:36.974395 10926 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:36.994674  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:36.999078  7327 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:36.973479 10706 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:37.001788  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:37.004308  7182 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:37.011682  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.020483  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:37.021337  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.017163  7259 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:37.032614  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.032966  7178 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:37.033488  7333 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:37.034410  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.034783  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:37.035169  7333 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:37.036005  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.037071  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.037626  7333 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:37.037683 10814 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:37.037827  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:37.038424  7180 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:37.036108  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:37.034364  7178 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:37.032820 10854 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:37.038589  7253 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:37.039649  7254 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:37.041389  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:37.041326 10829 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:37.041837  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:37.042615  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:37.042853  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:37.043346  7254 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:37.043715  7261 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:37.044010  7253 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:37.045814  7179 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:37.038532  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:37.047402  7333 raft_consensus.cc:2368] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13.
I20260709 13:14:37.048532  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.049238  7329 raft_consensus.cc:2368] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13.
I20260709 13:14:37.050056  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.050208  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.053293  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.054757  7333 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:37.004156 10884 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:37.060356 10884 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:37.059355  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.028438 10897 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:14:37.066471 10820 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 13:14:36.980957 10736 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:37.069479 10736 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:37.070744 10867 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.002s
I20260709 13:14:37.073784  7330 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:14:37.074831  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 186996us
I20260709 13:14:37.079888  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:37.081055  7888 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:37.000720 10676 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:37.085243  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:37.112545  7179 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:37.072381 10532 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.113893 10371 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:37.088534  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.115342  7327 raft_consensus.cc:2410] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:37.084444  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.089666  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.115828  7334 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:37.021934 10699 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:37.116052  7336 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:37.095253 10926 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:37.097360  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:37.099874 10829 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:37.103823  7329 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:37.107329  7258 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:37.113814 10532 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:36.975282 10793 rpcz_store.cc:276] 0709 13:14:32.687270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.702982 (+ 15712us) service_pool.cc:224] Handling call
0709 13:14:32.869880 (+166898us) ts_tablet_manager.cc:934] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
0709 13:14:36.524984 (+3655104us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:36.876308 (+351324us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:36.876457 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:36.946123 (+ 69666us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:36.946405 (+   282us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:36.953679 (+  7274us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:36.953810 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8033,"tablet-copy.queue_time_us":96503,"thread_start_us":198644,"threads_started":2}
I20260709 13:14:37.136978  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:37.139497 10905 raft_consensus.cc:2764] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:14:37.142884 10793 tablet_copy_client.cc:806] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:37.143599 10793 tablet_copy_client.cc:670] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
W20260709 13:14:37.144368  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47236.6us
I20260709 13:14:37.145525  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:37.145761  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:37.146492  7259 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:37.147464  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:37.121309  7185 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:36.983314 10819 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:37.077564 10884 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:37.129114  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:37.129899  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.114672 10371 consensus_queue.cc:1243] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:37.093279  7150 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:37.148151  7253 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:37.159675  7301 leader_election.cc:400] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14.
I20260709 13:14:37.171732  7301 leader_election.cc:403] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:14:37.169646 10867 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:14:37.173435  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:37.174367  7889 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:14:37.175071 10819 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:37.174571  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:37.176534  7896 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:37.177954 10884 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:37.180454  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 87374.7us
I20260709 13:14:37.175580  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:37.181694  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.183908 10819 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:37.185240  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:37.181155  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:37.175112  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:37.191323  7894 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:14:37.193900  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 43897us
I20260709 13:14:37.200999  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:37.202169  7891 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:37.203024  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:37.203948  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:37.175611  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:37.205813  7892 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:37.216385  7150 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:37.193336 10701 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13.
I20260709 13:14:37.226504  7178 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:14:37.226799  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:37.227185 10879 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.000s
I20260709 13:14:37.227722 10879 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:37.228263 10820 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:37.231178 10644 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:37.231743 10644 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:37.232015  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:37.232700 10644 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:37.169938 10926 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:14:37.236486 10907 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:37.238232  7255 raft_consensus.cc:2410] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:14:37.227733  7895 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:37.241021  7330 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:37.241252  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:37.193348 10829 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:37.253504  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:37.251396  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:37.240988 10814 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:37.258005  7182 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:37.259580  7187 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:14:37.251053  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:37.251137  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:37.261430  7261 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:37.175994 10676 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:14:37.204453 10736 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.255759  7185 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:37.265800  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:37.266641  7890 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:37.223452 10699 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:37.312494  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.313561  7330 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:37.313922  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 45109.8us
I20260709 13:14:37.335556  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:37.258673 10814 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:37.344630  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:37.262346 10884 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:37.289227 10907 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:37.353463  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:37.354278  7890 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:37.290803 10879 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:37.317646 10676 consensus_queue.cc:1243] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:37.290956 10829 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:37.377723  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:37.382400  7895 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:37.291118 10736 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:37.364260 10920 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.340132 10826 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:14:37.366053 10945 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:14:37.368909 10950 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.421s	user 0.003s	sys 0.000s
W20260709 13:14:37.372524  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.431982 10637 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:37.362958  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:37.385774  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:37.396525  7331 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:37.388242  7333 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:14:37.351052 10907 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.385144 10919 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:14:37.402699  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:37.393447 10813 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:37.365252 10645 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:37.424111  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:37.449733  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 64062.8us
I20260709 13:14:37.450325  7182 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:14:37.450531  7257 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:37.448091  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:37.385915 10910 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:37.452152  7181 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
W20260709 13:14:37.457190  7332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.013s	sys 0.013s
I20260709 13:14:37.429905 10945 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:14:37.460769  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.441854 10871 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:37.443351 10907 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:37.466868  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.468361  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.008s	sys 0.019s
W20260709 13:14:37.477787  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.009s	sys 0.019s
W20260709 13:14:37.478389  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 540188us
W20260709 13:14:37.458554  7332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.013s	sys 0.013s
I20260709 13:14:37.449541 10813 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:37.454468 10645 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.459846 10867 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:37.454974 10908 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:37.472025 10909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.027s	sys 0.054s
I20260709 13:14:37.470309 10532 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:37.440847 10920 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:37.523545  7893 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:37.487969 10813 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:37.495522 10645 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:37.544776  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 57123us
W20260709 13:14:37.511076 10855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.013s	sys 0.018s
I20260709 13:14:37.496753 10867 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.554064  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:37.554791  7184 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:37.541383 10909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.027s	sys 0.054s
I20260709 13:14:37.556865  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:37.543342 10871 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.559414 10867 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:37.559587 10897 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.497861 10829 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:37.621106 10706 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:37.482569 10814 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:37.556252 10855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.013s	sys 0.018s
W20260709 13:14:37.634568 10854 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.001s
I20260709 13:14:37.664696  7261 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:37.663136  7180 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:37.599159 10908 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:37.672375  7335 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:37.667568 10897 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:37.676623 10897 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:37.680035 10740 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.680568 10740 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:37.624282 10871 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:37.728467  7181 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:37.599743 10945 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:37.778106  7329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.018s	sys 0.055s
W20260709 13:14:37.779613  7329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.018s	sys 0.055s
I20260709 13:14:37.787916  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:37.788914  7180 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:37.821791  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:37.792858 10705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.001s	sys 0.054s
W20260709 13:14:37.833841  7150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.016s	sys 0.042s
W20260709 13:14:37.837014  7150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.016s	sys 0.042s
I20260709 13:14:37.804030 10814 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:37.823891 10371 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:37.832484 10705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.002s	sys 0.054s
I20260709 13:14:37.827497 10884 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:37.859454  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:37.855911  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:37.830919 10920 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:37.872010  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.854480  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:37.827772 10637 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:14:37.882797  7262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.000s	sys 0.013s
W20260709 13:14:37.887718  7262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.000s	sys 0.014s
W20260709 13:14:37.889303  7258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.016s	sys 0.020s
W20260709 13:14:37.889830  7258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.017s	sys 0.020s
W20260709 13:14:37.857672 10819 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.017s	sys 0.013s
W20260709 13:14:37.883175 10834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.008s	sys 0.006s
I20260709 13:14:37.900244  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:37.854614 10699 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:37.868918 10701 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:37.910554  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:37.856884 10371 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:37.868188 10926 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:14:37.931404  7890 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.011s
I20260709 13:14:37.934995  7890 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:37.896474 10905 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:37.908342  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:37.913231  7184 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
W20260709 13:14:37.899379 10819 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.017s	sys 0.014s
W20260709 13:14:37.927845 10851 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.959s	user 0.013s	sys 0.007s
W20260709 13:14:37.906064 10834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.008s	sys 0.006s
I20260709 13:14:37.871163 10884 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:37.910244 10897 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:37.901150 10706 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:14:38.057536 10908 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:37.905506 10705 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 13:14:37.940254 10701 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.058722 10851 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:38.063053  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:38.067086 10699 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:38.068032 10910 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.933951 10871 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:37.932742 10602 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:38.074513  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:38.075301  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:38.076026  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:38.077548  7259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.017s	sys 0.029s
I20260709 13:14:38.073117 10897 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:38.088631  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 181327us
I20260709 13:14:38.096917  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:38.097791  7259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.017s	sys 0.030s
I20260709 13:14:38.103049  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 495) took 1518 ms. Trace:
I20260709 13:14:38.094165 10892 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:38.085057 10920 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:38.153379  7182 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.016s	sys 0.015s
W20260709 13:14:38.156003  7182 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.017s	sys 0.015s
I20260709 13:14:38.084867 10826 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.103546  7328 rpcz_store.cc:276] 0709 13:14:36.584753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.584902 (+   149us) service_pool.cc:224] Handling call
0709 13:14:36.585397 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:36.622870 (+ 37473us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:36.718499 (+ 95629us) log.cc:844] Serialized 14 byte log entry
0709 13:14:37.313566 (+595067us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:37.313619 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:37.313666 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.102449 (+788783us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b5400289bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:38.102526 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.102976 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45995,"raft.queue_time_us":46541,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":24917,"spinlock_wait_cycles":97800064,"thread_start_us":376549,"threads_started":1,"wal-append.queue_time_us":763951}
I20260709 13:14:38.193679  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:38.158864  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:38.160429  7335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1659) took 1544 ms (client timeout 2045 ms). Trace:
W20260709 13:14:38.195209  7335 rpcz_store.cc:269] 0709 13:14:36.616142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.990839 (+374697us) service_pool.cc:224] Handling call
0709 13:14:38.160267 (+1169428us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b540013cc54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:38.160371 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495472896}
W20260709 13:14:38.098067 10644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.022s	sys 0.022s
I20260709 13:14:38.096846 10532 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:38.096612 10602 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:38.192042 10440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.010s	sys 0.017s
I20260709 13:14:38.103351 10897 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:38.196557  7184 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:14:38.104796  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:38.199295  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:38.097594 10970 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:38.165313 10908 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:38.198396 10644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.023s	sys 0.023s
I20260709 13:14:38.200556 10532 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:38.186833 10892 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:38.214243 10440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.010s	sys 0.017s
I20260709 13:14:38.207181  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:38.103904 10910 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:38.208943 10959 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
W20260709 13:14:38.209756 10965 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
W20260709 13:14:38.210595 10960 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:14:38.210453  7180 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
W20260709 13:14:38.201200 10957 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:14:38.223737  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:38.224895  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:38.226667  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 121999us
I20260709 13:14:38.165016 10920 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.230501 10963 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:38.192786 10826 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:38.208252 10964 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.277s	user 0.000s	sys 0.000s
I20260709 13:14:38.196097 10958 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:38.264390 10826 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:38.264603 10958 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:38.265738 10958 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:38.267089  7336 raft_consensus.cc:2410] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:38.268079  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 643) took 1024 ms. Trace:
I20260709 13:14:38.244226  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.269178  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:38.269930  7185 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:38.270414  7184 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:38.272094  7184 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:14:38.273293 10867 consensus_meta.cc:287] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.612s	user 0.014s	sys 0.000s
I20260709 13:14:38.273700 10867 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.278327  7185 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:38.283532  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.220733 10905 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:38.218969 10975 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:38.256898  7335 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:38.257375  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:38.212379 10820 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.984s	user 0.005s	sys 0.007s
I20260709 13:14:38.294049  7332 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:38.295334  7183 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:38.322129  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2468) took 1116 ms. Trace:
I20260709 13:14:38.322507  7183 rpcz_store.cc:276] 0709 13:14:37.205655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.283278 (+1077623us) service_pool.cc:224] Handling call
0709 13:14:38.322064 (+ 38786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:38.295936  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:38.323524  7178 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:38.296888 10963 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:38.268904 10972 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:14:38.334484  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.336197  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:38.336894  7181 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:38.298017  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.339789  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:38.341182  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:38.297712 10817 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.343165 10817 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:38.344117  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1672) took 1648 ms. Trace:
I20260709 13:14:38.344609  7327 rpcz_store.cc:276] 0709 13:14:36.695803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.127953 (+432150us) service_pool.cc:224] Handling call
0709 13:14:37.140007 (+ 12054us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:37.140519 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.140554 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:37.141140 (+   586us) log.cc:844] Serialized 52 byte log entry
0709 13:14:37.611094 (+469954us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:37.611141 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.611216 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:38.343893 (+732677us) raft_consensus.cc:1685] finished
0709 13:14:38.343920 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.344057 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2140,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":469519,"threads_started":1,"wal-append.queue_time_us":745918}
I20260709 13:14:38.345700 10884 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:38.346315  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2633) took 1341 ms. Trace:
I20260709 13:14:38.346704  7262 rpcz_store.cc:276] 0709 13:14:37.005190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.005444 (+   254us) service_pool.cc:224] Handling call
0709 13:14:37.028987 (+ 23543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.117648 (+ 88661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.117693 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:37.160959 (+ 43266us) log.cc:844] Serialized 26 byte log entry
0709 13:14:37.888179 (+727220us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:37.888223 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.888293 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:38.346102 (+457809us) raft_consensus.cc:1685] finished
0709 13:14:38.346121 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.346261 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2278,"raft.queue_time_us":2910,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9164,"thread_start_us":626316,"threads_started":1,"wal-append.queue_time_us":1020894}
I20260709 13:14:38.301352  7862 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:38.304301  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 448459us
W20260709 13:14:38.307272 10966 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:14:38.348857 10736 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:38.309978 10892 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.241564 10644 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:38.295872 10701 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:38.325063  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 67787.6us
I20260709 13:14:38.325172 10961 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:38.329499 10371 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:38.347644 10740 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:38.309773  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 660) took 1082 ms. Trace:
I20260709 13:14:38.298951 10970 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:38.228431 10908 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:38.383416  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.350415  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.385425  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.342509  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.268675  7259 rpcz_store.cc:276] 0709 13:14:37.244052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.244183 (+   131us) service_pool.cc:224] Handling call
0709 13:14:37.244583 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.262915 (+ 18332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.262959 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:37.348291 (+ 85332us) log.cc:844] Serialized 26 byte log entry
0709 13:14:38.103746 (+755455us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:38.103873 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.103975 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:38.267752 (+163777us) raft_consensus.cc:1685] finished
0709 13:14:38.267783 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.267998 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9749,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":23838,"thread_start_us":686462,"threads_started":1,"wal-append.queue_time_us":848888}
I20260709 13:14:38.354061  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:38.355391  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.322363 10826 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.355870  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.391901  7185 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:38.316370 10834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54082 (request call id 0) took 5509 ms. Trace:
I20260709 13:14:38.378997  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.323282 10975 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:14:38.381601  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 473528us
I20260709 13:14:38.391191  7180 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:38.395085  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:38.397228  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:38.397486  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:38.352731 10820 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14.
W20260709 13:14:38.359591 10962 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.324s	user 0.001s	sys 0.001s
I20260709 13:14:38.400348  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:38.400180  7183 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
W20260709 13:14:38.403092  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 101773us
I20260709 13:14:38.404484  7334 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:38.408474  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:38.409075  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.410509  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:38.411530  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:38.380820 10961 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.257243 10602 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.412345  7331 raft_consensus.cc:2410] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:14:38.376780 10867 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:38.413868  7254 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:38.378440  7888 rpcz_store.cc:276] 0709 13:14:37.227337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.344022 (+116685us) service_pool.cc:224] Handling call
0709 13:14:37.363800 (+ 19778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.442340 (+ 78540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.442387 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:37.462009 (+ 19622us) log.cc:844] Serialized 26 byte log entry
0709 13:14:37.946074 (+484065us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:37.946120 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.946217 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:38.309477 (+363260us) raft_consensus.cc:1685] finished
0709 13:14:38.309505 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.309665 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43901,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9623,"thread_start_us":466688,"threads_started":1,"wal-append.queue_time_us":773628}
I20260709 13:14:38.383735 10819 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:38.446789 10905 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:38.448369  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:38.448134 10963 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.450788 10637 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:14:38.451915 10813 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.854s	user 0.020s	sys 0.007s
W20260709 13:14:38.452643  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.452332 10813 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:38.453500  7328 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:38.416625  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:38.455291 10644 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:38.455724 10644 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:38.455799 10867 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.455927 10820 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.412366  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:38.456665  7892 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:38.456389 10867 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:38.456498 10820 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.417349  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:38.458542 10974 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.212s	user 0.003s	sys 0.000s
I20260709 13:14:38.459793 10945 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:38.461659 10645 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.860s	user 0.016s	sys 0.000s
I20260709 13:14:38.397670 10975 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:38.463442  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1800) took 1471 ms. Trace:
I20260709 13:14:38.464010 10865 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:38.464444 10865 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:38.464814  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1673) took 1768 ms. Trace:
W20260709 13:14:38.465370 10956 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.795s	user 0.002s	sys 0.009s
I20260709 13:14:38.465322 10865 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.421900  7255 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:38.399745 10826 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.463826  7186 rpcz_store.cc:276] 0709 13:14:36.991844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.999320 (+  7476us) service_pool.cc:224] Handling call
0709 13:14:37.014858 (+ 15538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.071400 (+ 56542us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:14:37.071444 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:37.072078 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:14:37.475832 (+403754us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:37.475902 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.476000 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:38.463245 (+987245us) raft_consensus.cc:1685] finished
0709 13:14:38.463265 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.463387 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13010,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":173,"thread_start_us":403271,"threads_started":1,"wal-append.queue_time_us":833546}
I20260709 13:14:38.465245  7329 rpcz_store.cc:276] 0709 13:14:36.696138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.140647 (+444509us) service_pool.cc:224] Handling call
0709 13:14:37.141108 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.141641 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:37.142014 (+   373us) log.cc:844] Serialized 14 byte log entry
0709 13:14:37.781367 (+639353us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:37.809082 (+ 27715us) log.cc:844] Serialized 26 byte log entry
0709 13:14:37.809287 (+   205us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:37.809341 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.809433 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:38.464573 (+655140us) raft_consensus.cc:1685] finished
0709 13:14:38.464600 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.464740 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":802,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":12606,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":16213,"spinlock_wait_cycles":193920,"thread_start_us":638843,"threads_started":1,"wal-append.queue_time_us":961867}
I20260709 13:14:38.469802  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:38.470598  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:38.471655  7329 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:38.471825 10910 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:38.472579 10867 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:38.471863  7186 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:38.473557  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:38.474562  7329 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:38.476296  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:38.476406  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:38.477000  7331 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:38.378432 10871 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:38.437402 10908 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:38.437808 10943 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:14:38.438025  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.509454  7185 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:38.440515 10970 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:38.441833 10907 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.959s	user 0.015s	sys 0.011s
I20260709 13:14:38.442200 10920 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:38.471017  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:38.511343  7262 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:38.436117  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:38.512369  7335 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:38.357652 10532 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:38.437077  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:38.477923  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:38.478448  7330 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:14:38.466611 10865 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:38.478878  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:38.450469  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:38.480032  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44932.8us
I20260709 13:14:38.456171 10644 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:38.481892  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2466) took 1366 ms. Trace:
I20260709 13:14:38.482168  7181 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:38.521690  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1681) took 1613 ms. Trace:
W20260709 13:14:38.433835  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.484755  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:38.484997  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 644) took 1240 ms. Trace:
W20260709 13:14:38.522540  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.517581  7331 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:38.498096  7178 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:38.525290  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.528462  7888 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:38.521037  7179 rpcz_store.cc:276] 0709 13:14:37.115190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.130601 (+ 15411us) service_pool.cc:224] Handling call
0709 13:14:37.170643 (+ 40042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.191912 (+ 21269us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:37.713447 (+521535us) log.cc:844] Serialized 14 byte log entry
0709 13:14:38.481570 (+768123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:38.481624 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:38.481664 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.481725 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.481834 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":718318,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":44,"raft.queue_time_us":181188,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":1213476,"threads_started":3,"wal-append.queue_time_us":604713}
I20260709 13:14:38.522240  7333 rpcz_store.cc:276] 0709 13:14:36.913614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.057526 (+143912us) service_pool.cc:224] Handling call
0709 13:14:38.515965 (+1458439us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b540013db54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:38.521615 (+  5650us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746551680}
W20260709 13:14:38.505045  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 297978us
I20260709 13:14:38.506443  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:38.422387 10961 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:38.462072 10645 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.519272  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 640) took 1049 ms. Trace:
I20260709 13:14:38.552661  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:38.550882  7187 rpcz_store.cc:276] 0709 13:14:37.469691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.477160 (+  7469us) service_pool.cc:224] Handling call
0709 13:14:37.504136 (+ 26976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.544004 (+ 39868us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:38.077149 (+533145us) log.cc:844] Serialized 14 byte log entry
0709 13:14:38.518806 (+441657us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:38.518882 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:38.518940 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.519026 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.519182 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":395437,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":33651,"thread_start_us":868960,"threads_started":2}
I20260709 13:14:38.553808  7331 raft_consensus.cc:2410] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:38.454519 10813 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:38.554649  7178 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:38.538451  7861 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:38.557348  7862 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:38.558542  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.522537  7258 rpcz_store.cc:276] 0709 13:14:37.245101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.245230 (+   129us) service_pool.cc:224] Handling call
0709 13:14:37.260916 (+ 15686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.290354 (+ 29438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.290388 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:37.344191 (+ 53803us) log.cc:844] Serialized 26 byte log entry
0709 13:14:37.895514 (+551323us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:37.895597 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.895711 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:38.338580 (+442869us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:38.468136 (+129556us) raft_consensus.cc:1685] finished
0709 13:14:38.468156 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.484932 (+ 16776us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":203,"raft.queue_time_us":24035,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":31343,"spinlock_wait_cycles":4133120,"thread_start_us":538586,"threads_started":1,"wal-append.queue_time_us":842252}
I20260709 13:14:38.570676  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:38.573868  7186 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:38.573915  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 95110.4us
I20260709 13:14:38.574990  7299 leader_election.cc:400] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14.
I20260709 13:14:38.574839  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:38.574002  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:38.477430 10820 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:38.578896  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 641) took 1083 ms. Trace:
W20260709 13:14:38.579919  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 129514us
W20260709 13:14:38.580055  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 73756.2us
I20260709 13:14:38.581693  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.582324  7185 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:38.579324  7182 rpcz_store.cc:276] 0709 13:14:37.495394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.496448 (+  1054us) service_pool.cc:224] Handling call
0709 13:14:37.524577 (+ 28129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:37.540555 (+ 15978us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:38.192703 (+652148us) log.cc:844] Serialized 14 byte log entry
0709 13:14:38.578240 (+385537us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:38.578347 (+   107us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:38.578418 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.578609 (+   191us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.578816 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49635,"prepare.queue_time_us":484796,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":21310,"thread_start_us":926930,"threads_started":2}
W20260709 13:14:38.586828  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 273089us
W20260709 13:14:38.588068  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49702.3us
I20260709 13:14:38.590083  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:38.510756 10907 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.603933  7302 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:38.594484  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:38.600651  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:38.606145  7255 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:38.607002  7333 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:38.612097  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.513682 10871 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.569044 10989 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:38.619539  7262 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:38.515019 10991 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:14:38.629233  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:38.586890 10908 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:38.630461  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.585050 10995 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:38.631445  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:38.592137 10943 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:38.631280  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:38.761838  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.773499  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 179427us
I20260709 13:14:38.697904 10637 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:38.751680  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:38.744590 10602 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:38.716692  7186 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:38.772842  7332 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
W20260709 13:14:38.676282  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.694909 10736 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:38.767726 10993 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:38.671587 11001 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.637801 10943 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.702751  7081 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 7 to 9, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 9 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:38.633404 10435 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:14:38.866533 10435 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:38.866951 10435 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:38.867914 10826 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:38.703464 10990 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.703059 10985 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:38.635918 10995 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:38.871371 10995 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:38.588006 10819 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:14:38.632761 10892 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:38.872078 10892 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.874315 10892 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:38.684846  7150 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:38.668030  7256 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:38.671083 10705 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:38.635910  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:38.785421  7335 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:38.716801 10975 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.400884 10834 rpcz_store.cc:276] 0709 13:14:32.806069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.807884 (+  1815us) service_pool.cc:224] Handling call
0709 13:14:32.924752 (+116868us) log.cc:844] Serialized 501 byte log entry
0709 13:14:33.687046 (+762294us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b5400951620. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b5142 00007fece9195eaa 00007fece919cd53 00007fece919ccd9 00007fece919cc69 00007fece919cc31 00007fece919bdfd 000000000038f354 000000000038f199 00007fece614f475
0709 13:14:38.314899 (+4627853us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1078,"raft.queue_time_us":1671,"raft.run_cpu_time_us":10360,"raft.run_wall_time_us":829802,"spinlock_wait_cycles":8654208,"thread_start_us":74103,"threads_started":1,"wal-append.queue_time_us":175011,"wal-append.run_cpu_time_us":2602,"wal-append.run_wall_time_us":1189432}
W20260709 13:14:38.805850  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.854416 10854 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.672277  7327 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:38.637015  7333 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:14:38.807518  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 176315us
I20260709 13:14:38.853684  7255 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
W20260709 13:14:38.855372  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.990077  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.856314  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 104679us
W20260709 13:14:38.864583  7225 connection.cc:256] RPC call timeout handler was delayed by -1.3168442599999253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
I20260709 13:14:38.867786 10435 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:38.740963 10871 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:38.869989 10907 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:38.870955 10990 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:38.617630 10813 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:38.756381  7334 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:14:38.887717  7185 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
W20260709 13:14:38.906210  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 270790us
W20260709 13:14:38.908382  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.012522  7150 leader_election.cc:400] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13.
I20260709 13:14:38.667606  7299 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:38.916769  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 248379us
W20260709 13:14:38.862120 10897 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.002s
I20260709 13:14:38.858973 10993 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:14:38.972826  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 349734us
I20260709 13:14:38.861172 10920 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:38.857857 10908 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:14:38.990993  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.884450 10943 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:38.905369 10867 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:14:39.000768  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 149172us
I20260709 13:14:38.987409 10985 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.001765 10854 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:38.998014 10371 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:39.035465 10371 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.035897 10371 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:39.036609  7081 catalog_manager.cc:5697] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:39.008997 10855 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:39.038527 10993 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:38.859117 10637 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.025554 10907 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:14:39.040338 10644 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:39.041857 10637 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:39.015280  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:39.016088 10989 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:39.017673  7150 leader_election.cc:400] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13.
I20260709 13:14:39.011145  7334 pending_rounds.cc:85] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 5
I20260709 13:14:39.052955  7334 pending_rounds.cc:107] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:14:39.053313  7334 raft_consensus.cc:2889] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:39.023833  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.029678  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:39.033134  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:39.034888 11012 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:38.921749 10705 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:39.059007  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.054073 10740 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:39.060151 10740 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:39.060387  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:39.060702 10705 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:39.060959  7262 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:39.061265 10705 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:39.010905 10813 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.054016 10920 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:39.076540  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65108.2us
I20260709 13:14:39.042570 10532 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:39.046098  7261 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:39.060582 10740 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:39.070281  7255 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:39.025278 10829 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:39.071169  7257 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:39.058148 10820 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.025377 10908 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:39.023037 10871 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.038949 10855 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.109771 10908 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:39.112987 10855 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:39.081038  7260 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:39.042586 10644 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:38.884217 11001 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.090641  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:39.019331 10897 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:39.115063  7185 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:39.059043 11012 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:39.078018 10813 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:39.108698 10820 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.110967  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:39.277252  7178 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:39.210016  7180 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:39.217254  7184 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:39.212847  7329 raft_consensus.cc:2410] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:14:39.192504  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.115758  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:39.230170  7081 catalog_manager.cc:5697] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:39.280612  7182 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
W20260709 13:14:39.147538  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.104619  7262 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:39.090538 10924 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:39.233631  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:39.111344  7084 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47542 (request call id 233) took 18600 ms (client timeout 15000 ms). Trace:
W20260709 13:14:39.248366  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.286288  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:39.287156  7187 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:14:39.106537 10961 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.002s
W20260709 13:14:39.233299  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 155891us
I20260709 13:14:39.078281 10705 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.226960  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.107514 10989 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:39.061595 10985 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.292428  7259 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:39.275462  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 196457us
I20260709 13:14:39.235061 10993 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:39.294353  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.295862  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:39.296222  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:39.274281 10970 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:39.297619  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:39.298574  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.321264  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.108119 11020 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.119300  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 242a63190870450082200759c7f513ab with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 4)
W20260709 13:14:39.299106  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 283897us
I20260709 13:14:39.326295  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:39.297015 10961 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:39.123894 10829 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:39.121268 10371 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:39.331540  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.202263 10871 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:39.329377  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 661778us
I20260709 13:14:39.337119  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:39.305066  7081 catalog_manager.cc:5697] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 5 to 6, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 6 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:39.299407  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:39.342410  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.343304  7260 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:39.321113 10924 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:39.295274 10644 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.348970  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.349700  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:39.324505 10970 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:39.115563 10920 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:39.363369  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:39.350593  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:14:39.347384  7069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 228185us
W20260709 13:14:39.352486  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53193.2us
I20260709 13:14:39.371124  7081 catalog_manager.cc:5697] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 4 to 7, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 7 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.353932  7299 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:39.355314  7253 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:39.355190  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:39.358317  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:39.361400  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:39.363436  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:39.281714 10908 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.374250  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:39.367947  7150 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:39.365218  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:39.373116  7890 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:39.348433 10826 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:39.322700 10989 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:39.375012  7896 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 6: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:39.378327  7889 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:39.379411  7892 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:39.385520  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:39.358444 10736 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:14:39.400949 10995 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.000s
I20260709 13:14:39.374962 11026 raft_consensus.cc:2764] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:14:39.422327  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.332382 11020 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.402732 10871 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:39.367034 10970 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:39.303990 10740 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.403498 10961 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:39.431622  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:39.432822  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:39.403990 10705 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:39.407407 11001 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:39.439755 11026 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:39.409061  7081 catalog_manager.cc:5697] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 2 to 6, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 6 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:39.372848 10644 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:39.286554  7084 rpcz_store.cc:269] 0709 13:14:20.510682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.513912 (+  3230us) service_pool.cc:224] Handling call
0709 13:14:39.111087 (+18597175us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:29.935894 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:30.071080 (+135186us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:30.071133 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:14:30.071154 (+    21us) tablet.cc:662] Decoding operations
0709 13:14:30.073035 (+  1881us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:30.073120 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:30.073147 (+    27us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:14:30.243351 (+170204us) tablet.cc:701] Row locks acquired
0709 13:14:30.252905 (+  9554us) write_op.cc:260] PREPARE: finished
0709 13:14:30.288115 (+ 35210us) write_op.cc:270] Start()
0709 13:14:30.288310 (+   195us) write_op.cc:276] Timestamp: P: 1783602870264725 usec, L: 0
0709 13:14:30.288337 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:14:30.289238 (+   901us) log.cc:844] Serialized 10635 byte log entry
0709 13:14:31.443022 (+1153784us) op_driver.cc:464] REPLICATION: finished
0709 13:14:31.629121 (+186099us) write_op.cc:301] APPLY: starting
0709 13:14:31.629237 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:31.629802 (+   565us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:31.629940 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:31.683146 (+ 53206us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:31.683442 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=27
0709 13:14:31.683472 (+    30us) write_op.cc:312] APPLY: finished
0709 13:14:31.683818 (+   346us) log.cc:844] Serialized 182 byte log entry
0709 13:14:31.684019 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:31.684234 (+   215us) write_op.cc:454] Released schema lock
0709 13:14:31.684322 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:31.716645 (+ 32323us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:31.723585 (+  6940us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":936660,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":145351,"apply.run_cpu_time_us":7228,"apply.run_wall_time_us":74838,"num_ops":27,"prepare.queue_time_us":112117,"prepare.run_cpu_time_us":39933,"prepare.run_wall_time_us":440072,"raft.queue_time_us":354159,"raft.run_cpu_time_us":8051,"raft.run_wall_time_us":201123,"replication_time_us":1093138,"thread_start_us":441619,"threads_started":4,"wal-append.queue_time_us":275656,"wal-append.run_cpu_time_us":77064,"wal-append.run_wall_time_us":2123604}]]}
I20260709 13:14:39.426865  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:39.427896  7260 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:39.390079 10826 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.386893 11012 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:39.433732  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 77041.7us
W20260709 13:14:39.438040  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 70216.2us
I20260709 13:14:39.438360 11034 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:39.439101  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.438951 10924 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.362447 10975 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:39.409498 10736 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.430335 10910 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:39.461529  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:39.464890  7152 leader_election.cc:336] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.500s (SENT)
I20260709 13:14:39.466538  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:39.473721  7152 leader_election.cc:336] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.544s (SENT)
I20260709 13:14:39.474272  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:39.477695  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 88747.4us
I20260709 13:14:39.460337 10826 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:39.466741 11022 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.172s	user 0.001s	sys 0.001s
I20260709 13:14:39.467633 10736 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:39.426483 10995 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.460935 11035 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:39.459774 10990 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:39.489905  7081 catalog_manager.cc:5697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 3 to 6, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:39.494160  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.495039  7260 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:39.497869  7335 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:39.498196  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:39.505081  7334 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:39.506598  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:39.507567  7327 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:39.501646 10644 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:39.511348 10644 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:39.512643 10995 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:39.512784 10644 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:39.453799 11029 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:14:39.515857 10829 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:39.516575 10829 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:39.516942  7330 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:39.518031  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:39.518358 10908 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:39.519373  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.520143  7254 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:39.493492 11035 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:39.522758  7181 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:39.522956 11035 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:39.525974  7330 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:39.526306  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.503381 10897 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:39.526925  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:39.526990  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:39.527624  7330 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:39.528110  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:39.528228  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:39.528466  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:39.529578  7332 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:39.530304  7890 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:39.532480  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:39.533974  7895 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:39.534489  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:39.488883 10820 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:39.539011  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:39.539716  7332 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:14:39.548532  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 163107us
I20260709 13:14:39.549407  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:39.551241  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:39.553642  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:39.558164  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:39.556602  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:39.560159  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:39.560782  7889 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:39.561213  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.561827  7260 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:39.563117  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:39.564086  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.564447  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:39.564710  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:39.554687 10820 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:39.572548  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:39.547452 11029 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:14:39.576241 10908 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:39.576747 10908 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:39.577690 11020 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:39.577595 10908 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.578974 10908 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:39.563004 10995 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:39.585320 10995 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.585683 10995 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:39.551044 10371 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:39.587100  7892 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:39.558956 11024 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:39.588157  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.588611 11024 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.589039 11024 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:39.589465  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:39.590251  7254 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:39.553357 10637 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.590906  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:39.598747  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.599211 10826 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:39.600057  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:39.601102  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:39.601495 10826 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:39.601747  7260 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:39.601785 10532 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.003s
I20260709 13:14:39.602886 10867 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:39.607972 10867 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:39.609032  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2669) took 1042 ms. Trace:
I20260709 13:14:39.609594 10736 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:39.611967  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 2655) took 1223 ms. Trace:
I20260709 13:14:39.612332  7253 rpcz_store.cc:276] 0709 13:14:38.388233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.401558 (+ 13325us) service_pool.cc:224] Handling call
0709 13:14:39.611762 (+1210204us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b5400125054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:39.611887 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061078400}
I20260709 13:14:39.613472  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.603192 10985 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:39.614317  7253 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:39.605747 10865 consensus_meta.cc:287] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.055s	user 0.007s	sys 0.003s
I20260709 13:14:39.605916  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:39.627666  7181 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:39.606242 10637 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:39.591866 10817 consensus_queue.cc:1175] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" responder_term: 12 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:39.604444 11031 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:14:39.547401 10990 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:14:39.570930  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:39.618556  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:39.552975 10905 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:14:39.609463  7258 rpcz_store.cc:276] 0709 13:14:38.566858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.637593 (+ 70735us) service_pool.cc:224] Handling call
0709 13:14:38.690817 (+ 53224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:39.061836 (+371019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:39.061862 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:39.061899 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:39.061925 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.608820 (+546895us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54002166d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:39.608863 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.608977 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852826496}
W20260709 13:14:39.639617  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 159701us
I20260709 13:14:39.637182  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:39.547010 10970 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:39.615542  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:39.664995  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 94136.8us
I20260709 13:14:39.560184 10897 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:14:39.671080  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.625337 10676 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:39.591903 10961 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:14:39.735180  7183 raft_consensus.cc:2410] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:14:39.756078  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:39.809402  7260 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6.
I20260709 13:14:40.060053  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:40.061632  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 497224us
I20260709 13:14:39.769093  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:40.063572  7254 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:40.063760  7256 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:39.770607  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.063632  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:39.677549  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.696985 11025 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.066841  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:40.067577  7258 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:39.864316  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:40.067375 11025 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:40.068511  7261 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:40.069463  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.062548  7336 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9. Ops: []
W20260709 13:14:40.061954  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 322675us
I20260709 13:14:39.766748  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:39.647838 10602 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:39.747176  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.821136  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.071794  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.077975  7260 raft_consensus.cc:2368] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11.
W20260709 13:14:39.900879  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.763872  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.075464  7253 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:40.080641  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 316853us
I20260709 13:14:39.672187 10985 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:14:39.931762 10813 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.001s
I20260709 13:14:40.073055  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:40.076761  7152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.000s	sys 0.014s
I20260709 13:14:40.083290 10905 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:14:40.083583  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.097271  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:40.097450  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.095942  7256 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:39.858477 10854 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.129531  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.086608  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.087136  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:40.059918 10736 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:40.090678  7889 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:40.131853  7261 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:39.734280 10943 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
I20260709 13:14:39.673852 10865 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:39.762132 11012 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.009383 11040 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.678845 10532 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:39.871551 10705 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:14:40.095938  7152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.015s
I20260709 13:14:40.099061  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.099210  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.099836  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.084800 10988 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:40.120653  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:40.120761  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:40.150017  7893 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:40.121119 11037 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:40.074186 11034 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:40.080456 11035 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.553s	user 0.005s	sys 0.005s
I20260709 13:14:40.065090 10989 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:39.995510 10970 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:40.121593  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:40.128378  7150 connection.cc:256] RPC call timeout handler was delayed by -1.1609725089999756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260709 13:14:40.129750  7892 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:40.159710  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.160466  7255 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:40.124668  7332 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:14:40.134464  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.125133  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:40.074278 11025 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:40.162256  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 688518us
I20260709 13:14:40.163039  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:40.163164  7152 leader_election.cc:336] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.606s (SENT)
I20260709 13:14:40.140010  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.164312  7261 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:40.164932  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.165082  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.096077 10985 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:40.142942  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.166756  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:40.167129 10602 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:40.167411  7256 raft_consensus.cc:2376] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 6. Re-sending same reply.
I20260709 13:14:40.167588 10602 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.168030 10602 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:40.168393  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.169567  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:40.126657 11024 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.001s
I20260709 13:14:40.170763 11024 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.171496  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:40.098170 10813 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.177518  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:40.145802 10532 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.145952  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.144697  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.146649  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.126963 10637 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.076835 10676 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.142210 10943 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:40.141768 11026 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:40.142079 10993 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:40.088330  7895 pending_rounds.cc:85] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 6
I20260709 13:14:40.170775 10996 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.141606 10865 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:40.126091 10867 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 13:14:40.161072  7332 pending_rounds.cc:85] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 7
I20260709 13:14:40.224118  7332 pending_rounds.cc:107] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:14:40.223945  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.224516  7332 raft_consensus.cc:2889] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:40.173861  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.175225  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:40.175916  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:40.226507  7255 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:40.170615  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.177122  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.227309  7179 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:40.161834 11037 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:40.178244  7186 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:40.178920  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.302963  7888 raft_consensus.cc:2368] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:40.303442  7181 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:40.207809  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.207998  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.304212  7187 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:40.195700  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.155354  7258 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:40.207505  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:40.214092  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:40.182370  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.306141  7260 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:40.216158  7335 raft_consensus.cc:2368] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
I20260709 13:14:40.172688 10740 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:40.327775  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.328617  7258 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:40.161345  7254 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:40.219012  7895 pending_rounds.cc:107] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:14:40.329185  7895 raft_consensus.cc:2889] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:40.158959 11034 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:40.172698 10985 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:40.148387 11040 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.341183 11040 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:40.180576 10970 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:40.191874 10820 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:40.345393 10820 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:40.346932 11053 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:14:40.348418 10820 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.189811 10532 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:40.351292 11052 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:14:40.228255 10865 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.355440 10865 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:40.356704 11054 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:14:40.223637 10988 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.231608  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.359171  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.359727  7332 raft_consensus.cc:1813] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Handling vote request from an unknown peer 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:40.232682  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.214437 10645 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.233692  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:40.346168 11057 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:14:40.271790 11045 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:14:40.225266  7182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d6277156300462b934adab718a32e44"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:14:40.368302  7182 raft_consensus.cc:606] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.368718  7182 raft_consensus.cc:614] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:40.272078 10813 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.272426 10905 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.218930 10993 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:40.233170 10867 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.279923 11048 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:40.280437  7179 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
W20260709 13:14:40.282356  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 107207us
I20260709 13:14:40.365159 11024 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:40.289086  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.296907  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:40.399024  7328 raft_consensus.cc:2368] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10.
I20260709 13:14:40.188004 10910 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.399924  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.399966 10910 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.330739  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:40.329960 10637 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:14:40.336390  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.408108  7327 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:40.337014  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.337468 11034 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:40.360337  7332 raft_consensus.cc:2410] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:14:40.363670  7261 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:40.124260 10995 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:14:40.358301 10705 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:40.369323  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 286260us
W20260709 13:14:40.370136  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 191399us
I20260709 13:14:40.374377  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:40.413157  7152 leader_election.cc:336] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.642s (SENT)
I20260709 13:14:40.371726  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:40.376425  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.414250  7255 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
W20260709 13:14:40.380082  7259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 2661) took 1989 ms (client timeout 1748 ms). Trace:
I20260709 13:14:40.414710  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:40.414932  7259 rpcz_store.cc:269] 0709 13:14:38.390245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.400027 (+  9782us) service_pool.cc:224] Handling call
0709 13:14:40.377253 (+1977226us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54002170d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:40.379982 (+  2729us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034215296}
I20260709 13:14:40.388779  7896 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:40.390105  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:40.281502  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:40.397131  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 265647us
W20260709 13:14:40.397544  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 119604us
I20260709 13:14:40.400770  7328 raft_consensus.cc:2410] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:14:40.235281 10996 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.401284  7185 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:40.417973  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.162503 11035 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.301230 10602 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.408722  7260 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:40.390748 10993 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:40.335312 11026 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:40.431430  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 59775.6us
I20260709 13:14:40.413656  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.415505  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.428555  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.433656  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.416599  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:40.358297 10988 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:40.418881  7258 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:14:40.419363  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:40.391063 10905 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:40.482802  7328 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:40.484876  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52718.6us
I20260709 13:14:40.484941  7261 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:40.419065 10705 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:40.489622  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:40.503376  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.504241  7328 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:40.501796  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:40.505964  7255 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:40.507040 11060 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:14:40.508412 11026 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.418882 11037 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.517737 10996 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.418350 10995 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:40.519481  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.520490  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:40.520617 10867 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.521870  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:40.529414  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.522543  7258 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:40.548326 10435 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:40.522848 11046 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:14:40.552306  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 754) took 1004 ms. Trace:
I20260709 13:14:40.552573  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 505) took 1038 ms. Trace:
I20260709 13:14:40.552726  7888 rpcz_store.cc:276] 0709 13:14:39.548112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.549658 (+  1546us) service_pool.cc:224] Handling call
0709 13:14:40.552096 (+1002438us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b5400563e54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:40.552244 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539187968}
I20260709 13:14:40.553640 10532 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.554793 10676 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.553298  7331 rpcz_store.cc:276] 0709 13:14:39.513823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.518762 (+  4939us) service_pool.cc:224] Handling call
0709 13:14:39.519066 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:39.519387 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:39.519413 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:39.519841 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:14:39.907799 (+387958us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:39.931239 (+ 23440us) log.cc:844] Serialized 14 byte log entry
0709 13:14:39.931968 (+   729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.932071 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:40.552293 (+620222us) raft_consensus.cc:1685] finished
0709 13:14:40.552336 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.552497 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":754,"prepare.queue_time_us":23296,"prepare.run_wall_time_us":43,"raft.queue_time_us":15925,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":3656,"spinlock_wait_cycles":3477248,"thread_start_us":387599,"threads_started":1,"wal-append.queue_time_us":843303}
I20260709 13:14:40.558513  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.560006  7254 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:40.560493  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.557906 10970 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:40.496182  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.519495 10943 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:40.493764  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:40.558547  7225 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.132:39125 timed out after 2.204s (SENT) [suppressed 33 similar messages]
W20260709 13:14:40.568483  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 74842.8us
I20260709 13:14:40.568638  7255 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
W20260709 13:14:40.501013  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 80813.5us
I20260709 13:14:40.523969 11040 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:40.569442  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:40.410840 10989 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:14:40.571077  7331 raft_consensus.cc:2368] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11.
I20260709 13:14:40.566022  7332 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:40.572080  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:40.572835  7332 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:40.573441  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:40.487425  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 72840.5us
I20260709 13:14:40.574471  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:40.567113  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:40.570211  7150 leader_election.cc:400] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10.
I20260709 13:14:40.488413 10908 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:40.488757  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:40.564989  7861 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:40.575405  7150 leader_election.cc:403] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:14:40.581058  7150 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:40.581280  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:40.488871 11025 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:40.575873  7328 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:40.502719 11012 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:40.523765 11055 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:14:40.524471 11043 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:14:40.583734  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:40.531883 10910 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:40.483544  7137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52260.7us
I20260709 13:14:40.575224  7332 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:40.583705  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.520490 10995 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.533334 10988 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.614176  7332 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:14:40.591150  7261 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:14:40.576892  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.596434  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:40.616987  7179 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 7.
I20260709 13:14:40.603367  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:40.618079  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:40.609767  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.619110  7180 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:40.579793 10908 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.612493  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:40.585142  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.623627  7182 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.618192  7178 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:40.612493 10834 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:40.598371 11012 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.634495 11012 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:40.628082 10908 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:40.634953  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:40.635608  7260 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:40.635763  7225 connection.cc:256] RPC call timeout handler was delayed by -1.1088485969999056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:14:40.636153  7225 connection.cc:256] RPC call timeout handler was delayed by -1.0764485969998532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 13:14:40.418584 11042 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 13:14:40.584617 10867 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:40.611413  7185 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 9: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:40.608736  7258 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:40.620473  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:40.625823 11062 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:14:40.644161  7261 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:40.593447  7256 raft_consensus.cc:2368] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:40.633665 11035 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:40.598330 10676 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:40.636489  7225 connection.cc:256] RPC call timeout handler was delayed by -1.0548485970000456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 13:14:40.619041  7328 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:40.677776  7225 connection.cc:256] RPC call timeout handler was delayed by -1.0305485970000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:14:40.677876 10676 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:40.678251  7225 connection.cc:256] RPC call timeout handler was delayed by -1.0305485970000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:14:40.678558  7225 connection.cc:256] RPC call timeout handler was delayed by -1.0116485969999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:14:40.678857  7225 connection.cc:256] RPC call timeout handler was delayed by -1.0116485969999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:14:40.668232 10996 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:40.679237  7225 connection.cc:256] RPC call timeout handler was delayed by -1.0098485969999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 13:14:40.679558 10996 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.681559  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:40.655566  7182 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:40.655699  7180 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:40.638427  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:40.683070  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44733.5us
I20260709 13:14:40.678880 10676 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.683920  7302 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:40.684147  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:40.685245  7302 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:40.686133  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:40.681695 10996 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.686208 10892 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:40.594508 10637 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:14:40.691154  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:40.697022  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 283867us
I20260709 13:14:40.668196  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.624248 10970 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:40.700379  7185 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:40.700380  7152 leader_election.cc:336] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.682s (SENT)
I20260709 13:14:40.629000 10371 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:40.705530  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.706789  7328 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:40.639153 10834 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:40.673143 11043 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:14:40.710330  7258 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:40.717897  7260 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:40.720621  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:40.721632  7180 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:40.667302 10867 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.686951 10871 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:40.691630 11040 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:40.728009  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:40.621649 10985 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:40.703255 11065 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:40.702831 10995 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:40.708009 10910 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:40.740442  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:40.720124 10834 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:40.750939  7187 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:40.744403  7185 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:14:40.751606  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51264.2us
W20260709 13:14:40.752666  7152 leader_election.cc:336] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.930s (SENT)
I20260709 13:14:40.753136  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.725557 10740 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:40.752756  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:40.729144 10867 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:40.758422  7890 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:40.725118 11023 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:40.691677 11034 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.729002 11040 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:40.736460 11065 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.736624 10602 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.763423  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 498) took 1273 ms. Trace:
W20260709 13:14:40.780616  7152 leader_election.cc:336] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.994s (SENT)
I20260709 13:14:40.789157  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.769402 10993 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:40.772526 10908 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.791991 10813 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.741123 10371 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:40.785142  7181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:14:40.793578  7181 raft_consensus.cc:606] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.793968  7181 raft_consensus.cc:614] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:40.792121 10908 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.744280 10995 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.757901 10910 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:40.761029 10854 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:40.817126 10854 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.817687 10854 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.787900  7336 rpcz_store.cc:276] 0709 13:14:39.490217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.490365 (+   148us) service_pool.cc:224] Handling call
0709 13:14:39.497249 (+  6884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.070043 (+572794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.763174 (+693131us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400421b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:40.763369 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299634944}
W20260709 13:14:40.803035  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 116957us
I20260709 13:14:40.763032 10740 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:40.815164 10995 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:40.782971 11040 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.778424 10970 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:40.787089 11065 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:40.830370  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2680) took 1211 ms. Trace:
I20260709 13:14:40.783766 11048 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:40.792955 10813 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:40.837571  7892 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:14:40.841954  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 411462us
I20260709 13:14:40.834676 10532 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:40.851151  7330 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:40.835258 10998 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:14:40.852200  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 71617us
I20260709 13:14:40.859093  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:40.844107  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:40.859400  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 282621us
I20260709 13:14:40.834730  7254 rpcz_store.cc:276] 0709 13:14:39.619399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.561243 (+941844us) service_pool.cc:224] Handling call
0709 13:14:40.593979 (+ 32736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:40.594234 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:14:40.614954 (+ 20720us) log.cc:844] Serialized 14 byte log entry
0709 13:14:40.830012 (+215058us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:40.830069 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:40.830108 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.830172 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:40.830301 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67046,"prepare.queue_time_us":26402,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":132,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":214615,"threads_started":1}
I20260709 13:14:40.786517 11042 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:14:40.866519  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.854967  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:40.858711 11093 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:40.831657 10905 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:40.771602 11073 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.249s
I20260709 13:14:40.871160  7185 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:40.838581 10985 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:40.868893 11078 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:40.840945 10993 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:40.834263 11075 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:40.839915 10371 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:40.878316  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:40.879614  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:40.882368  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.838832 11072 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10.
I20260709 13:14:40.859576 11024 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:40.893707  7329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1613) took 2605 ms (client timeout 2168 ms). Trace:
I20260709 13:14:40.865633 10440 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:40.894315  7329 rpcz_store.cc:269] 0709 13:14:38.281793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:38.475998 (+194205us) service_pool.cc:224] Handling call
0709 13:14:40.887276 (+2411278us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54001b8d54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:40.887457 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1691036928}
I20260709 13:14:40.865614 10740 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.871955 10910 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:40.871199 10908 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:40.903183  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.908754  7185 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.909731  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.914392  7180 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:40.871486 10998 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:40.873997 10637 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:40.919814  7299 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.923880  7332 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:14:40.886847 11061 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:40.889215 11078 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:40.946564  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:40.947083  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:40.947382  7186 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:40.951190  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 107160us
W20260709 13:14:40.944151 10865 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.588s	user 0.013s	sys 0.001s
I20260709 13:14:40.955821  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:40.878036 11012 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:40.891101 10905 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:14:40.895547 11042 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:14:40.918118 10435 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:40.936409 10793 tablet_copy_client.cc:538] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:40.954785  7185 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:40.944700 10637 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.919106 11093 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:14:40.961694  7152 connection.cc:256] RPC call timeout handler was delayed by -1.3964497009999377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 13:14:40.962481  7180 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:40.917338 10985 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:14:40.969386  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:40.970852  7152 connection.cc:256] RPC call timeout handler was delayed by -1.3928497009999319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
I20260709 13:14:40.972558  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 497) took 1490 ms. Trace:
I20260709 13:14:40.917649 11024 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:40.973941  7334 rpcz_store.cc:276] 0709 13:14:39.484875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.489357 (+  4482us) service_pool.cc:224] Handling call
0709 13:14:40.972389 (+1483032us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b540016c1d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:40.972502 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13819136}
W20260709 13:14:40.979626  7152 leader_election.cc:336] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.731s (SENT)
I20260709 13:14:40.980068  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:40.975102  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 55420.7us
I20260709 13:14:40.929744 10854 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:40.961807 11083 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:14:40.978127  7888 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:41.028399  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 59114.7us
I20260709 13:14:41.032831  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:41.027372  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:40.973093 10602 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:41.029381  7186 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:40.970328 10637 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.034546  7180 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:40.977154 11091 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:14:40.970680 11093 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:41.038977  7334 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:41.039788  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:41.029531 10985 consensus_queue.cc:1243] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:14:41.027451 10865 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:41.065668  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 91667.5us
W20260709 13:14:41.070302  7152 leader_election.cc:336] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.769s (SENT)
I20260709 13:14:41.070698  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:41.066188  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:41.066318  7329 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:41.065052  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 337458us
I20260709 13:14:41.031850 11034 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:41.038441 10435 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:41.073774  7180 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:41.073911  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:40.955655 11048 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.078804  7299 leader_election.cc:400] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
I20260709 13:14:41.079262  7299 leader_election.cc:403] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:14:41.080940 11098 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:14:41.077749 10435 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:41.081843 11096 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:14:41.081929 10813 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:41.082378  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.036849 11078 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.082998 11086 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:14:41.083487 11087 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:14:41.083902 11094 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:14:41.084263 10602 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:41.084544  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:41.085191 10532 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:41.085640 11079 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:14:41.069232 10910 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:41.087599 10865 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:41.159057 11012 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:41.104424 11065 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.131042 11093 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.159659  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 513) took 1635 ms. Trace:
I20260709 13:14:41.149696 10910 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.160216  7330 rpcz_store.cc:276] 0709 13:14:39.524474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.528259 (+  3785us) service_pool.cc:224] Handling call
0709 13:14:41.159446 (+1631187us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001f4fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:41.159581 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3017800448}
I20260709 13:14:41.146889 11104 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:41.161361 11065 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:41.106791 10435 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:41.111178  7262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1551) took 1781 ms (client timeout 1928 ms). Trace:
W20260709 13:14:41.164109  7262 rpcz_store.cc:269] 0709 13:14:39.329452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.331313 (+  1861us) service_pool.cc:224] Handling call
0709 13:14:41.110967 (+1779654us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54002d4454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:41.111116 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675812096}
I20260709 13:14:41.073732 11103 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:41.165328 11103 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.166905  7336 raft_consensus.cc:2368] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
W20260709 13:14:41.107906 11097 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:14:41.167618 11103 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:41.098304  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:41.116061 11075 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:41.139341 10854 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:41.141070 11028 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.654s	user 0.003s	sys 0.000s
I20260709 13:14:41.181679  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:41.142128 10705 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.001s
W20260709 13:14:41.142319 11077 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.283s	user 0.006s	sys 0.003s
W20260709 13:14:41.142849  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 58378.5us
I20260709 13:14:41.159163 11078 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:41.146574 10975 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:41.147091 11091 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:41.069445 10998 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.147215 10532 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:41.150978 10995 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:41.151301  7183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 659) took 1585 ms (client timeout 1788 ms). Trace:
W20260709 13:14:41.199208  7183 rpcz_store.cc:269] 0709 13:14:39.565825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.565970 (+   145us) service_pool.cc:224] Handling call
0709 13:14:41.151105 (+1585135us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400385c54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:41.151243 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329466112}
I20260709 13:14:41.154112 10637 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.149336 10820 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:41.160883 10910 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.169114  7861 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:41.074429 11027 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:14:41.176057  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 77879.9us
I20260709 13:14:41.184401  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.184481  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:41.145666 10867 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.181015 11065 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:41.194866 11040 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.188536 10975 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:41.214476 10532 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.216378 10975 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.212675 10371 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:41.217758 10371 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.219408  7187 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:41.220319 10867 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:41.221733  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 667) took 1129 ms. Trace:
I20260709 13:14:41.222328  7890 rpcz_store.cc:276] 0709 13:14:40.092157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.092407 (+   250us) service_pool.cc:224] Handling call
0709 13:14:41.221505 (+1129098us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54000bc7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:41.221650 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518338304}
I20260709 13:14:41.217787 10975 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.225869 11093 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:41.185463 10705 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.226960  7893 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:41.227053  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1558) took 1648 ms. Trace:
I20260709 13:14:41.227370  7893 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:41.212703 10905 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:41.228677 10905 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:41.227492  7257 rpcz_store.cc:276] 0709 13:14:39.578542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.556419 (+977877us) service_pool.cc:224] Handling call
0709 13:14:40.556766 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:40.557113 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.557139 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:40.557692 (+   553us) log.cc:844] Serialized 52 byte log entry
0709 13:14:40.703273 (+145581us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:40.724081 (+ 20808us) log.cc:844] Serialized 14 byte log entry
0709 13:14:40.724316 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.724432 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:41.223793 (+499361us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b1800365080. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:14:41.226743 (+  2950us) raft_consensus.cc:1685] finished
0709 13:14:41.226859 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:41.226997 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35806,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3282,"raft.queue_time_us":33134,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":5204,"spinlock_wait_cycles":10801408,"thread_start_us":145170,"threads_started":1,"wal-append.queue_time_us":204918}
I20260709 13:14:41.229565 10905 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.230293  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:41.232517 11025 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:41.233055 11025 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:41.233390 11024 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:41.215360 11040 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:41.243690  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:41.216883 11023 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:41.221791 10995 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:41.228178  7893 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.213771 10637 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:41.248333  7334 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:41.249030  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:41.202955  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 132680us
W20260709 13:14:41.250366  7152 leader_election.cc:336] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.797s (SENT)
I20260709 13:14:41.185920 10908 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:41.244396  7890 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:14:41.248090  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:41.251492  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:41.252916  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:41.255204  7328 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:41.256729  7893 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:41.237152 11061 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:41.257169  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:41.257685  7152 leader_election.cc:336] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.853s (SENT)
I20260709 13:14:41.259919  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:41.262869  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:41.245977 11023 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:41.270223  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 60565.6us
I20260709 13:14:41.270871 11048 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.271849 11110 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:41.272420 11107 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.233971 11025 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.280665 10435 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.283345  7336 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 12: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:41.219856 10371 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:41.275395  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:41.286062  7225 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:41.274507  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:41.277684  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:41.266448 10834 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 13:14:41.279243 11048 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.280022 11107 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.276422 11110 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.291173 10705 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:41.291396 10924 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:41.291756 10793 tablet_bootstrap.cc:492] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:14:41.291839 11091 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:41.293602  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:41.294448  7152 leader_election.cc:336] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.928s (SENT)
I20260709 13:14:41.311125  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:41.311478  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:41.258936 11061 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:41.273469 11040 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:41.258788 11012 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:14:41.303448  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:41.307502  7187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:14:41.307600  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:41.307883  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:41.303262 11110 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:41.314436  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:41.314363  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:41.315124  7893 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:14:41.314564  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:41.314342  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:41.322500  7887 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:41.322432  7181 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:41.308141 10988 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.307106 10897 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:41.299803 10637 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:41.326481 11024 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:41.327399  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.327787 11107 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:41.327965  7180 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:41.329108 10819 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:14:41.322979 10975 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:41.317384 10908 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.332772 10910 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:41.333514  7896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 536) took 1929 ms (client timeout 1760 ms). Trace:
W20260709 13:14:41.333914  7896 rpcz_store.cc:269] 0709 13:14:39.404546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.411349 (+  6803us) service_pool.cc:224] Handling call
0709 13:14:41.333346 (+1921997us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b5400641754. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:41.333452 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068395392}
I20260709 13:14:41.335074  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1689) took 1236 ms. Trace:
I20260709 13:14:41.334653 11023 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.335469  7335 rpcz_store.cc:276] 0709 13:14:40.098763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.131698 (+ 32935us) service_pool.cc:224] Handling call
0709 13:14:41.334881 (+1203183us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b540025c454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:41.335016 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81726848}
I20260709 13:14:41.336005 11023 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:41.317061  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:41.299129 10706 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:14:41.309055  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:41.319442  7187 raft_consensus.cc:606] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:41.341536  7186 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:41.319181  7185 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:41.302510 10998 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.326081 10705 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:41.326205 10924 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:41.326809 10637 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.316501  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:41.301288 10865 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:14:41.340767  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.322914 10435 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:41.313598 10892 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:14:41.341588  7187 raft_consensus.cc:614] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:41.316401 11061 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:41.321931  7892 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:41.301990 10834 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.367554 10998 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.369258 10705 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:41.367185 10637 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:41.350898  7180 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:41.318578 11104 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8.
W20260709 13:14:41.354197  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 59769.9us
I20260709 13:14:41.363070  7182 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9. Ops: []
W20260709 13:14:41.361312  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 67778.7us
I20260709 13:14:41.319096 11091 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:41.390594  7152 leader_election.cc:336] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.932s (SENT)
I20260709 13:14:41.391101  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:41.370756  7893 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:14:41.395056  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.347414 10988 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.372375 10924 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:41.436605  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:41.438987  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48429.1us
W20260709 13:14:41.439961  7152 leader_election.cc:336] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.971s (SENT)
I20260709 13:14:41.443923  7182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:14:41.444535  7182 raft_consensus.cc:606] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:41.444968  7182 raft_consensus.cc:614] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:41.445446  7152 leader_election.cc:336] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.045s (SENT)
I20260709 13:14:41.446801  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:41.447678  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.448339  7187 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.450203  7862 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:41.396556 10910 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:41.435751 10975 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:41.454262  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:41.455879 11025 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:41.456458 11025 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:14:41.456663 11118 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:14:41.456933  7152 leader_election.cc:336] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.768s (SENT)
I20260709 13:14:41.457458 11025 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.458467 10924 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.462740 10998 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:41.463868 11117 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:14:41.466313  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:41.470036  7187 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:41.473172  7330 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
W20260709 13:14:41.474148  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 166728us
I20260709 13:14:41.475133  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:41.453045 10985 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:41.435993 11119 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:14:41.479478 11099 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:41.480962  7862 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:41.484318  7180 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:41.451004 11012 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:41.490967  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.493320 10988 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:41.437484 10897 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:14:41.486570 10705 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.487454 10985 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:41.501255 11119 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:41.501333 10985 raft_consensus.cc:697] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:41.502590 10985 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.503068 10706 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:41.504088 10706 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:41.504438 10706 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:41.505285 10706 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.489778 10637 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:41.498490  7152 leader_election.cc:336] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.203s (SENT)
I20260709 13:14:41.507995  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:41.508287  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:41.506412 10706 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:41.513825 11048 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:41.490244 11061 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.519170  7187 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:14:41.494995 10926 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:41.393298 11091 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.524111  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:41.496150 10834 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:41.538908  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:41.534212  7329 raft_consensus.cc:2410] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:14:41.482113 10991 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:14:41.518544 10975 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:41.536774 11023 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:41.551051 11023 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:41.551887 10637 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:41.552486 11061 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:41.553102 11061 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:41.554028 11061 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:41.555025  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:41.555657  7329 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:41.559518 11061 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:41.560061 11061 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:41.525388 10926 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:41.543918 10897 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:41.561053 11061 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.585196 11061 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:41.584508 10926 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.565336 11119 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:41.586498 10926 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:41.565177 11121 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:14:41.591334  7301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.006s	sys 0.007s
W20260709 13:14:41.592963  7301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.007s	sys 0.007s
W20260709 13:14:41.593703  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 646640us
I20260709 13:14:41.566020 10924 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:14:41.587845 10897 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:41.595171 11121 consensus_queue.cc:1243] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:41.614702 10826 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.615355 10826 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.617605 10826 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:41.619122 11119 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:41.622143  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.606820 10736 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.623504 10736 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.625912  7329 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:41.626047 10736 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:41.627864  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.627566 10897 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.603111 11104 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:14:41.636062  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.637398  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.637981  7187 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:41.638602  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.640286  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.641149  7180 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 8: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:41.641301  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.642275  7253 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:41.643764  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.645031  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.599191 10705 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.640204  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.647020  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.648180  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.656009  7181 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.649466  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.657279  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:41.658064  7182 raft_consensus.cc:2410] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:14:41.650178  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:41.661233  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:41.661427  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.661835  7179 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:41.667486  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.668656  7187 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:41.668587  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.671288  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.671909  7180 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.671304  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.684702  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:41.691720  7180 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:41.692739  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:41.693643  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:41.694690  7152 leader_election.cc:336] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.221s (SENT)
I20260709 13:14:41.694578  7181 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:41.696492  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:41.697932 11024 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:41.698446 11024 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:41.698742  7302 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:41.699328 11024 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.701331 10998 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:41.701896 10998 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:41.702440 11065 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:41.702767 10998 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.703262 11065 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:41.704483 11065 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.695449 10996 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:41.709098  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.717070  7254 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:41.717409  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.717696  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.664600 10705 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.707244 10996 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.734511  7260 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:41.737404  7259 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:41.737803  7259 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:41.709169 11110 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.740293  7259 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.736709 10996 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.748414  7259 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:41.754945  7152 leader_election.cc:336] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.284s (SENT)
I20260709 13:14:41.755457  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:41.756646 10371 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:41.760046  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 221199us
I20260709 13:14:41.761214  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:41.761241 11124 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:14:41.763748  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:41.758956 11070 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.126s	user 0.000s	sys 0.004s
I20260709 13:14:41.769850  7329 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:41.770861 10706 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:41.770529  7225 leader_election.cc:400] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11.
I20260709 13:14:41.769941  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.773695  7225 leader_election.cc:403] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:41.781431  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:41.783002  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.783285  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:41.783838  7180 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:41.763132 11119 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:41.795102  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:41.796561 10706 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:41.799031  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.799172  7180 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:41.802484  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:41.803141  7186 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:41.803678  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:41.809170  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:41.808411  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2494) took 1632 ms. Trace:
I20260709 13:14:41.810781  7184 rpcz_store.cc:276] 0709 13:14:40.175947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.177014 (+  1067us) service_pool.cc:224] Handling call
0709 13:14:40.208380 (+ 31366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:40.222184 (+ 13804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:40.222204 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:40.236276 (+ 14072us) log.cc:844] Serialized 26 byte log entry
0709 13:14:40.413044 (+176768us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:40.427201 (+ 14157us) log.cc:844] Serialized 14 byte log entry
0709 13:14:40.500698 (+ 73497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:40.501474 (+   776us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:41.758349 (+1256875us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:41.808121 (+ 49772us) raft_consensus.cc:1685] finished
0709 13:14:41.808224 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:41.808344 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13981,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":105540,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":7453,"spinlock_wait_cycles":15664128,"thread_start_us":122169,"threads_started":2,"wal-append.queue_time_us":257630}
I20260709 13:14:41.810392  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:41.828519 11093 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:41.829483  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:41.831251  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:41.835220  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.835220 10637 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:41.838229  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:41.839494 11091 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.840169  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.840095 11091 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.841212  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.841729  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.842495  7254 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:41.843219  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.843972  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.844372  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.844547  7255 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:41.845439  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.845706  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.843312  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.846704  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.846909  7262 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:14:41.847765  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.847772  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.846477  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.850111  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.796949 11128 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11.
I20260709 13:14:41.848768  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.850832  7255 raft_consensus.cc:2368] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
I20260709 13:14:41.851974  7262 raft_consensus.cc:2368] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11.
I20260709 13:14:41.855144  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:41.800705 10926 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.860128  7186 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:41.864907  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.862610  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.865639  7255 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:41.842561 11091 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:41.861653  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:41.874366  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.877450  7259 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:14:41.873239  7261 raft_consensus.cc:2368] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10.
I20260709 13:14:41.878700  7259 pending_rounds.cc:85] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 5
I20260709 13:14:41.879091  7259 pending_rounds.cc:107] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:14:41.879428  7259 raft_consensus.cc:2889] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:41.880921  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.882292  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.883885  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.886142  7184 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:41.890116  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.856837 10637 raft_consensus.cc:697] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:41.893383  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:41.894239  7186 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:41.892251  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.896188  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.891554 11100 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:41.900043 11100 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:41.896723  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.897472  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:41.903504  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.903522  7259 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 6: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:41.891433 10855 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:14:41.904850  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:41.906950  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:41.908733  7258 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:41.910298  7255 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:14:41.863977 10926 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.916041  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:41.919196 10637 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:41.911295 10706 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:14:41.925516 11119 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:41.925967 11119 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:41.927376 11119 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:41.928678 11119 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:41.934616  7327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1694) took 1834 ms (client timeout 1718 ms). Trace:
W20260709 13:14:41.935096  7327 rpcz_store.cc:269] 0709 13:14:40.100346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.213745 (+113399us) service_pool.cc:224] Handling call
0709 13:14:41.934399 (+1720654us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540020fdd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:41.934546 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234893568}
I20260709 13:14:41.914203 10532 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:41.936579 10532 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.936961 10532 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:41.937940  7257 raft_consensus.cc:2410] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:14:41.939114  7256 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:41.941044 11131 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:14:41.946146 11110 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:41.905278 11037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.391s	user 0.011s	sys 0.006s
I20260709 13:14:41.948351  7185 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:41.955109  7332 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:41.958866  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:41.957065  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:41.963982  7334 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:14:41.957046  7330 pending_rounds.cc:85] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 5
I20260709 13:14:41.965202  7330 pending_rounds.cc:107] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:14:41.965462  7330 raft_consensus.cc:2889] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:41.966363  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:41.967000  7888 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:41.966921  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:41.917950 11091 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:41.970696  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:41.953876 11037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.440s	user 0.011s	sys 0.006s
I20260709 13:14:41.989075  7329 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:14:41.990142  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:41.990278  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:41.990155  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:42.004565  7892 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.974707  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:42.005455  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 89458.2us
I20260709 13:14:42.005887  7334 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:41.992663  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:41.952522 11137 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:42.000624  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:42.002020  7336 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:42.001776  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:41.992497  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:41.959865 10820 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.006264  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.007719  7896 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:42.006532  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:42.016229  7328 raft_consensus.cc:2368] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
W20260709 13:14:41.997583 11069 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 1.490s	user 0.000s	sys 0.004s
I20260709 13:14:41.991537  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:41.905906 11100 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:42.013775  7332 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:42.015211  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:42.015444  7893 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:42.017702  7327 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:42.022068  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:42.027232  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:42.029703  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:42.030354  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:42.031191  7887 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:42.030428  7890 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:42.036315  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:42.038033  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.054808  7896 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:42.055586  7887 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
W20260709 13:14:42.056550  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 50369.6us
I20260709 13:14:42.057271  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:42.058313  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:42.063149  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.032932 11091 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:42.071779  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:14:42.078087  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.081466  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:42.082464  7329 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:42.023377 10820 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:42.065287 10855 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:42.060885 10676 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:42.115578  7892 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:42.098078  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:42.117029  7893 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:42.098249  7333 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:14:42.117589  7333 pending_rounds.cc:85] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 9
I20260709 13:14:42.117828  7333 pending_rounds.cc:107] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:14:42.118070  7333 raft_consensus.cc:2889] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:42.081089 11086 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:14:42.093673 10897 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:42.094297  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.103408 10532 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:42.074388 10371 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:14:42.116101  7888 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:42.117079  7255 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:42.065070 11128 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:42.115871 11037 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:42.083868 11072 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:42.128219  7183 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:42.070466 10706 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:14:42.129508  7891 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: [7.7-10.8]
I20260709 13:14:42.129293 11137 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:42.130692 11072 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:42.135633 11072 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:42.130959  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.136787  7257 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:42.146927  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:42.147532  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:42.140627  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 119657us
I20260709 13:14:42.156363  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.157987  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.152953  7255 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
W20260709 13:14:42.159229  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.167048  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:42.167873  7888 raft_consensus.cc:2376] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12. Re-sending same reply.
I20260709 13:14:42.171206  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:42.171726 10820 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:42.174168  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:42.175611  7333 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:14:42.131711 11037 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:42.178707  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 140730us
I20260709 13:14:42.182839  7333 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:42.140733 10897 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:42.187312  7334 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:14:42.188380  7255 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:42.188570  7334 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:42.193290  7183 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:42.193567  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:42.194800  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 121582us
I20260709 13:14:42.198519  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.203012  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:42.223335  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:42.224786  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.204818  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.231647  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.202477 10991 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.231815  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.204672 10740 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:42.223124 11119 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:42.228994 10820 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:42.243137  7892 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:42.232726 10435 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:42.235096 10897 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:42.204365 11128 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:14:42.263903  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 107085us
I20260709 13:14:42.190645 11023 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:42.240106 10706 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:42.272296  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.234452 11137 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:14:42.234962 10676 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:14:42.245012 10855 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:42.245079 10910 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:42.271812 10820 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:42.326977  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:42.327072  7186 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:14:42.337618  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 54127.3us
I20260709 13:14:42.327858  7254 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:14:42.325562  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:42.324728  7179 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:42.326537  7183 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:14:42.284263 10897 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:14:42.341827  7181 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:42.342020  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.298367 11160 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:42.300117 10532 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:42.294246 10371 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:42.287849 10963 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:14:42.325089  7187 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:14:42.358649  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 65109.3us
I20260709 13:14:42.239823 10991 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:42.305284 10996 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.000s
I20260709 13:14:42.287932 11023 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:42.332767  7178 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:42.300397 11072 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:42.298826 11037 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:42.337913 11162 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:42.274473 11086 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:42.291857 10855 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:42.277869 11061 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:14:42.345947  7184 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:14:42.347597  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 189699us
I20260709 13:14:42.280783 11027 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:14:42.341378 10897 consensus_queue.cc:1243] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:42.271507 11119 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:42.251307 10740 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:14:42.413563  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:42.446260 11153 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:14:42.445986 11119 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:42.449003 11119 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:42.403716 10676 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:14:42.456506 10740 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:42.456995 10740 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:42.457954 10740 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:42.459753 11072 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:42.463371 10740 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:42.463697 10991 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:42.464387 10926 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:42.466866 11061 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:42.467625 11061 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:42.480480  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:42.394091  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.344790 10820 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:42.342846 11025 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:14:42.366003 11149 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:42.376238 10532 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:42.432744  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.368891 11086 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:14:42.401374 11152 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:14:42.362751 10996 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:42.485364  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 289679us
W20260709 13:14:42.485806  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 96235.9us
I20260709 13:14:42.487916  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:42.532974  7336 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:42.533075  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.487099  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:42.491040  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 58400.6us
I20260709 13:14:42.537699  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.519567  7329 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:42.539944  7150 leader_election.cc:400] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:42.540318  7150 leader_election.cc:403] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:14:42.544782  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.532644 10975 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:42.548043 10975 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:42.548462 10975 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:42.555224 11061 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:42.563982 11078 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:42.564580 11078 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:42.566768 11162 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:42.567322 11162 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:42.569427 11162 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:42.569365 10975 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:42.570209 11072 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:42.570891 11072 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:42.571624 10371 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:42.571969 10371 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:42.573647  7253 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:42.576623  7178 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:42.572808 10371 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:42.581899  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.583264  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.584443  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:42.539925 10793 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:42.597885  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:42.585786  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 243825us
W20260709 13:14:42.588649  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 43942.3us
I20260709 13:14:42.598869  7187 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:42.599519  7150 leader_election.cc:400] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
I20260709 13:14:42.599995  7150 leader_election.cc:403] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:14:42.589809  7152 leader_election.cc:400] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
I20260709 13:14:42.490378 10532 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:42.579334 11104 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:42.600687 11072 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:42.566619 11078 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:42.602301  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.600646  7152 leader_election.cc:403] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:42.600274 11160 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:42.614676  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.609544  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:42.595577 11035 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:42.612690  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 282743us
I20260709 13:14:42.600659 11164 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:42.600844 11161 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:42.634999  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:42.635890  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:42.608927 10371 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:42.637446  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 522) took 1399 ms. Trace:
I20260709 13:14:42.612126 11159 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
I20260709 13:14:42.652374  7225 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:42.624245 11164 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:42.644701 11072 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
I20260709 13:14:42.641467 10996 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:42.647889 11160 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:42.653951 10736 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:42.646241 11035 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:42.616470 11027 consensus_queue.cc:1243] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:42.607738 11086 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:42.791934  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 189905us
I20260709 13:14:42.793591 10975 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:42.657377 10855 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:42.808177  7258 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:14:42.856951  7259 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:42.658612 11164 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:42.851943  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:42.864344  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:42.865751  7259 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:42.864344  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:42.869117  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:42.870160  7258 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:42.870443  7258 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:42.871860  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 225706us
W20260709 13:14:42.858546  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 243935us
I20260709 13:14:42.874716  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.875197  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.876899  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:42.879418  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:42.856722 10793 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:14:42.792142 10435 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.789031 10736 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.644374 10532 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:42.887367  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:42.891352  7259 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:42.809634 10996 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:42.871245  7258 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:42.900215  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.930433  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.930943  7258 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:42.931784  7152 leader_election.cc:400] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10.
I20260709 13:14:42.932742  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:42.935813  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:42.893030 11035 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:42.892827 11086 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:42.894246 11173 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:42.893582 10975 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:42.942767  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 296139us
I20260709 13:14:42.905890 11159 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:42.906278 10736 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:42.925493 11072 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.967221  7258 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:14:42.969439  7258 pending_rounds.cc:85] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 5
I20260709 13:14:42.969870  7258 pending_rounds.cc:107] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:14:42.970283  7258 raft_consensus.cc:2889] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:42.905999  7259 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:42.980980  7259 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:42.904335 10435 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:42.910655 11027 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:42.981880  7896 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
W20260709 13:14:42.968552 10826 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.331s	user 0.021s	sys 0.064s
I20260709 13:14:42.985080  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:42.985486  7259 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:42.926970 11160 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:14:42.954325 11186 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:42.939486 10996 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:42.979410 11187 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:42.972481 11181 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:14:42.981179 10975 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:42.998553  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:43.003736 10820 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:42.987138 11035 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:14:43.004340 11185 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 13:14:43.032207  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.009503  7336 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
W20260709 13:14:42.999974  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 347612us
W20260709 13:14:42.998088 10826 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.361s	user 0.022s	sys 0.064s
I20260709 13:14:42.976599 11072 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:43.038699  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:43.014997  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 127710us
I20260709 13:14:42.990808 11189 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:42.997563 11184 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:43.042842 11186 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:43.011155 11190 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:43.046211 11170 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
I20260709 13:14:43.003371 11027 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:43.067981  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 135327us
I20260709 13:14:43.079252  7152 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:43.087323  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:43.062490 11184 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:43.094313  7258 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:43.098196 11197 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:43.049778 11035 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.103940  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:43.110713  7258 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:14:43.111402  7258 pending_rounds.cc:85] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 8
W20260709 13:14:43.092665 11175 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 13:14:43.120859  7180 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:14:43.124889  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:43.092374 11161 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:43.092262 10975 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:43.048619 11172 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:14:43.110806 11173 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:43.085155 11186 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:43.128804  7184 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:43.135759 10705 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.135530 11184 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:43.137068  7260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 2700) took 1492 ms (client timeout 1710 ms). Trace:
I20260709 13:14:43.137895  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 2713) took 1180 ms. Trace:
I20260709 13:14:43.166996  7257 rpcz_store.cc:276] 0709 13:14:41.957807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.957940 (+   133us) service_pool.cc:224] Handling call
0709 13:14:43.137705 (+1179765us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54002161d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:43.137835 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296239744}
I20260709 13:14:43.139477 11093 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:43.124756 11177 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:14:43.166168  7260 rpcz_store.cc:269] 0709 13:14:41.644890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.646739 (+  1849us) service_pool.cc:224] Handling call
0709 13:14:43.136861 (+1490122us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b5400226fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:43.137005 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180564352}
I20260709 13:14:43.117246 11195 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.143888 10435 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:43.113574 11187 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:14:43.085625 11190 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.155719 11173 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.221282  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:43.222733  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:43.223541  7257 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:43.155568 11186 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.225358  7257 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:43.114305 11197 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:43.160970 10371 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 13:14:43.163312 11072 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.164661 11155 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:43.233055 11190 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.233304 11155 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:14:43.141165 11104 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 13:14:43.111845  7258 pending_rounds.cc:107] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:14:43.213100  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 674) took 1165 ms. Trace:
I20260709 13:14:43.213440  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:43.216143  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:43.218886 10996 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.231346  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1626) took 1368 ms. Trace:
I20260709 13:14:43.232496 11035 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.236532  7258 raft_consensus.cc:2889] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:43.236610  7891 rpcz_store.cc:276] 0709 13:14:42.001227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.001407 (+   180us) service_pool.cc:224] Handling call
0709 13:14:42.129229 (+127822us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:42.132151 (+  2922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.166097 (+1033946us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54006608d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:43.166255 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281908480}
W20260709 13:14:43.241376  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 180150us
I20260709 13:14:43.252362  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.225507 11184 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:43.255792  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.240293  7261 rpcz_store.cc:276] 0709 13:14:41.863380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.906800 (+ 43420us) service_pool.cc:224] Handling call
0709 13:14:41.907053 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:41.911724 (+  4671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.911757 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:41.913568 (+  1811us) log.cc:844] Serialized 26 byte log entry
0709 13:14:42.330734 (+417166us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b1800477700. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:14:42.579327 (+248593us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:42.579367 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.579434 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:43.228800 (+649366us) raft_consensus.cc:1685] finished
0709 13:14:43.228822 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:43.231279 (+  2457us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1938,"raft.queue_time_us":2999,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":2953,"spinlock_wait_cycles":2535680,"thread_start_us":248406,"threads_started":1,"wal-append.queue_time_us":740831}
I20260709 13:14:43.259321  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:43.263480  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.264254  7334 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:43.264320  7257 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:43.247157 11104 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:43.250897 11194 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.263193 11189 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:43.225046 11195 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.267473 10820 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:43.285441 11177 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.288156 11177 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.290477 11177 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.291694 10793 tablet_bootstrap.cc:492] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260709 13:14:43.292918 10793 tablet_bootstrap.cc:492] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:14:43.293696 10793 ts_tablet_manager.cc:1403] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 2.002s	user 0.033s	sys 0.019s
I20260709 13:14:43.234406 11155 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:43.280299  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 327895us
I20260709 13:14:43.295976  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:43.296667  7891 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:43.301358 11181 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.323240 11027 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.327104  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1609) took 1482 ms. Trace:
I20260709 13:14:43.327551  7262 rpcz_store.cc:276] 0709 13:14:41.844856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.847510 (+  2654us) service_pool.cc:224] Handling call
0709 13:14:43.326891 (+1479381us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b5400125054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:43.327047 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6852608}
I20260709 13:14:43.328140 11195 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.330358  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:43.331135  7892 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:43.332870 11164 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.334180  7152 leader_election.cc:400] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11.
I20260709 13:14:43.335493 11197 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:43.277458 11194 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.338936  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:43.340121 11181 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.342011  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:43.316502 11155 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:43.345161  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:43.349217 11209 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:43.349660 11209 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.349978 11209 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:43.352281  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1604) took 1509 ms. Trace:
I20260709 13:14:43.352690  7254 rpcz_store.cc:276] 0709 13:14:41.843159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.847969 (+  4810us) service_pool.cc:224] Handling call
0709 13:14:42.327625 (+479656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:42.338422 (+ 10797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.352036 (+1013614us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54002e7550. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:43.352207 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102299520}
I20260709 13:14:43.334539  7152 leader_election.cc:403] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:43.305227 10826 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:43.356762  7892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:59728
I20260709 13:14:43.359153  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:43.360383  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65498us
I20260709 13:14:43.358469  7892 raft_consensus.cc:606] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:43.366235  7186 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:43.375385  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.378275  7336 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:43.379854 11024 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:43.380486 11024 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.385291 11110 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:43.360276 11160 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11.
I20260709 13:14:43.386716 10705 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:43.388200  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1601) took 1547 ms. Trace:
I20260709 13:14:43.388162 10705 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.388700  7253 rpcz_store.cc:276] 0709 13:14:41.840735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.840887 (+   152us) service_pool.cc:224] Handling call
0709 13:14:43.388024 (+1547137us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b5400057b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:43.388139 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682498304}
I20260709 13:14:43.386678 11189 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.398168  7186 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:14:43.355618 11181 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.401386  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:43.384944 11210 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:43.380170 11207 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:43.362833 10826 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.411824 10826 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.408475 11177 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:43.414958 11177 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.415035 11024 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.415397 11177 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:43.310118 10820 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:43.407382  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48984.9us
W20260709 13:14:43.433131  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:43.433800  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:43.439328  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.437603 11195 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:43.465631  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.423309 11110 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:14:43.427191 11207 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.439503 11173 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 13:14:43.491786 11215 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:14:43.474169 11195 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:43.495905 11211 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:14:43.497071 10736 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:14:43.498735 11207 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.479592 10998 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:14:43.503441 11164 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.483070 11178 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.641968  7331 rpcz_store.cc:276] 0709 13:14:41.238002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.238113 (+   111us) service_pool.cc:224] Handling call
0709 13:14:41.238396 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:41.238580 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:41.251884 (+ 13304us) log.cc:844] Serialized 14 byte log entry
0709 13:14:42.456489 (+1204605us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b180038ab20. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a 00007fece9246a2a
0709 13:14:42.636964 (+180475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.637038 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:42.637101 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.637196 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.637371 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21805,"prepare.queue_time_us":12731,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":37,"raft.queue_time_us":26085,"spinlock_wait_cycles":11987328,"thread_start_us":158277,"threads_started":1}
I20260709 13:14:43.512353  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:43.478148 11110 consensus_queue.cc:1243] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:43.520510  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:43.512111 11195 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.511300 11184 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:43.513581 11160 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.525308 11222 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:43.528470 11184 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.529222 11177 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.502120 11209 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.532692 10998 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:43.535168 10998 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.537410 10998 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:43.538136 10705 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.519004 11178 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.514889 10736 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.524575 11207 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:43.542948  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:43.543241  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:43.545853  7258 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:43.533941 11164 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:43.538193 11156 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 1.238s	user 0.002s	sys 0.003s
I20260709 13:14:43.550251  7261 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:14:43.551477  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:43.553822 11178 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:43.556329  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:43.557016  7262 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:43.560163  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:43.563247  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:43.563959  7255 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:43.564417 11177 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.568343 11209 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.531276 11160 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.577188  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:43.554486 11164 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.559149 11184 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.583612  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:43.584290 10998 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:43.585584  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.587373 11164 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.541836 10793 raft_consensus.cc:359] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEARNER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:43.592151 10867 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:43.592638 10867 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:43.593106 10867 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:43.592344 10793 raft_consensus.cc:886] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEARNER]: Ignoring setting pending config change with OpId 7.5 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:14:43.593973 10793 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:14:43.594692 10793 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:43.595798  7894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 673) took 1621 ms. Trace:
I20260709 13:14:43.596184  7894 rpcz_store.cc:276] 0709 13:14:41.974364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.974693 (+   329us) service_pool.cc:224] Handling call
0709 13:14:41.991231 (+ 16538us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:42.033779 (+ 42548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.033819 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:42.064684 (+ 30865us) log.cc:844] Serialized 52 byte log entry
0709 13:14:42.232477 (+167793us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:42.232524 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.232612 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:43.537614 (+1305002us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:43.595492 (+ 57878us) raft_consensus.cc:1685] finished
0709 13:14:43.595513 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:43.595740 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39176,"raft.queue_time_us":38859,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":2172,"spinlock_wait_cycles":70419712,"thread_start_us":127998,"threads_started":1,"wal-append.queue_time_us":215789}
I20260709 13:14:43.597797 10793 ts_tablet_manager.cc:1434] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.304s	user 0.007s	sys 0.002s
I20260709 13:14:43.599920 11160 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:43.603685 11183 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.634s	user 0.001s	sys 0.001s
I20260709 13:14:43.609246  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 552) took 1371 ms. Trace:
I20260709 13:14:43.609694  7888 rpcz_store.cc:276] 0709 13:14:42.238222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.238453 (+   231us) service_pool.cc:224] Handling call
0709 13:14:42.238987 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:42.608077 (+369090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.608108 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:42.608587 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:14:42.906595 (+298008us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:42.906665 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.602418 (+695753us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400641754. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:43.602467 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:43.602517 (+    50us) raft_consensus.cc:1685] finished
0709 13:14:43.602532 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:43.609180 (+  6648us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10779,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":347404672,"thread_start_us":479825,"threads_started":2,"wal-append.queue_time_us":377440}
I20260709 13:14:43.612389 10736 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.617244 10637 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:43.601718  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:43.625871  7262 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:43.590582 11209 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:43.631538  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:43.632149  7333 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:14:43.634335  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:43.639662  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:43.641638  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:43.629276 10991 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:14:43.645166  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:43.630484 11151 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:43.646533  7896 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:43.646870  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:43.647614  7888 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.649629  7260 pending_rounds.cc:85] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 5
I20260709 13:14:43.651948  7327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:14:43.652559  7327 raft_consensus.cc:606] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:43.652940  7327 raft_consensus.cc:614] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:43.630025 10834 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:14:43.649964  7260 pending_rounds.cc:107] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:14:43.660070  7896 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:43.660647  7888 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:14:43.642939 10637 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.661933  7260 raft_consensus.cc:2889] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:43.663125  7260 pending_rounds.cc:107] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:14:43.663419  7260 raft_consensus.cc:2889] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:43.664742  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:43.667593  7262 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:43.648849 11151 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:43.675412  7262 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:43.661942 10532 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:43.685513 11194 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.668438 11202 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.695077  7333 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:14:43.702389  7262 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:43.678131 11151 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:43.681033 11078 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:14:43.692193 11121 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.010s	sys 0.021s
W20260709 13:14:43.746959  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 100160us
I20260709 13:14:43.675702 11214 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:14:43.672823 10637 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.764458  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:43.692404 10867 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.692412 11150 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
W20260709 13:14:43.762889 11201 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:14:43.739862 11209 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:14:43.845572  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:43.809762 10991 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:43.857961 11132 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:14:43.859683 11226 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:14:43.762379 10865 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:43.862850  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.863080 11132 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:43.863722 11132 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:43.864666 11132 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.867197 10637 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:43.769662 11159 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:43.858237 11228 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:14:43.722985 11202 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.862775 10865 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:43.845572  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:43.763334 11121 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.434s	user 0.010s	sys 0.021s
I20260709 13:14:43.898751 10867 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:43.905995  7327 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:43.906680 10865 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.907528  7328 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 12. Ops: []
I20260709 13:14:43.908568  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:43.913189  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.907375 10924 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.906965 10908 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.917667  7336 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:43.918738  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.941423  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.940560 11160 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:43.943557  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:43.943801 11160 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.944777  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.945840  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.945992 11164 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:43.946415  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.946530 11164 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:43.947283  7336 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:14:43.948799 11164 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.949389  7327 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:14:43.945865 11160 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.960387  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.911839 11150 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.962405 11150 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.965087 11150 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.967136 11202 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:43.977167  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:43.980047 11160 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:43.980798 11160 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.981372 11194 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:43.982509 10865 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:43.911911 11159 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.982908 10865 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:43.983804 11160 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:43.983767 10865 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:43.984462 11159 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.984961 10865 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:43.986299 11151 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:43.987067  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:43.987576  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 342814us
I20260709 13:14:43.992599  7328 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:14:44.115396 11209 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.116074 11209 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:44.119607  7331 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:44.056077  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:43.914737 10924 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:44.122473 10924 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:43.968868 10908 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:44.123875  7332 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:44.125128 10908 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:44.130182  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:44.131106  7328 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:44.152058 11151 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:44.168970 10998 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.002s
I20260709 13:14:44.169580 10998 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:14:44.100703  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.172158  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.172901  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:44.188517  7183 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:44.173545  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.190057  7185 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:14:44.191308  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.192744  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.193785  7185 raft_consensus.cc:2410] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:44.174235  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.175926  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:44.177726  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:44.194543  7184 raft_consensus.cc:2410] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:14:44.194651  7180 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:44.196852  7178 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:14:44.198987  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 71463.2us
I20260709 13:14:44.204010  7178 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:14:44.113454  7253 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:44.205605  7185 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:14:44.180977  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 354831us
I20260709 13:14:44.208117  7180 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:44.224011  7184 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:14:44.224416  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.232102  7183 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:44.213366 10865 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:14:44.214207 11121 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.234035 11121 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:44.236120 11121 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:44.239722  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.240386  7187 raft_consensus.cc:2376] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10. Re-sending same reply.
I20260709 13:14:44.241374  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.243906 11194 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.244508 11194 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:44.250064  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:44.253178  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:44.253396  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.253969  7183 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:44.254048  7187 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:44.255903  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.256557  7185 raft_consensus.cc:2410] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:14:44.257187  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.257799  7185 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:14:44.258312  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.258903  7180 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:44.260756  7178 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:14:44.261233  7178 pending_rounds.cc:85] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 7
I20260709 13:14:44.261475  7178 pending_rounds.cc:107] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:14:44.261750  7178 raft_consensus.cc:2889] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:44.263811  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.265662  7184 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:44.266462  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.267077  7178 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:44.268980  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.269318  7185 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:44.269622  7178 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:44.269876  7185 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:14:44.223263 11086 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.020s	sys 0.023s
I20260709 13:14:44.246989 10924 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:44.247128 10865 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.270991  7185 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:44.246615 11194 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:44.253181 11121 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.281103  7185 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:44.272827 11086 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.021s	sys 0.024s
I20260709 13:14:44.293533 11151 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.280303 10924 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:44.280932 10865 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:44.280833 11121 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:44.353740  7261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.017s	sys 0.037s
W20260709 13:14:44.401214  7261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.017s	sys 0.037s
I20260709 13:14:44.359424  7185 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:14:44.402246  7185 pending_rounds.cc:85] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 10
I20260709 13:14:44.402575  7185 pending_rounds.cc:107] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:14:44.402925  7185 raft_consensus.cc:2889] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:44.411303  7186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1845) took 1292 ms (client timeout 1710 ms). Trace:
W20260709 13:14:44.411811  7186 rpcz_store.cc:269] 0709 13:14:43.118944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.119080 (+   136us) service_pool.cc:224] Handling call
0709 13:14:44.411096 (+1292016us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54002706d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:44.411234 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553586432}
W20260709 13:14:44.423890  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.338188 11151 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:44.527622 11100 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:44.535189 11100 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:44.535959  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:44.537571 11132 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:14:44.527954 11203 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.374s	user 0.005s	sys 0.008s
I20260709 13:14:44.573915  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2730) took 1769 ms. Trace:
I20260709 13:14:44.574438  7256 rpcz_store.cc:276] 0709 13:14:42.804183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.940343 (+136160us) service_pool.cc:224] Handling call
0709 13:14:42.940775 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:43.006152 (+ 65377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:43.006199 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:43.012726 (+  6527us) log.cc:844] Serialized 26 byte log entry
0709 13:14:43.154092 (+141366us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:43.154151 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:43.154275 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:44.447384 (+1293109us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b2400100d18. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece5fd59c4 00007fece5fd3acb 00007fece618edc9 00007fece618ea55 00007fece618e09d 00007fece8dc010e 00007fece8dd788c 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221
0709 13:14:44.573539 (+126155us) raft_consensus.cc:1685] finished
0709 13:14:44.573570 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:44.573832 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48372,"raft.queue_time_us":65015,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5475,"spinlock_wait_cycles":91964160,"thread_start_us":79644,"threads_started":1,"wal-append.queue_time_us":92653}
I20260709 13:14:44.612617  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.615267  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:44.616689 11238 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:44.617414 11238 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:44.618515 11238 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:44.624559  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:44.809551  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.810415  7181 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
W20260709 13:14:44.810868  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 181702us
I20260709 13:14:44.812546  7329 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:14:44.813418  7896 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:14:44.816120  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 680) took 2764 ms. Trace:
W20260709 13:14:44.817374  7228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.054s	sys 0.146s
W20260709 13:14:44.817777  7228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.054s	sys 0.146s
I20260709 13:14:44.817971  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:44.818236  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 569952us
I20260709 13:14:44.818961  7888 raft_consensus.cc:2410] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:14:44.819123  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.816509  7893 rpcz_store.cc:276] 0709 13:14:42.042726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.043787 (+  1061us) service_pool.cc:224] Handling call
0709 13:14:42.116865 (+ 73078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.117551 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.806969 (+2689418us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b540043b2d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:44.807128 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110044928}
I20260709 13:14:44.812264  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:44.821478  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:44.830734  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:44.824167  7179 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:44.826344  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:44.826732  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:44.827620  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:44.828716  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:44.821066  7228 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:44.833528  7894 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:44.830950  7329 raft_consensus.cc:2368] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
I20260709 13:14:44.823189  7888 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:14:44.812994 11026 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:14:44.813942 11037 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:14:44.835314  7891 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:44.838236  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:44.835616  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:44.840494  7328 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:44.835692  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:44.835850  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:44.836063  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:44.836303  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:44.806524 11159 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.813410 10985 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:44.836447  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:44.859946  7891 raft_consensus.cc:1217] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEARNER]: Deduplicated request from leader. Original: 7.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 13:14:44.813331 11179 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:14:44.890672  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.033s	sys 0.044s
I20260709 13:14:44.839448 10998 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:44.891928  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.033s	sys 0.044s
I20260709 13:14:44.891893  7889 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:14:44.878973 11159 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:44.892926  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:44.858990 11037 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:44.819799 11110 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:14:44.831574 10924 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:44.894773 11037 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:44.832479 10867 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:14:44.881690  7891 raft_consensus.cc:2962] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEARNER]: Ignoring commit of config change with OpId 7.5 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:14:44.831875 11222 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:14:44.859851 11100 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:44.911183 10897 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:14:44.904914 11037 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:44.895735 11179 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:44.908036 10924 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:44.940300 10897 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:44.941013 10897 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:44.942207  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2761) took 1029 ms. Trace:
I20260709 13:14:44.943714 10897 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:44.942751  7260 rpcz_store.cc:276] 0709 13:14:43.913249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.115208 (+201959us) service_pool.cc:224] Handling call
0709 13:14:44.118809 (+  3601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:44.120185 (+  1376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:44.120225 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:44.129044 (+  8819us) log.cc:844] Serialized 26 byte log entry
0709 13:14:44.353450 (+224406us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:44.353506 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.353596 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:44.941937 (+588341us) raft_consensus.cc:1685] finished
0709 13:14:44.941964 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:44.942134 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":223818,"threads_started":1,"wal-append.queue_time_us":729957}
I20260709 13:14:44.944479 10897 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:44.945258 10897 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:44.945657 10897 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:44.946039 10897 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:44.902493 10998 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:44.935351 10865 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:44.936162 11254 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:44.938465 11121 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:44.960176 11137 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.624s	user 0.011s	sys 0.047s
I20260709 13:14:44.950522 11257 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:44.896755 10985 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:44.980023 11159 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:44.947422 10924 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:44.982829  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 144690us
I20260709 13:14:44.986717  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:44.989305  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:44.995007  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 102176us
W20260709 13:14:44.996184  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 175288us
I20260709 13:14:44.988605 11159 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.970846 11254 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:44.989377 11110 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:44.992147 10867 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:45.001014 11243 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
I20260709 13:14:45.014839  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 535) took 1659 ms. Trace:
I20260709 13:14:45.020133  7334 rpcz_store.cc:276] 0709 13:14:43.355529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.355653 (+   124us) service_pool.cc:224] Handling call
0709 13:14:43.357081 (+  1428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:43.366460 (+  9379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:43.366490 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:44.166433 (+799943us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b2c0013d8c8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:14:44.166967 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:14:44.280994 (+114027us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:44.281029 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.281095 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:45.008715 (+727620us) raft_consensus.cc:1685] finished
0709 13:14:45.008746 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:45.014754 (+  6008us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8981,"raft.queue_time_us":12791,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":11806,"spinlock_wait_cycles":9373568,"thread_start_us":113581,"threads_started":1,"wal-append.queue_time_us":788906}
I20260709 13:14:45.017383 10897 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:45.024338  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:45.025997  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:45.026757 11086 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.002s	sys 0.000s
I20260709 13:14:45.027065 10897 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:45.027482 11086 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.002s	sys 0.000s
W20260709 13:14:45.027901  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.032716 10924 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:45.033421 11262 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.034085 11262 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:45.038841  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:44.983803 11137 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.649s	user 0.011s	sys 0.048s
W20260709 13:14:45.047799 11247 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:14:44.984961 11179 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:45.049991 11179 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:45.051534 10998 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:45.004727 11159 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:45.054600 11271 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:45.055855  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1658) took 1079 ms. Trace:
W20260709 13:14:45.056205  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.056277  7327 rpcz_store.cc:276] 0709 13:14:43.976358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.976509 (+   151us) service_pool.cc:224] Handling call
0709 13:14:43.982518 (+  6009us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:43.989683 (+  7165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:43.989729 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:43.990179 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:14:44.259990 (+269811us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:44.260029 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.260093 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:45.055553 (+795460us) raft_consensus.cc:1685] finished
0709 13:14:45.055581 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:45.055780 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7416,"raft.queue_time_us":9029,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":8770,"thread_start_us":193669,"threads_started":1,"wal-append.queue_time_us":570827}
I20260709 13:14:45.056527  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2757) took 1185 ms. Trace:
I20260709 13:14:45.060585  7262 rpcz_store.cc:276] 0709 13:14:43.871241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.871851 (+   610us) service_pool.cc:224] Handling call
0709 13:14:43.872270 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:43.894367 (+ 22097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:43.894432 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:43.900016 (+  5584us) log.cc:844] Serialized 26 byte log entry
0709 13:14:44.260119 (+360103us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:44.260159 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.260218 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:45.056343 (+796125us) raft_consensus.cc:1685] finished
0709 13:14:45.056362 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:45.056475 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29479,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":8699,"thread_start_us":359741,"threads_started":1,"wal-append.queue_time_us":532415}
I20260709 13:14:45.064263  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:44.984479 11257 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:45.059966 11239 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:14:45.103189  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63335.3us
W20260709 13:14:45.060614 11245 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:14:45.104354  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.059587 11159 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:45.063498 11154 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:45.116247  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 120449us
I20260709 13:14:45.118490  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:45.119184  7186 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:45.119815  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2760) took 1215 ms. Trace:
I20260709 13:14:45.120303  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:45.120198  7258 rpcz_store.cc:276] 0709 13:14:43.904375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.945620 (+ 41245us) service_pool.cc:224] Handling call
0709 13:14:43.945913 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:43.946229 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:43.946255 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:43.946732 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:14:44.267207 (+320475us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:44.267241 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.267302 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:45.119605 (+852303us) raft_consensus.cc:1685] finished
0709 13:14:45.119622 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:45.119760 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8768,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":320187,"threads_started":1,"wal-append.queue_time_us":958438}
I20260709 13:14:45.123454  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:45.124075  7329 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:45.124358  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:45.155004  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:45.156781  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50742.9us
I20260709 13:14:45.158807  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:45.161118  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:45.164130  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 99989.8us
I20260709 13:14:45.162568  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:45.166750  7328 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:45.167881  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:45.168741  7258 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:45.174240  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:45.157938  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:45.175150  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:45.176146  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:45.176904  7330 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:45.156253 11159 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.206410  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:45.207090  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:45.214978  7262 raft_consensus.cc:2410] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:45.217458  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2755) took 1516 ms. Trace:
I20260709 13:14:45.155682 11261 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.217847  7261 rpcz_store.cc:276] 0709 13:14:43.700812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.701502 (+   690us) service_pool.cc:224] Handling call
0709 13:14:43.701920 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:43.738973 (+ 37053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:43.739022 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:43.744619 (+  5597us) log.cc:844] Serialized 26 byte log entry
0709 13:14:44.401774 (+657155us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:44.401850 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.401951 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:45.217237 (+815286us) raft_consensus.cc:1685] finished
0709 13:14:45.217257 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:45.217400 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17479,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3325,"thread_start_us":578813,"threads_started":1,"wal-append.queue_time_us":1068866}
I20260709 13:14:45.228899  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:45.208544 11263 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:45.055289 11271 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:45.229676  7261 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:45.153568 11154 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:45.242981  7299 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:45.247313  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:45.201090 11259 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:45.248005  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:45.251387  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 259754us
I20260709 13:14:45.255859  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:45.216576  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-c89d6774062049379248eca324d137c6 received from {username='slave'} at 127.0.0.1:44980
I20260709 13:14:45.239928 11137 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:45.275449  7258 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:45.276834  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:45.270992  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:45.272423  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:45.273546  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:45.266646  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 90525.9us
I20260709 13:14:45.240228 11194 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:45.239946 10897 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:45.278932  7261 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 6.
I20260709 13:14:45.223941 10865 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:14:45.248306 11121 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:45.284176  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:45.284994  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:45.254426 11222 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:45.295892  7328 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:45.215888 11159 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:45.245251 10924 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:45.328122  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-c89d6774062049379248eca324d137c6 on tablet c89d6774062049379248eca324d137c6 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:45.251235 11265 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.377188  7261 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:45.384963  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:45.395875  7261 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:45.396965  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:45.376647  7258 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
W20260709 13:14:45.376003  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 96250.6us
I20260709 13:14:45.289090  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:45.254891 11132 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:14:45.378679  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 107582us
W20260709 13:14:45.378686 11270 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:14:45.311585  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.260368 11258 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:45.437881  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:45.458389  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 186072us
I20260709 13:14:45.440284  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:45.459910  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.477279  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:45.446866 11132 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:45.292742  7330 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:14:45.498512  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:45.437232  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 148191us
I20260709 13:14:45.520013 11132 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:45.467934 11279 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.441452 11259 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:45.435932 11265 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:45.248476 11263 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:45.376979 11286 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:45.521247  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:45.476657 11025 raft_consensus.cc:993] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: : Instructing follower efc9ee9e1d86480790fa83f6ad0c295c to start an election
W20260709 13:14:45.535601  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 95413.2us
I20260709 13:14:45.376719 10985 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:45.240732 11261 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:45.397897 11189 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:45.379477 11159 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:45.283551 11269 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:45.539597  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:45.383538 11277 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:45.592867  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 55442.2us
I20260709 13:14:45.528072 11259 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.592902 10985 raft_consensus.cc:1081] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Signalling peer efc9ee9e1d86480790fa83f6ad0c295c to start an election
I20260709 13:14:45.477813 11257 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:45.481756 11275 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.378958 11262 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:45.542994  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:45.330796 10897 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:45.600124  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57214.4us
I20260709 13:14:45.528687 11086 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:45.515779 11222 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:45.379794 10924 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:45.533200  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 326893us
I20260709 13:14:45.530875 11288 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:45.607234 11159 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:45.607709 11159 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:45.608109 11159 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:45.608389 10924 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:45.597594 11270 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:14:45.597678 11259 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:45.603899 11274 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.611464 11274 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:45.527223 11198 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 2.431s	user 0.009s	sys 0.023s
I20260709 13:14:45.330524 11194 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:45.442768 11121 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:45.530179 11265 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:45.535674  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 95740us
I20260709 13:14:45.521217 11292 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:45.535933 11254 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:45.588357  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48827.1us
I20260709 13:14:45.287909 11137 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:45.604713  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:45.551932 11278 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:45.602007  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:45.602011 11289 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.606882 11189 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:45.614653 11086 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:45.527441 11279 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:45.642971 11292 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.642897 10924 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:45.648403  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 43828.4us
I20260709 13:14:45.648702  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:45.648927 11293 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:45.647126 11121 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:45.649358  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 54308.2us
I20260709 13:14:45.647567 11254 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:45.606940 11222 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:45.589727 11281 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:45.599434 11257 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:45.651257  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49316.7us
I20260709 13:14:45.604729  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:45.657416  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:45.684737  7260 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:45.650820 11278 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:45.642864 11272 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.452s	user 0.001s	sys 0.000s
I20260709 13:14:45.665113  7150 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:45.676993  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:45.654402 11265 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:45.680712  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:45.685673  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:45.619992 11271 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:45.688689  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:45.687179  7255 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:45.695554  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:45.698882  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:45.671417 11292 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:45.716425 10897 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:45.718465 11137 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:45.719825 11261 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:45.683614 11110 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:45.714361  7255 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:45.598004 11269 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:45.727490  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:45.694003 11278 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:45.600380 11277 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:45.699755 11265 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.699501 11257 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:45.736462  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 55828us
I20260709 13:14:45.731076 11261 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:45.707424 11154 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:45.604529 11275 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:45.684214 10924 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:45.775695  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 104476us
I20260709 13:14:45.664808 11289 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:45.689914 11254 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:45.785490  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:45.708436 10855 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:45.783565  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:45.792286 10855 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:45.793007 10855 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.774042 11265 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:45.722144 11262 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:45.782087 11285 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:45.731411 11271 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:45.773307 11110 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:45.802701  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:45.821355  7862 connection.cc:256] RPC call timeout handler was delayed by -1.6905098229999567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:14:45.804435 11300 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:14:45.824829  7862 connection.cc:256] RPC call timeout handler was delayed by -1.5258861849999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 13:14:45.801688 10897 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:45.829572  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:45.832260  7891 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:45.830029  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:45.822971 10995 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:14:45.817807 11285 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.776680 11261 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:45.838294  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:45.785043 11159 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:45.843920 11301 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:14:45.825709 10985 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.815142 11154 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:14:45.770793 11189 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:45.823669 11262 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.032176  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:46.031725  7334 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:45.885649  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:45.934767  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:45.894744  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:46.051568  7890 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:46.052137  7893 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:14:45.845872  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:46.039180  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:45.995292  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 296464us
I20260709 13:14:45.935560  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:45.903658  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:45.966760  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:46.057942  7892 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 6.
I20260709 13:14:45.913239  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:46.002660  7187 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:45.965962  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:45.902078  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.031448  7184 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:46.041949  7186 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:46.058300  7180 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:46.061131  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 125669us
I20260709 13:14:46.062594  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:46.065636  7334 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:14:46.040983  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:46.068364  7185 raft_consensus.cc:2410] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:46.078123  7335 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:45.827867 11302 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:45.854983 11307 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:14:46.090279  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:46.140174  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49619.9us
I20260709 13:14:46.148188  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:46.172710  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:46.174279  7890 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:45.895581 11305 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:14:45.931740 11306 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:14:45.919067 11299 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
W20260709 13:14:45.919948 11037 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.982s	user 0.006s	sys 0.007s
I20260709 13:14:46.107045  7180 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:14:45.900430 11311 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.845139 11285 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:45.873059 11281 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:46.090719  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:45.900305 11086 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:45.998158 11314 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:45.932662 11295 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:45.876421 11271 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:46.059726 11277 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:45.892937 11194 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:46.204026  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:46.172505 11259 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:14:46.091508 11025 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 13:14:46.112051 11302 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:46.031392 11292 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.092648 10985 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.209784 11037 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.230450 11259 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.231194 11276 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:46.231909 11304 log.cc:927] Time spent T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:14:45.842478 11257 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:45.920238 11110 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.246791  7327 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
W20260709 13:14:46.231225 11310 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:14:46.234509 11271 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.255067  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 696) took 1038 ms. Trace:
I20260709 13:14:46.263912  7261 raft_consensus.cc:1813] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Handling vote request from an unknown peer 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:46.264704  7261 raft_consensus.cc:2368] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:46.228152 11277 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.226352 11086 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:46.258386 11132 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.001s
I20260709 13:14:46.283521 11086 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.272357 11259 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:46.273411 11037 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:46.273989 11281 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:46.286319 11309 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:14:46.287250 11315 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:46.287976 11315 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.251586 11159 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:46.240926 11254 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.236255 11302 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:46.283643 11132 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.280089 11149 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:46.298758 11149 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:46.299242 11149 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:46.299598 11262 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.285192 11277 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.216765 11311 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.264181  7258 rpcz_store.cc:276] 0709 13:14:45.216229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.479231 (+263002us) service_pool.cc:224] Handling call
0709 13:14:45.513734 (+ 34503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:45.514064 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:45.514094 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:45.542155 (+ 28061us) log.cc:844] Serialized 26 byte log entry
0709 13:14:45.669987 (+127832us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:45.670052 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:45.670162 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:46.254799 (+584637us) raft_consensus.cc:1685] finished
0709 13:14:46.254829 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.254994 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82419,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"thread_start_us":51453,"threads_started":1,"wal-append.queue_time_us":106194}
W20260709 13:14:46.292572 11308 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260709 13:14:46.232352 10855 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.256013 11275 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:46.283521 11256 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.350s	user 0.002s	sys 0.005s
W20260709 13:14:46.289247 11179 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.239s	user 0.015s	sys 0.000s
I20260709 13:14:46.224769 11314 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.228709 11295 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.285017 11289 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:46.304610 11159 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:14:46.314792  7891 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:46.305671 11254 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.311932 11275 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:46.318498 11295 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.318213 11311 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.318789  7888 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:46.304646 11262 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.282544 11271 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.318401 11314 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.197738 11305 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:46.327183 11025 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:46.341300  7181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.017s	sys 0.040s
W20260709 13:14:46.345288  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.017s	sys 0.032s
W20260709 13:14:46.345484  7181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.017s	sys 0.041s
W20260709 13:14:46.345674  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.017s	sys 0.032s
W20260709 13:14:46.342298  7152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.010s	sys 0.031s
W20260709 13:14:46.345988  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 526161us
I20260709 13:14:46.346937  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1862) took 1228 ms. Trace:
W20260709 13:14:46.346151  7152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.011s	sys 0.031s
W20260709 13:14:46.348326  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 659676us
W20260709 13:14:46.340698  7153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.019s	sys 0.029s
W20260709 13:14:46.349159  7153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.019s	sys 0.030s
I20260709 13:14:46.361174 11259 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:46.361292 11194 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:46.361819 11259 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.361847 11194 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.362483  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.330575 11254 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.337388 11262 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.367489  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:46.377012  7228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.039s	sys 0.055s
W20260709 13:14:46.377532  7228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.039s	sys 0.055s
W20260709 13:14:46.377907  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 575255us
I20260709 13:14:46.378821  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:46.358232 11178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.016s	sys 0.044s
I20260709 13:14:46.364076 11259 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.383462 11259 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.384068 11259 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:46.387948  7301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.019s	sys 0.043s
W20260709 13:14:46.388388  7301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.019s	sys 0.043s
W20260709 13:14:46.388710  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 702291us
I20260709 13:14:46.389539  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:46.391832  7299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.013s	sys 0.011s
I20260709 13:14:46.356720 11305 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:46.364060 11194 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:46.392657  7299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.014s	sys 0.012s
I20260709 13:14:46.393954  7257 raft_consensus.cc:2410] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:14:46.386977 11178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.017s	sys 0.046s
I20260709 13:14:46.357504 11159 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:46.392691 11086 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:46.401489 11278 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.002s
W20260709 13:14:46.399359  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 616239us
W20260709 13:14:46.380116 11286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.028s	sys 0.064s
I20260709 13:14:46.365495 11025 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.400344 11194 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:46.492224 11025 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.396659 11317 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:14:46.401890 10998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.002s	sys 0.014s
I20260709 13:14:46.366670 11277 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.451546 10985 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.412168 11159 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:46.494445 11286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.032s	sys 0.088s
W20260709 13:14:46.497433 10998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.003s	sys 0.015s
W20260709 13:14:46.499828 11258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.022s	sys 0.070s
I20260709 13:14:46.483515 11278 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:14:46.527081 11265 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.003s
W20260709 13:14:46.573531  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 425211us
W20260709 13:14:46.574673  7151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.005s
I20260709 13:14:46.366662  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:46.592403  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.634809 11330 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:46.398597  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.597025  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:46.542130 11271 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:46.500650 11285 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.644619 11285 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:46.543874 11305 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.647526 11278 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.499404 11317 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.651113  7150 leader_election.cc:400] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
I20260709 13:14:46.614722  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:46.638336  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:46.530424 11258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.022s	sys 0.071s
I20260709 13:14:46.619930 11315 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:46.633141  7151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.002s	sys 0.006s
I20260709 13:14:46.639178  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:46.640889 11159 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.651539  7150 leader_election.cc:403] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:14:46.654492  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:46.655232 11317 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:46.658517 11262 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:46.660209 11319 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:46.662914 11265 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.664878 11278 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:46.664824  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 298085us
I20260709 13:14:46.636071 11330 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.672245  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 692) took 1498 ms. Trace:
I20260709 13:14:46.682811  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.683719  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.688573 11305 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:46.703594 11317 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:46.703857  7331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1647) took 2791 ms (client timeout 2246 ms). Trace:
I20260709 13:14:46.704927  7257 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:46.704562 11317 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:46.705822  7332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1716) took 2799 ms (client timeout 1733 ms). Trace:
I20260709 13:14:46.706341  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:46.706252  7332 rpcz_store.cc:269] 0709 13:14:43.906060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.908334 (+  2274us) service_pool.cc:224] Handling call
0709 13:14:46.705402 (+2797068us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400253854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:46.705649 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488260352}
I20260709 13:14:46.708019  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.708801  7257 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:46.709859 11265 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.711880  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.713150  7258 raft_consensus.cc:2410] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:14:46.713515  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 545) took 1533 ms. Trace:
I20260709 13:14:46.693378 11278 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.695132 11315 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
I20260709 13:14:46.693797  7253 rpcz_store.cc:276] 0709 13:14:45.167435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.167560 (+   125us) service_pool.cc:224] Handling call
0709 13:14:46.664459 (+1496899us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b5800003098. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117eee 0000000000375939 00007fecee18b1e0 00007fecee2540c4 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:14:46.664791 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.665172 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.665195 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:46.665249 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:46.665279 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.665334 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.665489 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11406080}
I20260709 13:14:46.695885 11319 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.714780 11159 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:14:46.719069 11319 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.719154  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.719842 11179 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.719991 11319 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:46.720711  7253 raft_consensus.cc:2410] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:14:46.720890 11179 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.699110 11302 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.704041  7329 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:46.690203  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.715082 11278 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:46.710522  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 1.23333e+06us
I20260709 13:14:46.714116  7328 rpcz_store.cc:276] 0709 13:14:45.180212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.386393 (+206181us) service_pool.cc:224] Handling call
0709 13:14:45.394882 (+  8489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:45.530786 (+135904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:45.530823 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:45.530866 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:45.530899 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.712818 (+1181919us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54001ffed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:46.712903 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.713209 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312036224}
I20260709 13:14:46.731302  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:46.721222 11319 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:14:46.732236  7890 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
W20260709 13:14:46.734362  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.734422  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:46.735311 11262 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.735522  7895 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:46.736009 11262 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:46.738600 11262 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:46.742846  7862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.008s	sys 0.003s
W20260709 13:14:46.704489  7331 rpcz_store.cc:269] 0709 13:14:43.912715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.912882 (+   167us) service_pool.cc:224] Handling call
0709 13:14:46.703195 (+2790313us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400421654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:46.703564 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472592128}
W20260709 13:14:46.749434  7862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.008s	sys 0.004s
W20260709 13:14:46.772078  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.783711  7259 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:46.838208  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 170399us
I20260709 13:14:46.709893  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.810966  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:46.816350  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:46.805826  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.810190  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 541) took 1692 ms. Trace:
I20260709 13:14:46.811671  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 542) took 1657 ms. Trace:
I20260709 13:14:46.808418  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:46.789819  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1640) took 1565 ms. Trace:
I20260709 13:14:46.847671  7257 raft_consensus.cc:2410] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:14:46.791332  7260 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 6. Current term is 8. Ops: []
W20260709 13:14:46.814836  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 84095.8us
I20260709 13:14:46.812515  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:46.791631  7253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:57560
I20260709 13:14:46.761425 11302 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:46.975761  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 913180us
I20260709 13:14:46.978941  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:46.979954  7889 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:46.793303  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 544) took 1620 ms. Trace:
I20260709 13:14:46.970404  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.846966  7329 rpcz_store.cc:276] 0709 13:14:45.154617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.163577 (+  8960us) service_pool.cc:224] Handling call
0709 13:14:46.703475 (+1539898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.726436 (+ 22961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.811368 (+ 84932us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400421650. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:46.811587 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3540508544}
I20260709 13:14:46.792407  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1633) took 1576 ms. Trace:
I20260709 13:14:46.969856  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:46.979116  7253 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.971274  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:46.768129  7262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1641) took 1537 ms (client timeout 1770 ms). Trace:
I20260709 13:14:46.985893  7253 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:46.983595  7262 rpcz_store.cc:269] 0709 13:14:45.230588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.689610 (+1459022us) service_pool.cc:224] Handling call
0709 13:14:46.768025 (+ 78415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:46.847540  7261 rpcz_store.cc:276] 0709 13:14:45.224471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.437568 (+213097us) service_pool.cc:224] Handling call
0709 13:14:46.789283 (+1351715us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54001e05d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:46.789566 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805759744}
I20260709 13:14:46.973709  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:46.763294 11317 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:46.846304  7327 rpcz_store.cc:276] 0709 13:14:45.118007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.118123 (+   116us) service_pool.cc:224] Handling call
0709 13:14:45.178121 (+ 59998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.254335 (+1076214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.809688 (+555353us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003868d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:46.810009 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457134848}
I20260709 13:14:46.751072 11132 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.801097 11330 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:46.847312  7861 connection.cc:256] RPC call timeout handler was delayed by -1.0443836699998883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 13:14:46.807926 10706 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:46.994455  7331 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:46.994352  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:46.996423  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:46.997789  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:46.808445 11258 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.788678 11137 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:46.802809 11179 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.818078 11260 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:46.980751  7330 rpcz_store.cc:276] 0709 13:14:45.172488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.177646 (+  5158us) service_pool.cc:224] Handling call
0709 13:14:45.228021 (+ 50375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:45.515818 (+287797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.792814 (+1276996us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b54001d29d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:46.793120 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130393856}
W20260709 13:14:47.003363  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 141399us
I20260709 13:14:46.763435 11209 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:46.770912 11210 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.015374 11210 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:47.015901  7258 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
W20260709 13:14:47.008886 11192 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 3.919s	user 0.007s	sys 0.030s
W20260709 13:14:47.017728 11253 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 2.396s	user 0.006s	sys 0.022s
I20260709 13:14:46.763897 11263 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:46.764446 11259 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:47.010803  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 148228us
I20260709 13:14:47.011130 11258 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:47.012275 11320 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:47.012512 11313 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:47.001802 10706 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:47.037462 10706 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:47.038708 10706 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:46.998495 11177 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:14:47.041745  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:47.043095  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 94948.7us
I20260709 13:14:47.043162 11341 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:47.044317  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 562) took 1159 ms. Trace:
I20260709 13:14:47.044732  7888 rpcz_store.cc:276] 0709 13:14:45.884814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.885314 (+   500us) service_pool.cc:224] Handling call
0709 13:14:47.043891 (+1158577us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400661554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:47.044087 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616060800}
I20260709 13:14:47.046337 11278 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:47.047528  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 559) took 1209 ms. Trace:
I20260709 13:14:47.047946  7891 rpcz_store.cc:276] 0709 13:14:45.837871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.838008 (+   137us) service_pool.cc:224] Handling call
0709 13:14:47.047183 (+1209175us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540056cf54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:47.047359 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085582080}
I20260709 13:14:47.048619 11278 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:47.053810 10924 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.031004 11313 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:14:47.060384 11255 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 2.148s	user 0.006s	sys 0.007s
I20260709 13:14:47.060631 11313 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.766837 10855 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.063356  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:47.063812  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 698) took 1818 ms. Trace:
I20260709 13:14:47.064265  7260 rpcz_store.cc:276] 0709 13:14:45.245911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.701354 (+455443us) service_pool.cc:224] Handling call
0709 13:14:46.790841 (+1089487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.926428 (+135587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.063575 (+137147us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001e05d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:47.063750 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2504706944}
I20260709 13:14:47.005985  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:47.030148  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:46.765504 11254 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:46.771564 11292 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.034279 11323 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.137447 11323 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:47.139047  7259 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:14:47.139443  7259 pending_rounds.cc:85] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 5
I20260709 13:14:47.139214  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:47.139700  7259 pending_rounds.cc:107] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:14:47.140049  7259 raft_consensus.cc:2889] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:47.062565 11313 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:47.141099  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2729) took 4337 ms. Trace:
I20260709 13:14:47.141481  7259 rpcz_store.cc:276] 0709 13:14:42.803887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.905189 (+101302us) service_pool.cc:224] Handling call
0709 13:14:42.905856 (+   667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:46.782185 (+3876329us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b58008d3ed0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91980aa 00007fece921a447 00007fece9232fe7 00007fece92347de 00007fece923eb49 00007fece923f416 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4
0709 13:14:47.140734 (+358549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.141029 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1458298624}
I20260709 13:14:47.145352  7889 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:47.133538  7329 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:47.133920  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:47.134305  7152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.770s (SENT) [suppressed 29 similar messages]
I20260709 13:14:47.139991 11323 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:47.034996  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:47.036095 11149 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.736s	user 0.022s	sys 0.001s
I20260709 13:14:47.174204  7253 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:47.185967  7331 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
W20260709 13:14:47.189863 11091 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:14:47.191253 11100 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:47.193095 11179 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:47.193612 11179 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:14:47.194881  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 62780.6us
I20260709 13:14:47.198341 11179 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:46.982048  7254 rpcz_store.cc:276] 0709 13:14:45.216122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.218213 (+  2091us) service_pool.cc:224] Handling call
0709 13:14:45.247290 (+ 29077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:45.644074 (+396784us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:45.650092 (+  6018us) log.cc:844] Serialized 14 byte log entry
0709 13:14:45.696354 (+ 46262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:45.696427 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:45.696491 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.791943 (+1095452us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b5400058a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:46.792010 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.792252 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6256,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":20900,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"spinlock_wait_cycles":911936896,"thread_start_us":44410,"threads_started":1,"wal-append.queue_time_us":250277}
W20260709 13:14:47.235344  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.347388  7181 rpcz_store.cc:276] 0709 13:14:45.118720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.118830 (+   110us) service_pool.cc:224] Handling call
0709 13:14:45.119115 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:45.119294 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:14:45.271682 (+152388us) log.cc:844] Serialized 14 byte log entry
0709 13:14:46.346589 (+1074907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:46.346664 (+    75us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:14:46.346707 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:46.346772 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:46.346884 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":258581,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":111,"thread_start_us":1183395,"threads_started":2}
I20260709 13:14:47.231362  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:47.245352  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 113326us
I20260709 13:14:47.249650  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:47.253103  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 272631us
I20260709 13:14:47.014298 11137 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:47.198778 11149 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:47.254315  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 223466us
I20260709 13:14:47.346966  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2770) took 2180 ms. Trace:
I20260709 13:14:47.432651  7253 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:47.293970  7329 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:47.433547  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:47.349803  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53506.4us
I20260709 13:14:47.368206  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 703) took 2077 ms. Trace:
I20260709 13:14:47.346619  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2556) took 3081 ms. Trace:
W20260709 13:14:47.319411  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54469.4us
W20260709 13:14:47.388214 11276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.019s	sys 0.052s
I20260709 13:14:47.442215  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:47.432770  7256 rpcz_store.cc:276] 0709 13:14:45.166745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.166913 (+   168us) service_pool.cc:224] Handling call
0709 13:14:45.216088 (+ 49175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:45.532486 (+316398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:45.532515 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:45.532559 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:45.532589 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.304437 (+1771848us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400218ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:47.308423 (+  3986us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.346756 (+ 38333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727219584}
I20260709 13:14:47.321871 11179 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:47.451967  7327 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:47.423970 11258 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:47.347271 11259 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:47.346364 10532 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.456032  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:47.384857 11319 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:47.459793  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:47.397949 11269 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:47.463171  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:47.464071 10865 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:47.464236  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:47.437434  7255 rpcz_store.cc:276] 0709 13:14:45.276375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:45.729668 (+453293us) service_pool.cc:224] Handling call
0709 13:14:45.730008 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:45.732388 (+  2380us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:45.772813 (+ 40425us) log.cc:844] Serialized 14 byte log entry
0709 13:14:46.781261 (+1008448us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b18000d71a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a 00007fece9246a2a
0709 13:14:47.186233 (+404972us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:47.230129 (+ 43896us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:47.276613 (+ 46484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.307927 (+ 31314us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.353188 (+ 45261us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40232,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1911,"raft.queue_time_us":107684,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":78166,"spinlock_wait_cycles":5732608,"thread_start_us":219281,"threads_started":1,"wal-append.queue_time_us":1279219}
I20260709 13:14:47.293265 11132 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:47.347158 11151 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:47.395098 11261 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.276212 11260 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:47.349190 11279 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.350173 11178 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:14:47.352799 11233 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:14:47.307121 11320 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:14:47.498181  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 45138.1us
W20260709 13:14:47.501380  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 46024.7us
I20260709 13:14:47.503252 11100 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:47.503098 11132 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:47.503878 11100 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:47.302861 11267 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.215s
I20260709 13:14:47.440577  7182 rpcz_store.cc:276] 0709 13:14:44.168656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.201184 (+ 32528us) service_pool.cc:224] Handling call
0709 13:14:44.201553 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:44.201981 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:44.202017 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:44.219195 (+ 17178us) log.cc:844] Serialized 52 byte log entry
0709 13:14:44.432960 (+213765us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:44.433017 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.433113 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.059354 (+2626241us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:47.066842 (+  7488us) raft_consensus.cc:1685] finished
0709 13:14:47.066865 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.249771 (+182906us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":595,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8585,"spinlock_wait_cycles":5406976,"thread_start_us":183763,"threads_started":1,"wal-append.queue_time_us":610882}
I20260709 13:14:47.509450  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:47.517130  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:47.491094 11210 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.506433 11132 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:47.518718 10865 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:47.512524 11100 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:47.464720 10532 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:47.535475  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.507930 11319 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:47.535662  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:47.527935  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:47.524392 11254 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.541637  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:47.545574 11026 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:14:47.551957 11260 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.511431 11259 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:47.564059  7327 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
W20260709 13:14:47.564064  7257 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.001s	sys 0.022s
W20260709 13:14:47.569794  7257 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.001s	sys 0.023s
I20260709 13:14:47.571787 11150 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:47.576202 11319 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:47.580113 10865 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.583398  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:47.587316  7331 raft_consensus.cc:2368] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11.
I20260709 13:14:47.538806 11274 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:47.592468  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:47.600593  7256 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:47.592968 11150 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:47.591043 11149 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.609107  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:47.621716  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 487434us
W20260709 13:14:47.628500  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.630064  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 382276us
W20260709 13:14:47.642228  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.601866 11267 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:14:47.614488  7895 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.018s	sys 0.017s
W20260709 13:14:47.689342  7895 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.018s	sys 0.020s
W20260709 13:14:47.622687 11282 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.095s	user 0.008s	sys 0.021s
I20260709 13:14:47.693096  7074 maintenance_manager.cc:419] P 50ff9c56d8414bdb8f05f31957b53075: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033364
I20260709 13:14:47.603005 11254 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:47.697880  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:47.613546 11209 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:14:47.609881 11100 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:47.725884 11150 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:47.726899  7150 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:47.727495 11279 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:47.727996 11274 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.733534  7255 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:47.723706 11267 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:47.740167  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 233268us
I20260709 13:14:47.736852 11137 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:47.695971 11282 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.169s	user 0.009s	sys 0.021s
I20260709 13:14:47.747705 11177 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:47.763538 11269 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:14:47.778726  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 87841.4us
W20260709 13:14:47.789686 11342 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:14:47.794889  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 796) took 1036 ms. Trace:
I20260709 13:14:47.795537  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:47.780483 11294 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.026s	sys 0.060s
I20260709 13:14:47.797780  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:47.779719 11320 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.795331  7890 rpcz_store.cc:276] 0709 13:14:46.759024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.764066 (+  5042us) service_pool.cc:224] Handling call
0709 13:14:46.764611 (+   545us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:46.765819 (+  1208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.765851 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:46.766787 (+   936us) log.cc:844] Serialized 52 byte log entry
0709 13:14:47.067011 (+300224us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:47.067052 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.130063 (+ 63011us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.794587 (+664524us) raft_consensus.cc:1685] finished
0709 13:14:47.794603 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.794804 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"thread_start_us":299611,"threads_started":1,"wal-append.queue_time_us":851719}
W20260709 13:14:47.804441 11238 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.179s	user 0.072s	sys 0.096s
I20260709 13:14:47.764587 11274 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:47.801602 11294 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.026s	sys 0.061s
W20260709 13:14:47.810374 11238 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.188s	user 0.072s	sys 0.097s
I20260709 13:14:47.817873  7253 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:47.818668 11267 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:47.786432 11210 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:14:47.820793  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:47.821909 11173 raft_consensus.cc:2764] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:14:47.834975  7860 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.013s	sys 0.016s
W20260709 13:14:47.836017  7860 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.014s	sys 0.017s
I20260709 13:14:47.824278  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:47.824659  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 50299.2us
I20260709 13:14:47.825733 11100 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:47.826227 11269 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:47.827443  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:47.816933 11259 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.783190 11279 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:47.830888 11274 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:47.841699  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:47.842594 11261 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:47.843103  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:47.844820  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:47.845091  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:47.845733  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:47.847011  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:47.854786  7891 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:47.847433  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:47.847844  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:47.849457  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:47.851428 11149 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:47.840592 11269 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:47.855939  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:14:47.860955 11313 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.003s
I20260709 13:14:47.862207  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:47.867213 11254 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.855259 11209 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:47.870116  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:47.871037  7262 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:47.855306 11261 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:47.880693 11205 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:47.881521 11205 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:47.882030 11205 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:47.883690 11323 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:47.884209 11323 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.884315  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:47.859684 11149 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:47.888980  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:47.888792 11173 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:47.891242 11173 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:47.892956  7895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 795) took 1144 ms. Trace:
I20260709 13:14:47.893414 11274 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:47.894045 11274 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.894744 11274 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:47.893507  7895 rpcz_store.cc:276] 0709 13:14:46.749128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.749399 (+   271us) service_pool.cc:224] Handling call
0709 13:14:46.751952 (+  2553us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:46.753027 (+  1075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:46.753065 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:46.939797 (+186732us) log.cc:844] Serialized 52 byte log entry
0709 13:14:47.693801 (+754004us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:47.693866 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:47.693967 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:47.892611 (+198644us) raft_consensus.cc:1685] finished
0709 13:14:47.892642 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:47.892838 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":152,"thread_start_us":749461,"threads_started":1,"wal-append.queue_time_us":905936}
W20260709 13:14:47.896653  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49422.5us
I20260709 13:14:47.899036 11355 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:47.899389  7152 leader_election.cc:400] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:47.900097 11355 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:47.901846  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:47.902120  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:47.902557  7181 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:47.880848 11100 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:47.884658 11323 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:47.861584 11269 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:47.902451  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:47.857206 11210 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:14:47.915716  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:47.914911  7183 raft_consensus.cc:2376] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14. Re-sending same reply.
I20260709 13:14:47.853653 11276 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:14:47.916416  7185 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:47.921609  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:47.915994 11210 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:47.903916 11261 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:47.929209  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 55870.1us
I20260709 13:14:47.929376  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:47.907523 11100 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:47.935313  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:47.936661  7253 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:47.938153  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:47.939258  7259 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:14:47.929209  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:47.943608 11356 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:47.939621  7259 pending_rounds.cc:85] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 10
I20260709 13:14:47.925516 11313 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.949028  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:47.949932  7185 raft_consensus.cc:2368] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12.
I20260709 13:14:47.956115 11279 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:47.960621  7259 pending_rounds.cc:107] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:14:47.961109  7259 raft_consensus.cc:2889] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:47.937108 11276 consensus_queue.cc:1243] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:47.925933 11210 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:47.945927  7178 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:47.937346 11100 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:47.941174 11238 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.979800  7178 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:47.965790  7262 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:47.968999 11279 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:47.992882  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.013979  7261 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:48.019233  7179 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:14:48.018844 11179 consensus_meta.cc:287] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.558s	user 0.014s	sys 0.000s
I20260709 13:14:47.976708 11313 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:48.031543  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.048843 10532 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:48.049197  7184 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:48.049849  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.055099  7887 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:48.020538 11238 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:48.078685  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.082482  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:48.078369 11078 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:14:48.087329  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:48.089470  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:48.087368  7179 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:48.093561  7890 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:48.092439  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 476467us
W20260709 13:14:48.069705 11091 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.017s	sys 0.029s
I20260709 13:14:48.102242  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:48.107923  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:48.112761  7257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.032s
W20260709 13:14:48.113263  7257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.011s	sys 0.032s
I20260709 13:14:48.116135  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:48.116843  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 706) took 1324 ms. Trace:
W20260709 13:14:48.103627 11091 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.017s	sys 0.030s
I20260709 13:14:48.129736  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:48.132782  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:48.132810  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.136325  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:48.144059  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:48.138486  7888 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:48.149117  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:48.149842  7889 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:48.153087  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:48.153764  7262 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:48.155027  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:48.125417  7257 rpcz_store.cc:276] 0709 13:14:46.792815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.995050 (+202235us) service_pool.cc:224] Handling call
0709 13:14:47.027435 (+ 32385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:47.041238 (+ 13803us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:47.581278 (+540040us) log.cc:844] Serialized 14 byte log entry
0709 13:14:48.116489 (+535211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:48.116547 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:48.116589 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.116662 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:48.116782 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9067,"prepare.queue_time_us":904076,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2106,"raft.queue_time_us":2793,"thread_start_us":1060550,"threads_started":2,"wal-append.queue_time_us":529174}
I20260709 13:14:48.156416  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:48.157361  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:48.159971  7327 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:48.090644 11210 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:48.161180  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:48.177251  7257 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:14:48.179908  7259 raft_consensus.cc:2410] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:14:48.186926  7179 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:48.115173 11149 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:48.177145  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.201932  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:48.207690  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:48.168061 10532 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:14:48.228945  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.197654 11313 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:48.232740  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 302650us
I20260709 13:14:48.233637  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:48.229915  7179 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:48.219389 11210 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:48.240324  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:48.245652  7181 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:48.240536  7187 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
W20260709 13:14:48.247807  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.262217  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:48.266549  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.266661  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:48.263662  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1734) took 1003 ms. Trace:
I20260709 13:14:48.268182  7330 rpcz_store.cc:276] 0709 13:14:47.263471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.210088 (+946617us) service_pool.cc:224] Handling call
0709 13:14:48.263597 (+ 53509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:48.268947  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:48.269299  7181 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:48.274312  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:48.252547 11173 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.278553  7332 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:48.299436  7328 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:14:47.843556  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:48.440949  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.301592  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:48.330058  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.380410  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:48.359719  7329 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 8: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:48.449536  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 215979us
I20260709 13:14:48.450876  7150 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:48.301003 11313 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:48.349745  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:48.453140  7334 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
W20260709 13:14:48.448253  7225 connection.cc:256] RPC call timeout handler was delayed by -1.2194235090000802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:14:48.455050  7225 connection.cc:256] RPC call timeout handler was delayed by -1.1947149720001562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260709 13:14:48.455835  7261 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:48.387606  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:48.478356  7257 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:48.479784  7896 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:48.429251 11238 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:48.486014  7253 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:48.480345  7896 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:48.449958 11149 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:48.517253  7896 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:48.455180 11078 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:48.518872  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:48.519048  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:48.529461  7262 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:14:48.530710  7181 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:14:48.531817  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.533284  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:48.534674  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:48.535483  7181 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:48.536723  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:48.520382  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:48.491781  7187 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:48.526849  7896 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:48.387408  7083 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 9 to 11, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 11 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.336540 11173 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:48.548875  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:48.551877  7182 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:48.558975  7262 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 8: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:48.565912 11274 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.670s	user 0.004s	sys 0.006s
I20260709 13:14:48.524771 11313 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:48.538902 11238 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:48.529115 11078 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:48.578333  7896 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:48.586000  7181 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:48.582497  7182 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
W20260709 13:14:48.637015  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 54517.2us
W20260709 13:14:48.639937  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46768.1us
W20260709 13:14:48.637655  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 186927us
I20260709 13:14:48.639230  7257 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:48.680842  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:48.639446 11370 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:48.638535 11378 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:14:48.684346  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:48.698264  7890 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.001s
I20260709 13:14:48.742133  7187 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
W20260709 13:14:48.703895 11205 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.821s	user 0.014s	sys 0.000s
I20260709 13:14:48.744599 11205 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:48.684808 11238 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:48.747905 11238 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:48.708659  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:14:48.736649  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 274965us
W20260709 13:14:48.737685  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61374.1us
I20260709 13:14:48.750008  7327 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:48.743711  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.736373 11173 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:48.738791 11370 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:48.739370 11383 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:14:48.740410  7225 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:48.698614  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:48.742481  7890 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:48.740666  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:48.745077 11100 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.004s
W20260709 13:14:48.738389 11269 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.808s	user 0.010s	sys 0.001s
I20260709 13:14:48.740989 11078 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:48.761507 10855 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:48.761754 11078 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:48.761994 10855 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:48.762470 10855 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:48.769164  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.769889  7185 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:14:48.770852  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:48.739734 11292 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:48.754699  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:48.754956  7182 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:48.753980  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:48.759248  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 82318us
I20260709 13:14:48.778152  7187 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:48.771461 11372 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:14:48.705113 11377 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:14:48.751147  7181 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:48.781638  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.589545 11274 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:48.750563 11258 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:14:48.777812  7228 leader_election.cc:336] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.710s (SENT)
I20260709 13:14:48.782505  7182 raft_consensus.cc:2410] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:14:48.778946  7150 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:48.784828  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:48.787302  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:48.780453 11372 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.801712 11372 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:48.804875  7181 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:48.786116 11205 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:48.774802 11100 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:48.811473  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.814807  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:48.814807 11313 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:48.815604 11313 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:48.816857  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:48.816632 11313 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:48.817724 11266 raft_consensus.cc:2764] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:14:48.818523 11266 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:48.820052  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:48.823302 11261 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.877s	user 0.007s	sys 0.004s
I20260709 13:14:48.808053  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.823918  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:48.825591  7184 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:48.826231  7185 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:48.827244  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 48687.2us
W20260709 13:14:48.817188 11210 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.001s
W20260709 13:14:48.829001  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44251.2us
I20260709 13:14:48.829936 11266 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:48.830119  7262 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:48.830431 11266 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:48.830612  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 76752.1us
W20260709 13:14:48.792606 11323 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.865s	user 0.012s	sys 0.000s
I20260709 13:14:48.830915 11266 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:48.778733 11269 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:48.826553  7180 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:48.837162 11397 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:48.837733 11397 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.838074 11397 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:48.838658  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.839365  7184 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:48.841763 11100 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:48.843195  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:48.850368  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.877382  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.887643  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.831357 11261 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:48.905524  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 84238.8us
I20260709 13:14:48.905958 11261 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:48.906998  7186 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:48.909360 10855 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:48.912519  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 80647us
I20260709 13:14:48.834565 11282 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:48.914109  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:48.931532  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:48.931919  7889 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:48.932799  7331 raft_consensus.cc:2410] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:14:48.944566  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:48.952862  7187 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:48.891101 10532 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:48.914022 11282 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:48.960249 11274 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:48.996227  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.960134  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:48.966812 11279 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:48.967897  7894 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:48.968878  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:48.998299  7896 raft_consensus.cc:2410] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:14:48.998168  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 238291us
I20260709 13:14:48.969169  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:48.966884  7183 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:14:48.970368  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.959405  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:48.803730 11292 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:48.990833  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 77746.2us
I20260709 13:14:48.994962  7181 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:14:48.854092 11323 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.005913  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:49.006492  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:49.008126  7187 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:48.947044 11258 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:49.014771  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:49.019244  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:48.976698 10532 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:48.996824 11282 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:49.031833  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:49.036288  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.036430  7889 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:49.035283  7258 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:49.040390 11208 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:14:49.040799 11178 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:49.041405 11208 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:49.041802 11208 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:49.042418 11100 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.035298 10532 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:49.043180 11100 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.045590 11100 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.035591 11391 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:49.047302 11391 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.047624 11258 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.049467 11391 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.050487 11370 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.051124 11370 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:49.051560  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:49.051623 11370 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.052964  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:49.053617  7178 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:49.053911 11370 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.042484 11194 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.055517 11269 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:49.054407  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:49.046785 11396 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:14:49.058462  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2784) took 1189 ms. Trace:
I20260709 13:14:49.058812  7178 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:49.059775  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:49.059898 11323 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.058908  7260 rpcz_store.cc:276] 0709 13:14:47.869226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.878138 (+  8912us) service_pool.cc:224] Handling call
0709 13:14:47.921054 (+ 42916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:47.959713 (+ 38659us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:47.960075 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 13:14:48.214083 (+254008us) log.cc:844] Serialized 14 byte log entry
0709 13:14:48.536614 (+322531us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b480033c3d8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:14:49.057735 (+521121us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b1800340660. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fececc343c7 00007fece92469a7 00007fece92560bf 00007fece9256038
0709 13:14:49.057964 (+   229us) log.cc:844] Serialized 14 byte log entry
0709 13:14:49.058142 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:49.058187 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:49.058232 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.058295 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.058402 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31329,"prepare.queue_time_us":955555,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":139,"raft.queue_time_us":18612,"raft.run_cpu_time_us":2667,"raft.run_wall_time_us":338242,"spinlock_wait_cycles":29499264,"thread_start_us":232681,"threads_started":1,"wal-append.queue_time_us":323586}
I20260709 13:14:49.060643  7178 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:49.061430 10532 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.061525 11279 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.063850  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:49.065526  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1868) took 1163 ms. Trace:
I20260709 13:14:49.056797 10855 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:49.101456  7186 rpcz_store.cc:276] 0709 13:14:47.902298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.908282 (+  5984us) service_pool.cc:224] Handling call
0709 13:14:49.065299 (+1157017us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b54002b57d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:49.065444 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2221373184}
I20260709 13:14:49.055296 11194 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:49.066329  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.033479  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:49.066655 11208 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.029982 11274 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:49.038111  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:49.108842  7183 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:49.086117 11078 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.086860  7179 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:49.090180  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 569) took 1010 ms. Trace:
I20260709 13:14:49.093529  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:49.110041  7890 rpcz_store.cc:276] 0709 13:14:48.079849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.080059 (+   210us) service_pool.cc:224] Handling call
0709 13:14:49.089975 (+1009916us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b540056cf54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:49.090115 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7370624}
I20260709 13:14:49.092834  7083 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 7 to 9, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 9 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:49.111404 11078 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.112705 11279 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.113584  7186 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:14:49.113718 11078 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.115844  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:49.116513  7257 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:14:49.099179  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:49.115854  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:49.116518  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:49.099900  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 94078.8us
I20260709 13:14:49.119632  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:49.121208  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:49.123517  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:49.127866 11205 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:49.128235 10532 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:49.128351 11205 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:49.128892 11205 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:49.130887 11266 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.132165 11194 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.133000 11266 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:49.133116 11208 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:49.134127  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:49.134991  7183 raft_consensus.cc:2410] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:14:49.137037 11205 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.140275  7187 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: [8.6-12.8]
I20260709 13:14:49.141808  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:49.165292  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:49.173151  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:49.174171  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:49.106225  7181 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:49.196003  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:49.196349  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:49.196712  7186 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:14:49.130939 11173 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:49.199411  7187 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:14:49.199810  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:49.203827  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:49.163878 11026 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:49.168306 11323 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.204216  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:49.211589  7331 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:49.200054 11374 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:49.200742 11404 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:49.213799 11389 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:14:49.171658 11149 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:49.218804 11149 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.219220 11149 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:49.204974 11274 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.221421 11274 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.222589  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.222993  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.223862  7335 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:49.224813  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:49.225539  7333 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:49.226382  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.227896  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:49.228264  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:49.223049  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.229158  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1878) took 1069 ms. Trace:
I20260709 13:14:49.229771 11356 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:49.230203 11356 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.230536 11356 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.232388  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:49.233075  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:49.229558  7179 rpcz_store.cc:276] 0709 13:14:48.163886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.249330 (+ 85444us) service_pool.cc:224] Handling call
0709 13:14:49.228984 (+979654us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b540017cd54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:49.229102 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773773568}
I20260709 13:14:49.233709  7888 raft_consensus.cc:2376] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8. Re-sending same reply.
I20260709 13:14:49.233376 11100 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:49.236196  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:49.236553 11100 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:49.236809  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:49.237598  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:49.237705  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:49.239270  7179 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:14:49.240715  7179 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:49.243916  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:49.244967  7890 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:14:49.245151  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.138926 11397 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.236982 11100 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:49.252655  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:14:49.213918  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 112301us
I20260709 13:14:49.255324  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:49.264427  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:49.265349  7896 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:49.267338  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:49.268401  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:49.269064  7887 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:49.269519  7336 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:49.270272  7179 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:49.245604 11279 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:49.233709 11404 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:49.278960  7891 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:49.286094  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1730) took 2310 ms. Trace:
W20260709 13:14:49.286000  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 53704.8us
I20260709 13:14:49.257903 11205 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:49.288035  7331 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:14:49.231277 11323 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.212980 11372 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.286559  7336 rpcz_store.cc:276] 0709 13:14:46.975786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.497080 (+521294us) service_pool.cc:224] Handling call
0709 13:14:47.513894 (+ 16814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:49.269921 (+1756027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.283691 (+ 13770us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400253854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:49.286029 (+  2338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4007013504}
I20260709 13:14:49.323827  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.293177  7179 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:14:49.329555  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44056.3us
I20260709 13:14:49.333778  7887 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
W20260709 13:14:49.339150  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.339003  7896 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:49.274695 11374 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:49.280994 11269 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:49.340677  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.343788  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.370448  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.344062  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.344669  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.281452 11274 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:49.328234 11279 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:49.375233  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:49.376269  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.290094 11150 raft_consensus.cc:2764] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:14:49.380707  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.375403  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.386984  7178 raft_consensus.cc:2368] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9.
I20260709 13:14:49.387140  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:49.386062  7335 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:49.391213  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:49.391882  7896 raft_consensus.cc:2393] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:49.307117 10532 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:49.396339  7334 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:49.396317  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.393107  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.378347 11292 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:49.397274 10532 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:49.399304 10532 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:49.399631  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:49.401176  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 134029us
I20260709 13:14:49.402292  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:49.405339  7329 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:49.409374  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:49.409142 11374 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.410159  7186 raft_consensus.cc:2376] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8. Re-sending same reply.
W20260709 13:14:49.412835  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 157593us
I20260709 13:14:49.403600  7330 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
W20260709 13:14:49.424950  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.390040 11294 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:49.449445  7253 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
W20260709 13:14:49.447255  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 155656us
I20260709 13:14:49.285418 11394 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.118s
I20260709 13:14:49.453061  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2578) took 1384 ms. Trace:
I20260709 13:14:49.456036  7182 rpcz_store.cc:276] 0709 13:14:48.068991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.786747 (+717756us) service_pool.cc:224] Handling call
0709 13:14:48.824323 (+ 37576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:48.832029 (+  7706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:48.832060 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:48.855217 (+ 23157us) log.cc:844] Serialized 26 byte log entry
0709 13:14:49.107854 (+252637us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:49.168705 (+ 60851us) log.cc:844] Serialized 14 byte log entry
0709 13:14:49.168993 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.169096 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:49.268026 (+ 98930us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b4800003fd8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:14:49.412576 (+144550us) raft_consensus.cc:1685] finished
0709 13:14:49.452873 (+ 40297us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.453007 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30952,"prepare.queue_time_us":56610,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":8846,"raft.queue_time_us":9935,"raft.run_cpu_time_us":1368,"raft.run_wall_time_us":154733,"spinlock_wait_cycles":20321664,"thread_start_us":166386,"threads_started":1,"wal-append.queue_time_us":386889}
I20260709 13:14:49.459832  7334 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:49.379307 11282 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.462123  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:49.460553  7179 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:49.461802  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:49.462817  7255 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:49.447839 11404 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.488507  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:49.488348 11414 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:49.454873 11391 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.494920 10532 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.496501 11414 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.498836 11414 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:49.506490  7182 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:14:49.506932  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:49.507539  7255 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:49.509755 11100 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:49.482527 11392 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.484s	user 0.002s	sys 0.000s
W20260709 13:14:49.515946  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 70409.1us
W20260709 13:14:49.519141 11411 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:14:49.520424  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 559) took 1248 ms. Trace:
I20260709 13:14:49.520798  7332 rpcz_store.cc:276] 0709 13:14:48.275853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.096951 (+821098us) service_pool.cc:224] Handling call
0709 13:14:49.097354 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:49.097742 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.097770 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:49.098256 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:14:49.256278 (+158022us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:49.256316 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.256377 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:49.520193 (+263816us) raft_consensus.cc:1685] finished
0709 13:14:49.520213 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.520341 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1393,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":157496,"threads_started":1,"wal-append.queue_time_us":282800}
I20260709 13:14:49.522922  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:49.525168 11372 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:49.506950  7182 pending_rounds.cc:85] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 9
I20260709 13:14:49.529075  7182 pending_rounds.cc:107] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:14:49.529448  7182 raft_consensus.cc:2889] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:49.535861  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:49.495004 11389 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.456774 11294 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:49.543728  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 96906.4us
I20260709 13:14:49.544333  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:49.485284 11279 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.514652 11391 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.546401 11292 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:49.545714  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:49.640354  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.638885  7890 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:49.588543  7253 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:49.623284  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2792) took 1406 ms. Trace:
I20260709 13:14:49.583602  7862 leader_election.cc:400] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9.
I20260709 13:14:49.640795  7256 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:49.566150  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:49.644263  7862 leader_election.cc:403] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:14:49.545737  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:49.644445  7255 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:14:49.642122  7259 rpcz_store.cc:276] 0709 13:14:48.216627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.216797 (+   170us) service_pool.cc:224] Handling call
0709 13:14:48.236178 (+ 19381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:48.257900 (+ 21722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:48.257948 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:48.258581 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 13:14:48.524653 (+266072us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:48.524703 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:48.524783 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:49.258490 (+733707us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b480033c3d8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:14:49.481941 (+223451us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:49.623006 (+141065us) raft_consensus.cc:1685] finished
0709 13:14:49.623036 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.623207 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36149,"raft.queue_time_us":15111,"raft.run_cpu_time_us":5726,"raft.run_wall_time_us":1000370,"spinlock_wait_cycles":29015552,"thread_start_us":183464,"threads_started":1,"wal-append.queue_time_us":628166}
I20260709 13:14:49.615981  7893 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:49.646322  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 129121us
I20260709 13:14:49.535526 11397 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:49.647975  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2592) took 1125 ms. Trace:
I20260709 13:14:49.641906 10532 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.643457  7182 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:49.648341  7180 rpcz_store.cc:276] 0709 13:14:48.522401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.137955 (+615554us) service_pool.cc:224] Handling call
0709 13:14:49.138304 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:49.222029 (+ 83725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.222058 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:49.222109 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:49.222140 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.647758 (+425618us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b5400259254. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:49.647807 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.647921 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192049536}
I20260709 13:14:49.655373  7260 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 6. Current term is 7. Ops: []
I20260709 13:14:49.657665 11356 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:49.659065 11406 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:14:49.662829  7887 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:49.642995 11294 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.653610 11151 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:49.667109 11151 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:49.667585 11151 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:49.668896  7187 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:49.615124 11149 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.541190 11209 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.674754  7889 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:49.643826 11292 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:49.675283 11292 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:49.674970 11209 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.675856  7896 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:49.552439 11394 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.129s
I20260709 13:14:49.677385 11394 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:49.677784 11394 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:49.651351  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:49.679250  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:49.545532 11403 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:49.583717 11282 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:49.645617 11374 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:49.679555  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:49.683002 10532 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:14:49.680781  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 135117us
I20260709 13:14:49.683877  7180 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:49.683350  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:49.680179 11372 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:49.688491  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:49.687608 10532 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:49.545342 11389 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.692243 11410 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:49.692483 11405 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:49.692900 11410 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:49.680228 11323 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:49.691190  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:49.703179 11282 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:14:49.712628  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65529us
I20260709 13:14:49.702940 11410 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:49.703696 11409 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
I20260709 13:14:49.688959 11397 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:49.709012  7187 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:14:49.711684  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 92723.8us
I20260709 13:14:49.726272  7150 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:49.718600  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:49.720083  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.720635  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:49.720932  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.720821 11173 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:49.720679 11026 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:14:49.723106  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.724565  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:49.715801 11418 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:49.735333 11209 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:49.727376  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:49.726788  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 143318us
I20260709 13:14:49.731017 11282 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:49.736990 11149 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.736840 11282 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.731451 11254 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:49.732398  7187 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:14:49.738881 11254 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:49.732962 10532 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.739883 11254 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.733786  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:49.734777 11394 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.741469  7330 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 8: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:49.741808 11397 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:49.773770  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:49.774529  7187 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:49.778860  7182 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:49.782192  7178 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:49.784327  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:49.799211  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 81967.9us
I20260709 13:14:49.800635  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:49.729362 11323 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:49.843865  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:49.761237 11210 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:49.871479  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 127852us
I20260709 13:14:49.877408  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:49.872213  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 146016us
I20260709 13:14:49.871630  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:49.727522 11178 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:14:49.879732  7150 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:49.880668  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 160479us
I20260709 13:14:49.738487 11151 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.824585 11100 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:49.843317 11405 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:49.870549 11410 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:49.727790 11374 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:49.931032  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:49.891083 11394 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:49.947445  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 70172.9us
I20260709 13:14:49.948046 10532 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:49.948487 10532 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:49.949002 10532 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:49.956049  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.961567  7891 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
W20260709 13:14:49.966698  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 248180us
I20260709 13:14:49.930136 11210 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:49.930047 11323 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:49.967509  7187 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:49.970458  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:49.935297 11279 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:49.938540 11397 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:49.930490 11390 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:50.006107  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:50.006436  7891 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:14:50.021942  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 134185us
W20260709 13:14:49.977061  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 71821.3us
I20260709 13:14:49.957597 11254 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:50.007591  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 136038us
I20260709 13:14:49.957739 11405 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:49.938555 11430 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:50.011243  7887 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:14:50.024530  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 54049.7us
I20260709 13:14:50.020373  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:50.025460  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:50.027153  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:50.001173 10532 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.033123  7187 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:14:50.038767  7150 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.042279  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.043534 11151 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:50.062474 11421 log.cc:927] Time spent T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:50.063241 11405 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.048840  7893 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:50.060537 11374 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:50.006235 11173 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:14:50.070144  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.030862 11430 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:50.028481 11390 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.076524  7150 leader_election.cc:400] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11.
I20260709 13:14:50.090838  7150 leader_election.cc:403] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:50.075574  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.096948 11405 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:50.099584 10532 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:50.102519 11254 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:50.102783  7890 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:50.103366 11358 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.075549 11432 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:50.103889  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 61680.7us
I20260709 13:14:50.105005  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.103926 11358 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.106134  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.107396  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:50.107962 11358 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:50.109637  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.109863  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:50.111152 11432 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:50.111981 11432 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:50.114854 11323 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11.
I20260709 13:14:50.114908 11254 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:50.115613 11323 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:50.115902 11254 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:50.116914 11254 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.119653 11429 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:50.123391 11279 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:50.124234 11323 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:50.124773 11418 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9.
I20260709 13:14:50.125726  7150 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.126281 11173 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:50.126688 11173 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:50.126860 11374 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:50.127769 11173 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.129097 11173 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:50.130980  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:50.131902  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1890) took 1171 ms. Trace:
I20260709 13:14:50.132141  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.134003  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:50.132273  7178 rpcz_store.cc:276] 0709 13:14:48.960947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.643662 (+682715us) service_pool.cc:224] Handling call
0709 13:14:49.781964 (+138302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:49.782744 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.131731 (+348987us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400246b50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:50.131846 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293095296}
I20260709 13:14:50.080324 11430 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.166500  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:50.167431  7178 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:50.155539  7255 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:50.156172  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:50.164392 11366 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:50.164352 11210 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:50.150236 11294 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:50.170338 11366 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:50.171561  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:50.171752 11366 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.172780 11366 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.174093  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:50.174850  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.160184  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:50.176165  7181 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:14:50.106493 11292 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:50.178064 11438 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:14:50.160228 11432 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:50.178730 11292 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:50.179126  7186 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:50.179514  7186 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:50.180289  7186 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.181269  7186 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:50.162030 11390 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:50.098345 11389 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:50.157874  7260 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:50.186421 11356 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:50.186940  7893 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:50.174995  7184 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:14:50.191514  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:50.195327  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:50.195894  7256 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:50.197808  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 63880.3us
I20260709 13:14:50.075502 11433 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:50.150102 11410 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:50.203646  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:50.178383  7181 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:14:50.205593  7259 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:14:50.205967  7259 pending_rounds.cc:85] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 5
I20260709 13:14:50.208791  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:50.154873 11323 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:50.209892  7259 pending_rounds.cc:107] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 11.6
W20260709 13:14:50.215368  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 139946us
I20260709 13:14:50.216507  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.215667  7259 raft_consensus.cc:2889] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:50.225289  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:50.225312  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 93225.9us
I20260709 13:14:50.226131  7258 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:50.235657  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:50.238562  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:50.240233  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:50.241820  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:50.242826  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.244446  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:50.245324  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.245668  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:50.246503  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:50.248643 11274 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:50.249218 11274 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:50.249357 11374 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:50.250773 11374 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:50.251050  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.251240 11374 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:50.251927  7333 raft_consensus.cc:2410] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:14:50.252197 11374 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.252975  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.253610 11374 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:50.254165  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.254784 11385 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:50.254938  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.255298 11385 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:50.258247  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.259387  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:50.260666  7261 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:50.261884  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.262070  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.260600 11443 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.263566  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.263733 11443 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.264782  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.265152  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.265844  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.265966 11443 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:50.266181  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:50.266700 11437 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:14:50.266939  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.268913 11444 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:50.269362 11444 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:50.269654 11208 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.269745 11444 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.270237 11208 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.271970 11173 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:50.272245 11205 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:50.272728 11173 consensus_queue.cc:1243] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:50.272934  7254 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:50.215425 11323 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:50.274160  7859 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.255754 11385 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.320338  7332 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:50.321169  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 47084.7us
I20260709 13:14:50.320420  7260 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:50.276723  7254 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:50.277006  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:50.277238  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.220348 11410 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:50.274919  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:50.278496  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:50.289842 11294 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:50.290539  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.331638  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:50.291826 11323 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:50.334180  7261 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:14:50.297068  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.299742  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.260943 11403 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:50.311853  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:50.250262 11274 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.330644 11418 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:50.313726  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 71989.4us
W20260709 13:14:50.314286  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 48947.6us
I20260709 13:14:50.343971  7255 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:14:50.316975  7334 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
W20260709 13:14:50.320106  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 45006.5us
W20260709 13:14:50.322978  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 78598us
W20260709 13:14:50.324791  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47849.9us
I20260709 13:14:50.325816 11390 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:50.331164 11405 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:50.325767  7333 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9. Ops: []
W20260709 13:14:50.326040  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 82006.4us
I20260709 13:14:50.348209  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.348615  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:50.333709  7890 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:14:50.228457 11433 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:50.349010 10532 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:50.313033 11313 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:50.311084 11078 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:50.318348 11254 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:50.347147 11356 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:14:50.335529  7331 raft_consensus.cc:2376] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11. Re-sending same reply.
I20260709 13:14:50.351671 11100 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:14:50.355160 11391 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:50.318154 11259 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:50.338948  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:50.339207  7187 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:14:50.340360  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:50.341477 11403 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:50.345551  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:50.370043  7262 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:50.262729  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:50.273828 11210 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:50.372231 11269 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:50.372848 11372 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:50.373060 11358 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:50.373534 11358 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.369079 11259 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:50.358917 11208 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:50.374539 11259 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:50.364351 11356 raft_consensus.cc:3055] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:14:50.374934 11445 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:14:50.375164 11356 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:50.314285 11389 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:14:50.327554  7328 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:50.350713  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.376528 11433 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.351102  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:50.261349 11432 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:50.346279  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:50.368140  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.380641  7186 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
W20260709 13:14:50.380700  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.381210  7186 pending_rounds.cc:85] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 8
I20260709 13:14:50.381676  7186 pending_rounds.cc:107] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:14:50.382086  7186 raft_consensus.cc:2889] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:50.373873 11358 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:50.382273 11178 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:50.362812 11449 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:50.385800 11449 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.386147 11449 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.392629  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:50.339919 11414 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:14:50.394268  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:50.396890  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 45863.4us
I20260709 13:14:50.396997 11292 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:50.397629 11405 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:50.345747 11442 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:14:50.352560 11426 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:14:50.352216 11173 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:14:50.354346 11026 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:14:50.381644 11403 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:50.399075  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 50969.8us
I20260709 13:14:50.355269 11418 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:50.401435  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:50.408998  7185 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:14:50.398381  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 135778us
I20260709 13:14:50.404639  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.467410  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.414041  7254 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
W20260709 13:14:50.472340  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 70983.1us
W20260709 13:14:50.485885  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.410861 11385 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.491202 11313 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:50.492063 11439 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:14:50.492637 11385 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:50.493876 11259 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.497402 11259 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:50.497519  7256 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:50.499087 11259 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:50.495298  7150 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.500382 11208 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:50.500661  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.501267 11385 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:50.501991 11385 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:50.501929  7150 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.500846 11208 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:50.503681  7150 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.503618 11208 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.504506 11313 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:50.504943 11208 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:50.505151 11313 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:50.505558 11313 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:50.505923 11313 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.466511 11178 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:50.507521 11178 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.411484 11292 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.481338  7861 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.511602  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:50.512847  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 144769us
I20260709 13:14:50.406339 11432 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
W20260709 13:14:50.527086  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 148117us
I20260709 13:14:50.406131 11405 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.481173 11078 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.480847 11429 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:50.362738 11451 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.190s
I20260709 13:14:50.469002 11210 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:50.524029 11391 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:50.542788 11458 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:50.559325  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 90808.4us
I20260709 13:14:50.405965 11441 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.143s
W20260709 13:14:50.561221  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 87963us
I20260709 13:14:50.529284 11292 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:50.579094  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 53271us
I20260709 13:14:50.579994  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.578588  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.580998  7254 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
W20260709 13:14:50.581135  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50818.9us
I20260709 13:14:50.543588 11282 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:50.473549 11258 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:14:50.579358 11149 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:50.611198  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:14:50.611541  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 85459.1us
I20260709 13:14:50.548422 11429 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:50.560228 11391 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.625921 11456 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:50.578770 11405 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:50.630448  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46107.9us
I20260709 13:14:50.611588 11269 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:50.637034  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 290802us
I20260709 13:14:50.641780  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:50.558748 11444 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.646807  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:14:50.648339  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 243755us
I20260709 13:14:50.556463 11078 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.574112 11210 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.580171 11430 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.654284  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:50.681286  7888 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:14:50.654661  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:50.627385 11429 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:50.657845 11435 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:50.658360 11100 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:50.660327 11463 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:50.661393 11205 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:50.662302 11468 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:50.628839 11456 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:50.628623 11391 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:50.667322 11451 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:50.723145 11451 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:50.723250 11442 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:50.723737 11442 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:50.724139 11451 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.724609 11442 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.725946 11451 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:50.401825 11410 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:50.670344 11452 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.346s	user 0.000s	sys 0.003s
W20260709 13:14:50.676057  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 97554.1us
I20260709 13:14:50.702131 11282 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:14:50.731578  7228 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:50.633074 11355 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:50.643461  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.732616 11355 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.733174  7150 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.735327  7150 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.701920 11463 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:50.736162  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.685912  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.623714 11414 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:14:50.736615 11463 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.737787 11442 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:50.737896 11458 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:50.689546  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 66262.9us
I20260709 13:14:50.692430 11435 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.711651  7888 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:50.712514  7256 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
W20260709 13:14:50.714814  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 64971.5us
I20260709 13:14:50.713268 11205 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:50.689316  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:50.738909  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.751654  7887 raft_consensus.cc:1813] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Handling vote request from an unknown peer 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:50.752235  7887 raft_consensus.cc:2368] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:50.656880 11432 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:50.682802  7890 raft_consensus.cc:2410] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:14:50.741487  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.743906  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:50.757234  7186 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:50.751186  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:14:50.723129  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 139069us
I20260709 13:14:50.748268  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:50.744246  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 73728.3us
I20260709 13:14:50.758590  7862 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:50.758908  7150 leader_election.cc:400] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:50.759207  7150 leader_election.cc:403] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:50.693872 11177 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:14:50.753592  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 67756.3us
I20260709 13:14:50.761783  7335 raft_consensus.cc:2410] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:14:50.751873  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.759287  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.760052 11419 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:50.764015  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.765339  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.765506  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.766176  7328 raft_consensus.cc:2410] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:14:50.628712 11418 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.766948  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.770829  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.771756  7332 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:50.756654 11282 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:50.738067 11463 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:50.782765  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.752679 11269 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:50.690191 11449 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.750382 11435 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:50.784252  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.793237  7888 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:50.770934  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:50.763851 11279 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:50.791879  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:50.794459  7327 raft_consensus.cc:1813] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Handling vote request from an unknown peer 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:50.769950 11419 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.794968  7327 raft_consensus.cc:2368] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:50.794562  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:50.775911 11468 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:50.780148 11274 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:14:50.810892  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:50.811450  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.826936  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:50.827173  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:50.827618  7887 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:14:50.827744  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.828420 11426 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:50.829078 11426 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:50.831295  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.832639  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:50.834218 11178 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:50.836731  7257 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:50.837332  7255 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:50.792162 11355 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:50.839367  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:50.806969 11279 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.843163 11279 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:50.849210 11209 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:50.849617 11209 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:50.850920 11431 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:50.850840 11358 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.851699 11431 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:50.852947 11440 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:50.853245 11358 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:50.853349 11440 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:50.854679 11469 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:50.855033  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:50.855337 11469 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:50.855682  7186 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:50.855893 11469 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:50.865903  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 95070.1us
I20260709 13:14:50.734265 11456 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.769783 11385 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:14:50.778187 11208 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:14:50.783588 11026 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:14:50.820538 11372 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:50.894991  7186 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:14:50.812561 11419 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:50.842797 11410 raft_consensus.cc:2764] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:14:50.881839  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 99123.1us
W20260709 13:14:50.900235  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 116070us
I20260709 13:14:50.900470  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:50.889729  7083 catalog_manager.cc:5697] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:50.874358 11358 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:50.939030 11472 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:50.812176 11459 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 13:14:50.895694 11151 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 13:14:50.872381 11323 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.004s
I20260709 13:14:50.871613 11475 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:50.950115 11374 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:50.969595  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:50.967640  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:50.980372 11397 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:50.984000 11323 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.984236 11397 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.985021  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:50.985584  7178 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
W20260709 13:14:50.983637  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 77029us
I20260709 13:14:50.986543  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:50.986814  7187 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:50.984036 11389 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:50.987834  7180 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:50.987895 11389 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:50.989022 11389 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.818826 11205 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:50.990448 11205 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:50.984314  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:50.984050  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:50.838863 11443 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:14:50.992769  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:50.986271 11323 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:50.994063  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:50.994326 11461 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:50.994110 11414 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:50.982129 11403 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:50.999025 11410 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:50.817782 11282 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:14:51.004979  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:51.006462  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:51.013260 11414 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.008821 11470 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.230s
W20260709 13:14:51.010046 11471 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:14:51.012411  7333 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:50.986320 11397 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:51.020337  7336 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:51.018257  7332 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:51.016559 11459 consensus_queue.cc:1243] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:51.036738 11292 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.038801 11430 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.039271 11210 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:50.967965 11208 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:50.982899 11374 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:51.061385 11469 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.042663 11391 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.044907 11419 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.048619 11294 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:51.049240  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:51.051813  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 230080us
I20260709 13:14:51.015412  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:51.007229  7893 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:51.030365  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:51.056653 11254 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.000s
I20260709 13:14:51.006462 11461 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:51.080621  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:51.033151 11323 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.087467  7336 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:51.041803 11279 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.062951 11444 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.105057  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:51.105899  7184 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:14:51.113674  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 274344us
I20260709 13:14:51.116209  7258 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:51.117784  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:51.095760  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 263157us
I20260709 13:14:51.106802  7328 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:51.108584  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:51.123626  7178 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:51.111184  7261 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:51.110396  7333 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:14:51.055040 11410 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:51.140995 11149 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.002s
I20260709 13:14:51.141357 11410 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.141611 11149 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:51.089329 11374 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:51.095238 11313 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.002s
I20260709 13:14:51.142879 11313 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.144976 11313 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.113257  7262 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:51.146271  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:51.147660  7262 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:51.114075  7889 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:14:51.115006 11323 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:51.126294 11474 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:14:51.127049 11476 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:14:51.127945 11419 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:51.128158 11269 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:51.129400 11449 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.131662  7255 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:51.160296  7896 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:14:51.110823 11254 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:51.133816 11479 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:51.186933 11479 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.186818 11461 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.188238 11461 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:51.189287 11479 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.135366 11439 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:51.136924 11403 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.103933 11294 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:51.190937 11294 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.137862  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:51.139503 11469 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:51.156780  7228 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:51.129343 11391 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.094450 11208 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.166605 11462 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:51.167018 11467 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.165726 11429 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.174578 11323 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.175148 11313 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:51.221964 11313 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:51.222398 11313 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:51.177456 11477 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:51.179176 11279 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:51.179891  7181 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:51.180872  7253 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:51.182089  7328 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:51.184878 11374 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.226166  7890 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:51.185876  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:51.200733  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 82934.8us
I20260709 13:14:51.226806  7187 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:51.191625 11150 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:51.230813 11485 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:51.232044 11485 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:51.232161  7299 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:51.207245  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50542.6us
I20260709 13:14:51.233637 11355 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:51.234025  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:51.234261 11355 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:51.234524 11483 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:51.230829 11150 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:51.235416  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:51.236685  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:51.205475 11274 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:51.209024  7258 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:14:51.233676 11485 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:51.235119 11483 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:51.212797 11405 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.561s	user 0.014s	sys 0.000s
I20260709 13:14:51.172349  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:51.252264  7333 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:51.210739  7178 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:51.238428  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:51.240391  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:51.254062  7896 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:14:51.255137  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:51.252746  7187 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:51.254165  7258 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:51.241425  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:51.206297 11419 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 13:14:51.260167  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.219681 11391 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.207888 11435 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.265942  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:51.250347 11178 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:51.263239  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:51.266049  7258 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:14:51.243047 11468 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:51.252135 11254 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:51.251012 11449 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:51.236331 11150 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:51.243041 11485 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:51.250730 11469 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:51.269057 11178 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.263492  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:51.274685 11481 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:14:51.276298 11429 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:51.264001 11463 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:51.277884  7894 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:51.235316 11355 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.277139  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:51.279973  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:51.215222 11404 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:14:51.285072  7150 leader_election.cc:400] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 7 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 7. Current term is 8.
I20260709 13:14:51.219295 11467 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.260505 11405 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.268193 11391 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:51.288599 11442 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.545s	user 0.005s	sys 0.005s
I20260709 13:14:51.294829  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:51.287014 11178 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:51.297385 11463 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:51.297773 11208 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:51.299055 11467 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.290975 11462 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:14:51.301638 11391 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.309567  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:51.332801  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:51.333966  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:51.334551  7187 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:51.335763  7083 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.337517  7083 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.309911  7254 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:51.310706  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:51.339272  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.312116 11150 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:51.312378 11486 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:14:51.312754  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:51.348066  7179 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:51.350554 11466 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.558s	user 0.002s	sys 0.000s
I20260709 13:14:51.352658 11467 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.353183 11467 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.352710  7083 catalog_manager.cc:5697] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.355471 11467 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:51.356988  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2804) took 1161 ms. Trace:
I20260709 13:14:51.357427  7257 rpcz_store.cc:276] 0709 13:14:50.195607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.199762 (+  4155us) service_pool.cc:224] Handling call
0709 13:14:50.210410 (+ 10648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:50.837126 (+626716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.356743 (+519617us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54003499d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:51.356930 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439934720}
I20260709 13:14:51.359089  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2822) took 1036 ms. Trace:
I20260709 13:14:51.359495  7256 rpcz_store.cc:276] 0709 13:14:50.322508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.498397 (+175889us) service_pool.cc:224] Handling call
0709 13:14:50.513960 (+ 15563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:50.752955 (+238995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.358850 (+605895us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400219dd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:51.359022 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455509376}
I20260709 13:14:51.359956  7187 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:51.361475  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:51.362099  7187 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:51.366564 11078 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:51.367949 11440 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.369585 11440 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:14:51.371663 11460 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.652s	user 0.001s	sys 0.000s
I20260709 13:14:51.313408  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:51.296131  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:51.378755  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 82696.5us
I20260709 13:14:51.379506  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:51.314380 11405 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.314612 11435 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:51.315021  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:51.315454 11485 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.308398 11469 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:14:51.286157 11475 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:14:51.322707 11483 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:51.329430  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:51.331375  7887 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:51.345964 11462 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:51.346669  7178 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:51.346493 11209 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.397377  7178 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:51.380304  7862 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:51.382970  7187 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:51.388695  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:51.398748  7178 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:51.392661  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:51.393831  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:51.400483  7187 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:51.405412  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:51.406476  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:51.391744 11372 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:51.411530 11488 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:51.388113 11463 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:14:51.390403 11467 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:14:51.336923 11313 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.428263 11313 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:51.395475 11210 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:14:51.431161 11403 consensus_queue.cc:1175] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 11 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:51.413259 11209 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:51.433761 11431 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:51.434218 11431 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:51.435230 11173 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:51.435645 11173 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:51.436506 11173 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.438045 11173 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:51.410877 11479 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:51.439293 11479 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.441351 11479 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:51.406263 11279 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:14:51.414688 11323 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:51.426084  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:51.402441 11274 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:51.442976 11274 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:51.443564 11456 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:51.443843 11274 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.444511  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:51.445876 11479 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:51.446389 11479 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:51.406702 11390 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:51.447227 11479 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.426316 11177 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.447700 11390 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:51.415372 11372 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:51.457770 11177 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.468533 11435 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:51.468983 11435 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:51.451400 11488 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:51.471302 11177 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.469902 11435 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.476698  7179 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:14:51.484952  7083 catalog_manager.cc:5697] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.406378 11405 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:14:51.492519 11356 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.496393 11449 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:51.496912 11449 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:14:51.505728  7081 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47554 (request call id 234) took 33800 ms (client timeout 15000 ms). Trace:
I20260709 13:14:51.508503 11292 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.508953 11372 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.515441  7896 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:14:51.520766  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:51.523751  7178 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:51.527508  7178 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:14:51.530236  7328 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:51.497913 11449 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.531369  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:51.531564  7186 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:14:51.537254  7186 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:51.535243  7887 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:51.541457  7187 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:51.541780  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:51.540485 11279 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:14:51.555651 11390 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.548976 11292 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:51.534266 11463 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:14:51.552052 11435 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:51.547417 11477 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:14:51.577572 11292 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.586355 11292 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:51.588857  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.595355 11292 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.597704 11178 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.598692 11292 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:51.601222  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:51.601733  7887 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:51.579128 11449 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:51.610474 11414 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:51.613797 11436 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:51.531132 11431 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.614287 11436 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:51.615295 11436 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.617544 11436 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:51.620998  7887 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:51.622283  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:51.625705 11463 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:51.626073 11178 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:51.626232 11463 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:51.633342 11431 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:51.639093  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.648598 11355 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:51.679385  7888 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:51.715494 11313 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:51.716161 11313 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.718295 11313 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.679798 11477 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:51.719847 11477 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.720489  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:51.721676  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:51.721798 11477 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.722352  7184 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:51.723685  7178 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:51.724633  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:51.733935  7184 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:51.735915  7184 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:51.739303 11418 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:14:51.739964 11463 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.773207  7253 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:51.776081  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:51.777171  7253 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:51.779732  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:51.780519  7253 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 7: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:51.746527 11374 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:51.781729  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.783505  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:51.786888  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:51.789769  7259 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:51.790694 11374 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.790977  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:51.791250 11374 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.793438 11374 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.793247 11463 consensus_queue.cc:1059] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:51.794123 11463 consensus_queue.cc:1243] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:51.794660 11463 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:51.795040 11463 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:51.796131 11463 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:51.797668 11463 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:51.799609 11274 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:51.800609  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 719) took 1524 ms. Trace:
I20260709 13:14:51.801379  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:51.802016  7254 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:51.794886 11374 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:51.804288 11374 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.806571 11374 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.811757 11374 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:51.812439 11374 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.814746 11374 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.801018  7185 rpcz_store.cc:276] 0709 13:14:50.276002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.276160 (+   158us) service_pool.cc:224] Handling call
0709 13:14:50.314831 (+ 38671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:50.467966 (+153135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.800347 (+1332381us) spinlock_profiling.cc:243] Waited 93.8 ms on lock 0x7b54000ed3d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:51.800525 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215737088}
I20260709 13:14:51.821270  7254 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:51.824069  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:51.829181  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:51.832614  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:51.819825 11100 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:14:51.836597 11233 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:51.839907 11463 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:51.840531 11463 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.841390 11436 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:51.843838 11463 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:51.848143 11233 raft_consensus.cc:3055] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:51.848603 11233 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:51.841046  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:51.852309  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:51.852041 11449 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:51.853391 11449 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:51.506178  7081 rpcz_store.cc:269] 0709 13:14:17.704816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.705103 (+   287us) service_pool.cc:224] Handling call
0709 13:14:17.965771 (+260668us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54000aa354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a6090 00007fece9244f3a 00007feceeffb1cc 00007fecef0f937e 00007feced5ba2a4 00007feced5ba232 00007feced5ba161 00007feced5ba0dc 00007feced5b9392 00007fece757748c 00007fece75768c6
0709 13:14:51.505494 (+33539723us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:40.280346 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:40.348618 (+ 68272us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:40.348674 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:14:40.348698 (+    24us) tablet.cc:662] Decoding operations
0709 13:14:40.349693 (+   995us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:40.349772 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:40.349806 (+    34us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:14:40.350605 (+   799us) tablet.cc:701] Row locks acquired
0709 13:14:40.372121 (+ 21516us) write_op.cc:260] PREPARE: finished
0709 13:14:40.406754 (+ 34633us) write_op.cc:270] Start()
0709 13:14:40.430644 (+ 23890us) write_op.cc:276] Timestamp: P: 1783602880394174 usec, L: 0
0709 13:14:40.435706 (+  5062us) op_driver.cc:348] REPLICATION: starting
0709 13:14:40.547190 (+111484us) log.cc:844] Serialized 2855 byte log entry
0709 13:14:41.342706 (+795516us) op_driver.cc:464] REPLICATION: finished
0709 13:14:41.546806 (+204100us) write_op.cc:301] APPLY: starting
0709 13:14:41.546890 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:41.547035 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:41.547134 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:41.547868 (+   734us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:41.548076 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:14:41.548107 (+    31us) write_op.cc:312] APPLY: finished
0709 13:14:41.548369 (+   262us) log.cc:844] Serialized 59 byte log entry
0709 13:14:41.548580 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:41.548693 (+   113us) write_op.cc:454] Released schema lock
0709 13:14:41.548750 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:41.549139 (+   389us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:41.549168 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1586975,"reported_tablets":49,"spinlock_wait_cycles":463808768,"child_traces":[["op",{"apply.queue_time_us":198289,"apply.run_cpu_time_us":2331,"apply.run_wall_time_us":2330,"num_ops":7,"prepare.queue_time_us":655229,"prepare.run_cpu_time_us":32355,"prepare.run_wall_time_us":551521,"raft.queue_time_us":80167,"raft.run_cpu_time_us":26910,"raft.run_wall_time_us":249912,"replication_time_us":875442,"thread_start_us":671844,"threads_started":4,"wal-append.queue_time_us":330019,"wal-append.run_cpu_time_us":28230,"wal-append.run_wall_time_us":1665754}]]}
I20260709 13:14:51.897805  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1717) took 1114 ms. Trace:
I20260709 13:14:51.906461  7336 rpcz_store.cc:276] 0709 13:14:50.783446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.110790 (+327344us) service_pool.cc:224] Handling call
0709 13:14:51.148769 (+ 37979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.149043 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:14:51.214429 (+ 65386us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.280510 (+ 66081us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.472333 (+191823us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b18004368a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:14:51.897227 (+424894us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b18004368a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:14:51.897419 (+   192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.897490 (+    71us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:51.897537 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.897610 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:51.897744 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1131,"prepare.queue_time_us":124142,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":3109,"raft.queue_time_us":1069,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6781,"spinlock_wait_cycles":13079168,"thread_start_us":97092,"threads_started":2,"wal-append.queue_time_us":120686}
I20260709 13:14:51.920514 11238 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:52.718896 11313 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.719717 11313 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:52.722218 11313 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:52.746138  7225 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.590s (SENT) [suppressed 21 similar messages]
W20260709 13:14:53.009600  7153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.007s	sys 0.012s
W20260709 13:14:53.010144  7153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.007s	sys 0.012s
W20260709 13:14:52.872641  7073 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.007s	sys 0.009s
W20260709 13:14:53.089944  7073 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.007s	sys 0.010s
W20260709 13:14:53.233385  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 487254us
W20260709 13:14:53.326917  7150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.004s	sys 0.016s
W20260709 13:14:53.327481  7150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.004s	sys 0.016s
I20260709 13:14:53.421432 11520 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:53.422067 11520 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:53.425838  7073 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 1.495s	user 0.008s	sys 0.010s
W20260709 13:14:53.532644  7151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.044s	sys 0.047s
W20260709 13:14:53.533129  7151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.044s	sys 0.047s
I20260709 13:14:53.422884 11519 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:53.425208 11520 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:53.450193 11313 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.566305  7186 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:14:53.567099  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2629) took 1921 ms. Trace:
I20260709 13:14:53.567427  7186 rpcz_store.cc:276] 0709 13:14:51.645881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.565698 (+1919817us) service_pool.cc:224] Handling call
0709 13:14:53.566050 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:53.566797 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.567035 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.567353 11313 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:53.569875 11313 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:53.572263 11436 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.730s	user 0.016s	sys 0.002s
I20260709 13:14:53.563795 11521 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.564177 11520 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.568982 11519 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:53.576561 11313 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.583768 11313 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:53.584836 11519 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:53.585687 11524 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.586606 11313 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:53.587369 11313 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:53.587884 11313 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:53.586228 11524 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:53.590515 11521 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:53.593382  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2626) took 2072 ms. Trace:
I20260709 13:14:53.593878  7179 rpcz_store.cc:276] 0709 13:14:51.521334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.532158 (+ 10824us) service_pool.cc:224] Handling call
0709 13:14:53.592875 (+2060717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.593053 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.593082 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.593127 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:53.593159 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.593210 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.593321 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.594228 11520 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:53.596460 11313 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:53.596804 11520 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:53.598428 11524 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:53.577057 11436 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:14:53.614986 11520 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:53.599514 11519 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:53.615648 11519 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:53.615031 11524 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:53.616803 11524 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:53.618053 11519 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:53.600418 11521 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:53.618600 11519 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:53.619525 11519 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:53.620788  7181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 727) took 2632 ms (client timeout 1674 ms). Trace:
W20260709 13:14:53.621234  7181 rpcz_store.cc:269] 0709 13:14:50.987856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.992470 (+  4614us) service_pool.cc:224] Handling call
0709 13:14:53.620533 (+2628063us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400116f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:53.620668 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428196096}
I20260709 13:14:53.615581 11520 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:53.618944 11521 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.622771 11521 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:53.623471 11520 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:53.619005 11524 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:53.624147 11524 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:53.625114 11521 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:53.599089 11523 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.619534 11313 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.621572 11519 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:53.637619 11313 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:53.637638  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.640272 11313 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:53.629942 11389 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:53.642287 11389 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:14:53.634613  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 2.29009e+06us
I20260709 13:14:53.644425 11313 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:53.637578 11523 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:53.624004 11374 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:53.645478 11374 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:53.644601 11528 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:53.646519 11279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.845s	user 0.016s	sys 0.043s
I20260709 13:14:53.646801 11523 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:53.638640 11524 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:53.646909 11528 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:53.648053 11313 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:53.647002 11279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.846s	user 0.017s	sys 0.043s
I20260709 13:14:53.648783 11524 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:53.612174 11526 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.611060 11525 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:53.663597  7183 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:53.657934  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 576) took 2570 ms. Trace:
I20260709 13:14:54.211572  7333 rpcz_store.cc:276] 0709 13:14:51.087940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.160468 (+ 72528us) service_pool.cc:224] Handling call
0709 13:14:51.171067 (+ 10599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.254985 (+ 83918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.657534 (+2402549us) spinlock_profiling.cc:243] Waited 81 ms on lock 0x7b54001ffed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:53.657809 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186285440}
I20260709 13:14:54.212460  7073 maintenance_manager.cc:643] P 50ff9c56d8414bdb8f05f31957b53075: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.423s	user 0.161s	sys 0.089s Metrics: {"bytes_written":29321,"cfile_init":1,"dirs.queue_time_us":2977,"dirs.run_cpu_time_us":370,"dirs.run_wall_time_us":4904,"drs_written":1,"lbm_read_time_us":617,"lbm_reads_lt_1ms":4,"lbm_write_time_us":64173,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":3,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"rows_written":63,"thread_start_us":1159879,"threads_started":2,"wal-append.queue_time_us":1305082}
I20260709 13:14:54.223856 11313 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.224452  7074 maintenance_manager.cc:419] P 50ff9c56d8414bdb8f05f31957b53075: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9192 bytes on disk
I20260709 13:14:54.224534 11525 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:51.850922 11233 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:53.863781  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.652693 11374 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:54.230048  7227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.000s	sys 0.006s
I20260709 13:14:54.230294 11532 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:14:53.682957  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 55811us
W20260709 13:14:54.230528  7227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.000s	sys 0.006s
I20260709 13:14:54.230894 11532 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.230105 11526 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.233903 11526 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:53.827057 11279 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.227919  7073 maintenance_manager.cc:643] P 50ff9c56d8414bdb8f05f31957b53075: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":328,"lbm_reads_lt_1ms":4}
I20260709 13:14:54.220135 11534 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.251225 11534 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.251475 11279 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.253549 11534 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:54.253589 11279 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.254259 11534 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.234834 11259 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.256022 11534 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.256176 11259 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.258401 11534 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.259073 11534 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:54.235332 11535 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.259534 11534 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.260138 11535 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.260788 11541 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.261304 11541 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:53.649317 11528 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.263003 11528 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.263482 11528 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.265551 11528 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.265913 11528 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.266180 11528 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.237524 11531 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:54.248732 11537 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.227715 11525 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.234244 11533 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.271449 11537 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.270992 11531 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.272392 11525 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.272675  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1914) took 3188 ms. Trace:
I20260709 13:14:54.272922 11525 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:54.273984 11537 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.274101 11531 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.274765 11531 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.275137 11525 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.275591 11525 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.275192 11531 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.275902 11525 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.277293 11531 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.277420 11525 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.277842 11525 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.261618 11534 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:54.278916 11528 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:54.235895 11530 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:54.279680 11530 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.273123  7182 rpcz_store.cc:276] 0709 13:14:51.084237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.237830 (+153593us) service_pool.cc:224] Handling call
0709 13:14:51.257433 (+ 19603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.263042 (+  5609us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:51.271370 (+  8328us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.397658 (+126288us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:51.408458 (+ 10800us) log.cc:844] Serialized 26 byte log entry
0709 13:14:51.408605 (+   147us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:51.408853 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.410296 (+  1443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.410457 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:54.272448 (+2861991us) raft_consensus.cc:1685] finished
0709 13:14:54.272468 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.272619 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3289,"prepare.queue_time_us":9890,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":6500,"raft.queue_time_us":6307,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":9719,"thread_start_us":111025,"threads_started":1,"wal-append.queue_time_us":249345}
I20260709 13:14:54.281891 11530 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:54.282506  7208 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9780 after lost signal to thread 6033
I20260709 13:14:54.258355 11259 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.262349 11535 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.271559 11533 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.285254 11533 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.266584 11526 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.236333 11532 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:54.286181 11526 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.288367 11541 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:54.269112 11540 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.288409 11526 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.278321 11525 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.292533 11525 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:54.292122  7083 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.293843  7083 catalog_manager.cc:5697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.297326  7083 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 6 to 7, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 7 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.277796 11531 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.298938 11531 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.299674  7083 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 7 to 8, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 8 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.301501  7083 catalog_manager.cc:5697] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 4 to 7, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 7 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:54.302610 11531 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.305953 11485 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:54.313385 11356 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:54.289139 11540 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.323019 11540 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:54.326706 11526 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.327287 11526 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.329366 11526 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:54.329893 11526 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:54.330345 11526 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.332491 11526 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:54.336788 11540 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:54.337967 11525 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:54.338356 11525 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:54.339186 11525 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.340322 11525 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.345353 11294 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:51.863224 11449 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.351186  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.352248  7259 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 8: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:54.353176  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.353952 11078 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:54.355360  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.353947  7259 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:14:54.355988  7256 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:54.356910  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.357230  7259 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:14:54.357458  7256 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:54.358326  7259 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:54.358559  7257 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:14:54.359642 11537 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.360157 11537 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.361903 11405 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:54.362437  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.363171  7257 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 8: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:54.367125  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.367736  7257 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:54.368903  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.369695  7256 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:54.370942  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.372663  7256 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:54.369977  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.373301  7257 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:54.378741  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:54.379361  7182 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:54.380172  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.380757  7257 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:54.381515  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.382462  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.382957  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.371541  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.383713  7256 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:54.383898  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.384491  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.384649  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.383018  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.385118  7261 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:54.385404  7179 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:54.385998  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.386770  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:54.387420 11500 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 2.719s	user 0.008s	sys 0.018s
I20260709 13:14:54.385308  7256 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:54.383354  7257 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:54.387384  7184 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:54.384685  7186 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:54.389081  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.386562  7261 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:54.390020  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.391149  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.392023  7261 raft_consensus.cc:2410] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:14:54.391973  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.392987  7179 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:54.391219  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.393175  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.393472  7257 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:14:54.393967  7261 raft_consensus.cc:2410] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:14:54.393187  7182 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:54.372062  7259 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:54.394382  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:54.395040  7179 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.402510  7179 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:54.403307 11238 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:54.404415  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.411923  7179 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:54.412775  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:54.404278 11238 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.405725  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.406785  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:54.416867  7182 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:54.416991  7186 raft_consensus.cc:2376] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12. Re-sending same reply.
I20260709 13:14:54.389851  7256 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:14:54.418358  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.419780  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.420372  7186 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:54.407035  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:54.407447  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:54.408874  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.410027  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:54.423005  7185 raft_consensus.cc:2376] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11. Re-sending same reply.
I20260709 13:14:54.423153  7178 raft_consensus.cc:2376] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12. Re-sending same reply.
I20260709 13:14:54.424211  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.424468  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.425312  7178 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:54.426326  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:54.428696 11100 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.429039 11435 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.429286 11100 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.429638 11435 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.428741  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 714) took 2619 ms. Trace:
I20260709 13:14:54.431685  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.427317  7178 raft_consensus.cc:2376] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12. Re-sending same reply.
I20260709 13:14:54.422204  7184 raft_consensus.cc:2376] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13. Re-sending same reply.
I20260709 13:14:54.434309  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.426880  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.435813  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.437533  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.436417  7185 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:54.438359  7184 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:54.440951  7184 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:54.425189  7186 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:54.431279  7888 rpcz_store.cc:276] 0709 13:14:51.808897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.814768 (+  5871us) service_pool.cc:224] Handling call
0709 13:14:51.815180 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.815445 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:14:51.819506 (+  4061us) log.cc:844] Serialized 14 byte log entry
0709 13:14:54.262722 (+2443216us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b18002bf120. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fececc343c7 00007fece92469a7 00007fece92560bf 00007fece9256038
0709 13:14:54.262920 (+   198us) log.cc:844] Serialized 14 byte log entry
0709 13:14:54.428353 (+165433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:54.428422 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:54.428471 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.428541 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.428658 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172736,"prepare.queue_time_us":4306,"prepare.run_wall_time_us":35,"raft.queue_time_us":127,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4790,"spinlock_wait_cycles":13851264}
I20260709 13:14:54.442652  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.444590  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:54.444528  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.443441  7186 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 7.
I20260709 13:14:54.459519  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.511763  7179 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:54.539995  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.542418  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:54.543359  7185 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
W20260709 13:14:54.547873  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 103811us
I20260709 13:14:54.435801 11475 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:54.438917 11390 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.556025  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:54.558677  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:54.482450 11418 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:54.570796 11418 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:54.571255 11418 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:54.559811  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.575615  7228 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:54.558346  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:54.570252  7253 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:54.579288  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.578411  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.583626 11323 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:54.580026  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.586604 10532 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:54.587107 10532 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.587627 10532 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:54.585695  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.570230  7180 raft_consensus.cc:2376] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11. Re-sending same reply.
I20260709 13:14:54.580485 11385 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:54.582252 11294 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:54.581060 11463 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:54.593338 11274 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:54.590796  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.584105 11323 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.581465 11468 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:54.598511  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.595731  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:54.652493  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54071.2us
W20260709 13:14:54.652626  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57001us
I20260709 13:14:54.653898  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.654114  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:54.710508  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56669.7us
W20260709 13:14:54.711485  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 57467.9us
I20260709 13:14:54.711661  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.712391  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.580442 11390 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.712975  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.569523 11475 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.728166  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:54.744729  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.726783  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:54.756503  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 190972us
I20260709 13:14:54.757923 11462 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:54.755098  7253 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:54.758168  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.758682 11462 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:54.759927 11449 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:54.759912 11462 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.760848 11449 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:54.762049 11449 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.757032  7152 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.594558 11294 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.769850  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:54.775993 10532 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.741598 11279 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:54.602242 11274 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.654734 11468 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.742116 11481 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:54.624775 11323 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:54.755530 11405 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:54.814896 11405 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.724990 11390 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.725567 11467 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:54.779327  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.821450  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.813702 11274 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.810114 10532 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.810741 11279 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.588773 11404 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.167s
I20260709 13:14:54.725138 11463 raft_consensus.cc:697] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:54.726971 11526 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:54.741931 11477 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:54.597338 11372 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.183s
I20260709 13:14:54.709555 11292 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:54.741777 11374 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:54.819087  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49333.3us
I20260709 13:14:54.780579 11294 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:54.848954  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.814190 11468 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:54.851468  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.816967 11525 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:14:54.820533 11405 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:54.819235 11481 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:54.845185 11477 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.829608 11279 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:54.851320 10532 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:54.868806 10532 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.869323 10532 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:54.852253 11372 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:54.852679 11292 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:54.847882 11374 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.852855 11404 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:54.861251  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.862411  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.844833 11526 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.820355 11467 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.864518 11531 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:14:54.884546  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63193.6us
I20260709 13:14:54.870728 11477 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:54.878304  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.886596  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.871320 11372 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.875662 11374 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:54.888180 11372 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:54.892584 11449 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:54.875066 11404 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.880020 11526 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:54.880905 11467 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:54.893296  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:54.896368  7258 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:54.880909 11531 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.887837  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.883268 11462 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:54.896039  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.875314 11525 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:14:54.910063 11405 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.910908 11292 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.912678  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:54.913585 11475 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.893407 11463 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.914547 11418 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.923138 11233 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.900812 11531 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:54.920629 11372 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.922135 11481 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:54.933678  7183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1904) took 3952 ms (client timeout 2181 ms). Trace:
I20260709 13:14:54.895000 11404 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:54.914459 11389 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.924405 11279 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.917606 11403 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:14:54.935986 10532 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.936671 11469 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:54.965955 11469 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.966379 11469 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:54.967600 11279 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:54.968286 11279 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:54.968631 11279 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.968950 11279 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:54.969600 11403 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:54.970095 11403 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:54.895084 11449 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:54.938879  7181 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:14:54.941069  7862 connection.cc:256] RPC call timeout handler was delayed by -2.44695157000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260709 13:14:54.942574 11078 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.942791 11456 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:54.943351 11390 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.943517 11356 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.945184 11467 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:54.948015 11458 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:54.920624  7887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 604) took 3132 ms. Trace:
W20260709 13:14:54.952869  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56954.4us
W20260709 13:14:54.953406  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65735.1us
I20260709 13:14:54.952399 11462 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:54.960842  7183 rpcz_store.cc:269] 0709 13:14:50.980848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.984108 (+  3260us) service_pool.cc:224] Handling call
0709 13:14:54.933453 (+3949345us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b540041aad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:54.933597 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6019161984}
I20260709 13:14:54.964057  7255 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:54.970841 11449 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:54.955689 11433 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:54.973455 10532 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:54.992655 11294 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:54.983086  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:54.981884 11458 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:54.981956 11356 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.984647  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.016377  7893 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:54.984860 11389 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:54.979557 11419 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:54.985991 11467 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.007575 11462 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:54.987624  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:55.053570  7180 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:54.982228  7887 rpcz_store.cc:276] 0709 13:14:51.787908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.788045 (+   137us) service_pool.cc:224] Handling call
0709 13:14:51.788417 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.788765 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.788792 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:51.789222 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:14:51.856344 (+ 67122us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:51.856384 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:51.856446 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:54.323827 (+2467381us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b4800261e58. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:14:54.920284 (+596457us) raft_consensus.cc:1685] finished
0709 13:14:54.920311 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.920554 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86900,"raft.queue_time_us":1310,"raft.run_cpu_time_us":29059,"raft.run_wall_time_us":2533945,"spinlock_wait_cycles":19105024,"thread_start_us":66729,"threads_started":1,"wal-append.queue_time_us":83198,"wal-append.run_cpu_time_us":2395,"wal-append.run_wall_time_us":1094412}
I20260709 13:14:54.989076  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:54.984066 11485 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.989974  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:54.991492  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:54.992813  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:54.993063  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:54.994747 11355 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:54.994841  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:55.000368  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.092872  7889 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:54.982190 11390 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.015323 11557 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:14:55.002710  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.955988 11526 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:54.980857  7181 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:54.975211 11456 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:54.976606 11475 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.016417 11458 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:54.986943  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:55.032145 11356 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:55.122488  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.032711  7187 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:14:55.127355  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 731) took 3521 ms. Trace:
I20260709 13:14:55.032181 11372 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.035441 11374 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.037647 11525 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.038105 11435 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.045513 11385 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:55.047845 11537 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.047714  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.049106 11468 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.049373 11100 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.166083 11405 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.168918 11404 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.171676 11294 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.049831 11419 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:55.052572  7208 debug-util.cc:398] Leaking SignalData structure 0x7b0800106620 after lost signal to thread 7119
I20260709 13:14:55.173269  7894 raft_consensus.cc:2410] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:14:55.173811  7208 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7a80 after lost signal to thread 7211
W20260709 13:14:55.174149  7208 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7ac0 after lost signal to thread 7212
I20260709 13:14:55.174198 11419 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:55.174769  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:55.175390  7208 debug-util.cc:398] Leaking SignalData structure 0x7b08003f1da0 after lost signal to thread 7286
I20260709 13:14:55.092345 11485 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.175941 11390 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.176549  7892 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:55.178063  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:54.976780 11078 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.086413  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:55.179133  7182 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:55.176577 11456 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:55.099840  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 105075us
I20260709 13:14:55.179967 11456 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:55.180191 11078 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.180440  7862 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:55.181255 11078 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:55.181618 11078 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:55.181967 11078 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:55.086390  7895 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:55.183153 11279 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.184082 11100 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:55.103964  7887 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:55.185489  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.185854 11210 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.180470 11531 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.186561  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.186894 11372 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:55.187304  7887 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:55.188059 11531 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.188149  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.109951  7896 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:55.110481  7890 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:14:55.189466  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:55.120869  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.189709  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:55.128859  7889 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:14:55.192086  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.193318  7889 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:55.127844  7187 rpcz_store.cc:276] 0709 13:14:51.606396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.032020 (+3425624us) service_pool.cc:224] Handling call
0709 13:14:55.032366 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.127036 (+ 94670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.127285 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.112612 11149 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.194222 11149 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.135481  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.196360  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:55.196683  7893 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:55.107448 11389 raft_consensus.cc:2764] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:14:55.196382 11149 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.129478 11233 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:55.198256  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:55.175707  7208 debug-util.cc:398] Leaking SignalData structure 0x7b08003547e0 after lost signal to thread 7287
I20260709 13:14:55.007897 11433 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.198885  7181 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 7.
I20260709 13:14:55.198976 11433 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:55.199476 11323 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.181977 11477 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:55.183446  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:14:55.093580  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 82646.5us
I20260709 13:14:54.994681  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:55.203364  7888 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:55.185786 11374 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.189599  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.121484  7184 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:55.197080  7182 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:14:55.139565  7891 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:14:55.198073 11233 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.201771  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:55.175963  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.209512  7181 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:14:55.204560  7862 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:14:55.204859  7208 debug-util.cc:398] Leaking SignalData structure 0x7b0800394000 after lost signal to thread 7360
I20260709 13:14:55.207067  7896 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:55.208134  7890 raft_consensus.cc:2410] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:14:55.164171 11468 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.208912  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:55.175657 11418 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:55.151024 11556 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:14:55.214612  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:55.122552 11475 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.178139 11485 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:55.254223  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50895.5us
W20260709 13:14:55.274945  7208 debug-util.cc:398] Leaking SignalData structure 0x7b08002184e0 after lost signal to thread 7361
W20260709 13:14:55.239089  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.268239  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:55.255204  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 46360.1us
I20260709 13:14:55.111426 11355 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:55.277594  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 62894.9us
W20260709 13:14:55.183198 11558 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:14:55.285727  7208 debug-util.cc:398] Leaking SignalData structure 0x7b08003ef0c0 after lost signal to thread 7920
I20260709 13:14:55.286890  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:55.311146  7208 debug-util.cc:398] Leaking SignalData structure 0x7b080026c7c0 after lost signal to thread 11258
I20260709 13:14:55.299449  7893 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:55.187315 11372 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:55.308678  7862 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:55.139710 11525 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.186529 11210 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.284768 11463 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:55.331110  7892 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:55.269793 11389 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:55.324256  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:55.324757  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:55.332795  7253 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:14:55.333086  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:55.331279 11418 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:55.334214  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:55.178234 11469 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.326110  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:55.347169  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:55.327111  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:55.327461  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:55.327968  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:55.311988 11537 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.285104  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:55.350515  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 65507.5us
I20260709 13:14:55.350816  7262 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:14:55.351305  7262 pending_rounds.cc:85] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 8
I20260709 13:14:55.334440 11418 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.329262 11481 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.325292 11372 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:55.210506 11149 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 13:14:55.201764 11323 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.340432  7888 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:55.287213 11419 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:55.334105  7253 raft_consensus.cc:1217] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Deduplicated request from leader. Original: 8.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:14:55.370488 11419 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.370664  7253 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:14:55.370967 11419 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:55.371951  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:55.373302  7253 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:55.342846 11233 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.346179 11477 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.312599 11294 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.374922 11294 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.375512  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:55.349179  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:55.351605  7262 pending_rounds.cc:107] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:14:55.351425  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:55.376973  7262 raft_consensus.cc:2889] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:55.378269 11485 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:55.335956  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:55.313493 11405 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:55.347239 11531 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:14:55.354192  7208 debug-util.cc:398] Leaking SignalData structure 0x7b0800377620 after lost signal to thread 11414
I20260709 13:14:55.330811 11463 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.353648 11292 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:55.352651 11210 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.357373 11418 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:55.368117  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:55.389279  7259 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:55.331981 11389 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.373922  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:55.312428 11467 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:55.353462  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:55.394044  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:55.383111  7208 debug-util.cc:398] Leaking SignalData structure 0x7b080038ad60 after lost signal to thread 11429
I20260709 13:14:55.394745  7183 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
W20260709 13:14:55.367879  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 266661us
I20260709 13:14:55.395393  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:55.396106  7181 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:14:55.369408 11274 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 13:14:55.354044 11404 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:55.394846  7208 debug-util.cc:398] Leaking SignalData structure 0x7b0800371100 after lost signal to thread 11431
W20260709 13:14:55.401995  7208 debug-util.cc:398] Leaking SignalData structure 0x7b0800380340 after lost signal to thread 11440
W20260709 13:14:55.402348  7208 debug-util.cc:398] Leaking SignalData structure 0x7b0800344bc0 after lost signal to thread 11442
W20260709 13:14:55.402676  7208 debug-util.cc:398] Leaking SignalData structure 0x7b080003c980 after lost signal to thread 11443
W20260709 13:14:55.403040  7208 debug-util.cc:398] Leaking SignalData structure 0x7b08001bfe00 after lost signal to thread 11459
W20260709 13:14:55.403353  7208 debug-util.cc:398] Leaking SignalData structure 0x7b08003f7780 after lost signal to thread 11461
W20260709 13:14:55.403954  7208 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6260 after lost signal to thread 11483
W20260709 13:14:55.404265  7208 debug-util.cc:398] Leaking SignalData structure 0x7b0800210960 after lost signal to thread 11484
I20260709 13:14:55.397715  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:55.383888  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 48005us
I20260709 13:14:55.408592  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:55.368762 11279 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.410892  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:55.411580  7183 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:55.412787  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:55.379534 11568 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:55.413686  7183 raft_consensus.cc:2410] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:55.384922 11557 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:55.353379 11472 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:14:55.382405 11485 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.428324 10532 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:55.387259 11233 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:55.387032 11463 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:55.418183  7184 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:55.418673  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:55.434135  7181 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:55.385493 11531 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:55.419354  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:55.435182  7179 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:55.419646  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:55.435858  7187 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:55.419992  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:55.436332  7185 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:55.436630  7181 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:14:55.387187 11292 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.385917 11462 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.399032 11389 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:55.426021  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:55.446714  7182 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:55.414413  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:55.432708  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:55.436959  7181 pending_rounds.cc:85] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 8
I20260709 13:14:55.448076  7181 pending_rounds.cc:107] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:14:55.448326  7181 raft_consensus.cc:2889] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:55.449126  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.369716 11481 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.432121 11485 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:55.433440 11233 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.419221 11356 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:55.421370 11557 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:14:55.441744 11292 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:55.476445  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:55.452365  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:55.426723 11526 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:55.355898 11537 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.427052 11568 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:55.433658 11374 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:55.482544  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 67510.2us
I20260709 13:14:55.414381 11467 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.387667 11100 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:14:55.438109 11531 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:55.478986  7258 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:55.414057 11274 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.468601 11233 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:55.428145 11403 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.457947 11477 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:55.459497 11238 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:14:55.496608  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1701) took 1149 ms. Trace:
W20260709 13:14:55.497414 11567 log.cc:927] Time spent T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:14:55.498790 11323 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:55.498930  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:55.533774  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.499888  7335 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:14:55.500814  7333 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:14:55.501367  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.501988  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.536211  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.537429  7336 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:14:55.503255 11560 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:14:55.503336  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.468601 11564 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:14:55.504549 11461 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.504717  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.505362  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.551689  7327 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:55.505440  7301 connection.cc:256] RPC call timeout handler was delayed by -1.4839791909998894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 13:14:55.505957 11539 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.460472 11279 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:14:55.507671 11366 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:55.508288 11441 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.508912 11458 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.509625  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 571) took 5245 ms. Trace:
I20260709 13:14:55.509910 11178 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.510950 11525 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:55.512620 11481 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:55.471561 11557 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:55.516285  7185 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:55.517627  7260 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:14:55.519382  7150 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:55.572695  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53378.4us
I20260709 13:14:55.573374  7150 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:55.483619  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:55.524726  7257 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:55.527230  7254 rpcz_store.cc:276] 0709 13:14:54.347334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.115139 (+767805us) service_pool.cc:224] Handling call
0709 13:14:55.115461 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.115803 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.115832 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.125467 (+  9635us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.329619 (+204152us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:55.329658 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.329725 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.496388 (+166663us) raft_consensus.cc:1685] finished
0709 13:14:55.496409 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.496545 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":538,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":78,"thread_start_us":130270,"threads_started":1,"wal-append.queue_time_us":209798}
I20260709 13:14:55.537532  7331 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:14:55.502705  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.504081  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:55.540928  7302 connection.cc:256] RPC call timeout handler was delayed by -1.6576871360000496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 13:14:55.541020  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.574582  7328 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:55.542014  7182 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:55.506342 11419 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.557593  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.561049  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.538152 11451 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.562026  7330 rpcz_store.cc:276] 0709 13:14:50.264000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.314513 (+ 50513us) service_pool.cc:224] Handling call
0709 13:14:50.331341 (+ 16828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:50.331536 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:14:50.338941 (+  7405us) log.cc:844] Serialized 14 byte log entry
0709 13:14:51.485418 (+1146477us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b18000488e0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a 00007fece9246a2a
0709 13:14:54.386983 (+2901565us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:55.136473 (+749490us) log.cc:844] Serialized 14 byte log entry
0709 13:14:55.509255 (+372782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.509305 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:55.509352 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.509414 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.509530 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3749488,"prepare.queue_time_us":313466,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":12867,"raft.queue_time_us":4014615,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":151,"spinlock_wait_cycles":31895040,"thread_start_us":264412,"threads_started":3,"wal-append.queue_time_us":1323927}
I20260709 13:14:55.542438 11440 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.492156 11374 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.543875 11469 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.542858 11475 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.574072  7327 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:55.720599  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.562696 11366 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:55.576691  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 93128.5us
I20260709 13:14:55.579962  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.581068  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:55.575150  7302 connection.cc:256] RPC call timeout handler was delayed by -1.5658871359999011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
I20260709 13:14:55.584307  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.585433  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.624673  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:55.659716  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.724982  7335 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:55.667106  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.558284 11461 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.570762 11431 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.570240 11442 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.570523 11483 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.563695 11209 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.577874 11553 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.657204 11414 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:14:55.681820 11451 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:55.684299  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 99593.3us
I20260709 13:14:55.688206 11426 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.680521 11394 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.664980 11443 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:14:55.692783 11419 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.585009 11573 raft_consensus.cc:2764] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:14:55.582495 11481 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:55.576541 11568 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.705152 11374 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:55.706452 11458 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.571347 11178 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:55.707612 11449 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.691s	user 0.006s	sys 0.003s
I20260709 13:14:55.561028 11539 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.688608  7861 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:55.716954  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:55.576104 11484 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:55.723176  7302 connection.cc:256] RPC call timeout handler was delayed by -1.5433871360000921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260709 13:14:55.835086  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:55.722358  7893 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 7.
I20260709 13:14:55.565219 11441 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.749738  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.750510  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.839962  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.840565  7330 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:55.756713 11209 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.578263 11205 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.145s
I20260709 13:14:55.841382  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.842439  7329 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:14:55.842660  7332 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:55.843029  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.844826  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.817883 11481 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.779258 11414 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:55.722252 11258 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.786145 11467 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:55.788414 11461 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:55.770936 11553 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.789613 11233 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.756930 11442 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.763998 10532 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:14:55.805612  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.810859  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:55.809975  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54801.3us
I20260709 13:14:55.816908  7328 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:55.821559  7299 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:55.716091 11440 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.768652 11462 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.774551  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.769799  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.846494  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.784631 11531 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.836182 11173 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:55.887426  7336 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:14:55.887701 11173 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:55.887812 11233 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:55.887259 11440 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:55.832813 11443 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:14:55.852483 11537 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:55.890971 11443 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:55.891388 11443 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:55.892194 11443 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.757144 11431 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:14:55.853794  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.881443  7334 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:55.883467  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 192204us
I20260709 13:14:55.887252 11531 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:55.756820 11483 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.821715 11459 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:14:55.817672 11426 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.814826 11394 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.893507  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.838716 11397 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:14:55.922858  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.885426 11461 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:55.923659  7330 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:55.920810  7333 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:55.836061 11449 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.849259 11414 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:55.921952 11462 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:55.930538  7335 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:55.944674  7331 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
W20260709 13:14:55.899973  7150 leader_election.cc:336] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.653s (SENT)
W20260709 13:14:55.948997  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49082.2us
W20260709 13:14:55.932483  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 243947us
I20260709 13:14:55.937124  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.950816  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:55.951370  7334 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:55.924728  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.919962  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:55.843479 11484 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.945742 11294 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:55.946938 11442 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:55.925287 11539 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:55.958930  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.959107  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.959585  7334 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:55.959753  7330 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:55.850992 11481 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:55.965209  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.966353  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.968225  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.969362  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.943117  7327 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:55.952749  7328 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:55.855518 11258 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:55.925200 11429 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.957278  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:55.947222  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.844971 11389 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:55.970817  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:55.972092  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:55.974040  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:55.971321  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:55.975714  7183 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:55.941931 11475 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:55.980979 11442 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.947690 11397 consensus_queue.cc:1243] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:14:55.947705 11443 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:55.999107  7184 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:56.018525  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:55.999679  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:55.991873  7261 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 9: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:55.993178 10532 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:56.021093 10532 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:55.992601  7185 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:55.996616  7260 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
W20260709 13:14:56.006438  7150 leader_election.cc:336] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.757s (SENT)
I20260709 13:14:56.006742  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:56.023033  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:56.023574  7254 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
W20260709 13:14:56.000451  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 165445us
I20260709 13:14:56.011029  7256 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:56.011381  7262 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:56.011325  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:55.993333  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:55.956753 11461 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:55.948184 11462 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:56.010346  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:56.018654  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:56.034188  7328 raft_consensus.cc:2376] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12. Re-sending same reply.
I20260709 13:14:56.030740  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:56.031651  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:56.035138  7253 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:55.963570 11209 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.032389  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:56.033993  7330 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:14:55.991273 11539 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.991076 11458 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.042132 10532 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:56.028239 11463 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.001s
I20260709 13:14:55.979701 11479 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.044041  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:56.037406 11559 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:56.119571 11431 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:56.032809 11537 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:56.041390 11467 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:14:56.100196 11209 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:56.033455 11374 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:14:56.038597 11580 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:14:55.948163 11173 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.130606  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:56.089896  7185 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:14:56.040454 11397 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:56.042199 11366 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:55.998308 11429 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:56.161621  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 340124us
I20260709 13:14:55.997728 11442 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:56.118475 11477 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.000s
I20260709 13:14:56.045264 11205 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:56.130527 11458 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:56.101537 11433 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.902s	user 0.004s	sys 0.007s
W20260709 13:14:56.160758 11372 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.773s	user 0.010s	sys 0.001s
I20260709 13:14:56.183930 11389 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:56.123265 11279 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:56.042306 11461 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:56.175192 11485 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.000s
I20260709 13:14:56.161646 11323 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:56.100209 11525 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:14:56.260656  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:56.123091 11539 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.174650  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:56.284027  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:56.280231 11209 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.180s
I20260709 13:14:56.250111 11537 raft_consensus.cc:697] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:56.223403 11397 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:56.224707 11178 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:56.155139 11479 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.389969 11394 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.041790 11414 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.279711 11584 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.271122 11578 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:14:56.450598  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 445370us
I20260709 13:14:56.319609 11477 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:56.227231 11559 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 13:14:56.471438  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:56.513589  7889 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:56.318480 11205 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:56.401563 11374 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.396394 11173 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:56.479121  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 304551us
I20260709 13:14:56.130774 11463 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.317402 11596 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.187s
I20260709 13:14:56.562664  7260 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:56.478963  7891 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:14:56.474855 11483 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:56.321655 11366 consensus_queue.cc:1175] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" responder_term: 12 status { last_received { term: 11 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:56.442312 11441 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.547501 11559 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:14:56.395190 11233 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:14:56.474110 11588 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.388429 11372 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.473457 11431 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.388644 11433 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.481676 11426 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.453907 11279 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.604264 11279 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:56.585225 11431 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.608027 11431 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:56.582090 11588 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.610962 11588 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:56.595692 11372 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:56.619319 11078 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.437s	user 0.008s	sys 0.004s
I20260709 13:14:56.477897 11485 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.494788 11449 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.498646 11209 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:56.505482 11553 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.537171  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:56.656809  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 119729us
W20260709 13:14:56.538471 11594 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
W20260709 13:14:56.538640 11593 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 13:14:56.508139 11578 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:56.539770 11539 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:56.538393 11600 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:14:56.516966 11414 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:56.549508 11479 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:56.526703 11205 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:56.692107 11578 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.693431 11578 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:56.557775  7335 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.000s
I20260709 13:14:56.695328  7335 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:56.696238  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:56.505792 11459 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:14:56.507903 11208 consensus_queue.cc:1175] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" responder_term: 13 status { last_received { term: 10 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:56.528092 11458 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:56.543129 11374 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.565529 11463 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.569191 11461 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.571136  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1963) took 1178 ms. Trace:
W20260709 13:14:56.571977 11599 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:14:56.507269 11584 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.577710 11233 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:14:56.578140 11537 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:56.593202 11418 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.184s	user 0.002s	sys 0.006s
I20260709 13:14:56.595378 11442 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:56.590498 11292 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.103s	user 0.009s	sys 0.002s
I20260709 13:14:56.602108 11433 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:56.620895 11557 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.038s	user 0.010s	sys 0.000s
I20260709 13:14:56.720278  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:56.628037 11565 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:14:56.632555  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.765954  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:56.766765  7254 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:56.633342  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:56.634120  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:56.767977  7887 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:56.769032  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:56.636111  7895 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:56.637516  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:56.639919  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:56.769959  7182 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:56.641095  7187 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:14:56.771066  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:56.772205  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:56.641639  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:56.772944  7183 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:14:56.642858  7889 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:56.648715 11483 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:56.596017  7186 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:56.651090 11294 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:56.490523 11150 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:14:56.654415  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 274874us
I20260709 13:14:56.689128  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:56.659551 11553 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:56.698853  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:56.685860 11431 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 13:14:56.705176  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 161649us
I20260709 13:14:56.707278  7178 rpcz_store.cc:276] 0709 13:14:55.392607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.411686 (+ 19079us) service_pool.cc:224] Handling call
0709 13:14:55.425131 (+ 13445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.429911 (+  4780us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:55.429940 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.430368 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.956467 (+526099us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b180048a4e0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:14:56.158377 (+201910us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:56.158425 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.158507 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.570833 (+412326us) raft_consensus.cc:1685] finished
0709 13:14:56.570856 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.571072 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4334,"raft.queue_time_us":4428,"spinlock_wait_cycles":16207360,"thread_start_us":201715,"threads_started":1,"wal-append.queue_time_us":1066728}
I20260709 13:14:56.712081  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:56.755728  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:56.792886  7256 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:56.734345  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:56.622921 11443 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.591s	user 0.001s	sys 0.009s
W20260709 13:14:56.734611  7300 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:33688 dropped due to backpressure: service queue is full with 50 items
I20260709 13:14:56.759207 11451 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.762588 11205 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.738497 11440 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:56.655172 11078 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.712654 11233 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:56.804761  7894 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:56.804931 11233 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.805920 11078 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:56.806253 11233 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:56.763924  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:56.698242 11459 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:56.802709 11440 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:56.811396 11459 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.811928 11440 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.812657 11459 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:56.767155  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:56.779062  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:14:56.813766  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46701.5us
I20260709 13:14:56.815265  7891 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 9: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:56.782804 11557 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.783548  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:56.786160 11584 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:56.754451 11418 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.819331 11557 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:56.819586 11418 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:56.787896 11481 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.827s	user 0.010s	sys 0.001s
I20260709 13:14:56.820405 11481 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.821005 11205 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:56.790093  7892 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:56.822576 11481 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:56.822944  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:56.823523  7254 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:56.823774  7259 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:56.790146  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:56.825582  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:56.793470  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:56.793833  7255 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:56.827910  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:56.828914  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:56.830374  7254 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:56.830969 11485 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:56.831027 11467 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:56.831806 11485 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:56.832278  7896 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:56.795779  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:56.796132  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:56.763785 11374 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.742215 11403 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.743177 11355 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:56.774381 11565 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:56.789760 11150 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:56.798975  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:56.801641  7334 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:56.776175 11483 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:56.802728  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:56.754245 11292 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.826892 11233 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:56.752807  7299 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:44980 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1779)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1762)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1740)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1752)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1785)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1756)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1774)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1731)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1732)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1737)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1778)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1787)
W20260709 13:14:56.842698  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 43833.8us
I20260709 13:14:56.826539  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:56.830374  7892 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:56.833257 11433 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:56.802201 11553 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:14:56.841320  7889 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:56.844087  7859 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:56.848374  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:56.834766 11440 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:56.845871  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:56.853097 11608 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.341s	user 0.000s	sys 0.003s
I20260709 13:14:56.850674 11355 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:56.850957 11433 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:56.854972 11565 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.848302 11559 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:14:56.856156 11565 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:56.856391 11451 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:56.855940 11433 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.856781 11451 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:56.857748 11451 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.858920 11451 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:56.859184 11483 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.860311 11483 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:56.842765 11233 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.861080  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 586) took 1151 ms. Trace:
I20260709 13:14:56.869683  7890 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
W20260709 13:14:56.864979  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.873386 11587 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:56.874576 11233 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:56.861332 11173 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:56.875555  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.883158  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 581) took 1311 ms. Trace:
I20260709 13:14:56.883569  7333 rpcz_store.cc:276] 0709 13:14:55.571265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.751216 (+179951us) service_pool.cc:224] Handling call
0709 13:14:56.882969 (+1131753us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b5400421b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:56.883093 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90004864}
I20260709 13:14:56.849416 11431 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:56.870849 11292 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:56.882391 11233 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.848881 11418 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:56.892174 11598 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.433s	user 0.000s	sys 0.000s
I20260709 13:14:56.895287 11397 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.904353 11397 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:56.851577 11205 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:14:56.909746 11258 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:56.912528 11443 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:56.913044 11443 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:56.913889 11443 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:56.845683 11150 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:56.888227 11431 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.909965 11205 consensus_queue.cc:1243] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:14:56.940208 11443 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:56.941901 11431 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:56.940599 11484 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:56.946933 11620 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:14:56.963917 11233 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:56.965704 11485 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:56.971081 11418 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:56.972560 11150 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:56.741494  7150 leader_election.cc:336] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.827s (SENT)
I20260709 13:14:56.784746  7182 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:14:57.006220  7179 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:57.006181  7150 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:57.008551  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:57.009320  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 267823us
I20260709 13:14:57.009677  7182 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:57.006373  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 1979) took 1033 ms. Trace:
I20260709 13:14:57.011488  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.010519  7180 rpcz_store.cc:276] 0709 13:14:55.973110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.973264 (+   154us) service_pool.cc:224] Handling call
0709 13:14:56.019034 (+ 45770us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:56.041855 (+ 22821us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:14:56.219230 (+177375us) log.cc:844] Serialized 14 byte log entry
0709 13:14:56.576619 (+357389us) log.cc:844] Serialized 14 byte log entry
0709 13:14:56.576786 (+   167us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:56.577390 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 13:14:56.577543 (+   153us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:56.577583 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.577672 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.840476 (+262804us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:14:57.005391 (+164915us) raft_consensus.cc:1685] finished
0709 13:14:57.005483 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.006020 (+   537us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2009,"prepare.queue_time_us":133137,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":85,"raft.queue_time_us":46787,"raft.run_cpu_time_us":474,"raft.run_wall_time_us":112548,"spinlock_wait_cycles":51478912,"thread_start_us":356174,"threads_started":3,"wal-append.queue_time_us":233740}
I20260709 13:14:56.797147  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.014060  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.014499  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.015165  7182 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:57.015204  7181 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:57.016323  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.016502  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:57.016896  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:57.017324  7182 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:57.017632  7180 raft_consensus.cc:2410] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:14:57.017668  7181 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:14:56.778296  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:14:57.019706  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.022085  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:56.788313  7183 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:14:57.018515  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:57.025420  7178 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:57.025979  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.026574  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:56.749171  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.030232  7184 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:57.023394  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:56.745805  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.032393  7185 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:57.033574  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.033746  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.034562  7255 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:57.031149  7187 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:57.039466  7182 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:57.040484  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:57.040962  7182 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:57.041211  7184 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:57.042367  7182 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:56.838217  7256 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:57.043924  7182 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:57.043903  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.044759  7256 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:57.045408  7182 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:57.045686  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.046321  7256 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:57.046839  7182 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:57.047240  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.048339  7182 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:57.048961  7185 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:57.050586  7185 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:57.058010  7256 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:57.060899  7262 raft_consensus.cc:2410] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:14:57.053792  7150 leader_election.cc:336] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.923s (SENT)
I20260709 13:14:57.030079  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.063825  7253 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:57.063997  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.065212  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.068149  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:57.055235  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:56.873349  7327 rpcz_store.cc:276] 0709 13:14:55.710134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.720353 (+ 10219us) service_pool.cc:224] Handling call
0709 13:14:56.860797 (+1140444us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54001d29d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:56.860953 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510252928}
I20260709 13:14:57.086791  7255 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:57.090364  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.091991  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.092974  7255 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:57.093976  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.095996  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.097502  7256 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:57.090070  7187 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:14:57.098835  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.098492  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1976) took 1132 ms. Trace:
I20260709 13:14:57.101882  7253 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:14:57.101336  7179 rpcz_store.cc:276] 0709 13:14:55.965927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.966038 (+   111us) service_pool.cc:224] Handling call
0709 13:14:57.098279 (+1132241us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54000eddd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.098421 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264691456}
W20260709 13:14:57.112830  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 57856.6us
I20260709 13:14:57.119494  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:57.120214  7261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 763) took 1792 ms (client timeout 2117 ms). Trace:
I20260709 13:14:57.120715  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1766) took 1232 ms. Trace:
I20260709 13:14:57.121155  7327 rpcz_store.cc:276] 0709 13:14:55.888586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.088658 (+1200072us) service_pool.cc:224] Handling call
0709 13:14:57.120601 (+ 31943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.121626  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 2849) took 1113 ms. Trace:
I20260709 13:14:57.118671  7181 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:14:57.123548  7255 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:57.121619 11404 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:14:57.120733  7261 rpcz_store.cc:269] 0709 13:14:55.327304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.327943 (+   639us) service_pool.cc:224] Handling call
0709 13:14:57.119670 (+1791727us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54002d3a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.119955 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452480896}
I20260709 13:14:57.122078  7260 rpcz_store.cc:276] 0709 13:14:56.007996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.032148 (+ 24152us) service_pool.cc:224] Handling call
0709 13:14:57.121204 (+1089056us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b540009abd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.121452 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206558464}
I20260709 13:14:57.109416 11394 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:57.133085  7178 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:57.136690 10532 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:57.137198  7185 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
W20260709 13:14:57.138784  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 85123.8us
I20260709 13:14:57.135406 11394 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.145450  7330 raft_consensus.cc:2410] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:14:57.146358  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.154400 11405 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:57.156963 11431 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.159852  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1760) took 1303 ms. Trace:
I20260709 13:14:57.160306  7328 rpcz_store.cc:276] 0709 13:14:55.856213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.970580 (+114367us) service_pool.cc:224] Handling call
0709 13:14:57.159492 (+1188912us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b54002891d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.159674 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96343424}
I20260709 13:14:57.161811  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.163002  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:57.164203  7327 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 8.
I20260709 13:14:57.164710  7862 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:57.165448  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.145124 11394 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:57.172165  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1761) took 1291 ms. Trace:
I20260709 13:14:57.172601  7330 rpcz_store.cc:276] 0709 13:14:55.880308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.038474 (+158166us) service_pool.cc:224] Handling call
0709 13:14:57.171912 (+1133438us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54001f4ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.172095 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995225984}
I20260709 13:14:57.173950  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.166317  7327 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:14:57.187609  7184 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:14:57.190111  7330 raft_consensus.cc:2410] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:14:57.193385  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1748) took 1431 ms. Trace:
I20260709 13:14:57.193569 11404 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:14:57.194223 11404 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:57.195273  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.196130 11404 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.196808  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.198244  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.200423  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 731) took 1621 ms. Trace:
I20260709 13:14:57.193885  7334 rpcz_store.cc:276] 0709 13:14:55.761489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.043763 (+282274us) service_pool.cc:224] Handling call
0709 13:14:57.193016 (+1149253us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b540013d654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.193201 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487852416}
I20260709 13:14:57.204974 11485 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:57.207387 11431 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:57.208163 11274 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:57.208622 11258 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:57.212607 11355 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.215373  7888 rpcz_store.cc:276] 0709 13:14:55.578779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.579228 (+   449us) service_pool.cc:224] Handling call
0709 13:14:55.579508 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.877461 (+1297953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.877495 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:56.877553 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:56.877585 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.199778 (+322193us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400684f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:57.199858 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.200180 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2984485760}
W20260709 13:14:57.225035  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 80673.4us
I20260709 13:14:57.234059  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:57.234440  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.234512  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 92879.2us
I20260709 13:14:57.235984  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:57.236992  7890 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:57.224100 11258 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:57.226923 11355 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:57.243054 11623 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:14:57.246328  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.247466  7330 raft_consensus.cc:2410] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:57.248481  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.248914  7327 raft_consensus.cc:2410] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:14:57.249146  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1762) took 1361 ms. Trace:
I20260709 13:14:57.249504  7330 rpcz_store.cc:276] 0709 13:14:55.887327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.248069 (+1360742us) service_pool.cc:224] Handling call
0709 13:14:57.249099 (+  1030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.249814  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.250530  7327 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:57.250514  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.234083  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.253424  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.238222 11485 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:57.259620  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.260208 11258 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:57.260622 11485 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.262010 11258 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:57.263156  7328 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:57.264364  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.265045  7328 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:14:57.265492  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1740) took 1701 ms. Trace:
I20260709 13:14:57.265798  7328 rpcz_store.cc:276] 0709 13:14:55.564414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.263986 (+1699572us) service_pool.cc:224] Handling call
0709 13:14:57.265444 (+  1458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.267577  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.268476  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1752) took 1431 ms. Trace:
I20260709 13:14:57.268848  7334 rpcz_store.cc:276] 0709 13:14:55.836708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.267219 (+1430511us) service_pool.cc:224] Handling call
0709 13:14:57.268410 (+  1191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.270078  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.271333  7152 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:57.272673 11374 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:57.274058  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:57.261157  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.279165  7327 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:57.280550  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.282029  7327 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:57.285225  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.287914  7334 raft_consensus.cc:2410] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:14:57.288803  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1749) took 1497 ms. Trace:
I20260709 13:14:57.289384  7334 rpcz_store.cc:276] 0709 13:14:55.791684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.269651 (+1477967us) service_pool.cc:224] Handling call
0709 13:14:57.288733 (+ 19082us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:57.294808  7225 connection.cc:256] RPC call timeout handler was delayed by -1.3007762820000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 13:14:57.295535  7225 connection.cc:256] RPC call timeout handler was delayed by -1.2980762820000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 13:14:57.295949  7225 connection.cc:256] RPC call timeout handler was delayed by -1.2034594879999077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 13:14:57.296339  7225 connection.cc:256] RPC call timeout handler was delayed by -1.1882762819998334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
I20260709 13:14:57.300915 11418 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.301611 11418 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.308146  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1725) took 1810 ms. Trace:
I20260709 13:14:57.308357 11355 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.308718  7329 rpcz_store.cc:276] 0709 13:14:55.497688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.504499 (+  6811us) service_pool.cc:224] Handling call
0709 13:14:57.307681 (+1803182us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400253354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.307941 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668627328}
I20260709 13:14:57.311194  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.311367  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.311945  7334 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:57.312237  7335 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:57.313237 11475 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:57.313757 11475 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:57.311514  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.315256  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1765) took 1427 ms. Trace:
W20260709 13:14:57.315342  7257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 764) took 1987 ms (client timeout 2063 ms). Trace:
I20260709 13:14:57.315620  7331 rpcz_store.cc:276] 0709 13:14:55.888320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.311017 (+1422697us) service_pool.cc:224] Handling call
0709 13:14:57.315180 (+  4163us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:57.315727  7257 rpcz_store.cc:269] 0709 13:14:55.327612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.327735 (+   123us) service_pool.cc:224] Handling call
0709 13:14:57.314983 (+1987248us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54002260d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.315157 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404517632}
I20260709 13:14:57.316936  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.282923  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1753) took 1441 ms. Trace:
I20260709 13:14:57.316705  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.318370  7327 rpcz_store.cc:276] 0709 13:14:55.841207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.280114 (+1438907us) service_pool.cc:224] Handling call
0709 13:14:57.282799 (+  2685us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.319732  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1785) took 1025 ms. Trace:
W20260709 13:14:57.320493  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.321182  7329 rpcz_store.cc:276] 0709 13:14:56.294364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.309701 (+1015337us) service_pool.cc:224] Handling call
0709 13:14:57.316500 (+  6799us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b5800094b98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:14:57.319668 (+  3168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11212032}
W20260709 13:14:57.322703  7258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 2837) took 1949 ms (client timeout 1602 ms). Trace:
W20260709 13:14:57.329274  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55406.7us
W20260709 13:14:57.327668  7258 rpcz_store.cc:269] 0709 13:14:55.370511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.373583 (+  3072us) service_pool.cc:224] Handling call
0709 13:14:57.319680 (+1946097us) spinlock_profiling.cc:243] Waited 86.3 ms on lock 0x7b540034b2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.319902 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198398848}
W20260709 13:14:57.338636  7150 leader_election.cc:336] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.943s (SENT)
W20260709 13:14:57.373984  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.378676  7330 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:57.376308 11355 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:57.376101 11394 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:57.381793  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 53755.3us
I20260709 13:14:57.376659 11404 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:57.382637 11394 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:57.383141 11404 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.386539  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.386111  7187 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:14:57.389739  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:57.384724 11629 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:14:57.391495 11404 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:57.412344  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:57.400348  7330 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
W20260709 13:14:57.422919  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 125993us
I20260709 13:14:57.423961  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1757) took 1575 ms. Trace:
I20260709 13:14:57.424458  7330 rpcz_store.cc:276] 0709 13:14:55.848843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.379579 (+1530736us) service_pool.cc:224] Handling call
0709 13:14:57.423873 (+ 44294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.394263 11418 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:57.427110  7335 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:14:57.429019  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 597) took 1133 ms. Trace:
I20260709 13:14:57.431360  7335 rpcz_store.cc:276] 0709 13:14:56.295183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.310764 (+1015581us) service_pool.cc:224] Handling call
0709 13:14:57.428960 (+118196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203136}
W20260709 13:14:57.432410  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 84049.1us
I20260709 13:14:57.436020  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.436858  7327 raft_consensus.cc:2410] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:14:57.437295  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1756) took 1595 ms. Trace:
I20260709 13:14:57.437541  7327 rpcz_store.cc:276] 0709 13:14:55.843913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.327260 (+1483347us) service_pool.cc:224] Handling call
0709 13:14:57.437252 (+109992us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:57.438645  7225 leader_election.cc:336] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.590s (SENT)
I20260709 13:14:57.441486  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1791) took 1016 ms. Trace:
I20260709 13:14:57.443013  7330 rpcz_store.cc:276] 0709 13:14:56.425140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.425353 (+1000213us) service_pool.cc:224] Handling call
0709 13:14:57.441405 (+ 16052us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.447928  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:57.450254  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.450798  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.456830  7335 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:57.463891  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.465888  7330 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:14:57.466282  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1788) took 1085 ms. Trace:
I20260709 13:14:57.466465  7330 rpcz_store.cc:276] 0709 13:14:56.380407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.443627 (+1063220us) service_pool.cc:224] Handling call
0709 13:14:57.466240 (+ 22613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.471838  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.474537  7327 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:57.475000  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1789) took 1094 ms. Trace:
I20260709 13:14:57.475000  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:57.476426 11636 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:14:57.483096 11150 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:57.483703 11150 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.484143 11150 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:57.475651  7327 rpcz_store.cc:276] 0709 13:14:56.380667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.442692 (+1062025us) service_pool.cc:224] Handling call
0709 13:14:57.474942 (+ 32250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:57.489343  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.489526 10532 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:57.493631  7334 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:14:57.496320  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1764) took 1606 ms. Trace:
I20260709 13:14:57.496901  7334 rpcz_store.cc:276] 0709 13:14:55.888017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.291384 (+1403367us) service_pool.cc:224] Handling call
0709 13:14:57.494087 (+202703us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.498368  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.495070 11405 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:57.500344 11405 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:57.505354  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.507412  7186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 1970) took 2112 ms (client timeout 2068 ms). Trace:
W20260709 13:14:57.507884  7186 rpcz_store.cc:269] 0709 13:14:55.394452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.397500 (+  3048us) service_pool.cc:224] Handling call
0709 13:14:57.506948 (+2109448us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002b5cd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.507208 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2734121856}
I20260709 13:14:57.511374 11578 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.512645  7330 raft_consensus.cc:2410] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:14:57.515000 11578 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:57.519382  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.520905  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.525606  7186 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:57.515969 10532 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:14:57.528720  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 94156.7us
I20260709 13:14:57.530821 11431 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.539255 11431 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:57.541679 11431 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:57.538199 11475 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.543779  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:57.544963  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:57.545400  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.546132  7328 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:57.546703 11394 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:57.547082 11394 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:14:57.547415 11394 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:57.551220  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:57.552511  7225 connection.cc:256] RPC call timeout handler was delayed by -1.108822119000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 13:14:57.552914  7225 connection.cc:256] RPC call timeout handler was delayed by -1.1063762819999283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 13:14:57.553205  7225 connection.cc:256] RPC call timeout handler was delayed by -1.0050044019999405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:14:57.528211 11550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.672s	user 0.028s	sys 0.016s
I20260709 13:14:57.553655  7334 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:57.554255  7329 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:14:57.559108  7335 raft_consensus.cc:2410] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:57.559574  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1774) took 1267 ms. Trace:
I20260709 13:14:57.559986  7335 rpcz_store.cc:276] 0709 13:14:56.291860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.477501 (+1185641us) service_pool.cc:224] Handling call
0709 13:14:57.559509 (+ 82008us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.561883  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1737) took 2016 ms. Trace:
I20260709 13:14:57.562341  7334 rpcz_store.cc:276] 0709 13:14:55.541766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.516099 (+1974333us) service_pool.cc:224] Handling call
0709 13:14:57.526443 (+ 10344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.556777 (+ 30334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.558225 (+  1448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.562758  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1731) took 2047 ms. Trace:
I20260709 13:14:57.563330  7329 rpcz_store.cc:276] 0709 13:14:55.511975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.494424 (+1982449us) service_pool.cc:224] Handling call
0709 13:14:57.519135 (+ 24711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:57.559176 (+ 40041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.559366 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:57.557824 11550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.775s	user 0.029s	sys 0.017s
I20260709 13:14:57.564958  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1732) took 2047 ms. Trace:
I20260709 13:14:57.567799  7335 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 13. Ops: []
W20260709 13:14:57.564435  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 77277.2us
W20260709 13:14:57.574816  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53258.9us
I20260709 13:14:57.576318  7330 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:14:57.573189  7327 rpcz_store.cc:276] 0709 13:14:55.512584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.495909 (+1983325us) service_pool.cc:224] Handling call
0709 13:14:57.528853 (+ 32944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.556221 (+ 27368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.556239 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.559850 (+  3611us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:57.559892 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.559946 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.560034 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.579317  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 584) took 1998 ms. Trace:
I20260709 13:14:57.579788  7335 rpcz_store.cc:276] 0709 13:14:55.575860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.560779 (+1984919us) service_pool.cc:224] Handling call
0709 13:14:57.561190 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.573707 (+ 12517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.573965 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.576716  7330 pending_rounds.cc:85] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 11
W20260709 13:14:57.584654  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.567468 11485 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.616581  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.571245 11429 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:57.577677 11431 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:57.582656  7330 pending_rounds.cc:107] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:14:57.578104 11578 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:57.618547 11475 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:57.626008  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:57.626710 11449 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:57.626488  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.627454  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.630064 11150 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.631639  7335 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:14:57.632671 11404 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:57.635421  7257 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:14:57.636027  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.637709  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.638453  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.639541  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:57.640281  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1783) took 1346 ms. Trace:
W20260709 13:14:57.640803  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 69565.2us
I20260709 13:14:57.648460  7335 pending_rounds.cc:85] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 7
I20260709 13:14:57.642289 11485 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.644742  7330 raft_consensus.cc:2889] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:57.643723  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 56103.2us
I20260709 13:14:57.644984  7890 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:57.651086  7335 pending_rounds.cc:107] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:14:57.654134  7335 raft_consensus.cc:2889] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:57.650570  7329 rpcz_store.cc:276] 0709 13:14:56.293925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.624501 (+1330576us) service_pool.cc:224] Handling call
0709 13:14:57.639501 (+ 15000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.639880 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.639913 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.639980 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:57.640015 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.640076 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:57.640201 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.644649 11431 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:57.655318  7150 leader_election.cc:336] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.584s (SENT)
I20260709 13:14:57.659243  7256 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:14:57.659498  7253 raft_consensus.cc:2410] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:57.659935  7328 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:14:57.658953  7261 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:57.658967  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.658928  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.661892  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:57.651895 11449 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:57.663038  7896 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 10: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:57.660303  7328 pending_rounds.cc:85] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 10
I20260709 13:14:57.663959  7150 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:57.666656  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1775) took 1374 ms. Trace:
I20260709 13:14:57.667035  7254 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 7. Current term is 8. Ops: []
I20260709 13:14:57.667110  7335 rpcz_store.cc:276] 0709 13:14:56.292104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.580688 (+1288584us) service_pool.cc:224] Handling call
0709 13:14:57.631053 (+ 50365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.666317 (+ 35264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.666570 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.668376  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.668543  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.669535  7335 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 13: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:57.669822  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.670739  7255 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:57.670921  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:57.671939  7888 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:57.673134 11449 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:57.673738  7329 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:14:57.658160 11431 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:57.676674  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.677405  7331 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:57.678939  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.679426  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.680136  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.680570  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.680846  7261 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:57.681690  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.681804  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.681829  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.683442  7327 raft_consensus.cc:2410] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:14:57.670485  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.685374  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.685926  7335 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:57.664667 11462 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:57.684336  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.686725 11462 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:57.687083  7327 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 13: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:57.688997  7333 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:57.689472  7333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1773) took 1397 ms (client timeout 1827 ms). Trace:
I20260709 13:14:57.689862  7327 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:57.690831  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1787) took 1310 ms. Trace:
I20260709 13:14:57.691206  7327 rpcz_store.cc:276] 0709 13:14:56.380136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.687718 (+1307582us) service_pool.cc:224] Handling call
0709 13:14:57.688236 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.690516 (+  2280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.690756 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:57.695650  7332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1736) took 2155 ms (client timeout 2095 ms). Trace:
W20260709 13:14:57.696247  7332 rpcz_store.cc:269] 0709 13:14:55.539894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.540761 (+   867us) service_pool.cc:224] Handling call
0709 13:14:57.695216 (+2154455us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540036b354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.695402 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597690624}
W20260709 13:14:57.698132  7894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 722) took 2566 ms (client timeout 1601 ms). Trace:
W20260709 13:14:57.698720  7894 rpcz_store.cc:269] 0709 13:14:55.131147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.175729 (+ 44582us) service_pool.cc:224] Handling call
0709 13:14:57.697557 (+2521828us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400552b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.697858 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3668498688}
W20260709 13:14:57.700187 11646 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
I20260709 13:14:57.700548  7893 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:57.703678  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.704998  7183 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:57.705437  7184 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:57.705605  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:57.705492  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.707182  7185 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:57.706638  7186 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 13:14:57.707540  7328 pending_rounds.cc:107] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:14:57.707907  7328 raft_consensus.cc:2889] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:57.708187  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 825) took 1449 ms. Trace:
W20260709 13:14:57.708459  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.706429  7180 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:14:57.689841  7333 rpcz_store.cc:269] 0709 13:14:56.291628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.284639 (+993011us) service_pool.cc:224] Handling call
0709 13:14:57.688670 (+404031us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b5400277fa8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef019924 00007fecee202227 00007fecee201ab8 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6
0709 13:14:57.689412 (+   742us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73616768}
I20260709 13:14:57.712203  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.713560  7256 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:57.710698  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:57.715284  7255 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:14:57.716523  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.716523  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 582) took 2142 ms. Trace:
I20260709 13:14:57.708529  7893 rpcz_store.cc:276] 0709 13:14:56.259077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.259777 (+   700us) service_pool.cc:224] Handling call
0709 13:14:57.700167 (+1440390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.701131 (+   964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.708000 (+  6869us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400552b50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:14:57.708134 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3311355264}
I20260709 13:14:57.719550  7253 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:57.718777  7330 rpcz_store.cc:276] 0709 13:14:55.571507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.524809 (+1953302us) service_pool.cc:224] Handling call
0709 13:14:57.559649 (+ 34840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.710729 (+151080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.713750 (+  3021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.723572  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:57.724324  7187 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:57.725615  7894 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:57.726994  7329 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
W20260709 13:14:57.725834  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 59864.6us
I20260709 13:14:57.726429  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 583) took 2154 ms. Trace:
I20260709 13:14:57.729296  7328 rpcz_store.cc:276] 0709 13:14:55.571725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.554856 (+1983131us) service_pool.cc:224] Handling call
0709 13:14:57.643460 (+ 88604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.724947 (+ 81487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.726376 (+  1429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:57.716035 11258 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:57.732419  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.735451 11573 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:57.756132 11565 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:57.757601  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:57.758556  7258 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:57.737095  7253 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:56.798014  7300 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:33688 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1779)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1762)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1740)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1752)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1785)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1756)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1774)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1731)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1732)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1737)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1778)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1787)
I20260709 13:14:57.740381 11647 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:57.744611  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.744863  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.745519  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:57.758838 11475 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:14:57.746135  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:57.728353 11150 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:14:57.747042  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 91751.3us
I20260709 13:14:57.747565  7180 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:57.748999 11431 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.749872  7890 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:14:57.770856  7336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 585) took 2183 ms (client timeout 2522 ms). Trace:
I20260709 13:14:57.767350 11475 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:14:57.750861  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:57.751533 11481 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:57.776468  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.752311  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:14:57.761313  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 121909us
I20260709 13:14:57.762281  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.758999  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.768554  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.778911  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:57.779419  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.779739  7889 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 9: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:57.780175  7255 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:57.780470 11525 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:14:57.782454  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.782783 11292 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:57.784123  7186 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:57.776125  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.785557  7262 raft_consensus.cc:2368] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12.
I20260709 13:14:57.786394  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.787065  7893 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:57.787210  7257 raft_consensus.cc:2410] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:14:57.788328  7257 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:57.771610  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:14:57.771652  7150 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 2.023s (SENT) [suppressed 52 similar messages]
I20260709 13:14:57.750080  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:57.773725  7335 raft_consensus.cc:2410] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:14:57.774559  7178 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:14:57.772919  7336 rpcz_store.cc:269] 0709 13:14:55.587348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.293956 (+1706608us) service_pool.cc:224] Handling call
0709 13:14:57.744359 (+450403us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b5800094b98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:14:57.770796 (+ 26437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53642496}
I20260709 13:14:57.757933 11565 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:14:57.794040  7256 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:57.774883 11475 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:57.764734  7185 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:14:57.776132  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:57.793040  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.788679 11481 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:14:57.795989  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 43808.7us
I20260709 13:14:57.795958  7255 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:14:57.807973 11418 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:14:57.817481  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.823839  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:57.826458  7888 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:57.832661  7150 leader_election.cc:336] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 2.043s (SENT)
I20260709 13:14:57.833333  7150 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:57.803843 11481 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:57.835088  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:57.843493  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:57.844377  7258 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:57.845096  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:57.848830  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 91352.9us
I20260709 13:14:57.808915 11647 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:14:57.836659  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:57.850879  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:57.848307  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:57.852152  7184 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:57.859555  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.863190  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2843) took 1851 ms. Trace:
I20260709 13:14:57.863610  7259 rpcz_store.cc:276] 0709 13:14:55.995071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.998308 (+  3237us) service_pool.cc:224] Handling call
0709 13:14:55.998573 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.824148 (+825575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.811975 (+987827us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54002170d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:14:57.846343 (+ 34368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897319296}
I20260709 13:14:57.864629  7888 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:14:57.866047 11475 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.866516 11403 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.867439 11475 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:57.867338 11403 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.871115 11481 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:57.872527 11481 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:57.875583  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:57.876602 11178 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:57.878598 11178 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:57.880014 11178 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:57.880468 11178 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:57.881585 11178 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:57.883428 11178 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:57.883631  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:57.885854 11390 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:14:57.886747 11390 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:57.888991  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:57.890105  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:57.830588 11418 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:57.895938 11418 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.870273 11403 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:57.900568  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:57.904690  7253 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:14:57.905280 10532 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:57.913408  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.913761  7331 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:14:57.915400  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:57.826931 11150 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:14:57.918087 11429 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:57.919350 11483 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:57.921208  7255 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:57.923089  7896 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:57.903224 11573 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:57.928387  7301 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:57.933691  7888 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:57.933889  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:57.940224  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.940696  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.941215  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52346.3us
I20260709 13:14:57.943742  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:57.942296 11292 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:57.951414  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.948832 10532 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.953325  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.953859 10532 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:57.929795 11404 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:57.952051  7335 raft_consensus.cc:2376] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11. Re-sending same reply.
I20260709 13:14:57.907306 11394 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.958232  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.953960  7336 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:57.959681  7261 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:57.959842  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:57.964507  7328 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:57.967748  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 145548us
I20260709 13:14:57.971755  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:57.950232 11431 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:57.959384 11238 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:57.974269 11238 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:57.974761 11238 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:57.975726 11238 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:57.979621  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:57.979393  7329 raft_consensus.cc:2376] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9. Re-sending same reply.
I20260709 13:14:57.986743  7331 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:57.941821 11485 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:57.989804  7861 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:57.996325  7861 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:57.965371 11565 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:58.002660  7327 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:58.000945  7330 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:58.005927  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.006987  7329 raft_consensus.cc:2368] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
W20260709 13:14:58.008739  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 87866.3us
W20260709 13:14:58.028191  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 91645us
I20260709 13:14:57.996253 11485 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:58.031157  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:58.032892  7150 leader_election.cc:336] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 2.170s (SENT)
I20260709 13:14:58.033536  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.035300  7253 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 8: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:14:58.040426  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 214374us
I20260709 13:14:58.048511  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.054983  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.061045  7329 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:58.062426  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.042659 11475 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:58.054488 11404 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:58.079895  7862 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:58.091849  7184 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:14:58.092507 11651 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:14:58.098961 11650 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:14:58.099164 11238 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.100535  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1778) took 1807 ms. Trace:
I20260709 13:14:58.100973  7334 rpcz_store.cc:276] 0709 13:14:56.292767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.583553 (+1290786us) service_pool.cc:224] Handling call
0709 13:14:57.627564 (+ 44011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:57.628232 (+   668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.628268 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:57.628908 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 13:14:57.711789 (+ 82881us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:57.711830 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.711892 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:58.100308 (+388416us) raft_consensus.cc:1685] finished
0709 13:14:58.100327 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.100480 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1494,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":192,"thread_start_us":82395,"threads_started":1,"wal-append.queue_time_us":205658}
I20260709 13:14:58.099749 11238 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:58.108567 11238 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:14:58.110421  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 77582.6us
W20260709 13:14:58.117758  7150 leader_election.cc:336] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 2.170s (SENT)
W20260709 13:14:58.087083  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 115429us
I20260709 13:14:58.117847  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.123831  7330 raft_consensus.cc:2410] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:14:58.125031  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:58.126446  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.089386 11475 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:58.137881  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.138587  7334 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:58.113600 11485 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:58.137068 11390 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:58.141477 11475 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:58.142505 11564 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:58.147456  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56408us
I20260709 13:14:58.152257 11485 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:58.153486  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.157845  7327 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:58.128099 11150 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:58.154421 11652 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:14:58.138567  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 84456.3us
I20260709 13:14:58.167299 11655 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:58.162442  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.137543 11429 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:14:58.154969 11390 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:58.166333 11658 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:58.165493  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.139691 11483 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:58.180219  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.163488  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:58.200655  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 82915.2us
I20260709 13:14:58.178809 11394 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:58.166790  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.175235  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.333920  7336 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:58.190761  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 274577us
I20260709 13:14:58.165874  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:58.192261 11653 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:14:58.179517  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.229120  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.252703 10532 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:58.327982  7333 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:14:58.322537 11652 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:14:58.329185  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 169521us
I20260709 13:14:58.326536 11655 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:58.334053  7335 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:58.338033  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 306544us
I20260709 13:14:58.335096  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.342996  7334 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:14:58.139235 11660 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:58.346273  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.345105  7328 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:58.349202 10532 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:58.343987 11664 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:58.350279  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:58.354080  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.356199  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 192787us
I20260709 13:14:58.358330  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.334138 11429 consensus_queue.cc:1243] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:14:58.365764  7334 raft_consensus.cc:1813] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Handling vote request from an unknown peer 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:58.368084  7334 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:58.344444 11658 consensus_queue.cc:1243] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:58.372015  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.373314  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.355834 11483 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:58.381961  7150 leader_election.cc:336] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 2.222s (SENT)
I20260709 13:14:58.387626  7301 leader_election.cc:400] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12.
I20260709 13:14:58.387905  7301 leader_election.cc:403] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:58.372306 11418 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:58.399005 11418 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.399338  7186 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:58.399444 11418 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:58.377331 11462 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.001s
I20260709 13:14:58.401818  7257 raft_consensus.cc:2410] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:14:58.389050  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.403277 11564 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:58.378212 11449 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:14:58.405825  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:58.406440  7187 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:58.391198  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.412664  7184 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:14:58.391731  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:58.393260 11431 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:58.416391 11431 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:58.416965 11258 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.002s
I20260709 13:14:58.417479 11258 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:58.417548 11431 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:58.393741 11664 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:58.396821 11429 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:58.397843  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.368630 11656 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:58.422009  7187 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:14:58.443344  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:14:58.426122  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.426990  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 80801.5us
I20260709 13:14:58.427130  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:58.448555  7184 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:14:58.428035  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54814.5us
I20260709 13:14:58.449826  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.431355  7335 raft_consensus.cc:2410] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:14:58.455176  7331 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
W20260709 13:14:58.456398  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.457667  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.459803  7332 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:14:58.442893 11483 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12.
I20260709 13:14:58.472805 11418 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:58.474802 11662 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:58.475734 11418 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:58.476727  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.477391  7333 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:58.478284  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.479049  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.479938  7332 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:58.480984  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.483388  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.485699  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.486946  7334 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:58.489104  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.491250 11565 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:58.493096  7333 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:14:58.493232 11418 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:58.494077  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.494254  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.494689  7333 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:58.494756  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.495368 11418 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:58.499184  7334 raft_consensus.cc:2368] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
I20260709 13:14:58.510550  7327 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:14:58.512421  7336 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
W20260709 13:14:58.502642  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 126458us
I20260709 13:14:58.462757  7894 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:14:58.517699  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:58.526407  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 360624us
W20260709 13:14:58.523924  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 86625.7us
I20260709 13:14:58.529381  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:58.531028  7332 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:58.533746  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:58.531172  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:58.534785  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.538548  7329 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:58.540653  7182 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:58.514778 11431 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:58.543718  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 167464us
I20260709 13:14:58.544025  7332 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:58.445674 11658 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:14:58.515595 11664 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:58.550592  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56417.5us
I20260709 13:14:58.555106  7178 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:58.552274  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.552903 10532 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:58.432092 11390 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:58.553457  7896 raft_consensus.cc:2410] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:14:58.527307 11429 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.557699  7329 raft_consensus.cc:2410] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:14:58.557638  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.558736  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.538715 11662 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:14:58.565196  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.567260  7180 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:14:58.561586  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:58.577339  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.582823 11578 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:58.583384 11578 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:14:58.584218 11578 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:58.540019 11258 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:14:58.597873  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 206284us
I20260709 13:14:58.598008  7332 raft_consensus.cc:3055] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:58.598778  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:58.598939  7332 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:58.597862 11658 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:58.600986  7332 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:58.602533  7332 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:58.605779 11178 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:58.606480 11178 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:58.569288 11429 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:58.609833 11429 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:58.511818 11655 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:58.610875  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:58.617820  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 60251.4us
I20260709 13:14:58.633810  7333 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:14:58.597323 11670 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:58.642171  7894 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:14:58.640211  7150 leader_election.cc:336] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.504s (SENT)
I20260709 13:14:58.641968 11672 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.650128 10532 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:58.652153  7150 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.653024  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.654661  7332 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:14:58.661237 10532 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:58.662405  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 85169.2us
I20260709 13:14:58.578919 11664 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:58.639299 11670 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:14:58.685463  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 74684.5us
I20260709 13:14:58.686554  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.642678 11658 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:58.697383  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 75199us
I20260709 13:14:58.649904 11418 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:58.711864 10532 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:58.678668 11431 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:58.665110 11150 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:14:58.682976 11663 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:58.642895 11178 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:58.707219 11564 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:58.685144 11238 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.732241 11674 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.732620 11238 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:58.732862 11674 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:58.734754 11429 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:58.735150 11679 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:14:58.662335 11672 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:58.735630 11683 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.736171 11683 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:58.736776  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 50338.7us
I20260709 13:14:58.737105 11672 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:58.737587  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:58.737713 11672 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:58.738276 11683 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:58.785465 11659 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:58.786167 11659 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:58.731722 11664 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:58.731313  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.740073 11238 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:58.740649 11178 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:58.742336  7327 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:58.743355  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.800449  7331 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:14:58.744259  7328 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:58.747088  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.801251  7332 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:58.747412  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.747820  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.747916 11658 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:58.748585  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.802327  7333 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:14:58.749534  7335 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:58.754282  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:58.747089  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.710112 11678 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
W20260709 13:14:58.755983  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 105897us
I20260709 13:14:58.764573 11674 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:58.708190 11655 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:58.771193  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:58.795231  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:58.722949 11662 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:14:58.803774  7329 raft_consensus.cc:2368] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13.
I20260709 13:14:58.841022  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:58.755730  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.804785  7336 raft_consensus.cc:2368] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10.
I20260709 13:14:58.833529  7334 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:14:58.835391  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 81179.4us
W20260709 13:14:58.835788  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 104554us
I20260709 13:14:58.845338  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:14:58.794764 11666 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:14:58.839583  7186 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:14:58.847208  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:58.876129  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.798949 11418 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:14:58.882750 11483 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:58.885866  7183 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:14:58.837453 11670 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:58.729743 11663 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:58.890990  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 265622us
I20260709 13:14:58.892043  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:58.848479 11429 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:58.914454  7261 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:14:58.908538  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:14:58.918116  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 238372us
I20260709 13:14:58.919996  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.920589  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:58.894156  7083 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 153) took 24928 ms (client timeout 15000 ms). Trace:
I20260709 13:14:58.895179  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:58.895952  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:14:58.900810  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.921245  7257 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
W20260709 13:14:58.922380  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.900498 11150 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:58.847916 11258 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:58.901290 11659 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:58.902026 11658 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:58.902649  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:58.904043  7330 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:14:58.922675  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:58.923049  7334 raft_consensus.cc:2410] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:14:58.905416 11483 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:58.924211  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:58.927153  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:14:58.925177 11678 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:58.919206 11449 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:58.942591  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.971426  7333 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
W20260709 13:14:58.972045  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.943979  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.973255  7335 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:58.953524  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.976459  7331 raft_consensus.cc:2410] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:14:58.959594  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.982754  7332 raft_consensus.cc:2376] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13. Re-sending same reply.
I20260709 13:14:58.965837  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:58.985059  7328 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:14:58.969369  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45256.5us
I20260709 13:14:58.909188 11418 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:58.992784 11178 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:58.993793 11418 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:58.988651 11238 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:59.000200 11238 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.000743 11238 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:59.001092  7085 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 12, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 12 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:59.003247  7085 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:14:58.988895  7327 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:58.988287  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:59.005004  7336 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
W20260709 13:14:59.006856  7150 leader_election.cc:336] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.916s (SENT)
W20260709 13:14:59.012547 11682 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:14:58.925622 11674 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:59.028707  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 111578us
I20260709 13:14:59.036430  7333 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:14:59.011466  7085 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.052573  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:59.054666  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:59.055338  7894 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
W20260709 13:14:59.058216  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51453.6us
I20260709 13:14:59.057044  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:59.062599  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:58.968058 11449 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.025545 11671 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:59.070222  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:59.071852  7334 raft_consensus.cc:2410] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:14:58.967583 11394 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:14:59.067899  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 191166us
I20260709 13:14:59.066805  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:59.069527  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:14:59.070168  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:59.073726  7327 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
W20260709 13:14:59.074990  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 175955us
I20260709 13:14:59.073992  7896 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
W20260709 13:14:59.077382  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.051803 11418 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.929800 11681 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 13:14:59.057389 11578 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.079280 10532 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.088147 10532 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:59.065886 11150 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:59.091241 11673 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.091993 11673 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.093829 11663 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:59.094318 11665 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:59.094337 11673 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:59.094879 11665 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:59.095217  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:59.095494  7085 catalog_manager.cc:5697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 4 to 6, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 6 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.097431  7085 catalog_manager.cc:5697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 10, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 10 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:14:59.091274  7152 leader_election.cc:336] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.536s (SENT)
I20260709 13:14:59.099956 11684 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.100596 11684 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.100605 11578 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.103106 11578 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:59.104799  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:59.071252 11671 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.107228 11671 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:59.098932  7085 catalog_manager.cc:5697] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 10, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 10 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:59.070937 11449 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:59.095376 11665 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:59.110371  7085 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 10, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 10 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.114701  7331 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:14:59.106437  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:59.056286 11429 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:59.116787  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:59.127117  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:59.181571  7182 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:59.185106  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:59.185616  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:59.185833  7187 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:14:59.185729  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:59.188122  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 125654us
I20260709 13:14:59.190093  7253 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:14:59.191088  7150 leader_election.cc:336] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 2.600s (SENT)
I20260709 13:14:59.186210  7180 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:14:59.192826  7330 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:14:59.125316 11578 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:59.196723 10532 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:59.088330 11394 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:59.090801 11418 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.199994 11695 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:14:59.200101  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 93792.7us
I20260709 13:14:59.200112 10532 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:14:58.921535  7083 rpcz_store.cc:269] 0709 13:14:33.965681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.965912 (+   231us) service_pool.cc:224] Handling call
0709 13:14:58.893934 (+24928022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:54.365748 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:54.395196 (+ 29448us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:54.395263 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:14:54.395282 (+    19us) tablet.cc:662] Decoding operations
0709 13:14:54.396441 (+  1159us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:54.396542 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:54.396569 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:14:54.397668 (+  1099us) tablet.cc:701] Row locks acquired
0709 13:14:54.397716 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:14:54.397904 (+   188us) write_op.cc:270] Start()
0709 13:14:54.398040 (+   136us) write_op.cc:276] Timestamp: P: 1783602894397842 usec, L: 0
0709 13:14:54.398071 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:14:54.408094 (+ 10023us) log.cc:844] Serialized 4750 byte log entry
0709 13:14:54.554881 (+146787us) op_driver.cc:464] REPLICATION: finished
0709 13:14:54.882404 (+327523us) write_op.cc:301] APPLY: starting
0709 13:14:54.887193 (+  4789us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:55.030459 (+143266us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:55.030592 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:55.732522 (+701930us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:55.779923 (+ 47401us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 13:14:55.779981 (+    58us) write_op.cc:312] APPLY: finished
0709 13:14:55.780429 (+   448us) log.cc:844] Serialized 113 byte log entry
0709 13:14:57.387368 (+1606939us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece61320ac 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b
0709 13:14:57.631206 (+243838us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:57.631620 (+   414us) write_op.cc:454] Released schema lock
0709 13:14:57.631763 (+   143us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:57.632470 (+   707us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:57.632510 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5856446,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":317320,"apply.run_cpu_time_us":71872,"apply.run_wall_time_us":2749993,"cfile_cache_hit":46,"cfile_cache_hit_bytes":48139,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":1,"lbm_read_time_us":31709,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":5,"num_ops":12,"prepare.queue_time_us":42850,"prepare.run_cpu_time_us":4665,"prepare.run_wall_time_us":42698,"replication_time_us":156619,"spinlock_wait_cycles":28446080,"thread_start_us":2098477,"threads_started":3,"wal-append.queue_time_us":1743399,"wal-append.run_cpu_time_us":1471,"wal-append.run_wall_time_us":1017893}]]}
I20260709 13:14:59.205668 11429 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:59.198385  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 103237us
I20260709 13:14:59.194706  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:59.224946  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:59.199230  7862 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:14:59.223316  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:59.221959  7085 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.232630  7085 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 10, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 10 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.235145  7187 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:59.236011  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:14:59.237809  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48997.2us
W20260709 13:14:59.241037  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 92686.8us
I20260709 13:14:59.242911 11681 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:59.243356 11681 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.243708 11681 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:59.245195  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:59.231952 11673 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.221009 11418 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:59.235050 11150 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:59.231185 11684 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:59.267113  7085 catalog_manager.cc:5697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 10 to 12, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 12 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:59.270572  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:59.239826 11694 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:59.266657 11394 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:59.250576 11390 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:59.268987 11678 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:59.272068  7085 catalog_manager.cc:5697] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 4 to 6, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 6 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.250082 11663 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:14:59.267236 11695 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:14:59.300333  7186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:14:59.311053  7186 raft_consensus.cc:606] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Received request to transfer leadership to TS c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:59.311388  7186 raft_consensus.cc:614] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:59.271857 11662 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:14:59.305666  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:59.272217 11673 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:14:59.315152  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 72520.6us
I20260709 13:14:59.316715 11673 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:59.294819 11390 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:59.318094  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:59.317909 11390 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.285619 11678 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.320227 11678 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:59.282401 11664 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:14:59.307790 11671 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:59.296214  7085 catalog_manager.cc:5697] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 9, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 9 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:59.312934 11238 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.331406 11418 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:59.331835 11418 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:14:59.332561 11238 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:59.332755 11418 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.334216 11418 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:59.340016 11670 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:59.327000 11687 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:14:59.343775 11687 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:59.344151 11687 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:14:59.344956 11449 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:59.361863 11694 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.363898 11694 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:59.365816  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:14:59.366791 11683 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:59.366968 11664 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:14:59.367452  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:59.368368 10532 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:59.368261 11664 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:59.369719  7225 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:59.367286 11683 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:14:59.358310 11684 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:59.370888 11683 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:59.355886 11150 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:59.371987 11655 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.004s
I20260709 13:14:59.374187  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:59.358100 11695 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.374857  7185 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:14:59.375370 11695 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.375789 11671 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:59.376757 11681 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.377195  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:59.377751 11695 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:14:59.378336 11695 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:59.344977 11687 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.378909 11681 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:59.370909 11674 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:59.379303  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:59.380510 11449 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:14:59.380961 10532 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:59.360852  7085 catalog_manager.cc:5697] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:59.397123  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:14:59.392133  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 145226us
I20260709 13:14:59.396173  7185 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:14:59.398684  7299 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:59.382608 11578 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:59.400094  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:14:59.391294 11695 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.402298  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:14:59.403301  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:14:59.398895  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 102981us
I20260709 13:14:59.403091  7085 catalog_manager.cc:5697] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:59.424582  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:14:59.398607 11694 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:14:59.427793  7896 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:14:59.402771 11655 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:59.415298 11695 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:59.409152 11658 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:14:59.415093 11671 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:14:59.418149 11687 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:59.476784  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 82149.3us
I20260709 13:14:59.435832  7888 raft_consensus.cc:1217] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Deduplicated request from leader. Original: 8.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 13:14:59.477914  7888 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:14:59.475219  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 48994.1us
I20260709 13:14:59.426798 11394 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:14:59.534790  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 131562us
I20260709 13:14:59.429774 11178 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:59.432696 11655 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.581642  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:59.586486  7861 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:14:59.587909  7185 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:14:59.595500  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:59.596400  7187 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:59.594833  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:59.581144 11706 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:14:59.470211 11238 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 13:14:59.598592  7182 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:59.434587 11564 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 13:14:59.606736  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:59.606906  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:59.607370  7330 raft_consensus.cc:2376] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13. Re-sending same reply.
I20260709 13:14:59.607514  7332 raft_consensus.cc:2376] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11. Re-sending same reply.
I20260709 13:14:59.581470 11655 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:59.599690  7085 catalog_manager.cc:5697] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 9, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 9 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:14:59.598454  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:59.615564  7331 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:14:59.578102 11394 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:59.598567  7150 connection.cc:256] RPC call timeout handler was delayed by -1.0646099020000293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.38860000000000006s for a response
W20260709 13:14:59.616056  7150 connection.cc:256] RPC call timeout handler was delayed by -1.0514601579998271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 13:14:59.616406  7150 connection.cc:256] RPC call timeout handler was delayed by -1.0505601579998256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 13:14:59.598932  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:14:59.580036 11178 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.617136  7327 raft_consensus.cc:2376] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10. Re-sending same reply.
I20260709 13:14:59.618561 11394 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:59.619186  7150 leader_election.cc:336] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.546s (SENT)
I20260709 13:14:59.622156  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:59.620585  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:59.622977  7180 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:59.625399  7187 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
W20260709 13:14:59.586912  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.588047 11671 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:59.629278  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.632050  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:59.634859  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 232590us
I20260709 13:14:59.625978 11178 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:59.471602 11483 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:59.637508  7260 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:59.638202  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:14:59.592651  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.639148  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:59.640018  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:14:59.638249  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:59.641498  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:59.642270  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:59.643234  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:14:59.643810 11703 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:59.646188 11678 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.695468  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:59.601468 11665 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.710922  7085 catalog_manager.cc:5697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 12, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 12 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.683516  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:14:59.730173  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 111052us
I20260709 13:14:59.634490 11671 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:14:59.980553  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:14:59.983256  7180 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:14:59.983203  7332 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:14:59.984998  7257 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
W20260709 13:14:59.985666  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 399265us
I20260709 13:14:59.987308  7187 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:59.987902  7256 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:59.988632 11663 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.988842  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:14:59.989194 11663 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:14:59.981513  7253 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:14:59.989722  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:14:59.990777  7182 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:59.989470  7183 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:14:59.991467 11663 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:14:59.999845  7152 leader_election.cc:336] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.639s (SENT)
I20260709 13:14:59.987448  7259 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 8.
I20260709 13:15:00.002040  7335 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:15:00.000443  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:59.989430  7331 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:14:59.982429  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 60299.7us
I20260709 13:15:00.009493  7182 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:00.011111  7862 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:00.012679  7183 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:15:00.019642  7150 leader_election.cc:336] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.601s (SENT)
I20260709 13:15:00.020455  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:14:59.984318  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:00.022116  7330 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:59.983171  7085 catalog_manager.cc:5697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 3 to 10, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 10 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.004407 11681 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:00.074100  7256 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:00.039880 11258 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:00.094132  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 74586.3us
I20260709 13:15:00.116791  7085 catalog_manager.cc:5697] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 9, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 9 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:15:00.140352  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.057235 11483 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:00.136955  7152 leader_election.cc:336] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.188s (SENT)
I20260709 13:15:00.159895  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:00.164999  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.168011  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 156970us
W20260709 13:15:00.187286  7150 leader_election.cc:336] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.664s (SENT)
I20260709 13:15:00.096689 11703 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.040884 11655 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:00.197657  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.194104  7085 catalog_manager.cc:5697] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 9, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 9 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:00.119594 11564 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.207811  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.094907 11711 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:00.211076  7085 catalog_manager.cc:5697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 9, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 9 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:00.213258  7330 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:00.136797 11485 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.220083  7862 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:00.188661 11681 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:00.248577  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 248233us
I20260709 13:15:00.197441 11694 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:00.215416 11150 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.227399 11429 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.227197 11664 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.235067  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:00.151963 11258 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.231904 11481 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.270967 11696 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:00.233569 11723 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:00.273790 11418 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.939s	user 0.015s	sys 0.003s
W20260709 13:15:00.275112 11683 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.904s	user 0.014s	sys 0.006s
I20260709 13:15:00.229398 11703 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:00.272336 11710 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
W20260709 13:15:00.293362  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 106115us
I20260709 13:15:00.283316 11665 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:00.300721 11695 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.823s	user 0.013s	sys 0.000s
I20260709 13:15:00.234191 11564 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.238966 11681 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:00.283473 11687 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.807s	user 0.008s	sys 0.015s
I20260709 13:15:00.262611  7085 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index -1 to 5, term changed from 7 to 9, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 9 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:15:00.250198 11485 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.285068 11481 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:00.299973 11670 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.959s	user 0.010s	sys 0.009s
I20260709 13:15:00.276479 11150 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.237753 11711 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.282433 11429 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:00.303345 11178 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.624s	user 0.016s	sys 0.006s
I20260709 13:15:00.302561 11655 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:00.325287  7329 raft_consensus.cc:2410] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:15:00.283666 11664 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.327462  7085 catalog_manager.cc:5697] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:15:00.308614  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 286241us
I20260709 13:15:00.282672 11694 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.288754 11696 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.306388 11418 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:00.311389 11681 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:00.322701 11394 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.690s	user 0.016s	sys 0.006s
I20260709 13:15:00.305465 11671 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:00.341521  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:00.337447  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:00.298807 11683 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.325549 11709 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:00.306835 11662 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:15:00.333916 11670 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:00.356647  7085 catalog_manager.cc:5697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:00.360148  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:00.376399  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:00.310241 11695 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.348160 11655 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.331547 11665 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:15:00.331740 11178 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.395744  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.398203  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:00.398655  7257 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:00.398839  7259 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:00.384124 11671 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:00.364143 11418 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:15:00.408006  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 70695.7us
I20260709 13:15:00.395591 11709 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.398100 11718 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:00.396885 11670 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.397114 11674 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:00.353596 11394 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.427536  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:00.447638  7184 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:00.431073  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.448915  7182 raft_consensus.cc:2410] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:15:00.435505  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 275662us
W20260709 13:15:00.435001  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 236458us
I20260709 13:15:00.435196  7327 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:00.441198  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.442349  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:00.446267  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 86197.6us
I20260709 13:15:00.432896 11671 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.461329  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.416803 11481 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:00.414752 11258 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:00.407737 11733 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:00.418265 11429 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:00.467523  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.469686  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:00.469997  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.470296  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.470412  7257 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:00.470510  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:00.471056  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.464092  7261 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:00.392619 11655 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.414112 11696 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:00.406733 11664 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.487347 11655 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.487845 11664 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.412815 11150 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.488384 11664 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:00.488883  7329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1780) took 1744 ms (client timeout 1953 ms). Trace:
I20260709 13:15:00.417384 11683 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:00.499394  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.495038  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.443198 11709 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:00.400624 11734 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:00.409943 11695 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.502264 11664 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.502753 11678 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:00.502921 11709 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.468029  7256 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:15:00.418000 11564 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:00.473645  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:00.507262 11734 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:00.508323 11734 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.475019  7254 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:00.476454 11394 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:00.476850 11687 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:00.465296 11671 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:00.472760 11733 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.479580 11429 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.473122 11258 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.476472 11659 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:00.483441  7257 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:00.483557 11418 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.485450 11178 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:00.486106 11485 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:00.486470 11660 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.545055 11660 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.546707  7859 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.548007  7336 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:00.548147  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.549804  7331 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:00.524659 11733 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:00.550809 11390 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.551311 11390 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:00.551952  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 237155us
I20260709 13:15:00.553371 11390 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.554802 11673 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:00.554858 11485 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:00.557152 11485 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:00.557590 11485 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:00.463476 11663 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:15:00.411985 11703 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:00.487303  7259 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
W20260709 13:15:00.489290  7329 rpcz_store.cc:269] 0709 13:14:58.744584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.840683 (+ 96099us) service_pool.cc:224] Handling call
0709 13:15:00.488682 (+1647999us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540013cc54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:00.488824 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3411106176}
I20260709 13:15:00.411360 11694 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.494971  7182 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:00.516389  7184 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:00.519155  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.520599  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.478929 11670 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.524408  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.525622  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:00.511081 11449 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:00.530630  7330 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:00.586122  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:00.564807  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:00.531541  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 287464us
I20260709 13:15:00.524205 11695 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.586853  7888 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:00.562314  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:00.533350  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 83978.3us
I20260709 13:15:00.587494  7862 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.534418  7335 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:00.536154 11711 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.524834 11687 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.528635 11429 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.595782  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.596357 11429 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.597093  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:00.598011  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.554154 11671 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.598512 11742 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.598739  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:00.599364  7331 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:00.599231 11742 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.600188 11671 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:00.559015 11709 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.589727  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:00.601073  7894 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:00.600981 11709 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.602283 11431 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.602834 11703 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:00.603223 11662 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:00.603768 11738 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:00.603399 11703 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.604240 11738 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.604631 11738 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:00.605072 11655 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:00.602869 11431 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.608062 11709 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.603148 11483 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:00.562017  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:00.596577 11695 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.565141  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:00.609839  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:00.628307  7152 leader_election.cc:336] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.672s (SENT)
I20260709 13:15:00.562727  7861 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:00.609992  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:00.629613  7260 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 10: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:00.629897  7336 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:00.611079  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:00.611970  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:00.612548 11178 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:00.634353 11695 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.628615  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:00.615648 11742 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.634905 11656 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.635385 11670 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:00.635461 11656 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.635417  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.637014  7178 raft_consensus.cc:2410] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:15:00.593211  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:00.637662 11656 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.638007 11740 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:00.638561 11740 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:00.560456  7328 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
W20260709 13:15:00.620518  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 55925.7us
I20260709 13:15:00.562971  7185 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:00.641281  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.622520  7180 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:15:00.623868  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.621686  7183 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 8.
I20260709 13:15:00.625905  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.630860  7894 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 10: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:00.626740 11709 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:15:00.646333  7256 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:00.530169 11258 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.608074 11431 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.554587 11390 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:00.653510  7152 leader_election.cc:336] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.011s (SENT)
W20260709 13:15:00.649704  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 87067.9us
I20260709 13:15:00.653781  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.670342  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1850) took 1090 ms. Trace:
I20260709 13:15:00.671411  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.671548  7328 rpcz_store.cc:276] 0709 13:14:59.579489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.579626 (+   137us) service_pool.cc:224] Handling call
0709 13:15:00.670102 (+1090476us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b540025c454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:00.670262 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2178524032}
I20260709 13:15:00.655339  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.656770  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.663823  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.672979  7184 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:00.673058  7181 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:00.672676  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.674520  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:00.651079  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.596905 11429 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:00.674718  7185 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:15:00.527118 11681 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.560837 11730 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:00.678367  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.682948  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.683317  7186 raft_consensus.cc:2410] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:15:00.680498  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 228394us
I20260709 13:15:00.678452  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:00.680662  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:00.684661  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 91570.2us
I20260709 13:15:00.679807  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.651765  7331 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:15:00.687258  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:00.681782  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:00.682502  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 53989.2us
I20260709 13:15:00.688817  7178 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:15:00.685091  7261 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:15:00.656850 11687 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:00.639549 11740 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:00.670368 11704 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:00.677130 11390 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.697695  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:00.699290  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.684185 11737 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:15:00.686470 11736 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:00.679945 11696 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
W20260709 13:15:00.779429  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 125953us
I20260709 13:15:00.779459  7888 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:00.692377 11150 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.676622 11662 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:15:00.689823 11703 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:00.692193 11678 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:00.798924  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 101303us
I20260709 13:15:00.821019  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:00.821847  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.695739 11663 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:00.682235 11694 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.773612 11660 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.773334 11723 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:00.825378 11150 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.775727 11671 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:15:00.838562 11694 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.681993 11673 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.143s
I20260709 13:15:00.780418 11687 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:00.791352 11664 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:15:00.848688  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 156865us
I20260709 13:15:00.826081  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:00.834076  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 144917us
I20260709 13:15:00.850025  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.685268 11665 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
W20260709 13:15:00.835826  7152 leader_election.cc:336] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.935s (SENT)
I20260709 13:15:00.836688  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.691112 11742 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.792301 11727 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:00.841894  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 163536us
I20260709 13:15:00.791715 11695 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.842083  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.699739 11656 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:00.798103 11704 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:00.842872  7262 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:00.791781 11390 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:00.852231 11736 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:00.865864  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.866472 11258 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.859058 11178 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.867092  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:00.867251 11178 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.869491 11708 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:15:00.869724  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.698913 11564 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 13:15:00.870357 11739 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:00.870601  7256 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:15:00.825624 11678 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.874212 11678 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:00.875433 11694 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.876089 11694 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:00.876705 11694 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:00.877019 11741 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:00.883055 11658 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.885180  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:00.885833  7184 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:00.832041 11449 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.834288 11670 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:00.841756 11394 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.864555  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.867161 11258 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:00.852306 11655 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:00.911558  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:00.911916  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.856896  7261 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:00.904910  7179 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:00.910036  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.839742 11150 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.894809  7888 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:15:00.841712 11431 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:00.869658 11178 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:00.907249  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.907437  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:00.856098  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:00.921026  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65009.7us
I20260709 13:15:00.921525  7254 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:00.921737  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.908356  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:00.913341  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.877065 11694 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.870396 11708 consensus_queue.cc:1243] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:00.690991 11730 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.943518 11730 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.944119 11730 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:00.944468 11730 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:00.944892 11730 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:00.944972 11703 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:00.918987 11709 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.946704 11258 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:00.947172 11258 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.946923 11709 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.947538 11258 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:00.949136 11709 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.899816 11670 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:00.950258 11670 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.951462 11670 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:00.930744 11671 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.953013 11671 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.955130 11671 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:00.955503  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.956430  7255 raft_consensus.cc:2410] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:15:00.957820 11483 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:00.897233 11656 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:00.959336 11656 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.960354 11681 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:00.914526 11394 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.688023 11429 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.925235  7186 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:00.928985  7184 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:15:00.883611 11658 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.932097  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:00.971864  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:00.972952  7302 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:00.915939 11660 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.980839  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.911618 11655 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.894881 11742 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.909377 11739 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:00.934393  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.866190 11736 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.924894 11150 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.935727  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.041597  7253 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:15:00.936185 11431 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.936654  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:00.940879 11724 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:00.894837 11727 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.912693 11741 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:00.965020  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:01.075173  7262 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 9: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:00.967221  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:00.982013 11178 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:00.991722  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.869736 11733 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:00.962102 11485 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:00.931228 11694 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:01.031028  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50290.9us
I20260709 13:15:01.036118 11483 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:01.039309  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:00.904143 11695 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:01.045377  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.046114  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.048277  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.066982  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.062458  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.100503  7180 raft_consensus.cc:2410] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 14 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:15:00.968967  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54805.9us
I20260709 13:15:01.019407 11655 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:01.067102 11150 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.018312 11709 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.088699  7184 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:01.018776 11708 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:01.091084  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:00.905048 11449 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:01.085608  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 180246us
I20260709 13:15:01.045684 11475 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:01.100955  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.118968  7256 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:00.962697 11718 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:15:01.098637  7179 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:01.105818  7186 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:01.108148  7862 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:01.019209 11660 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.046053 11664 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:01.091240 11394 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:01.139881  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 249689us
I20260709 13:15:01.139923  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:01.143607  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 207029us
I20260709 13:15:01.143778  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.095011 11483 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.110488 11703 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:01.113840 11564 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:01.114113 11696 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:01.115927 11708 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.153816  7261 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:01.119822 11178 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.151603  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.118968 11709 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.144614 11734 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:01.158238 11748 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:15:01.149772 11483 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:01.159651 11687 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.162784 11726 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.163754 11664 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.164788  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.136289 11711 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:01.157994  7256 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
W20260709 13:15:01.176661  7152 leader_election.cc:336] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.128s (SENT)
I20260709 13:15:01.218796  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.112742 11738 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.202104  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.082114 11724 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.169418 11708 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:01.176741  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 109820us
I20260709 13:15:01.233572  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.234433  7253 raft_consensus.cc:2410] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:15:01.231309 11703 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:01.236842 11754 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:01.172605 11739 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.231127  7183 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
W20260709 13:15:01.231259  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54636.4us
I20260709 13:15:01.227494 11711 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:01.169247 11564 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.234139  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.075739 11704 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:01.247974  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 101147us
I20260709 13:15:01.251652  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:01.252547 11739 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:01.253038  7225 leader_election.cc:400] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13.
I20260709 13:15:01.253371  7225 leader_election.cc:403] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:15:01.253891 11739 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13.
I20260709 13:15:01.254115  7225 leader_election.cc:400] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10.
I20260709 13:15:01.215346 11734 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:01.248502  7301 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:01.257103  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 88183.7us
I20260709 13:15:01.164817 11390 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.257275  7258 raft_consensus.cc:2410] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:15:01.257583  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.254474  7225 leader_election.cc:403] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:01.173492 11696 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.246747 11703 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:01.230208 11394 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:01.184062 11178 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.246796 11711 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:01.284149  7896 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 10: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:01.276710 11703 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:01.231236 11687 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.289083  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:01.292047 11766 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:01.292923 11390 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:01.293211 11763 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.294133  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.281378 11739 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10.
I20260709 13:15:01.238502 11655 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:01.232317 11726 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.301771 11718 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:01.302906 11753 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:15:01.308065 11730 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.309036 11734 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.313800  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.318722  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.319530  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.319765  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:01.320288  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:01.327740  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 154852us
I20260709 13:15:01.340768  7181 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:01.338891  7187 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:01.185137 11741 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.330721 11723 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:01.418857 11723 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.419294 11723 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:01.420464 11678 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.000s
I20260709 13:15:01.420881 11678 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.330823 11695 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:01.294320 11703 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:01.423077  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 82372.9us
I20260709 13:15:01.424118  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:01.284123 11394 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.345161  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.440239  7181 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:01.408538  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:01.441465  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.442203  7187 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:15:01.410529  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.442987  7262 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:01.339349  7183 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:01.415685  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:01.416082 11761 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:15:01.417028 11760 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:15:01.417997 11564 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:01.418437 11449 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:01.459192  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:01.336913 11727 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:01.462461  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 142779us
W20260709 13:15:01.352820 11659 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.822s	user 0.011s	sys 0.000s
I20260709 13:15:01.329375 11733 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:01.459976  7181 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:01.464285  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 126429us
I20260709 13:15:01.465026  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:01.335289 11764 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:15:01.409876 11766 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:01.451929  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.342959 11742 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:01.457080 11670 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.505s	user 0.013s	sys 0.001s
I20260709 13:15:01.409876 11485 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:01.472026  7253 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:01.329555 11763 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.476147 11696 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:01.476235 11730 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:01.478945  7334 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:01.456583 11150 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:01.459650 11674 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:01.480824  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:01.485069  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 149995us
I20260709 13:15:01.486847  7299 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.457827 11695 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:15:01.500699  7335 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:01.477837 11678 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:01.458698 11708 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.502698  7181 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:01.504019  7332 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:01.469574 11773 raft_consensus.cc:2764] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:15:01.483263 11564 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:01.567391  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:01.567579 11564 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:01.490612 11660 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:01.568009 11564 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:01.568380  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.569226  7181 raft_consensus.cc:2410] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:15:01.572121 11708 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:01.515184  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 50215.7us
I20260709 13:15:01.573623  7150 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.485968 11729 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.516812 11765 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:15:01.519364 11756 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:15:01.529532 11772 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:01.531339 11763 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:01.536643 11758 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:01.538419 11178 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:01.579021 11775 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:01.539198 11724 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:01.584829 11564 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.543269 11738 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:01.544202 11687 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:01.548141  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:01.600778 11758 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:01.604851 11564 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:01.547851  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:01.605420  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 105911us
I20260709 13:15:01.605646 11758 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.606525 11775 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:01.606969 11724 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:01.607583 11775 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.608224  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:01.608594 11429 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:01.609511  7225 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:01.610883 11724 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:01.611533 11724 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:01.613626  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:01.615862 11724 raft_consensus.cc:2764] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 13:15:01.619465 11768 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:15:01.620958  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:01.623631 11724 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:01.625613  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.574208  7187 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:01.626536  7187 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:01.546190 11394 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:01.576231  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.578172  7150 leader_election.cc:400] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
I20260709 13:15:01.647670  7150 leader_election.cc:403] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:01.578605  7183 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:15:01.582518  7152 leader_election.cc:336] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.230s (SENT)
I20260709 13:15:01.648676  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.502907 11670 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:01.488520 11674 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.599427  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.578826 11729 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.504060 11671 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:15:01.514320  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 611) took 2616 ms. Trace:
I20260709 13:15:01.631131  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:01.663102  7182 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:01.633598  7302 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:01.635027  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:01.635586 11726 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:01.641036  7330 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:01.668264  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.586468 11765 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:01.641609 11774 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:15:01.724735  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.645491  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:01.726177  7328 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:01.647313  7185 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:01.651489  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:01.655268  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 538076us
I20260709 13:15:01.641973 11709 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:01.659121  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.660125  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.627323  7187 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:01.746943  7187 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:01.664330  7331 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:01.747529  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:01.662796  7334 rpcz_store.cc:276] 0709 13:14:58.898156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.085337 (+187181us) service_pool.cc:224] Handling call
0709 13:14:59.131667 (+ 46330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:01.485704 (+2354037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:01.513927 (+ 28223us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b5400253854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:01.514193 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5376782208}
I20260709 13:15:01.607091 11758 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:01.669155  7255 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 14 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:01.670578  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.753541  7178 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:01.665184  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.755478  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:01.756160  7181 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:01.652375 11696 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
I20260709 13:15:01.720134  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:01.720933  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 58512.5us
I20260709 13:15:01.720288  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:01.721706  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:01.663817 11258 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.002s
I20260709 13:15:01.741608  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:01.790813  7259 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:01.741958  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:01.742272  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:01.743249  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:01.744824  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:01.663286 11394 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:01.751691  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 169194us
I20260709 13:15:01.752133 11564 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:01.757050  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:01.757836  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 107529us
I20260709 13:15:01.663686  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:01.758884  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 93766.2us
I20260709 13:15:01.802170  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:01.803040  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:01.803804  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:01.764111  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:01.805068  7331 raft_consensus.cc:2410] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:15:01.806022  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:01.807403  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.721299 11485 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 13:15:01.666699 11674 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:01.765779  7888 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:01.767174  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 189198us
I20260709 13:15:01.719965 11178 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:01.753686 11777 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:01.811059  7328 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:15:01.786527  7334 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:01.810333  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:01.857776  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:01.788475  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:01.789427  7261 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:01.858595  7180 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:01.789749  7187 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:01.792162  7256 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:01.744238 11431 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:01.727837 11765 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:01.808027  7183 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:01.875344  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:01.765054  7336 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:01.808780  7331 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
W20260709 13:15:01.857919  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47653.3us
I20260709 13:15:01.856921  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:01.877252  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:01.843801  7181 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:01.855706  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:01.878283  7179 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:01.878324  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:01.742558 11656 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:15:01.880712  7259 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
W20260709 13:15:01.867192  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 203571us
I20260709 13:15:01.881887  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:01.872210  7182 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:01.877343  7328 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:01.785199 11709 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:01.884382  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:01.885016  7331 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:01.883667  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:01.885857  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:01.886117  7328 raft_consensus.cc:2410] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:15:01.887593  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:01.893226  7888 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:01.856560 11664 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:01.873031 11708 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:01.899399  7894 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:01.899699  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.900390 11776 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:01.900969  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:01.859632 11178 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.903133  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:01.920089  7328 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:01.920938  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:01.855705 11429 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:01.863185 11763 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:01.860432 11777 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.929983  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:01.930403  7328 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:01.789614 11258 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:01.917414  7256 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:01.913678  7889 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 8.
I20260709 13:15:01.915825  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.939172  7336 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:01.940657  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:01.941445  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:01.942164  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:01.944881  7256 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:01.806471 11394 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:01.925568 11483 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.003s
I20260709 13:15:01.963182  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:01.991952  7327 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:01.963692  7890 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:01.914999 11664 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:01.930722 11723 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.004s
I20260709 13:15:01.969290  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:01.925863 11178 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:01.927003 11660 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:01.930590 11564 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:01.976658  7262 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:01.926738 11429 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:01.938064 11763 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.931068 11708 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:01.983949  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:02.043380  7332 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:02.047111  7336 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:02.048190  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:01.984313  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:01.937541 11777 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:01.968250 11738 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:01.972494 11718 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:15:01.994205  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:01.994663  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.001600 11776 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:01.999135  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57748.1us
I20260709 13:15:02.046375  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.004173  7179 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:02.011662  7260 raft_consensus.cc:2368] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
W20260709 13:15:02.012723  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 121283us
W20260709 13:15:02.035451  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.048980  7256 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:02.055891  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:02.006736 11664 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:02.061838  7262 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:02.052834  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:02.007647 11687 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:02.051898  7258 raft_consensus.cc:2376] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12. Re-sending same reply.
I20260709 13:15:02.063010  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.078503  7327 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:02.079972  7327 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:15:02.081426  7327 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:15:02.081753  7327 pending_rounds.cc:85] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 7
I20260709 13:15:02.081974  7327 pending_rounds.cc:107] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:15:02.082218  7327 raft_consensus.cc:2889] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:02.083515  7256 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:02.084502  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:02.085534  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.048213 11564 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:02.092358  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:02.097285  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.097049 11564 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.098165  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:02.099148  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.035141 11723 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:02.107143  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 175116us
W20260709 13:15:02.110774  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 47868.6us
I20260709 13:15:02.127053  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:02.128584  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.114369 11736 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:02.123648  7258 raft_consensus.cc:2368] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9.
I20260709 13:15:02.056989 11429 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:02.035681 11660 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:02.056790 11763 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:02.131502  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.128798  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:02.107753 11781 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:15:02.111639  7256 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:02.000515 11483 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.142882  7332 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:15:02.093492 11431 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:02.150171  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:02.156894  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:02.160409  7256 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:02.157406  7186 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:02.158417  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:02.149350  7332 pending_rounds.cc:85] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 7
I20260709 13:15:02.163204  7332 pending_rounds.cc:107] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:15:02.163342  7258 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:02.163622  7332 raft_consensus.cc:2889] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:02.167732  7150 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:02.138885 11738 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:02.118605 11449 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:02.171368 11696 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:02.137894 11660 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:02.172858  7332 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:02.143895 11785 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:02.169984 11694 consensus_meta.cc:287] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.060s	user 0.011s	sys 0.000s
I20260709 13:15:02.159047 11431 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.166407 11776 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:02.189182 11703 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.001s
I20260709 13:15:02.172297 11775 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:02.172935 11754 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:02.209301  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 153465us
W20260709 13:15:02.210551  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.210909  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.211670  7258 raft_consensus.cc:2376] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13. Re-sending same reply.
I20260709 13:15:02.199259 11431 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:02.214427  7184 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:02.193120 11449 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.223770  7179 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:02.228689  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:02.232254  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:02.238989  7862 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:02.217444 11449 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:02.196828 11785 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.208994 11703 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.228421 11258 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.223546  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:02.286736  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:02.195667 11708 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:02.261179 11658 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:02.280301 11747 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.204s	user 0.004s	sys 0.007s
I20260709 13:15:02.199002 11694 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:02.288487  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 117680us
I20260709 13:15:02.229549 11775 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:15:02.299109  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:02.303216  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 79845.8us
W20260709 13:15:02.309238 11769 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.845s	user 0.004s	sys 0.003s
W20260709 13:15:02.316570 11670 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.648s	user 0.006s	sys 0.005s
I20260709 13:15:02.317065 11670 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:02.318435 11789 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:15:02.318406  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:02.238238 11390 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:15:02.287611 11711 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.992s	user 0.006s	sys 0.001s
I20260709 13:15:02.322211  7150 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.299094  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:02.282907 11394 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:02.364892  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.365525  7256 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:15:02.367000 11723 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:02.367091  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:02.330061  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 632) took 1694 ms. Trace:
I20260709 13:15:02.216676 11754 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.369343  7329 rpcz_store.cc:276] 0709 13:15:00.625653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.625769 (+   116us) service_pool.cc:224] Handling call
0709 13:15:00.639597 (+ 13828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:00.639913 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:00.639940 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:00.649321 (+  9381us) log.cc:844] Serialized 26 byte log entry
0709 13:15:00.840801 (+191480us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:00.840852 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:00.840919 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:02.279471 (+1438552us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:02.320008 (+ 40537us) raft_consensus.cc:1685] finished
0709 13:15:02.320062 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.320267 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114017,"raft.queue_time_us":796,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":21772,"spinlock_wait_cycles":10740608,"thread_start_us":149186,"threads_started":1,"wal-append.queue_time_us":238612}
I20260709 13:15:02.332888 11799 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:15:02.333499 11783 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 13:15:02.334031 11787 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
W20260709 13:15:02.334683 11788 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:15:02.332931 11678 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:02.336942 11709 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:02.334703 11656 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:15:02.342589 11714 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:02.343084 11483 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.386946 11754 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:02.346771 11258 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:02.348698 11703 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:02.363394 11785 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.384353  7335 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:15:02.389928  7256 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:02.303951 11696 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:02.393172  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 99317.6us
W20260709 13:15:02.398312  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 96324.5us
I20260709 13:15:02.399031  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:02.391855 11687 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:15:02.401932  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 83592.8us
I20260709 13:15:02.392225 11805 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:02.343480 11665 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:02.386924 11799 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.402562  7890 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEARNER]: Advancing to term 11
I20260709 13:15:02.371801 11711 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.424033 11806 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:02.435427 11806 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.437181 11804 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:02.437839 11804 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:02.438846 11804 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.441942 11429 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.443365 11723 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:02.448017 11775 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:02.448264  7225 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:02.451267 11694 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:02.451643 11674 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
I20260709 13:15:02.425698 11178 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.426733  7150 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.427008 11696 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.494167  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.425622 11703 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:15:02.453554  7888 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 13: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:02.424491 11258 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:02.456661 11711 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.458514  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:02.459563 11729 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:02.512739  7261 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:15:02.512841  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2698) took 1199 ms. Trace:
I20260709 13:15:02.460421 11806 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:02.461324  7182 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:02.513875  7186 rpcz_store.cc:276] 0709 13:15:01.313131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.319249 (+  6118us) service_pool.cc:224] Handling call
0709 13:15:02.512659 (+1193410us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54001b3fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:02.512788 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859425152}
I20260709 13:15:02.462666 11799 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:02.475086  7334 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
W20260709 13:15:02.415489 11758 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.002s
I20260709 13:15:02.410115 11678 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:02.482210  7178 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:02.486352  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:02.492008  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:02.451290 11773 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:15:02.494444  7327 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:02.476347 11805 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:02.479131 11664 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.502715  7258 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:02.503690 11655 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.504655 11431 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.521808  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:02.545090  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:02.545585  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.546152  7257 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:02.526894  7336 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:02.527513  7179 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:02.529832  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.548734  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.549229  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.531114  7255 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:02.499102 11718 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:02.537494  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 45610us
I20260709 13:15:02.538761 11481 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:15:02.554490  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 127843us
I20260709 13:15:02.523543 11694 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.540367  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 641) took 1031 ms. Trace:
I20260709 13:15:02.541817 11777 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:02.538250  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.544518  7328 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 10. Ops: [8.7-8.7]
I20260709 13:15:02.556370  7335 rpcz_store.cc:276] 0709 13:15:01.549334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.549486 (+   152us) service_pool.cc:224] Handling call
0709 13:15:02.540188 (+990702us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b5400289bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:02.540308 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724217728}
W20260709 13:15:02.536911 11765 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.000s
I20260709 13:15:02.495090 11674 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.535506 11687 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:02.597033  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.569027  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.544111 11429 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.499655 11804 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:15:02.597622  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:02.534313 11794 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:15:02.555073 11718 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.566062 11729 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:02.615682 11678 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.623202 11664 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.642997 11763 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.605427 11708 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:02.612403 11660 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.616190 11718 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:02.567480 11694 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.606099 11759 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:15:02.662304 11390 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:02.595671 11709 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:02.544960 11711 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:15:02.613958 11655 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:02.683915 11726 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:02.616827  7253 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:02.624892 11817 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:02.596197 11765 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.657785 11775 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:02.661616 11796 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.636479  7329 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:02.667200  7257 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:02.642886 11805 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.648720 11431 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.646476 11564 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:02.626878 11258 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.670565  7255 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
W20260709 13:15:02.683866  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 128369us
I20260709 13:15:02.693152  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:02.757294  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:02.699872 11449 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.697616  7178 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:02.642421 11738 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:02.698902  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52893.4us
I20260709 13:15:02.737862 11733 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:02.706256  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.719334  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:02.621354 11674 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:02.690475 11708 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.733798 11777 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:02.721748 11726 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:02.740017 11564 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:02.789579 11726 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.790820 11726 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:02.779745 11708 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:02.748188  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 199283us
I20260709 13:15:02.759070  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:02.799410 11687 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:02.799535 11660 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.800349 11178 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.800486  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.801599 11687 raft_consensus.cc:2764] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:15:02.694108  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:02.758066  7183 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:02.757294  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:02.803072  7187 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:02.701951  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:02.721458 11665 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:15:02.771394  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 811) took 1011 ms. Trace:
I20260709 13:15:02.730964 11655 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:02.779516  7332 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:15:02.805817  7255 rpcz_store.cc:276] 0709 13:15:01.759598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.788237 (+ 28639us) service_pool.cc:224] Handling call
0709 13:15:02.771172 (+982935us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54001e05d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:02.771318 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546278144}
I20260709 13:15:02.806562  7332 pending_rounds.cc:85] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 5
I20260709 13:15:02.806982  7332 pending_rounds.cc:107] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:15:02.807323  7332 raft_consensus.cc:2889] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:02.808909 11655 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:02.787786  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 84454.4us
I20260709 13:15:02.811478 11708 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.812813  7859 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:02.813835 11708 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.815901 11794 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:02.816692 11794 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:02.770983 11431 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.822326 11431 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.802573  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:02.830346  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 278142us
I20260709 13:15:02.835862  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:02.837356  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:02.825222 11431 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:02.839129  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:02.836653  7892 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:02.772166 11733 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:02.830796 11786 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:02.842592  7187 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:02.844343  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:02.835847 11687 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:02.847003  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:02.847246  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:02.852815  7187 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:02.853490 11821 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:15:02.738952 11796 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.844069  7150 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.855584  7892 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:02.848600  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:02.817993 11794 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.858569  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:02.860428 11733 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:02.863297 11724 raft_consensus.cc:3055] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:02.867620 11724 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:02.873467 11703 raft_consensus.cc:2764] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:15:02.875033 11759 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:02.875453 11759 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:02.876062  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 76990.6us
I20260709 13:15:02.876536 11740 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:02.868670 11724 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.877874 11741 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:02.881807  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.872970 11786 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:02.903244  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:02.905431  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:02.906261  7336 raft_consensus.cc:2368] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
I20260709 13:15:02.915675  7895 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:02.915511  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:02.916960  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:02.913472  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:02.918769  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.920567  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.921213  7261 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:02.923101  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:02.923794  7255 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:02.924165  7255 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:02.926939  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.927579  7256 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:02.896747 11687 raft_consensus.cc:2764] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:15:02.930775  7892 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:02.932662  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.933235  7257 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:02.937111  7256 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:02.939169  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:02.940045  7259 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:02.941196  7861 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.944628  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:02.945638  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:02.946026  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:02.946429  7187 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:02.896792 11724 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:02.953800  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:02.953823  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.954377  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:02.955051  7336 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
W20260709 13:15:02.956403  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.956404  7335 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: []
W20260709 13:15:02.957181  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 123422us
I20260709 13:15:02.959470  7861 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.960606  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:02.963881  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:02.966013  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:02.967141  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:02.968205  7336 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:02.966120  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:02.968961  7333 raft_consensus.cc:2376] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13. Re-sending same reply.
I20260709 13:15:02.918550 11804 raft_consensus.cc:2764] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:15:02.969741  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:02.970359  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:02.968008  7895 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:15:02.976977  7185 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:02.972973  7181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:15:02.973305  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:02.876241 11759 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:02.974244  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.975485  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.980893  7181 raft_consensus.cc:606] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:02.981142  7257 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:02.981366  7181 raft_consensus.cc:614] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:02.973873  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:02.970880  7255 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:02.983314  7255 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:02.983378 11830 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:15:02.991669 11759 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:02.993722 11711 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:02.995720 11786 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.996578 11665 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:02.997129 11665 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:02.998008 11665 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.974951 11726 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:15:03.001555 11828 consensus_queue.cc:1175] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 14 status { last_received { term: 14 index: 8 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:02.974437 11681 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:03.003429  7261 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:03.005996  7150 leader_election.cc:400] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
I20260709 13:15:03.006361  7150 leader_election.cc:403] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:15:02.982605  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:03.028739  7181 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:03.030162  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:03.031639  7255 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:15:03.044199  7255 pending_rounds.cc:85] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 7
I20260709 13:15:03.044456  7255 pending_rounds.cc:107] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:15:03.030403  7187 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:03.045851  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:03.045918  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:03.044697  7255 raft_consensus.cc:2889] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:03.049332  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.964378 11765 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:03.030571 11696 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:03.049436  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 66891.4us
I20260709 13:15:03.049329  7187 raft_consensus.cc:2410] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:03.078013  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:03.069427  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:03.080049  7336 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 9: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:02.974085 11799 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:02.978261 11773 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:03.083297  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.979489 11449 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:03.121667  7150 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:03.026701 11741 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:03.124832  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:03.069836 11804 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:15:03.088088 11831 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:15:03.085456 11805 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:03.147032  7888 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:03.059355 11671 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:03.146095  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:03.084456 11830 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:03.148288  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:03.152320  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.152304  7336 raft_consensus.cc:1813] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Handling vote request from an unknown peer 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:03.154379  7336 raft_consensus.cc:2368] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10.
I20260709 13:15:03.154461  7333 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:03.120464 11798 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:15:03.128293 11823 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:03.128150 11775 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:15:03.159593  7336 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:15:03.162938 11798 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:03.149884 11687 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:03.123847 11791 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:15:03.183043  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:03.126535 11770 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:15:03.130119 11777 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:15:03.153410 11830 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:03.191839  7336 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:15:03.166307 11823 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:03.176924 11834 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.289s	user 0.001s	sys 0.001s
I20260709 13:15:03.170877 11798 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:03.198688  7254 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:15:03.156255 11671 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.216317  7333 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
W20260709 13:15:03.219684  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51205.1us
I20260709 13:15:03.195714 11830 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:03.192744 11696 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:03.223145  7895 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:03.224388  7336 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:03.200701 11823 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:03.244820  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:03.193071 11804 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:03.258149  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:03.259860  7261 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:15:03.257390  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:03.194676 11739 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:15:03.243165 11449 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:03.265556  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.266331  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:03.267938  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:03.269819  7258 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:03.257889 11696 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:03.282269  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:03.269558 11671 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:03.267369 11758 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:03.280659  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:03.298419  7185 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:03.285667 11799 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:03.299957  7254 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:15:03.303849  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.308295 11846 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:15:03.310218  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.314913  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.321955 11687 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:03.325122 11718 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.000s
I20260709 13:15:03.325354 11687 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.325676 11718 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:03.298058 11804 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.299890 11806 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12.
I20260709 13:15:03.331907  7262 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:03.332893 11694 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:03.273170 11798 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:03.336310 11796 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:03.336604 11830 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:03.301498 11847 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:15:03.340999  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:03.351020  7185 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:03.271193 11449 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.343513  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:03.306725 11655 raft_consensus.cc:2764] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:15:03.350082  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:03.356103  7255 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:03.363241  7329 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:03.368619  7258 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:03.310078 11431 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:15:03.371832  7185 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:03.388108 11449 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:03.389892 11830 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:03.391144  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:03.391781  7333 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:03.392616 11823 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:03.395258 11848 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:15:03.395967 11842 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:15:03.375226 11798 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:03.379976 11763 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:03.370806 11796 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:15:03.426062 11718 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:03.382424 11696 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.435593 11823 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:03.442461  7253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 2915) took 1784 ms (client timeout 1607 ms). Trace:
W20260709 13:15:03.442915  7253 rpcz_store.cc:269] 0709 13:15:01.658261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.658468 (+   207us) service_pool.cc:224] Handling call
0709 13:15:03.442249 (+1783781us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54002279d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:03.442388 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897631104}
I20260709 13:15:03.447532  7896 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEARNER]: Advancing to term 12
I20260709 13:15:03.463153  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:03.465315 11805 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:03.465727 11805 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:03.465633  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:03.467402  7333 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:03.469491  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:03.481078  7259 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:03.482595  7330 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:03.484934  7330 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:03.485144 11718 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.485769 11718 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:03.488090 11718 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:03.498899  7330 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:03.504163 11564 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.505434 11564 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:03.506587 11853 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.510290 11449 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:03.512813  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 912537us
I20260709 13:15:03.514880  7330 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:03.484551 11665 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:03.482728 11765 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:03.524233  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:03.507200 11853 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:03.533463  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 345014us
I20260709 13:15:03.535665  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:03.537798  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.539386  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:03.542598  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:03.543615  7185 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:03.530035  7890 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:03.544603  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:03.547082  7185 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:15:03.549242  7187 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:15:03.550611  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.552873  7187 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:03.553611  7184 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:03.539330  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:03.525148 11655 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.558169  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1809) took 1638 ms. Trace:
I20260709 13:15:03.561055  7256 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:03.562498  7328 rpcz_store.cc:276] 0709 13:15:01.919698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.301391 (+381693us) service_pool.cc:224] Handling call
0709 13:15:02.544305 (+242914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.556736 (+ 12431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.557986 (+1001250us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400289bd0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:03.558112 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557786368}
I20260709 13:15:03.564393  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:03.565094  7328 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:03.565888  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:03.566772  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.568384  7182 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:03.572707  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:03.577243  7893 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:03.523358 11770 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:15:03.580542  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:03.541966 11665 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:03.524173 11830 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:15:03.596105  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:03.596875  7254 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:03.596875  7896 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:15:03.597545  7896 pending_rounds.cc:85] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 6
I20260709 13:15:03.597827  7896 pending_rounds.cc:107] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:15:03.598124  7896 raft_consensus.cc:2889] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:03.524334 11804 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:15:03.583560  7186 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:03.522758 11449 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:03.595104  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:03.599601  7256 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:03.600454  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:03.600910  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:03.601568  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:03.601759  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:03.602129  7262 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:03.595556  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:03.602793  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.603297  7253 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:03.592281  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:03.614457  7254 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:03.533661 11765 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.583276 11431 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:03.626719 11431 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:03.627628 11804 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:03.627434 11694 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:03.628044 11804 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:03.628708 11481 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:03.589860 11853 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:03.629299  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:03.525071 11805 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.630816  7187 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:03.633387  7262 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:03.632227  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:03.638036  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:03.638275  7253 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:15:03.634013  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.635622  7184 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:03.634028  7150 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:03.619133  7328 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:03.640730  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:03.640554  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:03.573199 11655 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.623885 11656 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:03.646852  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:03.628916 11431 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:03.642529  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:03.655397  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:03.655647  7256 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:03.656122  7328 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:03.635110 11481 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:03.660943  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.672708  7328 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:03.674706  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:03.675791  7328 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 13: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:03.677337  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:03.679715  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:03.691382  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.695714  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53289.7us
I20260709 13:15:03.697306  7150 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:03.633801 11823 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:15:03.705315  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:03.651026 11687 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:03.706578  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:03.654816 11740 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:03.655817 11806 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:03.708369  7328 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:03.707087  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:15:03.705024 11822 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:15:03.695399 11805 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:03.713814  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:03.743487  7328 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:03.696264 11431 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:03.647846 11853 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:15:03.628873 11804 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.735555 11733 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:03.753538  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:03.753690  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:03.754794  7186 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:03.714195 11696 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:03.738539 11765 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:03.699806 11861 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:03.715538 11481 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.743944  7150 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:03.747216  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:03.750382  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 109901us
I20260709 13:15:03.765360 11564 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:03.694943 11665 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:03.769402  7336 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:15:03.747000  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 100816us
I20260709 13:15:03.735800 11655 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:03.754797  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 174825us
I20260709 13:15:03.743363 11740 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:03.776865  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 136205us
I20260709 13:15:03.821061 11870 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.821908 11870 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.824689 11870 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:03.825695 11862 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:15:03.800704  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 121093us
I20260709 13:15:03.765618 11861 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:03.781370 11804 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:03.833662  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:03.750581 11431 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.841401  7335 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:03.841630  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:03.843761  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:03.844570  7179 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
W20260709 13:15:03.847654  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 66393.5us
I20260709 13:15:03.839061 11861 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:03.842636 11655 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:15:03.858821  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 114951us
I20260709 13:15:03.862022  7150 leader_election.cc:400] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 10.
W20260709 13:15:03.879276  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.883340  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.888612  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.853577 11449 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:03.891917  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:03.888806 11806 raft_consensus.cc:3055] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:15:03.906126 11866 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:15:03.911609 11857 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:03.852483 11878 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:15:03.902464 11431 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:03.912756 11857 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:15:03.899313 11873 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:03.918735 11877 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:15:03.849949 11740 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:03.931088  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 162347us
I20260709 13:15:03.932188  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:03.973917 11805 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:03.974771  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:03.975628  7255 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 15 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:15:03.898420 11853 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:15:03.977360  7255 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:03.979199  7258 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: []
W20260709 13:15:03.979391  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 85051.7us
I20260709 13:15:03.904526 11806 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:03.974395 11805 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:03.981894  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:03.985780  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:03.921581 11777 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:03.996755  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:03.998565  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:03.974655 11878 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.001560 11758 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:04.008463  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 166983us
I20260709 13:15:04.009974 11758 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:04.009284  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:04.001878 11798 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:15:04.020643 11696 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:04.021335 11696 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:04.023175 11853 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:04.022536 11696 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.025650 11696 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:04.026070 11843 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.767s	user 0.003s	sys 0.000s
I20260709 13:15:03.987743 11759 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:03.988488 11777 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:04.035333 11777 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:03.997313 11887 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:04.001753 11773 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:04.028259 11805 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.049576 11805 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:04.050712 11888 consensus_queue.cc:1175] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" responder_term: 12 status { last_received { term: 11 index: 6 } last_committed_idx: 6 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:15:04.064265  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:04.065100 11883 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:15:04.066854  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1863) took 1141 ms. Trace:
I20260709 13:15:04.046602 11777 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:03.999984 11852 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:15:04.083909 11791 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:04.084542 11791 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:04.073494  7331 rpcz_store.cc:276] 0709 13:15:02.925358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.926030 (+   672us) service_pool.cc:224] Handling call
0709 13:15:02.930352 (+  4322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.952466 (+ 22114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.952500 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.952902 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:15:03.068970 (+116068us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:03.342496 (+273526us) log.cc:844] Serialized 14 byte log entry
0709 13:15:03.347165 (+  4669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.347279 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:04.025308 (+678029us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:04.066527 (+ 41219us) raft_consensus.cc:1685] finished
0709 13:15:04.066663 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.066795 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14518,"prepare.queue_time_us":102270,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":22560,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":17087,"spinlock_wait_cycles":7861120,"thread_start_us":280514,"threads_started":2,"wal-append.queue_time_us":201942}
I20260709 13:15:04.085659 11791 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.078966  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:04.091310  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 92809us
I20260709 13:15:04.092463  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:04.077433  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 94396.8us
I20260709 13:15:04.094815  7150 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.046278 11876 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:04.030292 11564 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:04.102135  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.009099 11878 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:04.106760 11867 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.267s	user 0.000s	sys 0.002s
I20260709 13:15:04.106455 11671 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:04.092547 11737 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:04.101295 11857 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.097692 11889 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:04.105739 11876 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.116987  7180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb0912958bd849238a8f104a7916c427"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:15:04.123251  7180 raft_consensus.cc:606] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.123507 11892 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:04.117538 11857 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.124128 11892 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.123719  7180 raft_consensus.cc:614] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:04.115991  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:04.128011  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.047513 11806 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.135634 11857 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.111531 11852 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:04.111699 11887 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:04.138670 11857 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:04.114820 11773 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:15:04.120716 11737 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.148941 11703 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:04.149677 11878 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.153374 11853 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:04.132664 11671 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:04.163810 11564 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:04.183504  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.155601 11887 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:04.195428  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 68089us
I20260709 13:15:04.197312  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:04.203084 11890 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.176s	user 0.002s	sys 0.000s
I20260709 13:15:04.205569 11775 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:04.206189 11775 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:04.207111 11775 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.214068 11892 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.214830 11892 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:04.125567 11889 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.191344 11857 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:04.199515 11806 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:04.222718  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:04.225073  7180 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:04.223737  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.228751  7183 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:15:04.220583 11857 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:04.162851 11861 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.231509  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.235677 11900 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:04.236332 11900 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.238752 11900 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.240604 11876 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.241590 11889 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.243834  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.220274 11892 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.246133  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.245136 11887 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.249207 11857 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.250561 11857 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:04.257884 11873 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:04.258273  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.263444  7895 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
W20260709 13:15:04.269444  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.270241 11889 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:04.270938 11889 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.275254  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.276108  7257 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:15:04.279731  7180 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:04.286815 11861 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.288041 11861 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:04.288252 11892 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.291155 11889 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.292172 11740 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.297397  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.298707  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:04.300639  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.305348  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.311352  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.314841 11876 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.315448 11876 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.316743  7888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:59728
I20260709 13:15:04.317610  7888 raft_consensus.cc:606] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.318830  7888 raft_consensus.cc:614] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:04.322069  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.317654 11876 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:04.326946 11894 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:15:04.328207  7888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac"
dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:59728
I20260709 13:15:04.302553 11773 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:04.329017  7888 raft_consensus.cc:606] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.334514  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 866) took 1046 ms. Trace:
I20260709 13:15:04.334949  7896 rpcz_store.cc:276] 0709 13:15:03.287774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.287910 (+   136us) service_pool.cc:224] Handling call
0709 13:15:03.447359 (+159449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.598927 (+151568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.334327 (+735400us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400a1a750. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:04.334455 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334059904}
I20260709 13:15:04.339572  7255 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:04.343799  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:04.294672 11740 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.346941 11704 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:04.349077  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 653) took 1044 ms. Trace:
I20260709 13:15:04.349495  7329 rpcz_store.cc:276] 0709 13:15:03.304908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.305077 (+   169us) service_pool.cc:224] Handling call
0709 13:15:03.326978 (+ 21901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.363668 (+ 36690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.348818 (+985150us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b540013e054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:04.349012 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82988288}
I20260709 13:15:04.330722 11773 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.352335 11773 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:04.344815  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:15:04.364482  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.366416  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.370164  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.371706 11564 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:04.362618  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.376138  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 656) took 1019 ms. Trace:
I20260709 13:15:04.376442 11740 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:04.376622  7327 rpcz_store.cc:276] 0709 13:15:03.356974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.357237 (+   263us) service_pool.cc:224] Handling call
0709 13:15:03.374790 (+ 17553us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:03.381003 (+  6213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:03.381044 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:03.389229 (+  8185us) log.cc:844] Serialized 78 byte log entry
0709 13:15:03.578908 (+189679us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:03.635432 (+ 56524us) log.cc:844] Serialized 14 byte log entry
0709 13:15:03.635875 (+   443us) log.cc:844] Serialized 14 byte log entry
0709 13:15:04.363472 (+727597us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b18003e7700. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fecee165328 00007fecee15c901 00007fecee15c8a7 00007fecee254288 00007fecee253f37 00007fecee26855c 00007fecee268508
0709 13:15:04.375637 (+ 12165us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b18003e7700. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287
0709 13:15:04.375788 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.375865 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:04.375909 (+    44us) raft_consensus.cc:1685] finished
0709 13:15:04.375924 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.376069 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94935,"prepare.queue_time_us":42785,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":275524,"raft.run_cpu_time_us":12746,"raft.run_wall_time_us":638393,"spinlock_wait_cycles":67078272,"thread_start_us":367965,"threads_started":2,"wal-append.queue_time_us":270823}
I20260709 13:15:04.381728 11481 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:04.360054 11737 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:04.387486  7180 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:04.388767  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:04.389945  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.390746  7896 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:04.371842 11889 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:04.393013  7150 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:04.393983  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.303309 11861 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.398586 11889 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:04.407240  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.421339 11897 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:04.423409 11777 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:04.436810 11823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.001s	sys 0.017s
W20260709 13:15:04.449579 11902 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:04.414897 11889 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:04.449970 11884 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.450366 11889 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:04.450594 11884 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.452965 11884 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.453496 11884 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:04.454962 11880 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:04.455443 11872 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:04.456003 11872 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:04.456864 11872 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.465109  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.468088  7330 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:04.471006  7330 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:15:04.398931 11656 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:15:04.476683  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:04.491856  7329 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:04.493686  7332 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:15:04.494482  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.497288  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:04.470788 11823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.002s	sys 0.017s
I20260709 13:15:04.423967 11786 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:15:04.506685  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:04.506925  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:04.510929  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:04.500708 11740 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.447206 11777 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.522893 11777 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.523013 11874 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:04.522908  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 513662us
I20260709 13:15:04.527015 11884 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:04.527676 11884 consensus_queue.cc:1243] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:04.527940 11258 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:04.518962 11759 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:04.518735 11885 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:15:04.519520 11886 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.529003 11759 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.529628 11886 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.531266 11759 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.523444 11880 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:04.532467 11880 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:04.533370 11880 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.534894 11740 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:04.537341 11740 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:04.509294 11870 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:04.539111 11870 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.534994 11879 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:04.539808  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.540458  7893 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:04.541199 11870 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:04.541401  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.542526  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:04.543020  7333 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:04.543587  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:04.544312  7333 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:04.546770 11804 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:04.547238 11804 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:04.546929 11770 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:04.547663 11804 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:04.550196 11703 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:04.531852 11886 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:04.526309  7301 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:04.559103  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:04.653595  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 127336us
I20260709 13:15:04.654350  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:04.563931  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:04.564931  7183 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:04.565006 11759 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:04.566367 11875 raft_consensus.cc:993] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: : Instructing follower efc9ee9e1d86480790fa83f6ad0c295c to start an election
I20260709 13:15:04.567431 11418 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.568351  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:04.572831 11804 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.566359  7150 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:04.570317  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 292904us
W20260709 13:15:04.676210  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 109942us
I20260709 13:15:04.580852 11791 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:04.506366 11765 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:04.587677 11911 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:15:04.590292 11861 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:04.511983 11868 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:15:04.593782 11901 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.176s	user 0.003s	sys 0.000s
W20260709 13:15:04.594189  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.594488  7257 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:15:04.598490  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 134717us
I20260709 13:15:04.655758  7183 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:04.655174  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:04.699043  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 43956.4us
I20260709 13:15:04.662820  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:04.680598 11823 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:04.651871 11703 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:04.685611  7333 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:04.678567  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:04.669067 11870 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:04.673000 11799 raft_consensus.cc:1081] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Signalling peer efc9ee9e1d86480790fa83f6ad0c295c to start an election
I20260709 13:15:04.675635 11418 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.716802  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:04.692857 11765 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.694264  7182 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:04.704545  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:04.709523  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:04.720712  7180 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:04.710031  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:04.710734  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:04.723048  7187 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:04.711162  7183 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.737677  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:04.742015  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:04.742858  7180 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:04.744429  7183 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:04.725952 11805 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:04.710124 11886 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:04.688390 11896 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:15:04.752766  7335 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:04.687711 11906 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:15:04.740139 11870 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:04.732054 11564 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:04.766863  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 203025us
I20260709 13:15:04.771539  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:04.773804  7257 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:04.775094  7255 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:04.775966 11739 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:04.795533  7261 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:04.796042  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.796940 11739 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.797511 11739 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.798170  7895 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:15:04.795037 11878 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.801760 11878 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.804019 11878 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.806394 11896 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:04.806876 11896 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:04.807703 11896 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.809036 11896 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:04.809055  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:04.810580  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:04.810853 11790 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:04.811311 11790 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.811684 11790 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:04.811898 11852 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:04.812955  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.813972  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.814756  7261 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:04.814947  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.815394 11823 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:04.815624  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.817399 11804 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.819021  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.819857  7255 raft_consensus.cc:2410] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:15:04.820351  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:04.820640 11418 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:04.822311 11765 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.824925  7256 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:15:04.825443  7256 pending_rounds.cc:85] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 6
I20260709 13:15:04.825706  7256 pending_rounds.cc:107] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:15:04.826018  7256 raft_consensus.cc:2889] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:04.825858  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:04.708559 11773 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.713057 11889 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.840454  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.844213  7259 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:04.814420  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:04.841766  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 850774us
I20260709 13:15:04.847359  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:04.857759  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:04.859198  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44841.3us
I20260709 13:15:04.851219  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1821) took 1342 ms. Trace:
I20260709 13:15:04.867213  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.868417  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.884148  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.884606  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.740660 11887 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
W20260709 13:15:04.890975  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.900117  7258 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: [15.11-18.12]
I20260709 13:15:04.900233  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:04.777195 11886 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:04.902227  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:04.907876  7178 raft_consensus.cc:2410] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:04.908319  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.909235 11914 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:04.902604  7180 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:04.910138  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.911304  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.836735 11655 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:04.903712  7259 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:15:04.863595  7336 rpcz_store.cc:276] 0709 13:15:03.508631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.770915 (+262284us) service_pool.cc:224] Handling call
0709 13:15:03.771265 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:03.848741 (+ 77476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:03.848792 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:03.849859 (+  1067us) log.cc:844] Serialized 26 byte log entry
0709 13:15:03.981864 (+132005us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:04.003789 (+ 21925us) log.cc:844] Serialized 14 byte log entry
0709 13:15:04.202449 (+198660us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:04.770036 (+567587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:04.770116 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:04.770155 (+    39us) raft_consensus.cc:1685] finished
0709 13:15:04.850932 (+ 80777us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.851139 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":460330,"prepare.queue_time_us":19255,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":1171936,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":14690,"spinlock_wait_cycles":18026240,"thread_start_us":457462,"threads_started":3,"wal-append.queue_time_us":176873}
I20260709 13:15:04.916889  7302 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.917570  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:04.919142  7259 raft_consensus.cc:2410] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:04.867708 11806 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:04.884027 11879 raft_consensus.cc:2764] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:15:04.932050  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.932535  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.837752 11857 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:15:04.943822  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:04.905012 11258 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:04.900569 11804 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:04.953219 11918 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:04.885106 11418 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:15:04.955211 11910 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:04.955859 11910 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.956945 11773 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.959148 11655 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.959476 11886 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.961055 11879 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:04.961761 11879 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:04.936230 11887 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.962218 11879 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:04.962988 11887 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.964417 11879 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.939139  7253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:57560
I20260709 13:15:04.965022 11887 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:04.965476 11765 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:04.913702 11763 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:04.913062 11823 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:15:04.965740 11258 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:04.939793 11431 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:04.966071 11739 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:04.945276 11871 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:04.939591 11694 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:04.949448 11870 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.969091 11804 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:04.949103  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:05.011857  7333 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:04.958372 11910 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.988317  7253 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:05.013792  7253 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:04.990048 11889 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:04.995075  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:05.001008  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:05.007304  7183 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:05.020740 11258 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:05.015434  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:05.000479 11790 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.039281  7333 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:15:05.025378 11431 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:05.079111  7257 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:15:05.076021 11790 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.053198 11694 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:05.078141 11739 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.029235 11258 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:05.137478  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 193673us
I20260709 13:15:05.105451  7253 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.203488  7182 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:05.214389  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:05.127697  7333 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:15:05.208021 11908 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.675s	user 0.003s	sys 0.000s
W20260709 13:15:05.136318 11872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.009s	sys 0.014s
W20260709 13:15:05.210270 11920 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.387s	user 0.000s	sys 0.002s
I20260709 13:15:05.259842  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:05.120184 11773 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.127521 11884 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.199093 11804 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.202447 11759 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.180217 11696 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.236343 11937 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:05.164779  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 221013us
W20260709 13:15:05.278939  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 64648.7us
I20260709 13:15:05.126931 11806 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.107321 11887 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.107007 11790 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.284991 11896 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:05.217677 11703 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:05.325774  7328 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.013s	sys 0.011s
I20260709 13:15:05.289808  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:05.323722  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:05.324251  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:05.175066 11913 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:05.127279 11861 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:05.350162  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.307025  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:05.275106 11915 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:05.291090  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:05.278535 11872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.011s	sys 0.018s
W20260709 13:15:05.353349  7328 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.013s	sys 0.014s
I20260709 13:15:05.285641  7253 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:05.169178 11694 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.384884  7334 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:05.385186  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:05.302731 11925 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 13:15:05.303553 11930 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:15:05.361860  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:05.360235 11703 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:05.341704 11923 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:15:05.381953 11913 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.161577 11431 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.288334 11857 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:05.394151 11857 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:05.395138 11931 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:15:05.286931 11884 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.379294 11915 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.324121 11896 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:05.284871 11871 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
W20260709 13:15:05.356900  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:05.381588  7332 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.015s	sys 0.021s
W20260709 13:15:05.402427  7332 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.015s	sys 0.023s
W20260709 13:15:05.383935  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 77043.5us
W20260709 13:15:05.383946  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 59795.6us
I20260709 13:15:05.387092  7896 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:05.250768 11739 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.408077 11739 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.408953 11739 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:05.358713 11852 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.388877  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:05.381778 11861 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.286794 11696 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.389488 11481 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:05.302986 11906 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
W20260709 13:15:05.361405 11564 consensus_queue.cc:1175] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9a54ecc9fb4541df915f9f8c01e19429" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 8 index: 9 } }
I20260709 13:15:05.286612 11759 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.328313 11790 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.290201 11773 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.398044  7255 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:05.398828 11857 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.285442 11933 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:15:05.390116  7333 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:05.388006 11741 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:05.328532 11887 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.326109 11937 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.351644 11806 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.415428 11481 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.425622 11871 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:05.425308  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 146790us
I20260709 13:15:05.414191 11852 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.392422 11872 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:15:05.440835  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:05.399756 11874 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.445209  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1819) took 1937 ms. Trace:
I20260709 13:15:05.402001 11896 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:05.462080  7328 rpcz_store.cc:276] 0709 13:15:03.508035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.769864 (+261829us) service_pool.cc:224] Handling call
0709 13:15:03.770177 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:03.770505 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:03.770807 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:15:04.404409 (+633602us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b18003bd5e0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:15:04.669793 (+265384us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:04.670767 (+   974us) log.cc:844] Serialized 26 byte log entry
0709 13:15:04.670970 (+   203us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:05.377145 (+706175us) log.cc:844] Serialized 14 byte log entry
0709 13:15:05.438238 (+ 61093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.438363 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:05.444963 (+  6600us) raft_consensus.cc:1685] finished
0709 13:15:05.444985 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.445153 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665858,"prepare.queue_time_us":745699,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":90,"raft.queue_time_us":753015,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":510747,"spinlock_wait_cycles":10341760,"thread_start_us":1106743,"threads_started":4,"wal-append.queue_time_us":143461}
I20260709 13:15:05.462350  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:05.447810 11481 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:05.462528  7327 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:05.468226  7327 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:15:05.471038 11759 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.473165 11852 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:05.475015 11938 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:15:05.474679 11481 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.476909 11481 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.479674 11773 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.480224 11806 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.482985 11887 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.487632 11913 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:05.438354 11893 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:05.489138 11937 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:05.441326 11914 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:05.457926 11870 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:15:05.460256  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 169232us
I20260709 13:15:05.449721 11696 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.497761 11872 consensus_queue.cc:1243] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:15:05.460386  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 55480.7us
W20260709 13:15:05.506922 11880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.005s	sys 0.006s
W20260709 13:15:05.512394  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 107592us
I20260709 13:15:05.500288 11893 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:05.502385 11870 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:05.489583 11874 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.518146  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:05.519263 11893 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:05.517590 11880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.005s	sys 0.006s
I20260709 13:15:05.521978 11431 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:05.524096  7333 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:05.526717  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:05.527878  7261 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:05.537832  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 841) took 1144 ms. Trace:
I20260709 13:15:05.538251  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.539223  7261 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:05.529683  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.540464  7257 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:05.531019  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:05.532498  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.534215  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.542946  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:05.536221  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:05.540230 11481 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:05.549455 11950 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:05.549788 11703 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:05.550477 11804 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:05.550366 11703 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.550844 11790 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.550963 11804 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.551463 11804 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:05.552596 11703 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.549557 11884 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:05.555986 11874 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:05.556418 11893 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:05.557078  7255 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:05.538223  7260 rpcz_store.cc:276] 0709 13:15:04.393581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.398872 (+  5291us) service_pool.cc:224] Handling call
0709 13:15:04.399219 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.399414 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:04.471810 (+ 72396us) log.cc:844] Serialized 14 byte log entry
0709 13:15:05.209683 (+737873us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:05.515611 (+305928us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b18004ab600. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a
0709 13:15:05.537504 (+ 21893us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.537561 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:05.537602 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.537672 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.537779 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10183,"prepare.queue_time_us":51788,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":10369,"spinlock_wait_cycles":57404544,"thread_start_us":340014,"threads_started":2,"wal-append.queue_time_us":292963}
I20260709 13:15:05.560909  7254 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:15:05.562203  7302 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:05.563467  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.565100  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.565740  7254 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:05.570004  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:05.570561  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:05.570951  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:05.574244  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.577293  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.578125  7187 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:05.578447  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.581596 11884 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.581621  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.582263 11431 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:05.582331 11884 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.583007 11431 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.584697 11884 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:05.585155 11431 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:05.573309 11823 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:05.586014 11823 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.586387 11823 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:05.591960 11687 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:15:05.594004 11861 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.596057 11759 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:05.598232 11915 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:05.602324  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.606320  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.602566  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.607107  7186 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:15:05.566951 11872 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:05.619484  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.620510  7179 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:05.621140 11896 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.621470 11703 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:05.622072 11703 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.622547 11703 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:05.615691 11870 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.625423 11870 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:05.605401 11880 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:05.634006 11872 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:05.640658 11687 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.641431 11687 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:05.643836 11916 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.820s	user 0.003s	sys 0.000s
I20260709 13:15:05.644701  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:05.649426  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:05.650460  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:05.651391  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:05.652097  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:05.602160 11823 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.665151 11564 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:05.665652 11714 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:05.666674 11694 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:05.666751 11861 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:05.647869 11804 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:05.712752  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.653836 11880 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.611639 11655 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:05.707688  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 668) took 1004 ms. Trace:
I20260709 13:15:05.713542  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.714553  7262 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:05.729336  7335 rpcz_store.cc:276] 0709 13:15:04.703660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.223481 (+519821us) service_pool.cc:224] Handling call
0709 13:15:05.223818 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.392093 (+168275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.392124 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.392177 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:05.392208 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.707420 (+315212us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540038bdd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:05.707468 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.707626 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386545920}
I20260709 13:15:05.730458  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.731995  7335 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:15:05.653723 11896 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:05.715214  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.722525  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.675587  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:05.677079 11763 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:05.723192  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.699575 11564 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.661181 11887 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:15:05.740741  7256 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:15:05.805115  7253 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:15:05.738821  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63381.8us
I20260709 13:15:05.722535 11739 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:05.735294 11908 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:15:05.781523  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.729102 11655 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.736606 11906 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.733366 11861 raft_consensus.cc:697] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:05.793315 11794 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:05.803725 11564 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:05.806109 11763 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:05.735908 11799 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.118s
I20260709 13:15:05.854272 11655 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:05.793295 11918 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:15:05.847064 11852 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.736517 11880 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:05.870908  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 126018us
I20260709 13:15:05.860531 11763 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:05.885308  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.850317 11739 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.871546 11481 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:05.891011 11805 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:05.891459 11805 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:05.892689 11739 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.891018 11481 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.895855 11481 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:05.891037 11946 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:15:05.899653  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1878) took 1388 ms. Trace:
I20260709 13:15:05.900077  7334 rpcz_store.cc:276] 0709 13:15:04.510995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.511488 (+   493us) service_pool.cc:224] Handling call
0709 13:15:04.511825 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.385481 (+873656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.899393 (+513912us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b540013d654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:05.899590 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007214848}
I20260709 13:15:05.901263 11823 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:05.901898 11823 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:05.902362 11823 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.890105 11703 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.859345 11948 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:15:05.872394 11696 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.892294 11805 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.883312 11852 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.906072  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:05.953578  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.902586  7334 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:05.954506  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:05.955058  7187 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:05.914273  7261 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:15:05.919261  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.920076  7331 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:05.959257  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.920161  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:05.960122  7180 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:05.960243  7255 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:15:05.920802  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:05.913600  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:05.923293  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2108) took 1063 ms. Trace:
I20260709 13:15:05.938071  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:05.961934  7178 raft_consensus.cc:2368] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15.
I20260709 13:15:05.957705  7256 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:05.942885  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:05.935144  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 666) took 1237 ms. Trace:
I20260709 13:15:05.947219  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:05.938356  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:05.955665  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.921399  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:05.938900  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:05.966251  7262 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:05.963578  7336 rpcz_store.cc:276] 0709 13:15:04.698184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.032928 (+334744us) service_pool.cc:224] Handling call
0709 13:15:05.055738 (+ 22810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.637858 (+582120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.637889 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.637951 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:05.637983 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.934912 (+296929us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54001928d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:05.934959 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.935088 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338253056}
I20260709 13:15:05.933072  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:05.962126  7182 rpcz_store.cc:276] 0709 13:15:04.860350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.860490 (+   140us) service_pool.cc:224] Handling call
0709 13:15:04.905185 (+ 44695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.260482 (+355297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.923027 (+662545us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400256554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:05.923206 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685105536}
I20260709 13:15:05.942575  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:05.921403  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:05.995491  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:06.080348  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 166821us
I20260709 13:15:05.969614  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:06.097259  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:06.109634  7336 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:05.943827 11681 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:06.098110  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:06.080152  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.912595 11948 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:05.980270  7256 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:05.979565  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:06.737017  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:06.737814  7334 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:06.114791  7262 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:06.080161  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:06.082862  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:06.739924  7178 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:06.061640  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:06.741447  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:05.950022  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63586.2us
I20260709 13:15:05.858217 11906 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:06.107568  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.940747 11880 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:05.949085 11238 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.272s
I20260709 13:15:05.945315 11734 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.264s
I20260709 13:15:05.941534 11804 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:06.220474 11872 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:06.243109  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 435850us
W20260709 13:15:06.209486  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 239940us
I20260709 13:15:06.223089  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:06.751401  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:06.177974 11759 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.178153  7180 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:06.759063 11759 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:06.760517  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:06.761307 11759 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:06.761677  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:06.283593 11655 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:06.236426 11258 raft_consensus.cc:1064] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:15:06.299489 11943 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:06.150650 11885 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:06.762909 11258 raft_consensus.cc:1068] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Unable to promote non-voter 9a54ecc9fb4541df915f9f8c01e19429: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:06.763092 11885 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:06.763566 11885 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:06.764269 11655 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:06.765008  7333 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:15:06.532061 11958 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:15:06.545715  7260 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:05.969156 11953 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:06.767647  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1811) took 1235 ms. Trace:
I20260709 13:15:06.768033 11953 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:06.768477  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:06.768052  7258 rpcz_store.cc:276] 0709 13:15:05.531823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.531950 (+   127us) service_pool.cc:224] Handling call
0709 13:15:05.532249 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:05.535592 (+  3343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.535624 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.540525 (+  4901us) log.cc:844] Serialized 26 byte log entry
0709 13:15:05.999378 (+458853us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:05.999438 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.999533 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.767396 (+767863us) raft_consensus.cc:1685] finished
0709 13:15:06.767425 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.767585 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12701,"raft.queue_time_us":3118,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":12705,"thread_start_us":380342,"threads_started":1,"wal-append.queue_time_us":699111}
I20260709 13:15:06.312085  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 669) took 1603 ms. Trace:
I20260709 13:15:06.770965 11390 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:06.770769  7328 rpcz_store.cc:276] 0709 13:15:04.708322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.465214 (+756892us) service_pool.cc:224] Handling call
0709 13:15:05.476531 (+ 11317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.646225 (+169694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.646272 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.646330 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:05.646378 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.311768 (+665390us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400253854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:06.311838 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.312008 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389673856}
I20260709 13:15:06.772017 11258 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:06.771739 11390 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:06.772396  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:06.773119  7328 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
W20260709 13:15:06.335708 11924 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.162s	user 0.004s	sys 0.000s
I20260709 13:15:06.178764 11724 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:06.775614  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1842) took 2004 ms. Trace:
I20260709 13:15:06.775696 11906 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:06.776304 11906 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:06.776073  7333 rpcz_store.cc:276] 0709 13:15:04.771058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.617556 (+846498us) service_pool.cc:224] Handling call
0709 13:15:05.617841 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.765393 (+1147552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.775370 (+  9977us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540025c454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:06.775558 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2637695360}
I20260709 13:15:06.776712 11724 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:06.777205 11724 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:06.776983 11906 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:06.777501  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:06.183413 11861 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:06.695744  7254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.000s	sys 0.009s
I20260709 13:15:06.492791  7327 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:15:06.232996 11944 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:06.112128 11945 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:06.346122 11790 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:06.232571 11893 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
W20260709 13:15:06.450212  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:06.209146  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 100003us
I20260709 13:15:06.778972  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1841) took 2209 ms. Trace:
I20260709 13:15:06.606452 11878 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:06.205310 11773 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:06.329365  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:06.554489 11741 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.309069 11687 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:06.112828  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 164109us
I20260709 13:15:05.968320 11887 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.742432 11948 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:06.223977 11918 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:06.207630  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:06.850697  7185 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:06.498402  7253 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:15:06.852675  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:06.853628  7253 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 9: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:15:06.107913 11869 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.576s	user 0.020s	sys 0.019s
W20260709 13:15:06.154361  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 233020us
I20260709 13:15:06.762907 11943 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:06.297560 11564 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:06.885004 11943 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:06.886034 11564 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:06.781723 11966 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:06.886700 11564 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:06.886734 11966 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:05.945904 11786 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.264s
W20260709 13:15:06.352185 11962 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:15:06.889149 11966 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:06.096957 11879 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 13:15:06.194309  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:06.119833 11681 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:06.891328 11681 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:06.292316 11763 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:06.892493 11681 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:05.918102 11949 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:05.948765 11852 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:06.352069  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 852) took 1376 ms. Trace:
I20260709 13:15:05.904618 11823 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:06.181931  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:05.914669 11805 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:06.057723 11874 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:05.912633 11703 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:06.733861  7187 consensus_meta.cc:287] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.778s	user 0.011s	sys 0.001s
I20260709 13:15:06.641074  7082 catalog_manager.cc:5697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 1 to 9, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 9 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:05.973649  7257 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:06.911748  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:06.913328  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:06.915089  7329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.037s	sys 0.088s
I20260709 13:15:06.773960 11390 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:06.781152  7254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.000s	sys 0.009s
I20260709 13:15:06.783170  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1890) took 1951 ms. Trace:
I20260709 13:15:06.781566  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1892) took 1552 ms. Trace:
I20260709 13:15:06.778615  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:06.792258  7256 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:15:06.793816  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:06.920622  7896 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:06.783895  7334 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:06.921691  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:06.922857  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:06.773993  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:06.924983  7328 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:06.786968  7330 rpcz_store.cc:276] 0709 13:15:04.569339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.665052 (+ 95713us) service_pool.cc:224] Handling call
0709 13:15:04.665382 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:04.665748 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.665775 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:04.675906 (+ 10131us) log.cc:844] Serialized 26 byte log entry
0709 13:15:05.076638 (+400732us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:05.076681 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.076751 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.334891 (+1258140us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:06.778702 (+443811us) raft_consensus.cc:1685] finished
0709 13:15:06.778725 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.778906 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7510,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":1868,"spinlock_wait_cycles":3793792,"thread_start_us":373632,"threads_started":1,"wal-append.queue_time_us":470509}
I20260709 13:15:06.804636  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2951) took 1093 ms. Trace:
I20260709 13:15:06.918910  7335 rpcz_store.cc:276] 0709 13:15:04.831534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.732748 (+901214us) service_pool.cc:224] Handling call
0709 13:15:05.733024 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:05.737570 (+  4546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.737600 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.793876 (+ 56276us) log.cc:844] Serialized 26 byte log entry
0709 13:15:05.969880 (+176004us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:05.969937 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.970027 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.782967 (+812940us) raft_consensus.cc:1685] finished
0709 13:15:06.782988 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.783118 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":278368,"raft.queue_time_us":4292,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":216002,"thread_start_us":114106,"threads_started":1,"wal-append.queue_time_us":878703}
I20260709 13:15:06.925880  7260 rpcz_store.cc:276] 0709 13:15:05.711591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.711823 (+   232us) service_pool.cc:224] Handling call
0709 13:15:05.712196 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.767651 (+1055455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.804311 (+ 36660us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54002f7954. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:06.804561 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1916251904}
I20260709 13:15:06.805598  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:06.821792  7178 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:05.913102 11696 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:06.825007  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:06.747464 11857 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:06.779125 11804 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:06.729518  7255 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.769s	user 0.009s	sys 0.001s
I20260709 13:15:06.937232  7255 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:06.937588  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1819) took 1019 ms. Trace:
I20260709 13:15:06.937923  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1821) took 1018 ms. Trace:
I20260709 13:15:06.938532  7255 rpcz_store.cc:276] 0709 13:15:05.919791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.919917 (+   126us) service_pool.cc:224] Handling call
0709 13:15:06.937846 (+1017929us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.858837 11970 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:15:06.849751 11887 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:06.861173  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:06.803682 11741 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:06.814399 11878 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:06.862191 11694 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.862820  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:06.862615 11918 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:06.954851  7896 raft_consensus.cc:2410] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:15:06.955565  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:06.956713  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:06.869380 11906 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:06.770792 11481 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:15:06.815498 11773 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:06.782379 11790 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:06.772441 11258 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:06.784619 11759 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:06.871516  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:06.946768 11703 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:06.874660  7253 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:15:07.006529 11703 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:06.875581  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:07.008708  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 133208us
I20260709 13:15:07.009186 11703 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:06.966143 11869 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.434s	user 0.023s	sys 0.025s
I20260709 13:15:07.009781  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:06.877532 11724 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.013033 11724 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.013978 11915 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:15:06.879127  7085 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47542 (request call id 234) took 24772 ms (client timeout 15000 ms). Trace:
I20260709 13:15:06.880183 11893 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:06.839818 11655 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:06.941463 11857 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:06.781824 11944 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.019145 11893 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:07.019603 11893 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:07.020422 11893 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.020989 11944 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.021693 11893 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:07.019074 11655 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.023406  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:07.024220 11910 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:07.024700 11655 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:06.888376 11885 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:05.924813 11431 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.893366  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2738) took 1312 ms. Trace:
W20260709 13:15:06.895254  7184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.022s
I20260709 13:15:06.890372  7336 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
W20260709 13:15:07.026820  7184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.006s	sys 0.022s
I20260709 13:15:07.027043  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 1894) took 1075 ms. Trace:
I20260709 13:15:06.894821  7259 rpcz_store.cc:276] 0709 13:15:04.975711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.979766 (+  4055us) service_pool.cc:224] Handling call
0709 13:15:04.980191 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:04.980634 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:04.980673 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.903251 (+922578us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:05.903689 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.112553 (+208864us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:06.112591 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.112661 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.351591 (+238930us) raft_consensus.cc:1685] finished
0709 13:15:06.351624 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.351989 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":15447,"spinlock_wait_cycles":10790272,"thread_start_us":208483,"threads_started":1,"wal-append.queue_time_us":367532}
I20260709 13:15:07.027719  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2742) took 1093 ms. Trace:
I20260709 13:15:07.028239  7184 rpcz_store.cc:276] 0709 13:15:05.934288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.949469 (+ 15181us) service_pool.cc:224] Handling call
0709 13:15:05.949769 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:05.950079 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.950109 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.950480 (+   371us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.332958 (+382478us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b1800423d60. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:15:07.027249 (+694291us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:07.027286 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.027352 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:07.027398 (+    46us) raft_consensus.cc:1685] finished
0709 13:15:07.027410 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.027649 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9893,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":90155,"spinlock_wait_cycles":9986432,"thread_start_us":694076,"threads_started":1,"wal-append.queue_time_us":994517}
I20260709 13:15:06.907334  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:06.914961  7187 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:06.886087 11943 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:06.896842 11949 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:06.916785  7301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.001s	sys 0.034s
I20260709 13:15:07.033193  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:06.919085  7327 rpcz_store.cc:276] 0709 13:15:05.228769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.894267 (+665498us) service_pool.cc:224] Handling call
0709 13:15:05.894580 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.492447 (+597867us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b5400189320. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece923e1c0 00007fece923f231 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c
0709 13:15:06.781312 (+288865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.781516 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96267008}
I20260709 13:15:07.034183  7183 raft_consensus.cc:2410] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:15:07.033160  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.037293  7183 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:15:07.037797  7183 pending_rounds.cc:85] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 6
I20260709 13:15:06.935364  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:06.938045  7254 rpcz_store.cc:276] 0709 13:15:05.918498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.919184 (+   686us) service_pool.cc:224] Handling call
0709 13:15:05.919486 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:05.949135 (+ 29649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.949165 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:05.949609 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.918531 (+968922us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:06.918566 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.929472 (+ 10906us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54001a2a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:06.929526 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.929568 (+    42us) raft_consensus.cc:1685] finished
0709 13:15:06.929579 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.937527 (+  7948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10505,"raft.queue_time_us":911,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":98679,"spinlock_wait_cycles":67326848,"thread_start_us":968650,"threads_started":1,"wal-append.queue_time_us":917984}
I20260709 13:15:07.038128  7183 pending_rounds.cc:107] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:15:06.945751  7255 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:06.948261  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.038810  7178 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:15:07.040043  7183 raft_consensus.cc:2889] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:07.040169  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.037215  7184 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
W20260709 13:15:07.015182  7085 rpcz_store.cc:269] 0709 13:14:42.107237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.107495 (+   258us) service_pool.cc:224] Handling call
0709 13:15:06.879001 (+24771506us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:00.972472 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:00.973354 (+   882us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:00.973418 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:15:00.973446 (+    28us) tablet.cc:662] Decoding operations
0709 13:15:01.243901 (+270455us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:01.281335 (+ 37434us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:01.282749 (+  1414us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:15:02.208970 (+926221us) tablet.cc:701] Row locks acquired
0709 13:15:02.225840 (+ 16870us) write_op.cc:260] PREPARE: finished
0709 13:15:02.285380 (+ 59540us) write_op.cc:270] Start()
0709 13:15:02.329187 (+ 43807us) write_op.cc:276] Timestamp: P: 1783602902268043 usec, L: 0
0709 13:15:02.362658 (+ 33471us) op_driver.cc:348] REPLICATION: starting
0709 13:15:02.429218 (+ 66560us) log.cc:844] Serialized 9083 byte log entry
0709 13:15:02.651409 (+222191us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b54000aa354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9237e28 00007fececc72581 00007fececc71d58 00007fececc769f1 00007fececc769a9 00007fececc76939 00007fececc76901 00007fececc75b2d 000000000038f354 000000000038f199
0709 13:15:02.728992 (+ 77583us) op_driver.cc:464] REPLICATION: finished
0709 13:15:02.905420 (+176428us) write_op.cc:301] APPLY: starting
0709 13:15:02.905525 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:02.986833 (+ 81308us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:02.986879 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:03.590830 (+603951us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:03.591222 (+   392us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=0,mrs_lookups=0
0709 13:15:03.591290 (+    68us) write_op.cc:312] APPLY: finished
0709 13:15:03.591856 (+   566us) log.cc:844] Serialized 204 byte log entry
0709 13:15:03.592040 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:03.592279 (+   239us) write_op.cc:454] Released schema lock
0709 13:15:03.592346 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:03.592757 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:03.592790 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1134922,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":173130,"apply.run_cpu_time_us":33842,"apply.run_wall_time_us":687317,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100405,"num_ops":23,"prepare.queue_time_us":130146,"prepare.run_cpu_time_us":53525,"prepare.run_wall_time_us":1679198,"raft.queue_time_us":146355,"raft.run_cpu_time_us":17013,"raft.run_wall_time_us":160292,"replication_time_us":348266,"spinlock_wait_cycles":57407360,"thread_start_us":371170,"threads_started":4,"wal-append.queue_time_us":128834,"wal-append.run_cpu_time_us":8706,"wal-append.run_wall_time_us":2114667}]]}
I20260709 13:15:07.041723  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.041982  7183 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:06.971884 11874 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:06.770460 11953 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:06.951931  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:06.941139 11804 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:06.950415 11823 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:06.873018 11687 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:06.975534  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:06.973204 11861 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:06.981715  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.992658 11976 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.000267 11887 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.002092 11696 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.005412 11918 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:06.971702 11973 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.025951 11431 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.027093 11885 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.030990  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2117) took 1077 ms. Trace:
I20260709 13:15:07.117794  7187 rpcz_store.cc:276] 0709 13:15:05.953526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.954305 (+   779us) service_pool.cc:224] Handling call
0709 13:15:07.030931 (+1076626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.762295  7332 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:07.118911  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1855) took 1189 ms. Trace:
I20260709 13:15:07.119252  7332 rpcz_store.cc:276] 0709 13:15:05.929180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.761446 (+832266us) service_pool.cc:224] Handling call
0709 13:15:07.118848 (+357402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:07.025904  7181 rpcz_store.cc:276] 0709 13:15:05.580832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.600978 (+ 20146us) service_pool.cc:224] Handling call
0709 13:15:05.601309 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:05.648207 (+ 46898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.648255 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:05.662687 (+ 14432us) log.cc:844] Serialized 52 byte log entry
0709 13:15:05.863677 (+200990us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:05.863720 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.863786 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.893093 (+1029307us) raft_consensus.cc:1685] finished
0709 13:15:06.893117 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.893303 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46436,"raft.queue_time_us":47233,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":15709,"thread_start_us":138780,"threads_started":1,"wal-append.queue_time_us":531387}
I20260709 13:15:07.025447  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:07.120735  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 95358.8us
I20260709 13:15:07.120824  7181 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:07.121148  7332 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:07.121495  7299 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:07.121945 11918 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:07.033506  7301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.001s	sys 0.035s
I20260709 13:15:07.122608 11918 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:06.942266  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.123374  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1860) took 1192 ms. Trace:
I20260709 13:15:07.123821  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.123719  7334 rpcz_store.cc:276] 0709 13:15:05.930459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.923741 (+993282us) service_pool.cc:224] Handling call
0709 13:15:07.123300 (+199559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:07.124619  7187 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:15:07.125453  7253 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
W20260709 13:15:07.125933  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.126875 11765 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:07.127727  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:07.127591 11765 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.128474  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:07.128948 11945 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:07.129814 11765 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:06.917261  7329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.037s	sys 0.088s
I20260709 13:15:07.130163 11945 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:07.130962  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 677) took 2124 ms. Trace:
I20260709 13:15:07.131471  7329 rpcz_store.cc:276] 0709 13:15:05.007087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.868013 (+860926us) service_pool.cc:224] Handling call
0709 13:15:05.868325 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.868547 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:05.868800 (+   253us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.130593 (+1261793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.130682 (+    89us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:07.130726 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.130800 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.130911 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3626,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"thread_start_us":1261403,"threads_started":1,"wal-append.queue_time_us":1204544}
I20260709 13:15:07.032599 11258 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:06.962155 11694 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.074743 11861 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.143692 11694 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:07.064735 11724 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.144932  7333 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:07.077064 11823 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.067517 11804 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:07.070513 11944 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:07.081373  7255 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:07.080943 11948 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.081852 11949 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.087800 11773 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.089619  7185 pending_rounds.cc:85] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 6
I20260709 13:15:07.184401  7185 pending_rounds.cc:107] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:15:07.184815  7185 raft_consensus.cc:2889] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:07.089474 11878 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.091378 11763 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:07.180766  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 1900) took 1067 ms. Trace:
I20260709 13:15:07.144033 11861 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.100430 11857 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.104215 11481 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.104846 11879 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:07.111568 11953 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.069818 11874 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.115628 11973 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.116756 11431 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:07.034077 11759 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.117259  7331 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:15:07.117960 11741 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.027597  7336 rpcz_store.cc:276] 0709 13:15:05.951697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.110435 (+158738us) service_pool.cc:224] Handling call
0709 13:15:07.026979 (+916544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:07.126756  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.127158  7254 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:07.130553 11945 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:07.061781 11910 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:15:07.216948 11885 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:07.065354  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 113492us
I20260709 13:15:07.180263 11970 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:15:07.242268  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:07.243448  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:07.244180  7257 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:07.135957  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:07.244875  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 364897us
I20260709 13:15:07.180445 11724 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.147660  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.149695  7181 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:07.072214  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:07.165354  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2965) took 1186 ms. Trace:
W20260709 13:15:07.252887  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 117036us
W20260709 13:15:07.173234  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 281807us
I20260709 13:15:07.252882  7255 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 9.
I20260709 13:15:07.176535  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2126) took 1056 ms. Trace:
I20260709 13:15:07.178541  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.092098 11976 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.202601  7333 rpcz_store.cc:276] 0709 13:15:06.113793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.964563 (+850770us) service_pool.cc:224] Handling call
0709 13:15:06.964964 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:07.145415 (+180451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.152439 (+  7024us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540031b0d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:07.180702 (+ 28263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412723968}
W20260709 13:15:07.181504  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44379.7us
I20260709 13:15:07.203173  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.093845  7184 pending_rounds.cc:85] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 5
I20260709 13:15:07.258610  7184 pending_rounds.cc:107] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:15:07.258946  7184 raft_consensus.cc:2889] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:07.135517 11915 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:07.215451 11655 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:07.225852  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 368152us
I20260709 13:15:07.231068  7187 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:15:07.283247  7255 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:15:07.283692  7255 pending_rounds.cc:85] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 7
I20260709 13:15:07.283476  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:07.283954  7255 pending_rounds.cc:107] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:15:07.241150  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.217175 11694 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:15:07.284335  7255 raft_consensus.cc:2889] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:07.247341  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1861) took 1316 ms. Trace:
W20260709 13:15:06.949065  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.286196  7180 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:15:07.253500  7261 rpcz_store.cc:276] 0709 13:15:05.978546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.758709 (+780163us) service_pool.cc:224] Handling call
0709 13:15:06.759030 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.759389 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.759418 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:06.759859 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.911695 (+151836us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.911739 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.911810 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:07.165055 (+253245us) raft_consensus.cc:1685] finished
0709 13:15:07.165085 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.165273 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2544,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"thread_start_us":151452,"threads_started":1,"wal-append.queue_time_us":402628}
I20260709 13:15:07.259814  7257 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:15:07.287004  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.265210  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:07.266132  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.286111  7331 rpcz_store.cc:276] 0709 13:15:05.951112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.741134 (+790022us) service_pool.cc:224] Handling call
0709 13:15:07.247121 (+505987us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b540031abd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:07.247268 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862446336}
I20260709 13:15:07.289739  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.290374  7331 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:07.291368  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.292446  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.293056  7331 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:07.268257  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:07.255942  7186 rpcz_store.cc:276] 0709 13:15:06.120116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.743480 (+623364us) service_pool.cc:224] Handling call
0709 13:15:06.743807 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.936414 (+192607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.936450 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:06.944726 (+  8276us) log.cc:844] Serialized 26 byte log entry
0709 13:15:07.176022 (+231296us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:07.176062 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.176142 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:07.176204 (+    62us) raft_consensus.cc:1685] finished
0709 13:15:07.176216 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.176478 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1379,"raft.queue_time_us":80237,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":31016,"thread_start_us":382097,"threads_started":2,"wal-append.queue_time_us":222349}
I20260709 13:15:07.273252  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:07.211261 11790 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.212033 11948 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:07.211453 11918 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:07.302745 11655 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.303205 11918 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.272791 11944 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.304136 11944 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:07.304499 11914 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:07.306331  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:07.297868 11880 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:15:07.307741  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.308921 11887 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:07.309732 11887 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.312757 11887 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.267581  7179 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:07.316589 11966 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:07.317263  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44093us
I20260709 13:15:07.317785  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:07.296860  7225 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:07.319118 11966 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:07.319283 11914 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:07.320103  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:07.321172  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:07.299897  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:07.234594 11763 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:07.237696 11872 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:07.319648 11966 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:07.222985 11481 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.327313  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:07.301659  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:07.297544  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:07.314188 11887 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:07.225821 11953 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.278566 11857 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:07.333210  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.329986  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.363744  7180 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:15:07.352291  7178 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:07.364960  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.285308 11870 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:07.368656  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:07.332572  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 67941.2us
I20260709 13:15:07.331977 11884 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:15:07.396061  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.273061 11741 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:07.295729 11981 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.330850 11966 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:07.411551  7253 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:15:07.416147  7332 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:07.401321  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.423099  7178 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
W20260709 13:15:07.424782  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 56211.9us
I20260709 13:15:07.331135 11703 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:07.359639 11687 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:07.359160 11790 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:07.425550  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 52258us
I20260709 13:15:07.327739 11763 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:07.253310 11885 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.362744 11906 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:15:07.452466  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:07.359133 11975 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:07.417763 11733 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:07.367370 11910 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:15:07.458241 11258 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.362944 11794 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:15:07.460382  7894 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:07.469478 11857 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:07.470082 11794 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:15:07.444465 11805 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.003s
I20260709 13:15:07.470539 11794 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:07.402045 11943 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:15:07.438683 11726 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:07.470772 11857 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.471448 11726 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:07.397852 11887 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.477890 11687 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:07.417917 11741 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.397287 11945 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.453675 11982 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:07.488163 11823 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.495420 11823 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.472276 11733 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.464864 11734 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:07.473357 11975 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:07.480049 11726 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:07.427764 11981 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.450780 11790 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.471585 11794 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.528332 11794 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:07.529338 11953 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.496011 11823 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.514506 11976 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.520260 11734 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:07.527056 11987 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:15:07.527377 12000 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:15:07.527494 11893 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.004s
I20260709 13:15:07.496820 11982 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.546578 11982 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:07.546964 11790 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.547614 11981 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.548040 11885 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.537531 11949 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:07.549227 11949 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.549921 11918 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.551606 11949 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.545274 11724 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.552104 11734 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.548074 11944 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.545836 11823 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.546041 11733 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.554553 11982 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.556749 11982 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.556656 11966 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.537285 11763 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.560361 11763 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:07.563351 11887 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.564338 11953 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:07.564941 11973 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.578509 11975 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:07.405604  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 75594us
W20260709 13:15:07.627513  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 295606us
I20260709 13:15:07.490772 11390 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:07.489543 11681 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:07.488716 11687 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:07.680130  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49885.5us
I20260709 13:15:07.644289  7259 raft_consensus.cc:2410] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:15:07.542570 11804 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.683287 11390 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:07.686458 11759 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.642922  7183 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:15:07.586567 11966 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:07.680260  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 55326.1us
W20260709 13:15:07.672320  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.645202 11741 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.690413  7183 pending_rounds.cc:85] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 6
W20260709 13:15:07.687845 12019 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:15:07.700263  7256 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:07.702950  7183 pending_rounds.cc:107] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:15:07.703559  7183 raft_consensus.cc:2889] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:07.707607  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.715270  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:07.717777 11773 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:07.718393 11773 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.719168 11773 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:07.718248 12008 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:07.723337 11681 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.723522 12008 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.727584 12008 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.727938 11481 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:07.733498  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 413306us
I20260709 13:15:07.686296 11390 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.737254 11390 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:07.737998 12015 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:07.738828 11696 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:07.741050  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.733044 12008 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:07.744119  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1824) took 1663 ms. Trace:
W20260709 13:15:07.740700  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 287439us
I20260709 13:15:07.747370  7258 rpcz_store.cc:276] 0709 13:15:06.080926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.770327 (+689401us) service_pool.cc:224] Handling call
0709 13:15:06.770658 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.967412 (+196754us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:07.209554 (+242142us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.252169 (+ 42615us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.252414 (+   245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.252468 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:07.252516 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.453896 (+201380us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b18004050a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419
0709 13:15:07.519949 (+ 66053us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b18004050a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:07.563365 (+ 43416us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b18004050a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:07.743449 (+180084us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54001a2f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:07.743546 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.743846 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31149,"prepare.queue_time_us":278093,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":5009,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":46088,"spinlock_wait_cycles":664544384,"thread_start_us":260033,"threads_started":2,"wal-append.queue_time_us":297262}
I20260709 13:15:07.753159  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.754698 11804 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.739933 11696 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.752640  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.768370 11655 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:07.774899  7184 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:07.778730  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:07.779754  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:07.784416  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:07.787981  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:07.779982 12008 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.793951 11944 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.795400  7894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 660) took 1001 ms. Trace:
I20260709 13:15:07.795807 11733 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:07.800206  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:07.807250  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.807828  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.808524  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.777534 11681 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.810745 11870 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:07.812086  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:07.829200  7894 rpcz_store.cc:276] 0709 13:15:06.793879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.794336 (+   457us) service_pool.cc:224] Handling call
0709 13:15:07.795004 (+1000668us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54005b22d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:07.795198 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999923968}
I20260709 13:15:07.854481  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:07.856591  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 56737.2us
I20260709 13:15:07.847028 11870 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:07.833076 11886 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:07.862068  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.867429  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.868556 12007 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:07.869402 11258 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:07.869541 12007 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.876053 11880 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:07.878865 11431 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:07.879410 11431 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:07.879714 12007 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:07.880323  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:07.880861 11431 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:15:07.882879 11869 consensus_queue.cc:1175] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 12 index: 7 } }
I20260709 13:15:07.884176 11869 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:07.884843 11869 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:07.883080  7182 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:07.888823  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.860360  7254 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:15:07.891268 11915 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:07.891911  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:07.893486  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:07.894435  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:07.895061  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.883219  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:07.869531 11879 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:07.890458  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.911966  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:07.913942  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:07.915527 11870 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:07.916937 11870 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:07.903053 11879 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:07.941537  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.927800 12027 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:07.952093  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.886279 11869 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.954736  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.955531  7257 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:15:07.956619  7182 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:15:07.959007 12028 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:07.959074  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.956629  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.959895 12028 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:07.961063  7261 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:07.961719  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.963979  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 681) took 1112 ms. Trace:
I20260709 13:15:07.966392  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.976611 11945 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:07.978353 11485 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:07.985613  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:07.986123  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:07.940862 11879 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:07.986713  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.988045  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:07.989792  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.990406  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1859) took 2060 ms. Trace:
I20260709 13:15:07.990540  7261 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:07.990998  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:07.978307  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:07.979503  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 863) took 1194 ms. Trace:
I20260709 13:15:07.990887  7330 rpcz_store.cc:276] 0709 13:15:05.930212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.960580 (+1030368us) service_pool.cc:224] Handling call
0709 13:15:06.960943 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.973203 (+ 12260us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:07.119900 (+146697us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.824996 (+705096us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18003a0420. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fececc343c7 00007fece92469a7 00007fece92560bf 00007fece9256038
0709 13:15:07.849392 (+ 24396us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.875273 (+ 25881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.875382 (+   109us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:07.875531 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.990041 (+114510us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b540031b5d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:07.990087 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.990221 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39634,"prepare.queue_time_us":792630,"prepare.run_cpu_time_us":169,"prepare.run_wall_time_us":24329,"raft.queue_time_us":13260,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":6883,"spinlock_wait_cycles":54687360,"thread_start_us":183522,"threads_started":2,"wal-append.queue_time_us":281863}
I20260709 13:15:07.962392 12028 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.007171  7256 rpcz_store.cc:276] 0709 13:15:06.785125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.930707 (+145582us) service_pool.cc:224] Handling call
0709 13:15:06.931013 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:07.746082 (+815069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.979186 (+233104us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400058f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:07.979413 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1746172160}
W20260709 13:15:08.022229  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:08.030192  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 218223us
I20260709 13:15:08.024794  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:08.033392  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 253873us
I20260709 13:15:08.033778  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.039219  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2745) took 1255 ms. Trace:
I20260709 13:15:08.042950 11874 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:08.031687 11857 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:08.043985 11857 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.046759 11431 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:08.048249 12030 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:15:08.051106  7257 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:07.964428  7335 rpcz_store.cc:276] 0709 13:15:06.850985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.051712 (+200727us) service_pool.cc:224] Handling call
0709 13:15:07.058947 (+  7235us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:07.068275 (+  9328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:07.068321 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:07.149862 (+ 81541us) log.cc:844] Serialized 52 byte log entry
0709 13:15:07.375013 (+225151us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:07.940464 (+565451us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.963372 (+ 22908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.963515 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:07.963614 (+    99us) raft_consensus.cc:1685] finished
0709 13:15:07.963635 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.963819 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":477414,"prepare.queue_time_us":546825,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":11010,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":119,"thread_start_us":240667,"threads_started":2,"wal-append.queue_time_us":243807}
I20260709 13:15:08.039788  7183 rpcz_store.cc:276] 0709 13:15:06.784167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.062301 (+278134us) service_pool.cc:224] Handling call
0709 13:15:07.062619 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:07.704273 (+641654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.038773 (+334500us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b540039d0d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:08.039137 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294053120}
I20260709 13:15:08.040201  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:08.041653  7331 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:15:08.011323 12015 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:15:08.076592  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.076875 12008 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:08.083043  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:07.979499 11485 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.086365  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.096632  7253 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:08.100447  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.089080 12015 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:08.108933  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.088186 11773 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.036989 12027 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.125519 11915 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:08.129216 11726 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.012s
I20260709 13:15:08.130426 11872 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.134192  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:08.135509  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.137301  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 2964) took 2096 ms. Trace:
I20260709 13:15:08.104483 12015 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:08.260160  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.216723  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.140743  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.214824  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.207134  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:08.216318  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 106291us
I20260709 13:15:08.139009  7255 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:15:08.196125  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.138545  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:08.274837  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:08.217036  7228 leader_election.cc:400] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15.
I20260709 13:15:08.192142  7896 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:08.278609  7228 leader_election.cc:403] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:08.199337 11726 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:08.201928 11794 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.673s	user 0.012s	sys 0.015s
I20260709 13:15:08.198053  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:08.192934 11948 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.871s	user 0.013s	sys 0.007s
W20260709 13:15:08.190481 11763 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.552s	user 0.014s	sys 0.006s
I20260709 13:15:08.270746 11872 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:08.289772 11884 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:08.167929 11857 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:08.289443 12040 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:15:08.284667  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.199043 11773 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:08.209959 12027 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:08.282279  7258 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
W20260709 13:15:08.297454  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 227205us
I20260709 13:15:08.211247 11696 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:08.302285  7329 raft_consensus.cc:2410] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:15:08.296303  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:08.294963  7336 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:08.267642  7262 rpcz_store.cc:276] 0709 13:15:05.978275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.747731 (+769456us) service_pool.cc:224] Handling call
0709 13:15:06.748377 (+   646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:07.043308 (+294931us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:07.294270 (+250962us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.705333 (+411063us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.705471 (+   138us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:07.705653 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.040830 (+335177us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54002193d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:08.040873 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:08.074717 (+ 33844us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51868,"prepare.queue_time_us":167190,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":52666,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":390,"spinlock_wait_cycles":678323328,"thread_start_us":602977,"threads_started":2,"wal-append.queue_time_us":358477}
I20260709 13:15:08.316346  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:08.290014 11485 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:08.319777  7253 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:08.317776  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:08.325174  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 186727us
I20260709 13:15:08.325912  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:08.331986 11726 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.333087  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.333593 12015 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.335402 12015 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:08.338030  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.339716 11773 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:15:08.341136 11390 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.603s	user 0.014s	sys 0.001s
I20260709 13:15:08.341234  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:08.344120 11786 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:08.344853 11786 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:08.344731 11879 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.351734 11238 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:08.352046  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 58166.4us
W20260709 13:15:08.353106  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.351739 11879 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:08.347510  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 207061us
I20260709 13:15:08.347965 11794 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:08.347919 12027 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:08.348310  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 48106.9us
I20260709 13:15:08.364852  7256 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:15:08.367187  7330 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:08.372852  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.371012 11879 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:08.368306 11794 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.374833 11238 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:08.376659  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:08.377321 12027 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.381182  7253 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:15:08.384449  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:08.384514 11975 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:08.385526 11975 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.386082  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:08.386726 11878 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15.
I20260709 13:15:08.395064 11963 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.395879 11963 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.399765  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:08.400692 11870 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:08.400746 11886 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:15:08.405409  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 190862us
I20260709 13:15:08.407963  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:08.393440 12027 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.403312 11431 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:08.417858  7253 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 9: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:08.419790 11963 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.415030 11886 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.421598 11886 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.414568 11878 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:08.442550  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.446560  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:08.445611  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:08.469797  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:08.487044  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.425918 11975 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:08.491143  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 81750.2us
I20260709 13:15:08.494400  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.494779  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:08.495622  7253 raft_consensus.cc:2410] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:08.492498 11694 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:08.426802 11773 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:15:08.500991 11773 consensus_queue.cc:1243] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:15:08.501327  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 74216.1us
W20260709 13:15:08.502374  7332 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.012s	sys 0.017s
I20260709 13:15:08.502691  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:08.504308 11763 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:08.504823 11687 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:08.505158 11763 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.503319 12008 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:08.510254 11794 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.510802 11879 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:08.510967 11975 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:08.499724 11963 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:08.512699 12000 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:15:08.512429 11963 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:08.514156  7332 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.013s	sys 0.017s
I20260709 13:15:08.448441 11878 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:08.528370 11765 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:08.528755 11963 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.528913  7258 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:08.529361  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:08.513180  7150 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:08.542737 11975 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:08.547487  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.547530  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.515916 11804 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:08.550453  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.552134  7258 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:15:08.554028  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:08.554394  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 124811us
I20260709 13:15:08.557431  7336 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:15:08.553969 11878 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.559062  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:08.559669  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.560591 11886 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.561219 12028 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:08.561700 12028 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.562105 12028 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:08.562731  7328 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:08.563802  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.564755  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:08.559707  7327 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:08.566298  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.567206  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.559661  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.558265 11869 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:08.581571  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.579115  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.584080  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.580083  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.587628  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.584786  7889 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:15:08.588871  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.574877 11886 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:08.616194  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 103092us
W20260709 13:15:08.620364  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.622121  7892 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:08.628361  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.630774  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.631816  7888 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:15:08.604372 11880 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.633174 11880 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.635679 11880 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.637213  7260 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:08.605573 11869 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.637288  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:08.646178  7258 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:08.650420  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:08.655826  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:08.656973  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:08.659375  7327 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:08.572328 11765 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.661240  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.660506  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.665158  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.666497  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.667119  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:08.673549  7333 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:08.676982  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:08.654731 11773 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.662952 11874 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.687049  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:08.661026 11857 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:08.679523  7336 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:08.688639  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.666525 11485 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:08.697247 11733 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:08.697746 11733 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.698132 11733 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:08.703141  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 95145.3us
I20260709 13:15:08.692826  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:08.709733  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:08.716956  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 66639.2us
I20260709 13:15:08.707127 11773 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.721640  7185 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:15:08.726207  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 99036.3us
I20260709 13:15:08.726312  7261 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:08.728298  7331 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:08.665230 12008 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:08.695845 11485 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:08.733377  7150 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:08.677706 11886 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.694690 11874 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.734341  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:08.742763  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:08.743839  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:08.744485  7329 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:08.717247 11869 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.735394 11804 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:08.753921  7182 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:15:08.757373 12014 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:08.757968 12014 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.758713 11773 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:08.758962  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:08.759382 11773 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:08.759747  7186 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:08.771319  7333 raft_consensus.cc:2410] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:15:08.750953 12008 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.760738 11564 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:08.773607  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.774304 11886 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:08.774765  7327 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:08.777845  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:08.783082  7888 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:08.783852  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:08.784919 11485 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.787415  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.788698 11733 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.792200  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.792984  7335 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:08.794222  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.790546 11763 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.759879 11773 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:08.795775  7896 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:08.797219  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.800485 12014 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.804462  7335 raft_consensus.cc:2410] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:15:08.801142 11773 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:08.786365 11485 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:08.805631  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:08.811480  7335 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:08.813606 11874 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.814498  7334 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:15:08.814354 11872 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:08.811794 12052 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.281s	user 0.003s	sys 0.000s
I20260709 13:15:08.814924  7334 pending_rounds.cc:85] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 5
I20260709 13:15:08.794858 11733 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:08.808658 11763 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:08.811589 12008 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:08.818174  7334 pending_rounds.cc:107] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 11.6
W20260709 13:15:08.825011  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 128624us
I20260709 13:15:08.826234  7334 raft_consensus.cc:2889] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:08.841035  7331 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:08.841915  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.845546  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:08.847085 11948 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:08.848268  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:08.848984  7894 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:08.850966  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:08.851356  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:08.851974 11948 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:08.832860 11733 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:08.852404 11948 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:08.852819 11948 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:08.854714 11763 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.856848 11763 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.859026  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:08.860409  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:08.845561  7329 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:08.861346  7332 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:15:08.863397 12028 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.864641  7330 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:08.863399 11971 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:08.865345 11948 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:08.867736 12028 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:08.869845  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:08.870188  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:08.871004  7184 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:08.871511 11786 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:08.871984 11786 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.872058 11804 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:08.872429 11786 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:08.872520 11804 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:08.873525  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:08.875201 11765 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.877564 11872 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.878379  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:08.879453  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:08.879659 11733 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:08.880115 11733 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.880313 11687 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:08.880503 11733 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:08.880795 11687 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.881201 11687 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:08.883106 11564 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:08.879459  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 146216us
I20260709 13:15:08.879484  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:08.884533  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:08.885269  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:08.885509 11696 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:08.886163  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:08.883177  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 99459.2us
I20260709 13:15:08.887269  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:08.887524  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 687) took 1026 ms. Trace:
I20260709 13:15:08.883571 11564 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.887980  7178 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:08.888320 11564 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:08.888010  7152 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:08.892331  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:08.893573 11857 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:08.894496  7333 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:08.896984  7333 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:08.897115  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:08.898167 12050 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:15:08.901444  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:08.904006  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:08.875316  7334 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:08.904320  7186 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 9.
I20260709 13:15:08.904421  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:08.905153  7184 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:08.894367 11857 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:08.906036 11857 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:08.906427 11857 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:08.887928  7328 rpcz_store.cc:276] 0709 13:15:07.865343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.207987 (+342644us) service_pool.cc:224] Handling call
0709 13:15:08.530172 (+322185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:08.563134 (+ 32962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.887339 (+324205us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54001d29d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:08.887469 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740098816}
I20260709 13:15:08.899102  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:08.909490  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:08.910259  7187 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:08.901038  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:08.898236  7178 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:08.900632  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:08.886564  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:08.912884  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:08.922130  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:08.926193  7892 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:08.931363  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.931995  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.932497  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.932834  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.933807 11857 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.965191 11857 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:08.916692 11975 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:15:08.966897  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 224228us
I20260709 13:15:08.926878 11431 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:08.910579 11773 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.935597  7185 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:08.976836  7335 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:15:08.935184  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49114.6us
I20260709 13:15:08.967950  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:08.935997  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.936656  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:08.929840  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:09.007323  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 77545.5us
W20260709 13:15:08.978396  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56393.5us
I20260709 13:15:08.916481  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:09.008389  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:08.933465  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:08.937397  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:09.014580  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:09.010080  7258 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:09.016814  7184 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:15:08.938050 11870 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:08.968794 11733 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:08.954983 11687 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:08.951558 12068 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:15:08.934731 12008 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:08.932428 11765 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:15:09.056945 11763 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:08.952705 12070 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:09.059566 12070 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:09.060056 12070 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:09.060534 12070 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:08.929715 11963 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.063040 11963 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.047679 11872 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:09.065479 11872 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.065696 11963 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:09.065991 11872 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:09.006450 11431 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.068460 11431 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:08.934157  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:09.044700  7260 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:09.003696 11975 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:09.043635 11915 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.070132 11975 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:08.927057 12027 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:09.070590 11915 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.071202 11975 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.009177 12028 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:09.072834 11915 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:09.073038 12028 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.073489 12028 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:09.074198 11948 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:08.911247 12066 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:15:09.047573 11696 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:09.049705 12069 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:09.075314 11696 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:09.076504  7187 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:09.076654 11687 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:09.077725 11696 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:09.051460 11733 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:09.051051 11773 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:09.052202 11857 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:09.075254  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:09.078992 11857 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:09.079403  7329 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:08.945760 11485 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
W20260709 13:15:09.053586  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46183.4us
I20260709 13:15:09.080974  7150 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.081166  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:08.954303 11564 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.075943 12069 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:08.912891 11804 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.079454 11857 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.083101  7253 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:09.082959  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:09.084264  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 153491us
I20260709 13:15:09.084947  7862 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.071215 12027 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:09.087906 11794 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:09.088994  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.083854 12069 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:09.084146 11485 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:09.102416  7182 raft_consensus.cc:2368] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 10. Current term is 11.
I20260709 13:15:09.085127 12008 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:09.087356 12027 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:09.109309  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.110659 11799 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:09.111387 11799 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:09.113678 11799 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:09.115221 11799 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:09.128710  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 242210us
I20260709 13:15:09.100082 11794 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:09.103030 11726 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:08.950340 11786 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.103585 11485 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:09.139230  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:09.139814 11804 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:09.147317  7150 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.171550  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:09.174978  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:09.174978  7260 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:15:09.152359 11794 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:09.153653 11765 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.154809 11726 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.178704  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:09.180891  7895 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:09.181624  7253 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:09.182176 12069 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:09.186736  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.184737  7254 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
W20260709 13:15:09.184916  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 245766us
I20260709 13:15:09.188489  7302 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.190043  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:09.191344  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44147.8us
I20260709 13:15:09.192014  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:09.194432  7302 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.170194 12008 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.194988  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:09.195648  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 227873us
I20260709 13:15:09.200702 11564 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:09.201691 12065 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:09.202201 12065 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.198944 11870 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:09.203367 11696 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:09.203657 11870 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:09.204280 11870 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:09.204033 11696 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.204913  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.205693 12015 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:09.206096 12015 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:09.203094  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:09.214275 12072 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:15:09.196607 12071 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:09.220084 11786 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:09.220793 11874 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:09.221722 11874 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:09.222081 11874 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:09.222903 11874 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.224524 11485 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.196780 11765 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:09.226712 12008 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.203697 12014 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:09.247529  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:09.249111  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 63062us
I20260709 13:15:09.186766 11726 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:09.257220  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54230.9us
I20260709 13:15:09.258136  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:09.259395 11804 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:09.260304  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:09.202538 12065 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:09.206427 11696 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:09.263536 11948 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.264170  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.249377  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.268143  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:09.275787  7329 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:09.206470 12015 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:09.198479 11431 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:09.273458  7896 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:09.277711  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.282814  7862 leader_election.cc:400] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 10. Current term is 11.
I20260709 13:15:09.253333 12014 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:09.285614  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 93641us
I20260709 13:15:09.293210  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:09.295120  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.261650 11564 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:09.300889  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:09.303705  7069 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 242a63190870450082200759c7f513ab with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 6
I20260709 13:15:09.296416 11696 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:09.315218 11696 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:09.315771 11696 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:09.322978 11431 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:09.323659 11431 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.324126 11431 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:09.296264 11799 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:09.327136 11799 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:09.327654 11799 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:09.281580 11886 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:09.331135 11886 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:09.332412 11886 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:09.335203  7082 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 152) took 53355 ms (client timeout 15000 ms). Trace:
I20260709 13:15:09.335068  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:09.337838 12074 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:09.338979 11765 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:09.340524 12008 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:09.274549 11773 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:09.342355 12070 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.344735 12070 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:09.262490 11485 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:09.342924 11773 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:09.299834 12014 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:09.383733  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 88711.7us
I20260709 13:15:09.384625  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.386116  7259 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:09.386446 11687 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:09.386989 11687 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:09.387373 11687 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.395735 11687 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.401605 11870 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.417709 11870 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:09.427313 11763 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:09.428210 11763 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.358560 12008 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:09.431195 12008 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:09.432564 12008 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.440668 11874 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:09.377857 11773 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:09.363890  7258 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
W20260709 13:15:09.447576  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 166910us
I20260709 13:15:09.448921  7225 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:09.449909  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:09.450453  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:09.450971 11733 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:09.451524 11733 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.451961 11733 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.453325 11915 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:09.453853 11915 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:09.456612 12070 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:09.463261 12027 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.464591 12074 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:15:09.483253  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 197452us
I20260709 13:15:09.466449  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:09.486047  7258 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:09.526688  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 262610us
I20260709 13:15:09.528003  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.441035 11726 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.549264 11799 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.549921 11857 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.551585 11799 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:09.552059 11857 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:09.553057  7083 catalog_manager.cc:5697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.555193 12014 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.555378  7083 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 9, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 9 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:09.557192  7083 catalog_manager.cc:5697] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:09.558724 11763 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:09.559176  7083 catalog_manager.cc:5697] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 12, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 12 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:09.559402 11763 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:15:09.335726  7082 rpcz_store.cc:269] 0709 13:14:16.044835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.046914 (+  2079us) service_pool.cc:224] Handling call
0709 13:15:09.334967 (+53288053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:07.578312 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:07.583577 (+  5265us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:07.583629 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:15:07.583651 (+    22us) tablet.cc:662] Decoding operations
0709 13:15:07.584091 (+   440us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:07.584173 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:07.584214 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:07.584470 (+   256us) tablet.cc:701] Row locks acquired
0709 13:15:07.584497 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:15:07.584693 (+   196us) write_op.cc:270] Start()
0709 13:15:07.584850 (+   157us) write_op.cc:276] Timestamp: P: 1783602907584630 usec, L: 0
0709 13:15:07.584875 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:15:07.587622 (+  2747us) log.cc:844] Serialized 536 byte log entry
0709 13:15:08.132745 (+545123us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54000aa8a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a6090 00007fece91b36b8 00007fece91b32fa 00007fece9237965 00007fece9237e09 00007fececc72581 00007fececc71d58 00007fececc769f1 00007fececc769a9 00007fececc76939 00007fececc76901
0709 13:15:08.224658 (+ 91913us) op_driver.cc:464] REPLICATION: finished
0709 13:15:08.606381 (+381723us) write_op.cc:301] APPLY: starting
0709 13:15:08.646950 (+ 40569us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:08.759370 (+112420us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000aa354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923932a 00007fece91bef14 00007fece91beec3 00007fece91bee38 00007fece91bedf3 00007fece91be0dc 00007fece91e7e16 00007fece91cfcbb 00007fece91ba39d 00007fece91bdd75
0709 13:15:08.775863 (+ 16493us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:08.775905 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:08.776651 (+   746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:08.776888 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:15:08.776953 (+    65us) write_op.cc:312] APPLY: finished
0709 13:15:08.777306 (+   353us) log.cc:844] Serialized 25 byte log entry
0709 13:15:08.777485 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:08.777615 (+   130us) write_op.cc:454] Released schema lock
0709 13:15:08.777668 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:08.810160 (+ 32492us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:08.810193 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":386868,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":357538,"apply.run_cpu_time_us":5119,"apply.run_wall_time_us":207550,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":596980,"prepare.run_cpu_time_us":34781,"prepare.run_wall_time_us":557337,"raft.queue_time_us":204108,"raft.run_cpu_time_us":19527,"raft.run_wall_time_us":647532,"replication_time_us":639445,"spinlock_wait_cycles":526335744,"thread_start_us":796722,"threads_started":4,"wal-append.queue_time_us":157870}]]}
I20260709 13:15:09.487687 11872 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.567958  7083 catalog_manager.cc:5697] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:09.570272 11390 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:09.492859 11733 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.581967 11872 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:09.583005 11733 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:09.583665 11733 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:09.584466 11733 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:09.572229 11726 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:09.585772 11726 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:09.586105 11726 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:09.587137 11726 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.573736 12027 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:09.589823  7083 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:09.559576 12014 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:09.500651 12028 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:09.609432  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 225516us
I20260709 13:15:09.613883  7083 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:09.646431  7083 catalog_manager.cc:5697] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:15:09.654524  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 269965us
I20260709 13:15:09.520084 11915 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.662271  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:09.661229  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 203054us
I20260709 13:15:09.660265  7083 catalog_manager.cc:5697] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 13, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 13 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.634176 11696 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.665196 11948 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:09.665505 11804 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:09.682101  7083 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:09.693159  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 168232us
I20260709 13:15:09.701045 11975 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:09.703482 11564 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:09.707224  7083 catalog_manager.cc:5697] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 14, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 14 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:09.724291  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:09.723182  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:09.726356  7182 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:09.727072  7185 raft_consensus.cc:2368] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 10. Current term is 11.
I20260709 13:15:09.727398  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:09.728240  7180 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:09.721140  7083 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 14, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 14 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:15:09.740006  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 80425.7us
I20260709 13:15:09.739866  7083 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 10 to 12, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 12 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:09.743018 12091 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:09.743471 12091 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:09.743675  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:09.744307 12091 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.745419 12091 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.742667 12085 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:09.746829 12085 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:09.747869  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:09.747733 12085 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:09.748618  7257 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:09.748960 12085 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:09.749293  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:09.748317  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:09.750869  7258 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
W20260709 13:15:09.755285  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 225227us
I20260709 13:15:09.757027  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:09.757973  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 235495us
I20260709 13:15:09.747476  7083 catalog_manager.cc:5697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:09.756484  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:09.765584  7187 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
W20260709 13:15:09.733850 11794 consensus_meta.cc:287] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 13:15:09.759491  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:09.771031  7895 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:09.772174  7083 catalog_manager.cc:5697] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 5 to 10, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 10 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:09.770417  7260 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:09.782090  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:09.783911  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:09.784976  7186 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:09.786024  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:09.788542  7083 catalog_manager.cc:5697] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.751116 12074 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:09.792196  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:09.796393  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:09.797017  7261 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:09.733687 12094 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:09.801694  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:09.793331  7178 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:15:09.795123  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:09.797276  7187 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:09.800316  7181 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:09.791687  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:09.802763  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:09.728411 12087 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 13:15:09.838709  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 169666us
I20260709 13:15:09.840131  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:09.845818  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:09.796041 12014 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:15:09.848897  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:09.849551  7186 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:09.840900  7184 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:09.845737  7301 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:09.848369 12014 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:09.851572 12014 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:09.852029  7183 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
W20260709 13:15:09.852943  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 163882us
I20260709 13:15:09.854548  7182 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:15:09.793056 12069 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:15:09.859532  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 189997us
I20260709 13:15:09.862196  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:09.862879  7896 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:09.864681  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:09.878924  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:09.884068  7332 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:09.894776  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:09.895136  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:09.780342 11794 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:09.948153  7336 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:09.900046  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:09.951128  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:09.952531  7896 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:09.954979  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:09.956002  7331 raft_consensus.cc:2368] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16.
I20260709 13:15:09.954083  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:09.964151  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:09.966874  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 99265.2us
I20260709 13:15:09.969113  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:09.977710  7333 raft_consensus.cc:2410] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:15:09.979521  7181 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:09.877521 11763 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:09.877337 11886 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:09.981525  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 105152us
I20260709 13:15:09.985737  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:09.855743 12071 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:15:09.995086  7260 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:15:09.999122  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:09.992177  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 200363us
I20260709 13:15:10.000605  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:10.000819  7256 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:09.859874 11564 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:15:09.950174 12028 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:10.007278  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.003458  7186 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:10.009476  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:10.013645  7178 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:15:10.015265  7259 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:10.015448  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:10.015002  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:09.970233 12098 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.018250  7181 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:10.042130  7083 catalog_manager.cc:5697] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 11, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 11 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:09.852335 12014 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.018879  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:09.981889 11763 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.852802 12094 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.051599  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:10.055735  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:10.056248  7896 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:10.054782  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:10.063318  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:10.064080  7889 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.014915 11915 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:10.060014  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 61039.4us
I20260709 13:15:10.066026  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:10.045679 11872 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:10.043202 11696 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:10.057394 11763 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:10.084710  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:10.085783  7186 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:10.086550  7254 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:15:10.082929  7083 catalog_manager.cc:5697] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 5 to 9, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 9 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:09.979038 11765 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:10.074721  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:10.008441 11948 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.088027  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:10.089145  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:10.095806  7302 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:10.018180 11886 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.049765 12081 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:15:10.104486  7259 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:10.105945  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:10.109426  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:10.109537  7889 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:10.098433 11765 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.111128 12104 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:10.102151 12099 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:15:10.089107 12015 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.001s
W20260709 13:15:10.114364  7152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.611s (SENT) [suppressed 27 similar messages]
I20260709 13:15:10.103332 11794 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:10.101930 12086 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:15:10.089015 12008 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:15:10.107455 11485 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.002s
I20260709 13:15:10.118615  7187 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:10.118009  7181 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:10.139318  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:10.092456 12014 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:10.145233  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:10.076524 11872 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:10.049539 12098 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.140666  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:10.152292  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:10.153036  7302 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:10.120347 11886 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:10.118703  7083 catalog_manager.cc:5697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.147945  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.134773  7254 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:10.150592  7178 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:10.138563 12008 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:10.084301 11915 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.105394 11948 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.138190 12099 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:10.140857 11857 raft_consensus.cc:2764] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:15:10.261236  7083 catalog_manager.cc:5697] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 11, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 11 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:15:10.262071  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 116938us
I20260709 13:15:10.130417 12015 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:10.263325  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.264685  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:10.266233  7187 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:10.151846 11687 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:10.268416  7257 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:10.195309 11872 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.234987 12028 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:10.069880 12074 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.258391 11886 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:10.314081 12008 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.264017 12115 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:10.318886  7083 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 15, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 15 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:10.295217  7185 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:10.305233  7187 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:10.308122 12099 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:10.309664 11431 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.985s	user 0.009s	sys 0.003s
I20260709 13:15:10.310379 11915 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:10.267530 12069 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:10.337651  7182 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
W20260709 13:15:10.358839  7180 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
I20260709 13:15:10.367216  7180 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:10.367882  7181 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:10.369192  7150 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:10.384115 11687 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:10.384717  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:10.391050  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 276697us
I20260709 13:15:10.395056  7182 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:10.396327  7180 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:10.360592 11915 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.409300  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:10.388945 12008 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:10.415624 11915 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:10.418932 12113 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:15:10.431200 12109 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:15:10.431512  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 46894.3us
I20260709 13:15:10.439213 12123 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:10.344951 12115 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.449666 12115 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:10.455014 11726 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:10.456007  7083 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:10.457587  7083 catalog_manager.cc:5697] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 8, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 8 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:15:10.460247 12088 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.578s	user 0.006s	sys 0.000s
I20260709 13:15:10.346941 11431 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.465903  7083 catalog_manager.cc:5697] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 10, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 10 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:10.464293 11886 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:10.472291 12117 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:15:10.472092 11886 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:10.480762 12065 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.200s	user 0.011s	sys 0.001s
I20260709 13:15:10.481279 12065 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:10.484766 11773 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.041s	user 0.013s	sys 0.000s
I20260709 13:15:10.485234 11773 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.486284  7253 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:10.489449 11874 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.490037 11874 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.496032  7892 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:10.491806  7083 catalog_manager.cc:5697] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.453178 11763 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:15:10.497742  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 85233.4us
I20260709 13:15:10.508265  7083 catalog_manager.cc:5697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 10, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 10 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.524899  7327 raft_consensus.cc:2368] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
I20260709 13:15:10.507405 11687 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:15:10.502429 12115 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:15:10.531564 12028 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:10.540167  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 107173us
I20260709 13:15:10.546895  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:10.541074  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:10.550594 11726 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:10.539958 12070 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.009s	sys 0.004s
W20260709 13:15:10.551358 12070 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.009s	sys 0.005s
I20260709 13:15:10.551155 11726 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.551638 12070 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:10.552721 12070 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.556595 11564 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:10.558087  7150 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:10.561715  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:10.559840  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:10.568040 12094 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:10.569249  7187 pending_rounds.cc:85] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 6
I20260709 13:15:10.569630  7187 pending_rounds.cc:107] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:15:10.569864  7187 raft_consensus.cc:2889] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:10.571012  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.572669  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.573297  7184 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:10.574226  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:10.574852  7181 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:10.574976  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:10.575459 12015 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:10.562511 12087 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:10.577636 12100 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:10.579574  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.580217  7179 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:10.582227 12127 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:10.582918 12127 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:10.583863 12127 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.584528 11872 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.586917  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:10.587711  7256 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:10.589433 11696 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:10.589995 11696 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:10.590440 12081 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:10.590847 11696 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.591179 12081 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.577852  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:10.570350  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.597389  7888 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:15:10.600423  7261 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.000s
I20260709 13:15:10.601244  7261 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:10.626309  7254 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:10.633801  7255 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
W20260709 13:15:10.641208  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 81434.1us
I20260709 13:15:10.647279  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:10.654927  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 90285.3us
I20260709 13:15:10.657624  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:10.658349  7183 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:10.655216  7181 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:10.661275  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:10.661477  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:10.662160  7329 raft_consensus.cc:2410] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:15:10.664181  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.665100  7181 raft_consensus.cc:2410] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:15:10.661370  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:10.666575  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:10.667689  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:10.543087 12123 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:15:10.674909  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:10.675547  7254 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:10.669253  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:10.670383  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 108821us
I20260709 13:15:10.671689  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:10.679152  7327 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:10.672166  7895 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:15:10.680826  7336 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:10.666821  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:10.672369  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:10.681962  7261 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:10.684494  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:10.684864  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:10.652066 11872 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:10.687305  7225 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:10.662385 12094 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:10.666795 12095 raft_consensus.cc:2764] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:15:10.664937 12069 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:10.694773  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:10.695534  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:10.698937  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:10.699416  7180 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:15:10.696883  7150 leader_election.cc:400] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16.
I20260709 13:15:10.700111  7150 leader_election.cc:403] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:10.709451  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:10.690246 12014 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:10.718894 12130 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.719338 12137 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:10.719537 12130 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.722297 12131 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.722918 12131 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.725162 12131 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:10.725714 12082 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:15:10.727454 12124 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.728021 11431 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:10.728704 11431 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:10.729182 11431 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.729842 12137 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:10.731480 12080 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:10.731887 12080 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:10.732669 12080 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.733857 12080 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:10.700580 12074 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:10.737234  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.728025 12124 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.738441 12069 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:10.753713  7185 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
W20260709 13:15:10.742189 12091 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.996s	user 0.003s	sys 0.003s
I20260709 13:15:10.743793 11773 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:10.768174  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 66891.8us
I20260709 13:15:10.752895  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3007) took 1024 ms. Trace:
I20260709 13:15:10.707227 12100 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16.
I20260709 13:15:10.715109 12014 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:10.754793  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 45463.2us
I20260709 13:15:10.763310  7183 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:10.715723 12015 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:10.770031  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:10.766346  7180 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:10.748587 11431 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:10.771536  7888 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:15:10.771962 12083 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.772653  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.773478  7179 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:10.772459 12083 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.774232  7225 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:10.776180  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:10.779026 12075 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:10.779582 12075 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:10.780083 12124 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:10.780743 12081 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:10.780500 12075 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.781296 12014 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.783514  7225 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:10.776707 12074 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:10.777652 11773 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:10.784371 12130 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:10.776413 12083 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:10.785876  7333 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.785934  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:10.717037 11763 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:10.768916  7255 rpcz_store.cc:276] 0709 13:15:09.728868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.733704 (+  4836us) service_pool.cc:224] Handling call
0709 13:15:10.633633 (+899929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:10.644639 (+ 11006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.752604 (+107965us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b540034a3d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:10.752811 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103719168}
I20260709 13:15:10.756656 12069 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.788198  7332 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:10.792181  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:10.792682  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.752566 12094 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:10.787564  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 120818us
I20260709 13:15:10.800606  7185 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:10.801848  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:10.802474  7332 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:10.688999 12028 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.803771  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:10.804751  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:10.771304 12070 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.807170  7862 leader_election.cc:400] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 10 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 10. Current term is 11.
I20260709 13:15:10.793506 12074 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:10.810988 12074 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:10.811394 12136 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:10.809540  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:10.795377 11773 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:10.812215  7334 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:10.812513 11773 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:10.813439 11773 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.813746  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:10.814522  7185 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:10.817837 12082 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.818442 12082 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.819476  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:10.820024  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:10.820611  7331 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:10.811470 12074 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:10.803885 12130 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:10.826429 12130 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.827418 12082 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:10.828073 12106 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:10.828588 12130 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:10.828642 12106 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:10.829785 12106 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.821007  7183 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:10.823350  7150 leader_election.cc:400] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
I20260709 13:15:10.798712 12069 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:10.834061 12083 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:15:10.840934  7150 leader_election.cc:403] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:10.841379  7334 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:10.850729  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:10.841940  7332 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:10.842366  7333 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:10.845484  7330 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:15:10.853431  7330 pending_rounds.cc:85] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 6
I20260709 13:15:10.853672  7330 pending_rounds.cc:107] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:15:10.853941  7330 raft_consensus.cc:2889] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:10.806932 12081 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:10.805819 12015 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:10.853116  7335 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:10.852059  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:10.857357  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:10.857616  7334 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:10.857837  7187 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:10.855365  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:10.862090  7332 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:10.862591 12008 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:15:10.854984 12085 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.106s	user 0.005s	sys 0.007s
I20260709 13:15:10.868103  7328 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:15:10.870357  7331 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:10.869668  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.872901  7187 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:15:10.876633 12105 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:10.872535 12081 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.848933 12070 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.879290 11963 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:10.880326 12095 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:10.880669 12095 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:10.881085 12081 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:10.881814  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.881484 12095 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.884809  7260 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:10.883934  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:10.857179 12135 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
I20260709 13:15:10.888370  7179 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:10.890816 12095 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:10.860699 11564 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:15:10.931303 11564 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:10.931716 11564 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:10.932552 11564 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.890254 12070 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:10.872166 12008 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:10.934921 12008 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:10.935526 12074 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:10.937758 12074 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:10.881510 11765 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:10.921057 12015 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.079994  7185 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:11.215754  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:11.219995 12083 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:11.220584 12083 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:11.223632  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:11.225023  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:11.225133  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:11.221522 12083 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.225756  7889 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:11.229671  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:10.902932 12100 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.226267  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:11.225286  7895 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:11.226058  7327 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:11.231006  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:10.933861 11564 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:11.230861 12071 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:11.249646  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.255551  7327 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:11.241349 12100 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.340518 12100 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:11.350579 12027 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.351344 12027 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.354100 12027 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.355793  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:11.356962  7327 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:11.270776 12071 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:11.363016 12142 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:15:11.367480  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 680) took 1310 ms. Trace:
I20260709 13:15:11.372104  7892 rpcz_store.cc:276] 0709 13:15:10.055021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.055426 (+   405us) service_pool.cc:224] Handling call
0709 13:15:11.364940 (+1309514us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400661554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:11.365093 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980873984}
I20260709 13:15:11.376946 12070 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:11.377648 12070 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.379772 12070 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:11.380066 12071 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.380481 11963 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:11.381033 11963 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:11.382704 12014 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
W20260709 13:15:11.407495  7152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.004s
W20260709 13:15:11.408170  7152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.008s	sys 0.004s
W20260709 13:15:11.408577  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 510065us
I20260709 13:15:11.412690  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:11.413681  7330 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:11.414805  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:11.425904  7334 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
W20260709 13:15:11.403214 12148 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.495s	user 0.000s	sys 0.003s
I20260709 13:15:11.428198 11857 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:11.426129 11696 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:11.440496 12123 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.451943 11915 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:11.450526 12123 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.453521 12098 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.454509 11948 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:11.446362 12008 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.029s	sys 0.034s
W20260709 13:15:11.455933 12008 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.029s	sys 0.034s
I20260709 13:15:11.412322 12014 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.471817  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 901) took 2022 ms. Trace:
W20260709 13:15:11.472224 12150 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:15:11.480297  7253 rpcz_store.cc:276] 0709 13:15:09.449128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.449267 (+   139us) service_pool.cc:224] Handling call
0709 13:15:09.449605 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:10.486671 (+1037066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.471523 (+984852us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001a3454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:11.471726 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2383731072}
I20260709 13:15:11.459215 11963 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.469857 12157 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.512457  7185 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:11.471621 11726 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.516404  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:11.496291 11857 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:11.516423  7180 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:11.519731  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:11.521085  7187 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
W20260709 13:15:11.514344 12080 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.780s	user 0.012s	sys 0.002s
I20260709 13:15:11.521529  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:11.514740 12069 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.658s	user 0.005s	sys 0.006s
I20260709 13:15:11.524016  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:11.526137  7179 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:11.526968 12075 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:11.527601 12075 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.529865 12075 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:11.531025  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:11.531775  7187 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:15:11.532179  7187 pending_rounds.cc:85] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 7
I20260709 13:15:11.534065  7178 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:11.532392  7187 pending_rounds.cc:107] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:15:11.536546  7187 raft_consensus.cc:2889] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:11.530583 12098 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.530408 12074 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.540306  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:11.532996 12069 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.540549 12090 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.544915 12090 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.545466 12069 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:11.515201 12157 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.547111 12014 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:11.548316 12090 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.548483 12157 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.550433  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1859) took 1581 ms. Trace:
I20260709 13:15:11.541664 12074 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.550881  7260 rpcz_store.cc:276] 0709 13:15:09.968577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.108248 (+139671us) service_pool.cc:224] Handling call
0709 13:15:11.550231 (+1441983us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b5400226ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:11.550338 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712872192}
I20260709 13:15:11.552728 12074 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.554812 12082 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:11.555425 12082 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:11.556666 12082 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.558063 12082 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:11.558497 11857 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.560441  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:11.562963  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.563395  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.564137  7253 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:11.566592  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.567548  7255 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:11.569278  7259 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:15:11.571965  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:11.572818  7261 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:11.554838  7180 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:11.536820 12075 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:11.574757 12075 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.576571 12123 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:11.588702 12155 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:15:11.596704  7862 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:11.598016  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:11.598059  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.598824 11971 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:11.599246 11971 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.599565 11971 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:11.600374  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.601847 11874 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:11.603401 12126 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:11.603986  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:11.604137 12126 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.604900  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:11.605979  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:11.607390 12075 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.607461  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:11.608233  7187 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:15:11.608582 12126 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:11.611354 11726 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:11.611793 11726 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.612128 11726 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:11.614326  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:11.615660  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:11.616372  7262 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 10: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:11.617086  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:11.619998  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:11.623508 11804 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:11.624234  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:11.624114 11804 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.626173 11804 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.626792 12074 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:11.627489 12154 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:15:11.627667 12074 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:11.628136 12074 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:11.629055 12074 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.633795  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:11.633985  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:11.635344  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.638371  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:11.638533  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:11.643451  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:11.643919  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:11.644739  7258 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:11.646137  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:11.646495  7260 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:15:11.617110  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:11.649259  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 77412.2us
I20260709 13:15:11.579557 12069 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:11.650262  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.640017  7862 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:11.659703  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:11.660588  7888 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:11.651153  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.663303  7254 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 9.
I20260709 13:15:11.655216  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:11.664458  7257 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:11.656242  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.665665  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:11.642942 11878 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:11.667737  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:11.668438  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.627702 12065 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:11.541857 12098 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.681607  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:11.681907  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:11.670718  7255 raft_consensus.cc:2410] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:15:11.630684 11804 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:11.675937  7261 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:11.678928  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.637310 11765 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:11.642690 11874 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:11.691586  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:11.692802  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.683050  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:11.684496  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:11.642792 12137 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:11.718672  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:11.719255  7257 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:11.719390  7329 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:11.720427  7333 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:11.719410  7334 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:11.720830  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:11.721719  7332 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:11.687252  7254 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:11.690308  7187 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:11.696792  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:11.698014  7258 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:11.698912 12015 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.736588  7888 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:11.700208  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 61751.7us
I20260709 13:15:11.737684  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:11.700892 12138 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:11.739147  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.678432 12074 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:11.702025 11870 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:11.748975  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.749193  7257 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:11.708736 11687 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:11.710970  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.654119 12123 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:11.691040 12157 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:11.714445 11874 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:11.648679 12070 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:15:11.724707  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:11.725719  7327 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:11.726099  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.691241 11765 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.726907  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:11.761538  7260 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:11.648852 12124 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:15:11.677263 11799 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:11.654202 12158 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:11.730422 12075 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:11.731650  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:11.732692  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:11.716233  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:11.728147  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 87536.3us
I20260709 13:15:11.670959 12090 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:11.735576  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:11.699368 12081 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.733934  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:11.701459 12080 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:11.778008 12069 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:11.744429  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 59990.2us
I20260709 13:15:11.746132  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:11.752426  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 97459.1us
I20260709 13:15:11.752614  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:11.738780 12083 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.037s	sys 0.046s
I20260709 13:15:11.868530 11872 raft_consensus.cc:2764] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:15:11.748404 12015 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.750183 12137 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:11.755604 12028 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:11.744083  7258 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:11.880738 12081 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.771822 11765 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:11.858461  7335 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:11.859889  7256 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:11.885774  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:11.886673  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:11.887954  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.830142  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:11.753639 12157 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.862993 12080 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.863700 12135 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.914738 12135 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.916103 12015 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:11.916916 12135 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.917660  7260 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:15:11.921032 12098 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.924691 12080 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:11.863232 11874 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:11.930529 11857 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.931197 11857 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.933449 11857 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.864459 12091 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:11.934103 12091 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.934504 12091 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:11.866377  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:11.939852  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 73535.5us
I20260709 13:15:11.941787 12099 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:11.941843  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:11.757254 11870 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.942391 12099 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:11.942955 12099 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:11.867213  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 121216us
I20260709 13:15:11.944074 11870 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:11.945050  7299 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:11.868585 12172 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:11.945940 12172 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.948239  7259 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:11.948324 12172 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:11.870090  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:11.949543  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 79539.5us
I20260709 13:15:11.726188 12071 raft_consensus.cc:2764] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:15:11.950839 12074 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:11.951253 12099 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:11.827536  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 103640us
I20260709 13:15:11.951735 11726 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.953130  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1898) took 1102 ms. Trace:
I20260709 13:15:11.953562  7335 rpcz_store.cc:276] 0709 13:15:10.850730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.923195 (+ 72465us) service_pool.cc:224] Handling call
0709 13:15:10.923487 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.890857 (+967370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.952886 (+ 62029us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b540020fdd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:11.953063 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2145386880}
I20260709 13:15:11.755764 12065 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:11.778333 12158 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:11.892710  7261 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:11.897789  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:11.861742 12138 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:11.903901 11971 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:11.906109 12137 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:11.907142 12096 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:11.907789 12169 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:11.892081 12123 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:11.909641 12083 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:11.885106 11878 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:11.912559 11804 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:11.759122  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:11.883565  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 167417us
I20260709 13:15:11.830803 11799 raft_consensus.cc:697] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:11.956182  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:11.958712  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:11.935241  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.986543  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:11.967073 12027 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.023362 12027 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.026269  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:11.991927  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:11.884812 12028 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.956734  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:12.032248  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 73660.5us
I20260709 13:15:12.036918 12028 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:11.985939 12096 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.038489 12096 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:12.038995 11870 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:11.984721 12157 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:12.025230 12116 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:12.037791  7892 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:15:11.954101 11726 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:12.034466  7184 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:12.048163  7256 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
W20260709 13:15:12.063308  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 381436us
I20260709 13:15:12.067355  7225 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:12.072520 11687 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:12.076750  7896 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:15:12.078280 12135 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:12.079587 12135 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:12.080025 12135 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:12.081101 12135 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.022678 12169 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:15:12.089299  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 102839us
I20260709 13:15:11.955032 12099 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:12.095424  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:12.084872  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 58658.5us
I20260709 13:15:11.880311 12090 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:11.967427 12172 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 13:15:12.042843 12168 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:15:12.100780 12090 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.103250  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.103540  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:12.090421  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:12.036499 12158 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:12.066999 12138 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:12.069422 12123 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:12.083662 12110 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:12.030560 11872 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:15:12.113279  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:11.959213 12098 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.138s
I20260709 13:15:12.116117  7260 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:12.093936 11886 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.974591 12091 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.118480  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.123493  7888 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:12.106774 12135 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:12.093878 12169 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:12.130455  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:12.131742 11915 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:12.133232  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.108131 12065 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:12.126845  7260 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:12.139019  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:12.144927  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49569.3us
I20260709 13:15:12.135774 11799 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.157632  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.158241  7331 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:12.158793  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:12.108546 12171 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:12.157017  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.149596 12169 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.160409  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:12.108285 12071 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:15:12.172334  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.173338  7332 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
W20260709 13:15:12.170181  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 79876.8us
W20260709 13:15:12.160852  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 104140us
W20260709 13:15:12.168360  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 53929.1us
W20260709 13:15:12.171005  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 86062.8us
I20260709 13:15:12.126324 12110 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:12.176021  7260 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.207800  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:12.209089  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.209853  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.210525  7328 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:15:12.163596 11915 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:12.227519  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:12.171983 11874 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:12.177776 12126 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:12.231166  7331 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:12.231587  7260 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:12.182945 12106 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.175856 11696 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.241504  7335 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:12.189909 11971 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:12.206064 12127 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:12.266108  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:12.267068  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:12.293812  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 186012us
I20260709 13:15:12.268347  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:12.265319  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:12.295527  7185 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:12.295593  7258 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:15:12.155273 11886 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.275970  7183 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:12.271889  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:12.297053  7261 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:12.272161  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:12.290364  7180 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:15:12.298506  7180 pending_rounds.cc:85] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 12
I20260709 13:15:12.298794  7180 pending_rounds.cc:107] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:15:12.299059  7180 raft_consensus.cc:2889] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:12.230487 12169 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:12.125489 12069 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.158921 12141 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.099s
W20260709 13:15:12.271973  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 79601.5us
I20260709 13:15:12.242863 11874 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.121061 11878 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.230257 12074 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:12.324249  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:12.350356  7178 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:12.350456  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 148890us
I20260709 13:15:12.355628 12091 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:12.226261 12137 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:15:12.271255 12027 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:12.357161  7334 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:12.242180 12176 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 13:15:12.292194 12126 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:12.384594  7888 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:12.360948  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:12.389518  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 70966.1us
I20260709 13:15:12.397794  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:12.399374  7258 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
W20260709 13:15:12.356478 12166 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:15:12.402423  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:12.378573  7185 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:12.376209  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:12.349830 11874 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:12.420101  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.358325 12178 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:12.424562  7894 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:15:12.271622 12075 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:15:12.426261  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69339.6us
I20260709 13:15:12.427516  7327 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:15:12.433893  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57760.2us
W20260709 13:15:12.434614  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.435199  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:12.436923  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:12.271431 12174 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:12.386356 12071 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:12.370211 12168 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:12.324110 12127 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:12.293831 12106 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.453800  7331 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:12.454568  7178 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:15:12.368566 12185 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:15:12.430181 12178 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:12.439015 12075 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:12.443137 11763 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:12.298049 12123 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.300437 11696 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.450809 12174 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.490140  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:12.490872  7183 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:12.473932  7187 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:12.457147 12080 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:12.455030 12071 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:12.475952  7180 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:12.349287 12110 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.458804 12128 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:12.439978 12172 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:15:12.479517  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:12.574087  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 94668.8us
I20260709 13:15:12.465564 11971 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.484308  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:12.540814 11886 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:12.514197 12189 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:15:12.385186 12138 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.421473 12096 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.444248 12028 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.494653 12127 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.475283 11763 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:12.513070 12193 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:12.518959  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:12.492273  7178 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:15:12.492101 12071 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:12.497632 12186 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.517088  7254 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:12.597471  7254 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:12.517712  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:12.536832 12137 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:12.537539  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:12.536849  7187 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:15:12.499851 12174 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:12.530361 11765 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.001s
I20260709 13:15:12.542663  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:12.600170  7892 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 13:15:12.550729  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:12.600884  7333 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 13:15:12.600914  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50434.7us
W20260709 13:15:12.570013  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 140715us
I20260709 13:15:12.515662 11726 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:15:12.570302  7180 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:12.469611  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:12.608062  7185 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:12.499251 12126 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.608596 12106 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:12.609236 12083 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:12.609642 12083 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.609970 12083 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:15:12.611605 12181 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 13:15:12.612854 12190 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:15:12.613742 12190 consensus_queue.cc:1243] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:12.614907  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1870) took 1005 ms. Trace:
W20260709 13:15:12.616431 12179 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:15:12.615293  7255 rpcz_store.cc:276] 0709 13:15:11.609850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.758982 (+149132us) service_pool.cc:224] Handling call
0709 13:15:11.765960 (+  6978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.070000 (+304040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.070126 (+   126us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:12.072244 (+  2118us) log.cc:844] Serialized 26 byte log entry
0709 13:15:12.188942 (+116698us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:12.188991 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.189072 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:12.614692 (+425620us) raft_consensus.cc:1685] finished
0709 13:15:12.614713 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.614849 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102149,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":416001,"threads_started":2,"wal-append.queue_time_us":228054}
I20260709 13:15:12.539093 12075 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:12.586094  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 234888us
I20260709 13:15:12.622027  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1869) took 1012 ms. Trace:
W20260709 13:15:12.614444  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.622434  7253 rpcz_store.cc:276] 0709 13:15:11.609600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.750970 (+141370us) service_pool.cc:224] Handling call
0709 13:15:11.760420 (+  9450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.049909 (+289489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.049963 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:12.105733 (+ 55770us) log.cc:844] Serialized 26 byte log entry
0709 13:15:12.256725 (+150992us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:12.256780 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.257659 (+   879us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:12.621750 (+364091us) raft_consensus.cc:1685] finished
0709 13:15:12.621771 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.621966 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107542,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":51,"thread_start_us":358215,"threads_started":2,"wal-append.queue_time_us":235184}
I20260709 13:15:12.573081 12123 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.591794  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:12.592124 11763 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:12.468717 12168 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:12.607591 12157 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.000s
I20260709 13:15:12.582177 12098 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:15:12.618396 12199 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:15:12.635844  7260 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:15:12.646556  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 54853.4us
I20260709 13:15:12.649917 12098 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:12.654038 12098 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:12.603842 12137 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.657132 12091 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:12.658780  7150 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:12.658910  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:12.601250 12176 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:15:12.659752  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:12.649649 12157 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.661018  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:12.661579 12200 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:12.661968 12157 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:12.587093 11971 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.662436 12159 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:12.662892 12159 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.663254 12159 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:12.662907  7179 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:15:12.664119 12168 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:12.662014 12191 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:12.658561 12137 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:12.668216 12137 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:15:12.668653 12158 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.003s
I20260709 13:15:12.664211 11971 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:12.649528 12190 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:12.681381  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 919) took 1048 ms. Trace:
I20260709 13:15:12.681545  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:12.682250  7260 rpcz_store.cc:276] 0709 13:15:11.632809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.929627 (+296818us) service_pool.cc:224] Handling call
0709 13:15:11.929929 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.115974 (+186045us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54001c5d20. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece923e1c0 00007fece923f231 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c
0709 13:15:12.671638 (+555664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.681241 (+  9603us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392699136}
W20260709 13:15:12.683297  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 145838us
I20260709 13:15:12.684031  7895 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:15:12.668700 12137 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.604993 11765 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.694315  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:12.668480 11874 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.688925 11971 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.650679 12123 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.698359 12137 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:12.669358 12158 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.713872  7335 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:12.722303  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:12.725274  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:12.725828  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:12.726464  7331 raft_consensus.cc:2376] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15. Re-sending same reply.
I20260709 13:15:12.725838  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:12.729807  7257 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:12.730261  7331 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:12.732369  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.734191  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:12.736294  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.737185  7328 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:15:12.719383 12170 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:15:12.739987  7327 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:12.736662  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:12.727594 11696 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:12.742393 11765 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:12.742301 12208 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:15:12.714455 12126 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:15:12.749547  7331 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:12.742393  7334 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:12.716316 11971 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.764209  7896 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:12.737999 12091 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:12.774016 12205 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:12.774541 12205 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.774925 12205 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:12.603576 12186 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.750078 12168 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:12.778386 12083 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.779258 12186 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:12.779834 12186 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:12.750568 12106 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:12.730134 11878 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:15:12.779284 12158 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:12.791074 11878 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:12.791615 11878 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:12.792743 11878 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:12.765748 12028 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:12.780761 12198 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:12.784690 12206 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:15:12.567734 12178 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.732547 12190 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:15:12.794346 11878 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:12.781612 12096 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:12.777309 11696 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:15:12.801152 12106 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:12.886198  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 122260us
I20260709 13:15:12.842456  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.887156  7331 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:12.888281  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:12.907527  7896 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:12.911490  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:12.909184  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:12.805114 12116 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.833870  7254 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.929486  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:12.947638  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:12.831117 12171 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:12.783826 12212 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:15:12.884330 12083 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:12.822427 11874 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:12.943347 12135 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.777s	user 0.008s	sys 0.005s
I20260709 13:15:12.931094 11687 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.831620 12123 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:12.777516 12213 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 13:15:12.896703 12126 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.809809 12176 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 13:15:12.891422 12157 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:12.961488  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 72647.1us
I20260709 13:15:12.831044  7336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:15:12.935072 11799 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:15:12.949138 12192 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:12.974434 12200 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.996459 12126 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.808238 12198 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.836958 11763 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.002369 12091 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:13.005120  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1866) took 1396 ms. Trace:
I20260709 13:15:13.007936  7254 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:13.010114  7152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.000s	sys 0.019s
W20260709 13:15:13.081130  7152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.000s	sys 0.020s
W20260709 13:15:13.081915  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 874171us
I20260709 13:15:13.080309  7257 rpcz_store.cc:276] 0709 13:15:11.608789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.749957 (+141168us) service_pool.cc:224] Handling call
0709 13:15:11.750233 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.730220 (+979987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.004894 (+274674us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54001a2054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:13.005058 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2252367616}
I20260709 13:15:13.016314 12110 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:13.019897 11857 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.026803 11971 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:12.965739 11687 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.032645  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 912) took 1140 ms. Trace:
I20260709 13:15:13.040231  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:13.042065  7330 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:13.044148  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:13.045236  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:13.112601  7183 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:13.046602 12187 raft_consensus.cc:3055] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:13.046975  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:12.994019 12081 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:12.930927 12098 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.117800 11971 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:12.951139 12171 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:13.120568 11971 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:13.120677 11687 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.121522 12098 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.121317 12171 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.122428 12171 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:13.062605  7336 raft_consensus.cc:606] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.123346  7336 raft_consensus.cc:614] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:13.123874  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.064616  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:13.076195  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.125752  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:13.126366 12159 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.088050 12198 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.112179 11857 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:12.950327 12116 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.086709 12173 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:15:13.091760  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.128741 12116 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:13.128933  7332 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:13.079768 11948 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:13.129532 11948 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.130868  7332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:15:13.061908 12168 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.071429 12192 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.111908  7179 rpcz_store.cc:276] 0709 13:15:11.892405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.894529 (+  2124us) service_pool.cc:224] Handling call
0709 13:15:11.924610 (+ 30081us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.663865 (+739255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.032343 (+368478us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b540041aad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:13.032546 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697274752}
W20260709 13:15:13.114495  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 74358.7us
I20260709 13:15:13.102777 12137 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.114490 11763 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.115299  7184 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:13.078745 12157 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.115015 12187 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:13.089546 12106 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.115556  7328 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:13.077837 12200 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.117133  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.117694 12091 consensus_queue.cc:1243] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:15:13.126720  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.131465  7332 raft_consensus.cc:606] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.088475 12126 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:13.132827  7186 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:13.133927  7183 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:13.184279  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.184769  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.185179  7179 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 10.
I20260709 13:15:13.156270  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:13.107064 12169 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.719s	user 0.012s	sys 0.000s
I20260709 13:15:13.159340  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:13.161895  7862 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.163631  7327 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:13.160010 12116 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.155336  7254 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:13.180516  7332 raft_consensus.cc:614] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:13.180953  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54317us
W20260709 13:15:13.167726 12071 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 13:15:13.128741 11857 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.191052  7336 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:13.169778 12192 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:13.191718  7178 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
W20260709 13:15:13.204690  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:13.206084  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45092.5us
I20260709 13:15:13.161917 12087 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:15:13.158906 12123 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:15:13.210021  7896 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:13.125967 12218 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:15:13.186908 12198 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:13.201957 12070 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:15:13.170118 12168 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.121543 11971 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.236577 12197 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:15:13.237824 12174 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.627s	user 0.002s	sys 0.007s
I20260709 13:15:13.237915 11804 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:13.258248 11804 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:13.258445  7336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb0912958bd849238a8f104a7916c427"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:15:13.259135  7336 raft_consensus.cc:606] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.259366 11804 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.260730 11804 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:13.261121 12205 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.262856 12196 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:13.263270 12196 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:13.263425 12205 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.210525 12169 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:13.199100 11687 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:15:13.216171 11485 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:13.270249 11485 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:13.271556 11485 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.255381  7184 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:13.264381 12174 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.281329  7186 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:13.202591 12116 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:13.298249  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 101957us
I20260709 13:15:13.299432  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.299678 12116 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:13.210944 12071 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.302671  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.304507 11799 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.309048  7186 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:13.305267  7892 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:13.305625 12218 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:13.307622  7184 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:13.305151 12091 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:13.328900  7336 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:13.306541 12116 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:13.342096  7186 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:15:13.347155 12191 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:13.347579 11948 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.348387 12191 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:13.348224 12235 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:15:13.349138 12220 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:15:13.350060 12226 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:13.353158 12191 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:13.360425 12191 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.361778 12191 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:13.339298 12106 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:15:13.342972 12218 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:13.365439 12228 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:15:13.367118  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.343766 11687 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:13.369016 11687 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:13.369921 11687 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.371265 11687 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:13.306317 12126 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:13.302363 12176 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.368479  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.383795 12071 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:13.368495 12128 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.788s	user 0.010s	sys 0.000s
I20260709 13:15:13.320621 12198 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:13.398061  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.353669 12087 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:13.400938  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.404803  7330 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:13.408317  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:13.410606  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 198742us
I20260709 13:15:13.411916  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:13.366490 12218 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.414449  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.253682 12187 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:13.418462  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.392184 11948 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:13.452313  7226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.023s
W20260709 13:15:13.452642  7226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.009s	sys 0.023s
I20260709 13:15:13.322495 11799 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.355058 12091 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.421645  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.342474 12194 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.279s
I20260709 13:15:13.457021  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.498950  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.458935  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:13.459576  7186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:15:13.500236  7186 raft_consensus.cc:606] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.500574  7186 raft_consensus.cc:614] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:13.400218 12191 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:13.504112  7892 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:15:13.504068 12191 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.505250 12123 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:13.506497  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.394985 12159 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.461998  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:13.526536  7260 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 13: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:13.450169  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.527513  7333 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:13.413094 12080 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:13.464427 12232 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:13.472383  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.412472 12128 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:13.475070 12200 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.391050 12126 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:13.479782  7262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1867) took 1870 ms (client timeout 1552 ms). Trace:
W20260709 13:15:13.533564  7262 rpcz_store.cc:269] 0709 13:15:11.609051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.616877 (+  7826us) service_pool.cc:224] Handling call
0709 13:15:13.479529 (+1862652us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002d3f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:13.479707 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2458590592}
I20260709 13:15:13.475150 12192 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.373999 12116 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.399179 12176 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.540820  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:13.482715 12157 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:13.489954 12229 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 13:15:13.491139 11799 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.546474  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:13.450243 12185 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:13.495692  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.501264  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:13.502974  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.517127  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:13.547874  7889 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:13.505831 12123 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.520139 12194 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:13.461126 11948 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:13.522693 12172 consensus_queue.cc:1175] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:13.523516 12091 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.534315  7260 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:15:13.530750  7253 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:13.554198  7330 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:13.555719  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.557476  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:13.421453 12071 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:13.534679  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:13.549865 12194 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:13.508663 11878 consensus_meta.cc:287] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.000s
I20260709 13:15:13.541870  7896 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEARNER]: Advancing to term 14
I20260709 13:15:13.551405  7262 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 13:15:13.498658 12135 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:13.415520 11870 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.124s
I20260709 13:15:13.553437  7183 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:15:13.559263  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:13.524317 12191 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.560789  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:13.428675 12198 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.559508  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:13.568496  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.569929  7334 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:13.575214  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.572176  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:13.575350  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.562391 11799 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:13.580775  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:13.581883  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:13.583652 12171 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.584203 12171 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.541288 12232 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.587850  7260 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:15:13.589150 12232 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.590569  7896 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:13.591086  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.592355  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.593516  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:13.593708 12194 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.595204 12194 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:13.599534 12169 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:13.610978 12087 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:13.601404 12174 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.586445 12171 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.567778 12071 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.613718 11948 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:13.578570 12191 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:13.616614 12191 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.617087 12191 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:13.554751 12185 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.621235 12185 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.625753  7262 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:15:13.626915  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:13.628046  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:13.629318  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.631907  7262 raft_consensus.cc:2410] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:15:13.565014 12197 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:13.565665 12106 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.635900  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:13.646937  7335 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:13.645514  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 80553.1us
I20260709 13:15:13.660990  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.662954  7331 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 16. Ops: []
I20260709 13:15:13.670949  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.553438 12190 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:15:13.674108  7260 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:13.676090  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:13.671886  7262 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:13.677525  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:13.682924  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:13.683754  7334 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:13.689560  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:13.690328  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.632889 11799 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.698076  7262 raft_consensus.cc:2368] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16.
I20260709 13:15:13.573331 12135 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.643414 12197 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:13.676270 12239 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.715651  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:13.662264 12087 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:13.714779  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.721593  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:13.724570  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.725317  7329 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:13.726794  7262 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:13.726065  7260 raft_consensus.cc:2410] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:15:13.760665  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.709949 11799 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:13.720515  7257 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:15:13.771397  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:13.772379  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.773201  7335 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:13.723235 12197 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:13.777729  7334 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:13.723049 11765 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:13.780347  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:13.781122  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.781172  7260 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:13.667025 12106 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.763334 12071 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.783804  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.716267 11971 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:15:13.788756  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:13.764581 12087 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.806978  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:13.808200  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.809360  7260 raft_consensus.cc:2410] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:15:13.800289 12126 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.820468  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.788931 11765 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:13.818048 12246 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:15:13.837251  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:13.839298  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.840559  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:13.823155 12192 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.822969 12116 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.846231 12087 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.847481 12135 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.849687 12168 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.854377  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.855304  7187 raft_consensus.cc:2410] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:15:13.856048  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.857009  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.858147  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:13.861290  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:13.861842  7329 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:13.863128  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.863936  7187 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 10: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:13.865051  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:13.866775  7185 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:13.874010  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.874316  7228 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:13.775493 12239 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:13.875451  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.877086  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:13.881825  7185 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:13.882995  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:13.882762  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 193237us
I20260709 13:15:13.889425  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.891191  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:13.892536  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.893249  7185 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:13.888836  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:13.894136  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:13.897439  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:13.896469  7225 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:13.900485  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:13.905485  7152 leader_election.cc:400] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16.
I20260709 13:15:13.905804  7152 leader_election.cc:403] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:15:13.873705 12226 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.887840 12168 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:13.883910 12087 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:13.889320 12171 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:15:13.874315 12176 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.910403 12244 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:13.889119 12185 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:15:13.928351 11870 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:13.928952 11870 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.884184 12169 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:13.902784 11878 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:13.908969 12192 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:13.892112 12232 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:13.956027 12106 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:13.916095 12226 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.959074  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.959872  7257 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:13.960680  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.925858 12126 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:13.961757 12126 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:13.926172  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:13.963860 12126 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:13.923373 12248 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:15:13.964939 12244 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:13.915196  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.965427 12244 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:13.966110  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.959894 12080 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:13.967661 12244 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.967783 12080 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:13.968905 12251 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:15:13.970371  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.970894  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.972613  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:13.937862  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.921350 12196 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:13.940460 11870 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:13.920020 12239 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:13.941869 12183 consensus_queue.cc:1175] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:15:13.945158 12242 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.425s	user 0.001s	sys 0.000s
I20260709 13:15:13.947012  7261 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: [15.11-20.13]
I20260709 13:15:13.912144 12236 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:15:13.910835 12091 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:15:13.913232 12224 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16.
I20260709 13:15:13.915601 12218 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:13.952270  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.915556 12071 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:13.904001 11963 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:15:13.903177 12198 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.910243 12225 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:13.954181 11765 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.971021  7255 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:14.022115  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.999713 12196 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:14.023358  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:14.024501  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:14.025472  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:14.026110  7255 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:13.995556 12081 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:15:13.998582 12141 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:15:14.011560 12071 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.028836  7257 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:14.029085  7178 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:14.009740 12091 consensus_queue.cc:1243] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:13.978840 11431 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:13.911839  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:14.029940 11431 consensus_queue.cc:1243] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:14.030402 12185 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:15:14.030488  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 118735us
I20260709 13:15:14.031044 12185 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:14.032003 12185 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.033310 12185 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:14.034425 12198 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:14.034862 12198 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:14.034912 12234 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:14.035377 12198 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:14.030422  7178 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:15:14.029939 12191 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.035604 12234 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.040658 12178 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:14.041240 12191 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:13.983095  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.041473 12234 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:14.042034  7185 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:14.043169  7185 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 16. Ops: []
I20260709 13:15:14.044267  7185 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:13.985757  7186 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:13.981775  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:14.045727  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 64028.9us
I20260709 13:15:14.046424  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:14.046900 12124 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:14.047423 12124 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.049216 12096 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:14.049467 12124 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:14.049649 12096 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:14.049979 12124 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:13.980091 12110 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:14.050804 12110 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:14.051118  7186 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:14.051254 12110 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:14.052188 12110 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.054104  7253 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:14.054841  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:14.056104  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:13.994093 12226 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.973263 11878 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.056751  7255 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:14.056890 11878 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:14.057776  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:14.059660  7185 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:14.062075 12198 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.063793  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.064252 12198 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:13.991128  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:14.000691  7256 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
W20260709 13:15:14.015690  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.989661 12106 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:15:14.067376  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 78051.4us
I20260709 13:15:14.068573  7302 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:14.069344 12141 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:14.069725 12141 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:14.070304 12141 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:13.999054 12213 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:15:13.935322  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:14.080855  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 145838us
I20260709 13:15:14.081576  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:14.050057 12096 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:14.069665  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:14.019533 12218 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:14.088084  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:14.073307  7180 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:14.000880  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:14.088656  7257 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:14.004264  7329 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:14.069579  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:14.082463  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:14.091953  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:14.095422  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:14.096625 12074 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:14.097427 12158 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:14.097755 12137 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:14.100356  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:14.148357  7332 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:15:14.134477  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.115718  7331 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:14.028829 12071 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:14.114308  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44707.1us
I20260709 13:15:14.158003  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:14.158356  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:14.160583  7329 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:15:14.083668 12128 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:14.169530  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:14.113567 11431 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:15:14.165235  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:14.094591 12182 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:14.086908 12232 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:14.092846 12196 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:14.176411 11431 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:14.177768 11431 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:14.177976  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 77708us
I20260709 13:15:14.178162 11431 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:14.179554  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:14.175050  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:14.180685  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:14.146608 12198 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:14.151144 12185 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:14.182639  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:14.181317  7260 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:14.167899 12137 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:14.186273  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:14.080518 12197 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.171968 11948 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:14.084820 12124 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.160616  7257 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:14.096112 11799 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.176836 12212 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.208854 12212 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.194232  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:14.211519  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:14.212127  7260 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:14.185209 12116 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:14.213008 12116 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.213392 12116 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:14.214316 12080 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.215415 12080 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:14.215484 12187 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:14.183534 11804 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:14.184396 12198 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:14.199945 12218 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.164201 12081 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:15:14.183883 11765 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:14.187522 11870 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:14.184396 12185 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:14.233263 11431 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:14.232968  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.188884 12174 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:14.210438 11799 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:14.231484  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:14.221979  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 929) took 1161 ms. Trace:
I20260709 13:15:14.188942 11763 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:14.189448 12137 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:14.192185 12128 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:14.273957  7183 rpcz_store.cc:276] 0709 13:15:13.060095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.191237 (+131142us) service_pool.cc:224] Handling call
0709 13:15:13.191589 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.565605 (+374016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.221725 (+656120us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540039dad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:14.221900 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831574400}
I20260709 13:15:14.223909 12198 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:14.246291  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:14.278010  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46634us
I20260709 13:15:14.223452 11564 raft_consensus.cc:3055] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:14.232136 12091 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:15:14.232899 11765 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:14.286322  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.232812 11870 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:14.292106  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.297370  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.284746  7183 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:14.234941 11948 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:14.302711  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.282627 12137 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:14.231918 12138 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:14.234077 12195 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:15:14.275290 12185 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:14.294379  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 48177.2us
I20260709 13:15:14.279708 12126 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:14.295984  7180 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:14.305298 11431 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:14.281316 11804 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:14.294256 12120 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:14.281152 12141 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.289135 11564 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:14.301364 11870 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:14.272859 11872 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:15:14.292943 12183 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:15:14.281677 11763 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.308284 12138 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.334004  7187 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:14.295542 11878 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.332587  7181 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:15:14.336410  7185 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:14.321256 12120 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:14.321694 12081 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:14.329015 12169 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.324054 11804 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:14.357610  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:14.358834 11948 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.359007 12120 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.318655 12126 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.359833 12169 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.329526 11765 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.361665 11804 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.362469  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.407003  7181 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:14.363498  7185 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:14.335911 12138 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:14.365106  7255 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:14.370177 11878 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:14.371181 12266 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:14.372237 12124 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:14.372625 11971 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:14.372821 12197 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:14.376118  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.377600  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:14.415616  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:14.379334 12158 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:14.380052 12141 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:14.380923 12263 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:15:14.330224 11485 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:15:14.341310 12128 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:14.358500 11763 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:14.333822 12096 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:14.388537 12264 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:15:14.618168  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:14.618825  7328 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:15:14.389546 12267 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:15:14.348804  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:14.621269 12169 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:14.621845  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 273086us
I20260709 13:15:14.621958 12169 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:14.623000  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:14.396498  7256 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:14.408838 12120 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:14.431188 12257 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:14.627489 12257 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.627882 12257 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:14.631533  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 699) took 1087 ms. Trace:
I20260709 13:15:14.631680 12128 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.632126  7890 rpcz_store.cc:276] 0709 13:15:13.543971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.544111 (+   140us) service_pool.cc:224] Handling call
0709 13:15:13.553409 (+  9298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.562301 (+  8892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.562349 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.565350 (+  3001us) log.cc:844] Serialized 26 byte log entry
0709 13:15:13.958466 (+393116us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b180021b7a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:15:14.086296 (+127830us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:14.086338 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.086417 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.631231 (+544814us) raft_consensus.cc:1685] finished
0709 13:15:14.631250 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.631457 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3740,"raft.queue_time_us":11288,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":3441,"spinlock_wait_cycles":112108288,"thread_start_us":127664,"threads_started":1,"wal-append.queue_time_us":601441}
W20260709 13:15:14.640213 12178 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.001s
I20260709 13:15:14.443527  7892 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:14.445502  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:14.445827  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:14.446465  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:14.654018  7894 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:14.446825  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:14.446931  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:14.450039  7258 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:14.655414  7328 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:14.441198  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.477123 12075 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:14.664561 12096 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:14.479951 12159 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.665613 12159 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.666723 12110 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:14.667701  7262 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:14.668259 12173 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.668524 12159 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:14.668717 12173 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.670194  7254 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:14.672253  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:14.679819  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:14.415654 11765 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:14.615129 11431 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.450040  7150 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:14.687232 11431 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.615625  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:14.617260  7330 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:14.388975 12254 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:14.623188 11485 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:14.397341  7187 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 16: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:14.640899  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:14.408658 11963 consensus_queue.cc:1175] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" responder_term: 10 status { last_received { term: 8 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: [9.10-9.10]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:15:14.703572  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.645913 12071 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.646900  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:14.439399  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 403604us
I20260709 13:15:14.459050  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:14.731264  7182 raft_consensus.cc:2410] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:15:14.656291  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 177925us
W20260709 13:15:14.733773  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.661705  7335 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:14.662288  7253 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:14.406513 11564 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.756594  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:14.757148  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.662424  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:14.759052  7179 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:14.758733  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:14.622448 12169 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.678553 12138 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.620169  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:14.690964  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:14.694895  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 244898us
I20260709 13:15:14.713295 11431 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:14.716398  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.719005  7888 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:14.739940  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:14.753662  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.759915  7258 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:14.763025  7893 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:14.648530 12198 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.797049  7187 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:14.799469  7182 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:14.800401  7330 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 16: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:14.802590  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:14.802886  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 488814us
I20260709 13:15:14.771508  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:14.802590  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:14.808746  7259 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:15:14.818389  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:14.821920  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:14.822460  7892 raft_consensus.cc:2368] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16.
I20260709 13:15:14.823118  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:14.824468  7182 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 16: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:14.699432 12178 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:14.699040 12254 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:14.827601 12135 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:14.817414 12087 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:14.828411 12254 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:14.828037  7187 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:14.819672  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:14.764830  7331 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:14.849283 12126 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:14.850083  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.924248  7187 raft_consensus.cc:2368] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16.
I20260709 13:15:14.833904  7178 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 15. Ops: []
I20260709 13:15:14.833498  7182 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:14.925269  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 103457us
I20260709 13:15:14.717855 11485 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:14.851459  7334 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:15:14.832881  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:14.946506  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:14.763573 12187 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:14.958799  7182 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:14.959534  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.961030  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:14.832005 11564 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:14.809628 12091 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.820350 11878 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:15:14.940670 12137 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.627s	user 0.004s	sys 0.004s
I20260709 13:15:14.942572 12138 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:14.943073 12141 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.713841 12159 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:14.831300 12169 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:14.963090  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:14.988497 11870 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.000s
I20260709 13:15:14.967562  7892 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 13:15:14.964051 12254 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:14.973455 12212 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:14.974730 12187 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:14.976522 12075 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:14.976879 12071 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:14.985805  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.960171 12116 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.000s
I20260709 13:15:14.991045  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.959261 12178 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:14.996987  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.797386 12249 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:14.999485  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:14.985400 11878 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.986558 12123 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:15.108392  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:14.928278  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:15.156615  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.172741  7182 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
W20260709 13:15:15.164382  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.945613 11485 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:15.173844  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:15.180562  7182 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:15.181576  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:15.181967  7260 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:15.182315  7182 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:15.182667  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3067) took 1325 ms. Trace:
I20260709 13:15:15.183066  7260 rpcz_store.cc:276] 0709 13:15:13.857011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.086108 (+1229097us) service_pool.cc:224] Handling call
0709 13:15:15.181655 (+ 95547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.182344 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.182582 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:14.989168 12091 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.992750 12137 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:14.995931 12141 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:15.085031 12159 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:15.285048  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.298730  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:15.169196 11804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.014s
I20260709 13:15:15.261264  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3071) took 1277 ms. Trace:
I20260709 13:15:15.247763  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:15.226354  7182 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
W20260709 13:15:15.303355  7179 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.006s
I20260709 13:15:15.319087  7182 pending_rounds.cc:85] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 8
I20260709 13:15:15.262171  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:15.186327  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 258129us
W20260709 13:15:15.193998  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.319605  7182 pending_rounds.cc:107] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 15.9
W20260709 13:15:15.262933 12273 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 13:15:15.281888 12128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.010s	sys 0.020s
I20260709 13:15:15.312330  7260 rpcz_store.cc:276] 0709 13:15:13.983549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.236376 (+1252827us) service_pool.cc:224] Handling call
0709 13:15:15.260406 (+ 24030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.260785 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.260824 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.260881 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:15.260928 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.261006 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.261180 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:15.295280 12185 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.975s	user 0.006s	sys 0.007s
W20260709 13:15:15.281734 12080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.011s	sys 0.026s
I20260709 13:15:15.318714  7179 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:15.320725  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:15.309420  7893 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:15.320878  7182 raft_consensus.cc:2889] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:15.202472  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.353303  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:15.353749  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.352483  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:15.108105 12187 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:15.179461 11948 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.005s	sys 0.019s
I20260709 13:15:15.169363 12116 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:15.327872 11765 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
W20260709 13:15:15.328146  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:15.351100 12080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.011s	sys 0.030s
I20260709 13:15:15.329365  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:15.162603 11870 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:15.333630  7302 leader_election.cc:400] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16.
I20260709 13:15:15.367673  7302 leader_election.cc:403] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:15.336421 12141 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:15.265132 12071 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:15:15.309896 11804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.000s	sys 0.024s
I20260709 13:15:15.323544  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:15.108474 12075 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:15.177351 11878 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:15.346937 12128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.011s	sys 0.025s
I20260709 13:15:15.322693 12198 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:15.357125  7179 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
W20260709 13:15:15.354259  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:15.384240  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61420.3us
I20260709 13:15:15.173379 12178 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:15.179780 12249 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:15.359838  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:15.355152 12185 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:15.328469 12138 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:15.387477 11799 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:15.361366 12098 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:15:15.403860 12277 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.098s	user 0.001s	sys 0.001s
I20260709 13:15:15.404958 12116 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:15.401945 11799 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:15.406107 11799 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:15.388744  7187 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:15.407824 11870 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:15.324632 12159 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.389137  7332 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:15.393745  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:15.363993 11948 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.005s	sys 0.029s
W20260709 13:15:15.369048 12205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.004s	sys 0.034s
I20260709 13:15:15.403748 12098 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:15.376839  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 53416.5us
I20260709 13:15:15.407967  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1896) took 1722 ms. Trace:
I20260709 13:15:15.415802  7261 rpcz_store.cc:276] 0709 13:15:13.685790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.386524 (+700734us) service_pool.cc:224] Handling call
0709 13:15:14.386897 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.387258 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.387291 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.387856 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.852317 (+464461us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:14.970143 (+117826us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.973757 (+  3614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.973867 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.407710 (+433843us) raft_consensus.cc:1685] finished
0709 13:15:15.407730 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.407897 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2793,"prepare.queue_time_us":116956,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":4861,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":243,"thread_start_us":435209,"threads_started":1,"wal-append.queue_time_us":768966}
I20260709 13:15:15.395015 11765 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16.
W20260709 13:15:15.394472  7181 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.047s	sys 0.044s
W20260709 13:15:15.418915  7181 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.047s	sys 0.044s
I20260709 13:15:15.419230  7258 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:15.415679  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:15.413673  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 940) took 1095 ms. Trace:
I20260709 13:15:15.422226  7183 rpcz_store.cc:276] 0709 13:15:14.318606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.319934 (+  1328us) service_pool.cc:224] Handling call
0709 13:15:14.320344 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.320609 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:14.702252 (+381643us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.413155 (+710903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.413310 (+   155us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:15.413357 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.413445 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.413599 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":674951,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":52,"raft.queue_time_us":193037,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":3694,"spinlock_wait_cycles":6061312,"thread_start_us":1082239,"threads_started":3,"wal-append.queue_time_us":611984}
I20260709 13:15:15.425652  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:15.399806 12071 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:15.394255 12135 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:15.414242 12205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.004s	sys 0.034s
I20260709 13:15:15.430598 12135 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:15.445794 12075 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:15.401777 12080 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:15:15.454221 12141 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:15.455474 12272 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:15.455935 12178 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:15.457811 12212 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:15.464696 11431 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:15.465176 11431 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:15.465852 12257 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.000s
I20260709 13:15:15.414525 12159 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:15.468498  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3043) took 3201 ms. Trace:
I20260709 13:15:15.468837 12159 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:15.427407 11870 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:15.468941  7259 rpcz_store.cc:276] 0709 13:15:12.268872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.306592 (+ 37720us) service_pool.cc:224] Handling call
0709 13:15:12.307036 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.809288 (+2502252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.468193 (+658905us) spinlock_profiling.cc:243] Waited 2.5 s on lock 0x7b540021a2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:15.468383 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5752340224}
I20260709 13:15:15.469841 11870 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:15.470381 11870 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:15.471426  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2183) took 1666 ms. Trace:
I20260709 13:15:15.471819  7178 rpcz_store.cc:276] 0709 13:15:13.805429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.039692 (+234263us) service_pool.cc:224] Handling call
0709 13:15:14.039999 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.925429 (+885430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.471085 (+545656us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b540039d5d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:15.471350 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1825337216}
I20260709 13:15:15.472929 12137 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:15.472996  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:15.475232 11431 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:15.475960  7262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1898) took 1789 ms (client timeout 2246 ms). Trace:
W20260709 13:15:15.481029  7262 rpcz_store.cc:269] 0709 13:15:13.686302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.771120 (+ 84818us) service_pool.cc:224] Handling call
0709 13:15:15.475755 (+1704635us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54002e7a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:15.475899 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059710208}
I20260709 13:15:15.435221  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 938) took 1865 ms. Trace:
W20260709 13:15:15.483021  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:15.483561  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.484673 11431 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:15.476835  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3061) took 1621 ms. Trace:
I20260709 13:15:15.485319  7255 rpcz_store.cc:276] 0709 13:15:13.855405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.057551 (+202146us) service_pool.cc:224] Handling call
0709 13:15:15.476626 (+1419075us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400058554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:15.476775 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705188096}
I20260709 13:15:15.482329  7184 rpcz_store.cc:276] 0709 13:15:13.569922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.422064 (+1852142us) service_pool.cc:224] Handling call
0709 13:15:15.434385 (+ 12321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.434677 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.434715 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.434780 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:15.434879 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.434959 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.435118 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.486799  7255 pending_rounds.cc:85] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 5
I20260709 13:15:15.487082  7255 pending_rounds.cc:107] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:15:15.487301  7255 raft_consensus.cc:2889] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:15.487363  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 944) took 1411 ms. Trace:
I20260709 13:15:15.487761  7259 rpcz_store.cc:276] 0709 13:15:14.075568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.470247 (+1394679us) service_pool.cc:224] Handling call
0709 13:15:15.486821 (+ 16574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.487022 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.487046 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.487092 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:15.487129 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.487190 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.487307 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.477677  7256 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:15:15.477487 12098 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:15.478792 12187 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:15.476773  7183 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:15:15.511829  7184 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:15.431229 12128 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:15:15.513509 12281 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.189s	user 0.001s	sys 0.001s
W20260709 13:15:15.531286 12279 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:15:15.531546 12182 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:15.532423 12182 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:15.539063  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:15.541786 12126 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:15.542704 12283 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.194s	user 0.005s	sys 0.000s
I20260709 13:15:15.542500 12126 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:15.428818 12082 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
W20260709 13:15:15.574191  7152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.246s (SENT) [suppressed 4 similar messages]
I20260709 13:15:15.466331 12257 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:15.484073 12135 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:15.494797 12249 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:15.630330  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.653340  7889 raft_consensus.cc:2368] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 14. Current term is 15.
W20260709 13:15:15.655982  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 292789us
I20260709 13:15:15.669312 12187 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.520264 12128 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.616912 12069 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.600008 12226 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:15.619201 12159 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:15.546670 11878 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:15.674187  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2201) took 1038 ms. Trace:
I20260709 13:15:15.643179 11804 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:15.703015  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.687686  7186 rpcz_store.cc:276] 0709 13:15:14.635425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.636400 (+   975us) service_pool.cc:224] Handling call
0709 13:15:14.636764 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.637076 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.637120 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.637543 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.990302 (+352759us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:14.990355 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.990434 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:15.673846 (+683412us) raft_consensus.cc:1685] finished
0709 13:15:15.673879 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.674094 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":912,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":85,"thread_start_us":352438,"threads_started":1,"wal-append.queue_time_us":645143}
W20260709 13:15:15.712422  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 54947.2us
I20260709 13:15:15.713523  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:15.670140 12187 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:15.752871  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 949) took 1374 ms. Trace:
I20260709 13:15:15.686156 12135 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:15.682686 12128 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:15.742055 11804 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:15.757678  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.749579 12126 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:15.684952 12069 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:15.767057  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 53565.5us
I20260709 13:15:15.753471  7181 rpcz_store.cc:276] 0709 13:15:14.378398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.414691 (+ 36293us) service_pool.cc:224] Handling call
0709 13:15:14.439463 (+ 24772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.439656 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:15.419357 (+979701us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.752354 (+332997us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.752439 (+    85us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:15.752508 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.752609 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.752794 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63320,"prepare.queue_time_us":787642,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"thread_start_us":1039695,"threads_started":2}
W20260709 13:15:15.744928  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 323999us
I20260709 13:15:15.759475  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1906) took 1689 ms. Trace:
I20260709 13:15:15.750852 12159 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:15.688395 12226 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:15.937312  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 363146us
I20260709 13:15:14.679565  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:16.059304  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.941988  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:15.939778  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 945) took 1860 ms. Trace:
W20260709 13:15:15.963286  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:15.945978  7889 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 802) took 1501 ms (client timeout 1646 ms). Trace:
I20260709 13:15:15.900036  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1940) took 1253 ms. Trace:
I20260709 13:15:16.044546  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:16.030812  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:15.983232  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:15.926303  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:15.873172  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:15.979552  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:15.880465  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.252076  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 946) took 2151 ms. Trace:
W20260709 13:15:16.212761  7889 rpcz_store.cc:269] 0709 13:15:14.445114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.445251 (+   137us) service_pool.cc:224] Handling call
0709 13:15:15.945691 (+1500440us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400684f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:15.945886 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300208512}
I20260709 13:15:16.211764  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:16.264942  7257 rpcz_store.cc:276] 0709 13:15:14.101610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.250988 (+2149378us) service_pool.cc:224] Handling call
0709 13:15:16.251420 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.251652 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:16.251691 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:16.251748 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:16.251793 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.251865 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.252003 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:16.042106  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3066) took 2185 ms. Trace:
W20260709 13:15:16.188740  7182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.054s	sys 0.093s
W20260709 13:15:16.222059  7862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.002s	sys 0.010s
W20260709 13:15:16.184338  7179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.031s	sys 0.068s
I20260709 13:15:15.801039  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:16.266500  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:16.222188  7336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.011s	sys 0.003s
I20260709 13:15:16.209971  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:16.210986  7260 rpcz_store.cc:276] 0709 13:15:14.069729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.347287 (+1277558us) service_pool.cc:224] Handling call
0709 13:15:15.361429 (+ 14142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.361655 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:15.372046 (+ 10391us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.759052 (+387006us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.759120 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:15.759163 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.759232 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.759398 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10847,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":4853,"raft.queue_time_us":98,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":11776,"thread_start_us":385822,"threads_started":1,"wal-append.queue_time_us":571987}
W20260709 13:15:16.270328  7862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.002s	sys 0.010s
W20260709 13:15:16.234124 11431 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.745s	user 0.006s	sys 0.003s
W20260709 13:15:16.271677  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 754728us
W20260709 13:15:16.271862  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 61891.9us
W20260709 13:15:16.270846  7336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.011s	sys 0.003s
W20260709 13:15:16.270092  7179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.032s	sys 0.073s
I20260709 13:15:16.272631 11431 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:16.211335  7259 rpcz_store.cc:276] 0709 13:15:14.079785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.488653 (+1408868us) service_pool.cc:224] Handling call
0709 13:15:15.488938 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.489150 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:15.513606 (+ 24456us) log.cc:844] Serialized 14 byte log entry
0709 13:15:15.939311 (+425705us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.939385 (+    74us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:15.939461 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.939555 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:15.939706 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24559,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":77,"thread_start_us":425319,"threads_started":1,"wal-append.queue_time_us":534333}
W20260709 13:15:16.221984  7261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.007s	sys 0.007s
W20260709 13:15:16.274072  7261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.007s	sys 0.007s
I20260709 13:15:16.250718  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3059) took 2427 ms. Trace:
I20260709 13:15:16.081420  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3075) took 2002 ms. Trace:
I20260709 13:15:16.215744  7333 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:15.979120  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:16.274556  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:16.269667  7182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.056s	sys 0.099s
I20260709 13:15:16.213737  7334 rpcz_store.cc:276] 0709 13:15:14.646170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.646304 (+   134us) service_pool.cc:224] Handling call
0709 13:15:14.646646 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.946113 (+299467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.899638 (+953525us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54000e10d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:15.899915 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470400384}
I20260709 13:15:16.276325  7331 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
W20260709 13:15:16.222121  7187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.007s	sys 0.007s
W20260709 13:15:16.279244  7187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.008s	sys 0.008s
I20260709 13:15:16.275192  7255 rpcz_store.cc:276] 0709 13:15:14.079124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.486159 (+1407035us) service_pool.cc:224] Handling call
0709 13:15:15.486553 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:15.488014 (+  1461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.488045 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:15.493281 (+  5236us) log.cc:844] Serialized 52 byte log entry
0709 13:15:15.761665 (+268384us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:15.761714 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.761780 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.081094 (+319314us) raft_consensus.cc:1685] finished
0709 13:15:16.081124 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.081344 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1814,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":20193,"thread_start_us":268018,"threads_started":1,"wal-append.queue_time_us":482324}
I20260709 13:15:16.048437  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 939) took 2591 ms. Trace:
I20260709 13:15:16.280334  7254 rpcz_store.cc:276] 0709 13:15:13.457222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.498427 (+ 41205us) service_pool.cc:224] Handling call
0709 13:15:13.507079 (+  8652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.670613 (+1163534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.048149 (+1377536us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400125554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:16.048341 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2674062720}
I20260709 13:15:16.031574  7335 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
W20260709 13:15:16.116421 12276 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:15:16.284757  7185 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:16.285168  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:16.274582  7256 rpcz_store.cc:276] 0709 13:15:13.823738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.625583 (+801845us) service_pool.cc:224] Handling call
0709 13:15:15.477338 (+851755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.488779 (+ 11441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.250403 (+761624us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54002e7a50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:16.250620 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958098816}
I20260709 13:15:16.269469  7258 rpcz_store.cc:276] 0709 13:15:13.856767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.816232 (+959465us) service_pool.cc:224] Handling call
0709 13:15:14.816810 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.419652 (+602842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.041848 (+622196us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400349ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:16.042042 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384953728}
I20260709 13:15:16.268028  7332 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
W20260709 13:15:16.036073 12293 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:15:16.038034 12292 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:15:15.914310 12158 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.806093 12185 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.176537 12091 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:15.857448 11485 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:16.343055 12091 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.773813 12080 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.911942 11878 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.109489 12197 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.774269 12218 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.330935  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:16.285193 11870 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.000s
W20260709 13:15:16.266422 12141 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.812s	user 0.005s	sys 0.005s
I20260709 13:15:16.248514 12071 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.805896 12285 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:16.347744 12091 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:16.179805 12098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.012s	sys 0.021s
I20260709 13:15:15.797613 12138 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:15.966127 12087 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:16.119078 12173 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.124035 12123 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:16.359694 11878 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:16.039995 12187 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.248304 12287 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.769037 12135 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.284914 12198 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:16.284431 12300 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:16.318019 12296 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:16.324681 12096 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:16.045109 12257 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:16.349608 11564 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.361s	user 0.007s	sys 0.006s
I20260709 13:15:16.055234 12232 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:15:16.352433 11799 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.946s	user 0.013s	sys 0.000s
W20260709 13:15:16.354365 12169 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.341s	user 0.012s	sys 0.001s
I20260709 13:15:16.351287 12317 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.447659 11804 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.353833 12289 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:16.402709  7226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.002s	sys 0.027s
W20260709 13:15:16.465370  7226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.002s	sys 0.027s
I20260709 13:15:16.404089  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:16.404752  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:16.405133  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:16.405818  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:16.406287  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 194596us
W20260709 13:15:16.406881 12081 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.409s	user 0.009s	sys 0.022s
I20260709 13:15:16.408490 12302 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:16.405709  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 604901us
I20260709 13:15:15.926211 12178 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:16.369601  7888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.009s	sys 0.013s
W20260709 13:15:16.473237  7888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.009s	sys 0.013s
I20260709 13:15:16.344568 12158 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.410591 12138 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:16.372798 12098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.014s	sys 0.022s
I20260709 13:15:16.424270 12087 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.367712 12126 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:15:16.447373  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 129219us
I20260709 13:15:16.450217  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:16.368448 12082 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:16.353909 12080 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.362552 12141 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:16.454440  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.485785  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:16.396087 12313 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:16.359889 12218 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.454389 12287 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.395197 12285 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:16.459043  7180 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:16.514770 12320 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.515522 12320 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.410924 12123 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:16.364528 12071 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.425239 12330 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:16.378880  7328 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:16.451280 12296 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.501605 12126 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.466457  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:16.467861  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:16.362287 11870 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:16.468472  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53864us
W20260709 13:15:16.571918  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 105574us
W20260709 13:15:16.572254  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 104489us
W20260709 13:15:16.465206  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 200409us
I20260709 13:15:16.454573 12323 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:16.456001 12271 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:16.460033 12291 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:16.433707  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.449230 11878 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.461074 12075 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:16.469074 12081 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.473s	user 0.009s	sys 0.022s
I20260709 13:15:16.462497 12232 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:16.451503 12198 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:16.374971 12124 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.267s	user 0.012s	sys 0.010s
I20260709 13:15:16.487991  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2857) took 1546 ms. Trace:
I20260709 13:15:16.498277  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:16.593003  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:16.502700 12294 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:16.490397 12082 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:16.505291 12297 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:15:16.469219 12317 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:16.505782 12312 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:15:16.507462 12080 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:16.507807 12319 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:16.508641  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 1941) took 1861 ms. Trace:
W20260709 13:15:16.508780 12128 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.709s	user 0.004s	sys 0.004s
I20260709 13:15:16.508999  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 925) took 1336 ms. Trace:
I20260709 13:15:16.509622 12287 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.510010 12098 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.510465 12318 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:16.510756 12304 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:15:16.511319 12226 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.621325  7888 rpcz_store.cc:276] 0709 13:15:15.172551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.173091 (+   540us) service_pool.cc:224] Handling call
0709 13:15:15.173587 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.248164 (+ 74577us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:15.679419 (+431255us) log.cc:844] Serialized 14 byte log entry
0709 13:15:16.473710 (+794291us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:16.474305 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.479760 (+  5455us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:16.479802 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.479881 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.508778 (+ 28897us) raft_consensus.cc:1685] finished
0709 13:15:16.508798 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.508928 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2340,"prepare.queue_time_us":692622,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":13136,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":18817,"thread_start_us":1111859,"threads_started":2,"wal-append.queue_time_us":714379}
W20260709 13:15:16.512235 12303 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:15:16.513432 12285 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.359390 12197 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.478538 12178 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.519768 12159 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.521359 12091 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.521510 12272 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.464814 12169 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:16.501572  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51439.6us
I20260709 13:15:16.647997  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:16.453688 12300 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.500795 11971 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:16.403863  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:16.544350 12123 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.539287 12327 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.539378 12314 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:16.540820 12296 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:16.666010  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 951) took 1175 ms. Trace:
I20260709 13:15:16.666479  7186 rpcz_store.cc:276] 0709 13:15:15.490647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.758761 (+268114us) service_pool.cc:224] Handling call
0709 13:15:15.803881 (+ 45120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.915464 (+111583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.915494 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.937013 (+ 21519us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.181201 (+244188us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:16.181261 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.181357 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.505207 (+323850us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:16.657321 (+152114us) raft_consensus.cc:1685] finished
0709 13:15:16.657344 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.665936 (+  8592us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111112,"raft.queue_time_us":111638,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":15648,"spinlock_wait_cycles":31197568,"thread_start_us":213833,"threads_started":1,"wal-append.queue_time_us":369250}
I20260709 13:15:16.525249 11804 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.548646  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:16.672319  7183 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:15:16.549491 12218 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.551458 12320 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.501142 12313 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.478735 12302 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.553304  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3073) took 2474 ms. Trace:
I20260709 13:15:16.484726 12289 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.682935 12289 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.553697 12330 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.684032 12341 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:16.684644 12341 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.685124 12302 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:16.685637 12330 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:16.555696 12087 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.556535  7185 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:16.557504 12071 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.585249  7330 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:16.585103  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:16.688333 12313 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.583083  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:16.578836  7180 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:16.587309  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:16.589335  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 126483us
W20260709 13:15:16.588873  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 113293us
I20260709 13:15:16.589792  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:16.647564 12321 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:16.455433  7178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.018s
W20260709 13:15:16.702049  7178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.008s	sys 0.018s
I20260709 13:15:16.601275  7334 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:16.601666  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:16.601966  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:16.605355  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:16.565399 12158 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.566386 12135 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.564190 12138 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.592868  7187 rpcz_store.cc:276] 0709 13:15:14.941954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.453729 (+511775us) service_pool.cc:224] Handling call
0709 13:15:15.454104 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.454327 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:15.518503 (+ 64176us) log.cc:844] Serialized 14 byte log entry
0709 13:15:16.487353 (+968850us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:16.487429 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:16.487498 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.487595 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.487913 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38744,"prepare.queue_time_us":188526,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":122190,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":968310,"threads_started":2,"wal-append.queue_time_us":831847}
I20260709 13:15:16.586686 11564 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:15:16.600973 12124 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.516s	user 0.012s	sys 0.011s
I20260709 13:15:16.576303 12322 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:16.679557 12123 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:16.588181 12173 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:16.623615  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:16.624718  7259 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:15:16.625525  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:16.627261  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:16.627532  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:16.616496  7336 rpcz_store.cc:276] 0709 13:15:14.647018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.650199 (+  3181us) service_pool.cc:224] Handling call
0709 13:15:14.694749 (+ 44550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.695248 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.695283 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.720628 (+ 25345us) log.cc:844] Serialized 26 byte log entry
0709 13:15:15.475204 (+754576us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b18003bf0e0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:15:16.311000 (+835796us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:16.311065 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.311167 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.508304 (+197137us) raft_consensus.cc:1685] finished
0709 13:15:16.508323 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.508570 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29503,"raft.queue_time_us":4095,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":98334,"spinlock_wait_cycles":38635264,"thread_start_us":797397,"threads_started":1,"wal-append.queue_time_us":1609316}
I20260709 13:15:16.579205 12126 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.639159  7258 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:16.720396  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1907) took 2650 ms. Trace:
I20260709 13:15:16.728868  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.603250 12075 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.644979  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:16.633455 12318 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.650348  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:16.654199  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2849) took 1804 ms. Trace:
I20260709 13:15:16.747478  7179 rpcz_store.cc:276] 0709 13:15:14.850000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.383734 (+533734us) service_pool.cc:224] Handling call
0709 13:15:15.384082 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.398557 (+ 14475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.398648 (+    91us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.399350 (+   702us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.273039 (+873689us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:16.273077 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.273197 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.653916 (+380719us) raft_consensus.cc:1685] finished
0709 13:15:16.653958 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.654124 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10519,"raft.queue_time_us":102805,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":8044,"thread_start_us":869326,"threads_started":1,"wal-append.queue_time_us":949916}
I20260709 13:15:16.749212  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.635834 12319 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:16.659508  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 76545.1us
I20260709 13:15:16.587447 12323 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.660852  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:16.640256 12226 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:16.777875  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.777933 12226 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.614749 12335 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:15:16.591850 12291 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.780321 12226 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.591449 12271 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.780946 12169 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.643735 12329 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.673456  7253 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:16.782919 12329 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.783877  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3064) took 2927 ms. Trace:
I20260709 13:15:16.630460 12098 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.636000 12287 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:15:16.649386 12159 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.695022  7331 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:15:16.562618 12182 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.029s	user 0.010s	sys 0.002s
I20260709 13:15:16.631604 12128 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.676425  7262 rpcz_store.cc:276] 0709 13:15:14.078507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.482027 (+1403520us) service_pool.cc:224] Handling call
0709 13:15:15.482385 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:15.492118 (+  9733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.492149 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:16.043596 (+551447us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:16.057551 (+ 13955us) log.cc:844] Serialized 52 byte log entry
0709 13:15:16.375681 (+318130us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:16.375732 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.375818 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.552993 (+177175us) raft_consensus.cc:1685] finished
0709 13:15:16.553013 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.553243 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":495,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":19806,"spinlock_wait_cycles":11570432,"thread_start_us":305330,"threads_started":1,"wal-append.queue_time_us":428702}
I20260709 13:15:16.817173  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:16.818019  7262 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:16.630710 12328 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:15:16.688344  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:16.706583  7890 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:15:16.705092  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 952) took 1214 ms. Trace:
I20260709 13:15:16.819303  7178 rpcz_store.cc:276] 0709 13:15:15.491008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.761197 (+270189us) service_pool.cc:224] Handling call
0709 13:15:15.761668 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.774168 (+ 12500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.774245 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.775186 (+   941us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.702593 (+927407us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:16.704681 (+  2088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.704781 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.704850 (+    69us) raft_consensus.cc:1685] finished
0709 13:15:16.704869 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.705021 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20862,"raft.queue_time_us":112907,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":21760,"thread_start_us":849263,"threads_started":1,"wal-append.queue_time_us":548514}
W20260709 13:15:16.714854  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:16.822896  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.823706  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:16.719067  7183 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:16.727265  7896 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:16.727476  7328 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:16.727854  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:16.826474  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.827101  7183 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
W20260709 13:15:16.827556  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 133488us
I20260709 13:15:16.729521  7186 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:15:16.729040  7261 rpcz_store.cc:276] 0709 13:15:14.069987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.418193 (+1348206us) service_pool.cc:224] Handling call
0709 13:15:15.420985 (+  2792us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.421527 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:15.450894 (+ 29367us) log.cc:844] Serialized 14 byte log entry
0709 13:15:16.406961 (+956067us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:16.520269 (+113308us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:16.520735 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.520882 (+   147us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:16.520920 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.521001 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.707753 (+186752us) raft_consensus.cc:1685] finished
0709 13:15:16.720116 (+ 12363us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.720315 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32303,"prepare.queue_time_us":36026,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":124703,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":5052,"spinlock_wait_cycles":4084480,"thread_start_us":923237,"threads_started":2,"wal-append.queue_time_us":898134}
I20260709 13:15:16.831719  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:16.832298  7261 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:15:16.833092  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:16.833578  7261 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:16.465576 11799 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.737522  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2853) took 1796 ms. Trace:
I20260709 13:15:16.738745 12317 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.673069 12327 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.740442 11870 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.741199 11878 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.784745 12158 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:16.783880 12198 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:16.753355  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 103118us
I20260709 13:15:16.755326 12069 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.759830 12300 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.672816 12314 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.661026 12232 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.716192 12321 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.761260  7335 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:16.762382 12126 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:16.653316 12272 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.797783 12334 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:15:16.725142 12322 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:16.767542  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:16.902666  7258 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:16.768347  7255 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:15:16.768680  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 123772us
I20260709 13:15:16.766883 12323 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.777125 12341 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.777279  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:16.908221  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:16.784294  7184 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:15:16.784318  7253 rpcz_store.cc:276] 0709 13:15:13.856287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.763224 (+906937us) service_pool.cc:224] Handling call
0709 13:15:14.763706 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.783074 (+2019368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.783636 (+   562us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b5400226ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:16.783810 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4391419264}
I20260709 13:15:16.820670 12159 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.908939  7258 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:15:16.909479  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:16.695724 11804 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.782342 12271 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:16.825407  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:16.838733  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:16.783974 12319 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.751005 11564 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:16.844826 11431 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:16.930999 11431 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:16.931838 11431 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.933334 11431 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:16.782346 12178 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.835511  7182 rpcz_store.cc:276] 0709 13:15:14.940681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.393397 (+452716us) service_pool.cc:224] Handling call
0709 13:15:15.393746 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:15.408704 (+ 14958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.408756 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:15.428260 (+ 19504us) log.cc:844] Serialized 52 byte log entry
0709 13:15:16.278480 (+850220us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:16.278541 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.278658 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.737277 (+458619us) raft_consensus.cc:1685] finished
0709 13:15:16.737304 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.737456 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7073,"raft.queue_time_us":123489,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":26554,"thread_start_us":734029,"threads_started":1,"wal-append.queue_time_us":825802}
I20260709 13:15:16.919910 12309 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.784046 12091 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:16.873813  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 236394us
I20260709 13:15:16.881165  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.742910 12173 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.883955  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:16.952767  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 68912.2us
I20260709 13:15:16.953804  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:16.886901  7261 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:16.956142 11804 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.957021 11564 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.960695 12205 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:16.961144 12205 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:16.962941  7257 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:16.964125 12173 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.964999  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.966185  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.966764  7186 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:16.967558  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.953356 12091 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.970050 12091 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.970082  7257 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:16.970953 12319 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.972487 12291 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.972939 11799 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.973356 12328 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:16.973845 12328 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.974197 12075 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.891120  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.975298  7180 raft_consensus.cc:2410] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:15:16.975991 12328 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.976157  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.977056 11485 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:16.977304  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.977527 11485 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.977914 11485 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:16.895716  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.979136  7185 raft_consensus.cc:2410] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:15:16.979883  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:16.980526  7185 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:16.981180  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.981786  7185 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:16.896950  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 68974.1us
W20260709 13:15:16.897624  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 69471us
I20260709 13:15:16.764516 12318 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.897847 12353 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:16.984715  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.906843  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:16.822021 12324 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:15:16.985323 12110 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:16.985747 12082 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.914973  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:16.986033  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 79263.6us
I20260709 13:15:16.988009  7150 leader_election.cc:400] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 14. Current term is 15.
I20260709 13:15:16.988689  7150 leader_election.cc:403] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:16.988857 12350 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:16.989245 12071 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:16.989611  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:16.990006 12071 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:16.904525 12158 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:15:16.991645  7336 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:15:16.991771 12071 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 14. Current term is 15.
I20260709 13:15:16.988209  7330 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:16.990440  7331 raft_consensus.cc:2410] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 14 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:15:16.915963 12329 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.873164 12332 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:15:16.998986  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:16.917685  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:16.917886 12197 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.918058 12321 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.918506 12069 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:16.904132 12322 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:17.031925 12328 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:17.032984 12328 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:17.033320 12328 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:16.919231 12317 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:17.034883 12317 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.035727  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:17.036945 12317 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:17.037057  7150 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:16.904263 12334 consensus_queue.cc:1243] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:16.889328 11878 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:17.034137 12328 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.895344 12300 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.920535  7179 raft_consensus.cc:2410] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:15:16.830201 12182 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.822024  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.923947  7254 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:17.039387  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:16.924219 12159 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.924312 12187 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:16.924906  7262 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:17.014959 12291 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:17.044550 12291 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.925138 12272 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.926944 12327 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.927595 12098 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:16.872926 12120 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:15:16.936923  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:16.798506 12342 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:16.938797  7259 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:16.908066 12287 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:15:16.883996  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:16.943833 12309 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:16.948033 12198 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:16.915766 12128 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:16.992095  7336 pending_rounds.cc:85] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 12
I20260709 13:15:16.996827 11485 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:16.978389  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:16.982401  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:16.917340 12314 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:17.000403  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:17.079586  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 197797us
I20260709 13:15:17.080304  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:17.081079  7183 raft_consensus.cc:2410] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:15:17.002229  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:17.005762  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:17.006192  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:17.007123  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:17.082239  7896 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:15:17.008108  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:17.011795  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 955) took 1483 ms. Trace:
I20260709 13:15:16.988394  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:17.015745  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:17.011718  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:17.021335  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:16.985759 12110 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:16.998370 12123 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:17.066538 12296 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.087778 12123 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.089749 12296 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:17.090174 12123 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:17.025842  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 108220us
I20260709 13:15:17.091017  7892 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:17.026077  7333 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:15:17.091485  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:17.026463 11804 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:17.092161 11804 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:17.092573  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:17.027284  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:17.094357  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 60772.9us
I20260709 13:15:17.094942  7893 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:15:17.095187 12182 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:17.095366 12327 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:17.095721  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:17.096601  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:17.096944  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:17.097272  7254 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:17.015105 12138 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:15:17.097592 12091 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:17.098162 12091 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:17.030278  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:16.990024 12350 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:17.099243 12350 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:17.099085 12091 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.099752 12110 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:17.100135 12350 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.101485 12350 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:17.040470  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:17.102751 12069 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:17.102519 12205 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.103164 12069 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.086030 12120 consensus_queue.cc:1243] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:15:17.103847 12205 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:17.060885 12344 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:17.104873 12344 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:17.047852 12300 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.105705 12344 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.107019 12344 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:17.107071 12232 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:17.108048 12300 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:17.038687  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:17.111093  7255 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:17.111258 12332 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:17.051666  7182 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:17.011129 12318 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:17.112130 12318 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.112481  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:17.057086  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 63308.7us
I20260709 13:15:17.113643  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:17.043944 12328 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:17.115911 12135 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:17.063338 12325 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:17.116353 12135 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:17.117379 12135 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.092574 11804 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:17.038072 11878 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.067098  7336 pending_rounds.cc:107] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:15:17.118985  7336 raft_consensus.cc:2889] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:17.069628  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.076936  7185 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:17.067489  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:17.120872  7327 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:17.069984  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:17.069025 11485 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:17.082654  7329 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:17.083149  7334 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:17.097638  7179 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:17.082934  7184 rpcz_store.cc:276] 0709 13:15:15.512312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.538734 (+ 26422us) service_pool.cc:224] Handling call
0709 13:15:16.995130 (+1456396us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001b35d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:16.995279 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2861543808}
W20260709 13:15:17.084520  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63301.2us
I20260709 13:15:17.125226  7259 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:17.121727  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:17.126607  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 115013us
I20260709 13:15:17.127151  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:17.127285  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:17.127753  7254 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:17.129643  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:17.130266  7890 raft_consensus.cc:1813] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Handling vote request from an unknown peer 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:17.130555 12213 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:17.130857  7890 raft_consensus.cc:2368] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 11.
I20260709 13:15:17.131011 12213 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.131424 12213 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:17.114382 12318 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:17.134086 12120 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:17.135005 12332 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:15:17.136351  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 120706us
I20260709 13:15:17.137365  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:17.138051 11870 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:17.138787 12349 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:17.138885  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:17.139288 12349 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:17.139698 12349 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:17.139964  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:17.140503  7327 raft_consensus.cc:1813] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Handling vote request from an unknown peer 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:17.141628  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:17.142452  7262 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:17.098821 12317 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:17.142789  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:17.142973 12317 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:17.143822 12317 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.144418 11878 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:17.144869 12317 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:17.144994  7258 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:17.027855 12348 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:17.039284  7178 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:17.103550 12069 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:17.043394 12126 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:15:17.060606  7888 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:17.121654  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:17.152221  7255 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:17.043218 12071 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:17.157618  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 44066.9us
I20260709 13:15:17.135931 12332 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:17.141904  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46245.4us
I20260709 13:15:17.097139 12309 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:17.151486  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:17.161435  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:17.162056  7254 raft_consensus.cc:2376] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17. Re-sending same reply.
I20260709 13:15:17.146669  7327 raft_consensus.cc:2368] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 11.
I20260709 13:15:17.162859  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:17.065990 12353 raft_consensus.cc:1064] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:15:17.147346  7261 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:17.096505 12327 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:17.138451  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:17.167896  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:17.169490  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:17.130106 12335 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:15:17.153213  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 106711us
I20260709 13:15:17.177186 12110 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.051234 12187 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.156668  7334 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:17.134483 12322 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:15:17.157295  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.180426 12187 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:17.153852  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.181071 12322 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:17.151260  7185 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:17.159423  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:17.182065  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.183959 12187 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:17.064992 12291 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:17.047273 12271 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:15:17.162017  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:17.193652  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:17.162124 12081 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:17.161989  7262 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:17.197667  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:17.165165  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:17.177588  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:17.158320  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:17.158164  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:17.186388  7255 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
W20260709 13:15:17.162524 12355 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:15:17.159987 12071 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.161716 12341 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:17.066581 12198 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.853375 12341 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.853785 12341 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:17.085625  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:17.855506  7186 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:17.200841  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:17.198530  7254 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:17.201675  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:17.856313  7255 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:17.210026  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:17.857218  7262 raft_consensus.cc:2410] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:15:17.172967 12327 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:17.184621 12128 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:17.200489  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:17.181165 12110 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:17.188138 12320 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:15:17.258512  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.872974  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:17.262809  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:17.265537  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 107290us
W20260709 13:15:17.872723  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 672271us
I20260709 13:15:17.192420 12348 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:17.197055 12081 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:17.888754  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:17.204795 12197 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:17.192055 12335 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:17.858316 12071 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:17.290843  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:17.241569 12296 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:17.872676 12291 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:15:17.644322  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.913230  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:17.830977 12353 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:17.832248 12349 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.015s
W20260709 13:15:17.832593 12317 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.687s	user 0.015s	sys 0.014s
I20260709 13:15:17.262882 12080 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:15:17.833294  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3076) took 1207 ms. Trace:
I20260709 13:15:17.927265  7259 rpcz_store.cc:276] 0709 13:15:16.625591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.726401 (+100810us) service_pool.cc:224] Handling call
0709 13:15:17.315682 (+589281us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54002161d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:17.833155 (+517473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258077440}
W20260709 13:15:17.834715 12213 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.005s
I20260709 13:15:17.836035 12333 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:17.836436 12366 log.cc:927] Time spent T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.532s	user 0.000s	sys 0.010s
I20260709 13:15:17.836731 12330 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:17.194617 12187 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.190750 12323 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:15:17.837469 12249 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.839059  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 931) took 1202 ms. Trace:
I20260709 13:15:17.939533 12317 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:17.841709 12325 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:17.656754 12091 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.958688 12325 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.959407 12091 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.961485 12325 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:17.852177 11431 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:17.963274 11870 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:17.963714 11870 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:17.964582 11870 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:17.965591 12361 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.650s	user 0.000s	sys 0.011s
I20260709 13:15:17.965816 11870 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:17.865032 12327 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:17.873167 12232 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.766s	user 0.013s	sys 0.014s
I20260709 13:15:17.898996 12197 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:17.882449 11804 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.016s
W20260709 13:15:17.343178 12359 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:17.872927 12320 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:17.930238 12344 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.823s	user 0.018s	sys 0.001s
I20260709 13:15:17.912171 12322 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:17.909034 12296 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:17.933784 12343 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:17.841321 12324 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.929140 12349 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.945075 12330 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:17.944792 12213 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.955652 12249 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.982266 12330 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.983453 12330 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:17.984649 12249 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:17.958321 12069 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.795s	user 0.021s	sys 0.002s
I20260709 13:15:17.985680 12069 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.942240 12335 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.941221 12081 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.968675 12135 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:17.969175 12197 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:17.948354 12333 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:17.972762 12320 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:17.954799 12317 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.961516 12091 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:17.978976 12328 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.865s	user 0.011s	sys 0.008s
I20260709 13:15:17.979192 12296 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:17.978037 12322 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:18.004379 12205 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.898s	user 0.016s	sys 0.006s
I20260709 13:15:17.996378 12317 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:18.004841 12350 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.903s	user 0.007s	sys 0.014s
I20260709 13:15:17.987324 12324 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:17.988937 12343 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.005419 12322 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:18.019743 12349 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:18.022550 12324 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.023428 12333 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:17.989243 12341 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.028486 12343 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.028539 12341 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:17.842896  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:18.059007  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 857098us
I20260709 13:15:18.071995  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:17.871811  7255 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:17.939204  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:17.913977  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:17.930312  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.074642  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:18.075923  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.913915  7261 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:18.076536  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.077652  7259 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:18.077944  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.078953  7261 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:18.079428  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:17.928012  7254 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:18.080542  7335 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:17.882404  7150 leader_election.cc:400] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 11.
I20260709 13:15:17.205436  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:18.081525  7150 leader_election.cc:403] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:18.084049  7259 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:15:17.837335  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3083) took 1060 ms. Trace:
I20260709 13:15:18.084523  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2873) took 2206 ms. Trace:
I20260709 13:15:18.084805  7258 rpcz_store.cc:276] 0709 13:15:16.777372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.909657 (+132285us) service_pool.cc:224] Handling call
0709 13:15:17.305842 (+396185us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54002f7454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:17.837273 (+531431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364246272}
I20260709 13:15:18.063907  7257 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 11: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:18.074466  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:18.083793  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 878260us
I20260709 13:15:18.065428  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2872) took 2187 ms. Trace:
I20260709 13:15:18.084975  7187 rpcz_store.cc:276] 0709 13:15:15.877474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.779224 (+901750us) service_pool.cc:224] Handling call
0709 13:15:16.779561 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:16.797124 (+ 17563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:16.797175 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:16.797759 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:15:17.039627 (+241868us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:17.039665 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.039729 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.066307 (+1026578us) raft_consensus.cc:1685] finished
0709 13:15:18.066369 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.084314 (+ 17945us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25048,"raft.queue_time_us":18304,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":20079,"thread_start_us":241521,"threads_started":1,"wal-append.queue_time_us":373955}
W20260709 13:15:17.798220  7179 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.004s	sys 0.007s
I20260709 13:15:17.841059  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2879) took 1017 ms. Trace:
W20260709 13:15:18.068079  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.066493  7183 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:18.065260  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2007) took 1060 ms. Trace:
I20260709 13:15:18.063485  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 964) took 1027 ms. Trace:
I20260709 13:15:17.951486  7888 rpcz_store.cc:276] 0709 13:15:16.636356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.636596 (+   240us) service_pool.cc:224] Handling call
0709 13:15:17.441057 (+804461us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54005537d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:17.838897 (+397840us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946441088}
I20260709 13:15:18.067305  7262 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:17.971391 11804 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:18.118983  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.088728  7181 rpcz_store.cc:276] 0709 13:15:15.877245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.306030 (+428785us) service_pool.cc:224] Handling call
0709 13:15:16.339876 (+ 33846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:16.532110 (+192234us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:16.532142 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:16.829194 (+297052us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b2c0001afe8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:16.829573 (+   379us) log.cc:844] Serialized 26 byte log entry
0709 13:15:17.055552 (+225979us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:17.055595 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.055667 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:17.965260 (+909593us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b2400175898. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece5fd59c4 00007fece5fd3acb 00007fece618edc9 00007fece618ea55 00007fece618e09d 00007fece8dc010e 00007fece8dd788c 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221
0709 13:15:18.064654 (+ 99394us) raft_consensus.cc:1685] finished
0709 13:15:18.064702 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.065098 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64103,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":50,"spinlock_wait_cycles":68385280,"thread_start_us":416397,"threads_started":2,"wal-append.queue_time_us":375180}
I20260709 13:15:18.115392  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:18.090512  7258 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:18.100432  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:18.124672  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.179461 12341 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.188849  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.188558 12324 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:18.189193 12341 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.190025  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2235) took 1015 ms. Trace:
I20260709 13:15:18.190568  7187 rpcz_store.cc:276] 0709 13:15:17.174217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.090223 (+916006us) service_pool.cc:224] Handling call
0709 13:15:18.189905 (+ 99682us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.191167 12332 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:18.093163  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:18.192744 12341 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.095624  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:18.193976  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 101252us
I20260709 13:15:18.195116  7330 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:18.123711 12091 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:18.117231 12069 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.116920  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.203562  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:18.203413  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:18.203395  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.209100  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.216686  7327 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:18.217346 12324 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:18.217913  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.218191 12324 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:18.218966  7892 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:18.219034 12232 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:18.219583 12232 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.219965 12232 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:18.225742  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 343501us
I20260709 13:15:18.227624  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.232239 12325 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:18.233397 12325 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.237159 12333 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 8 FOLLOWER]: Advancing to term 11
I20260709 13:15:18.239097  7261 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:18.240264 12324 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.241734 11804 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.193979 12332 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:18.243077  7329 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:15:18.213277  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.206998 12091 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:18.253681  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.258972 12341 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:18.262392  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.262527 12341 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.263103 11431 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:18.264005 12198 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.265225  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.268136  7330 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:18.272125  7890 raft_consensus.cc:2410] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:15:18.190320 12376 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:15:18.174664  7256 rpcz_store.cc:276] 0709 13:15:17.035359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.036778 (+  1419us) service_pool.cc:224] Handling call
0709 13:15:17.037126 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:17.037487 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.037533 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:17.037999 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:15:17.061054 (+ 23055us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:17.151400 (+ 90346us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.162233 (+ 10833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.162310 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.062502 (+900192us) raft_consensus.cc:1685] finished
0709 13:15:18.062584 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.063091 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10554,"prepare.queue_time_us":90631,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":14483,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":7864,"thread_start_us":21784,"threads_started":1,"wal-append.queue_time_us":149536}
I20260709 13:15:18.278779 12349 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:18.278998  7260 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:18.279345 12205 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:18.282760 12341 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:18.286979 12135 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:18.287003  7179 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.009s	sys 0.009s
W20260709 13:15:18.291149  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.296461 12187 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.254608 12091 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:18.174393  7328 rpcz_store.cc:276] 0709 13:15:17.004764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.004881 (+   117us) service_pool.cc:224] Handling call
0709 13:15:17.005180 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:17.046884 (+ 41704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.046931 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:17.047463 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:15:17.289138 (+241675us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:17.294406 (+  5268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.304312 (+  9906us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:17.901198 (+596886us) spinlock_profiling.cc:243] Waited 965 us on lock 0x7b2c001a2298. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece74ec291 00007fece75070ca 00007fece92354ad 00007fece923cf8e 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:18.064308 (+163110us) raft_consensus.cc:1685] finished
0709 13:15:18.064363 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.064926 (+   563us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84849,"raft.queue_time_us":41929,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":9244,"spinlock_wait_cycles":2218752,"thread_start_us":125281,"threads_started":1,"wal-append.queue_time_us":886996}
I20260709 13:15:18.266584 12213 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:18.305348  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.326867  7258 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
W20260709 13:15:18.332340  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.332060  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.302865  7185 rpcz_store.cc:276] 0709 13:15:16.824091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.982208 (+158117us) service_pool.cc:224] Handling call
0709 13:15:17.371269 (+389061us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b540036db54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:17.841001 (+469732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6286208}
I20260709 13:15:18.333242  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.339555  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.329718 12349 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:18.339800  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 244586us
I20260709 13:15:18.341995  7256 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:18.346470  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.346863  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.347504  7890 raft_consensus.cc:2368] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16.
W20260709 13:15:18.348431  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.348671  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.348862  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.349145  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.349732  7327 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:15:18.351305 12376 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.351992 12376 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.348089  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.354605 12376 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.344450 12135 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.371807 12325 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.371868  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.372325 12071 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.373160 12135 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.371368  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.364835  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.367226  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:18.375357  7182 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:18.357986  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.376726  7891 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:18.376895 12197 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.367679  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:18.378513  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 972) took 1176 ms. Trace:
I20260709 13:15:18.378938  7185 rpcz_store.cc:276] 0709 13:15:17.202070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.367346 (+1165276us) service_pool.cc:224] Handling call
0709 13:15:18.378421 (+ 11075us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.379577 12197 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.380223  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.381023  7185 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:18.381587  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2237) took 1206 ms. Trace:
I20260709 13:15:18.381896  7185 rpcz_store.cc:276] 0709 13:15:17.174832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.379799 (+1204967us) service_pool.cc:224] Handling call
0709 13:15:18.381507 (+  1708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.358558  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:18.384171 11431 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:18.384912  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:18.386147  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:18.386831  7181 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:18.387602 11431 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:18.387334 12205 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.363837  7256 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
W20260709 13:15:18.389220 12381 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.357s	user 0.003s	sys 0.002s
I20260709 13:15:18.369132 12330 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:18.364405  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:18.356534 12296 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.365576 12317 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.125943  7080 catalog_manager.cc:5697] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.395147  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.338927 12320 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.403548  7893 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:18.403216 12325 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.403334  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 964) took 1617 ms. Trace:
I20260709 13:15:18.405064 12135 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:18.405762 12349 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.407756  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.409158  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1922) took 1203 ms. Trace:
I20260709 13:15:18.439990  7254 rpcz_store.cc:276] 0709 13:15:17.206025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.872679 (+666654us) service_pool.cc:224] Handling call
0709 13:15:18.408765 (+536086us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b5400217ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:18.408971 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124928768}
I20260709 13:15:18.373628  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:18.411345  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2226) took 1481 ms. Trace:
I20260709 13:15:18.412638  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:18.412806  7890 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:18.412875 12380 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:18.413522  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:18.414000  7186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2215) took 1566 ms (client timeout 1824 ms). Trace:
I20260709 13:15:18.427374 12330 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:18.416800 11431 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:18.446535 11431 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:18.426393  7181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2238) took 1241 ms (client timeout 1549 ms). Trace:
W20260709 13:15:18.447284  7181 rpcz_store.cc:269] 0709 13:15:17.175160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.254559 (+1079399us) service_pool.cc:224] Handling call
0709 13:15:18.416639 (+162080us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.425177  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:18.429891  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.430850  7187 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:18.432149  7150 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:18.432533  7255 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:18.415225  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.449868  7887 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:18.423401 12332 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:18.441802  7183 rpcz_store.cc:276] 0709 13:15:16.930239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.085376 (+155137us) service_pool.cc:224] Handling call
0709 13:15:18.411043 (+1325667us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540017cd54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:18.411240 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484346240}
W20260709 13:15:18.442798  7186 rpcz_store.cc:269] 0709 13:15:16.847714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.967324 (+119610us) service_pool.cc:224] Handling call
0709 13:15:18.413567 (+1446243us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b5400257954. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:18.413770 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040905984}
I20260709 13:15:18.452281  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.448695  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.452356 12330 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.461829 12330 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:18.454052  7212 heartbeater.cc:646] Failed to heartbeat to 127.5.227.190:45419 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.5.227.190:45419 timed out after 15.000s (SENT)
I20260709 13:15:18.455199 12126 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:18.459020  7335 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:18.464702  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.455376  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.452260  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:18.454119  7262 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:18.466010  7256 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.454036 12317 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.460350 12380 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.460721  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:18.436280 12325 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.436661  7178 rpcz_store.cc:276] 0709 13:15:16.785815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.146182 (+360367us) service_pool.cc:224] Handling call
0709 13:15:17.146455 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.146691 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:17.857255 (+710564us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.402695 (+545440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.402809 (+   114us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:18.402883 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.402967 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.403142 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4445,"prepare.queue_time_us":752423,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":8441,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":5302,"thread_start_us":587547,"threads_started":2,"wal-append.queue_time_us":444306}
W20260709 13:15:18.472826  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.473356  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.474123  7178 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:18.474344 12320 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:18.474677  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2239) took 1233 ms. Trace:
I20260709 13:15:18.474774  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.475186  7178 rpcz_store.cc:276] 0709 13:15:17.241443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.473021 (+1231578us) service_pool.cc:224] Handling call
0709 13:15:18.474600 (+  1579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.478223  7185 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:18.472306  7258 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:18.468713 12325 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.493139  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.498462  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:18.500976  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 114990us
W20260709 13:15:18.505019  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 73034.4us
I20260709 13:15:18.510269  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.506907  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.513013  7254 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:15:18.500672 11431 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.513450  7254 pending_rounds.cc:85] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 9
I20260709 13:15:18.514482  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.512305  7887 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:18.518182  7896 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
W20260709 13:15:18.520174  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 187475us
I20260709 13:15:18.518611  7896 pending_rounds.cc:85] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 12
I20260709 13:15:18.517107  7254 pending_rounds.cc:107] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:15:18.520953  7896 pending_rounds.cc:107] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 17.13
W20260709 13:15:18.518201  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 158885us
I20260709 13:15:18.523885  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.522336  7254 raft_consensus.cc:2889] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:18.522748  7896 raft_consensus.cc:2889] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:18.530342  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:18.531812  7327 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:18.515400 12205 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:18.532555  7181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2236) took 1358 ms (client timeout 1778 ms). Trace:
W20260709 13:15:18.534427  7181 rpcz_store.cc:269] 0709 13:15:17.174484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.468817 (+1294333us) service_pool.cc:224] Handling call
0709 13:15:18.532485 (+ 63668us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:18.535792  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.538058 11431 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.539085  7334 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:18.538949 12291 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:18.539598 12291 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:18.539901 12317 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:18.540042 12364 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.265s	user 0.014s	sys 0.009s
I20260709 13:15:18.540562 12317 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.543206 12317 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.543381  7150 leader_election.cc:400] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 11.
I20260709 13:15:18.531842 12325 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:15:18.552143 11870 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.586s	user 0.013s	sys 0.006s
W20260709 13:15:18.554311 12327 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.007s
W20260709 13:15:18.555912 12322 consensus_meta.cc:287] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.512s	user 0.004s	sys 0.011s
I20260709 13:15:18.514405 12135 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.559192 12296 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:18.560519  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 969) took 1362 ms. Trace:
I20260709 13:15:18.565583  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:18.609086  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.586024 12232 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:18.568311  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.567763  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.573137  7187 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
W20260709 13:15:18.573848  7185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2233) took 1400 ms (client timeout 1732 ms). Trace:
I20260709 13:15:18.574813  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.576081  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:18.611627  7187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 969) took 1451 ms (client timeout 1572 ms). Trace:
I20260709 13:15:18.576610  7335 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:18.577427  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.578529 12081 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:18.578779  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.580117  7262 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
W20260709 13:15:18.611621  7185 rpcz_store.cc:269] 0709 13:15:17.173627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.394749 (+1221122us) service_pool.cc:224] Handling call
0709 13:15:18.573639 (+178890us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b54002706d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:18.573786 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85672832}
W20260709 13:15:18.613173  7301 connection.cc:256] RPC call timeout handler was delayed by -2.00094117499998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
I20260709 13:15:18.613420  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1917) took 1454 ms. Trace:
I20260709 13:15:18.614017  7254 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:15:18.580195  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:18.581182  7260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3078) took 1937 ms (client timeout 1858 ms). Trace:
I20260709 13:15:18.613508  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.587402  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.580281  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 961) took 2004 ms. Trace:
I20260709 13:15:18.587893 12380 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:18.589080  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 45939.6us
I20260709 13:15:18.586024  7256 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:18.613472  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:18.591548 12325 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.596248  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.622617 12325 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:18.623270  7896 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:18.624512  7336 raft_consensus.cc:2410] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:15:18.598121  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:18.591631 12197 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:15:18.600565 12386 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:15:18.609088  7261 rpcz_store.cc:276] 0709 13:15:17.198054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.080070 (+882016us) service_pool.cc:224] Handling call
0709 13:15:18.080574 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.239647 (+159073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.560206 (+320559us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400218ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:18.560426 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363816192}
I20260709 13:15:18.569063  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2221) took 1668 ms. Trace:
W20260709 13:15:18.612252  7187 rpcz_store.cc:269] 0709 13:15:17.160388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.364057 (+1203669us) service_pool.cc:224] Handling call
0709 13:15:18.611564 (+247507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.617161  7178 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
W20260709 13:15:18.627712  7178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2234) took 1453 ms (client timeout 1865 ms). Trace:
W20260709 13:15:18.628113  7178 rpcz_store.cc:269] 0709 13:15:17.173917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.492876 (+1318959us) service_pool.cc:224] Handling call
0709 13:15:18.574699 (+ 81823us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117eee 0000000000375939 00007fecee18b1e0 00007fecee2540c4 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:15:18.627651 (+ 52952us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4067712}
I20260709 13:15:18.613926  7257 rpcz_store.cc:276] 0709 13:15:17.159013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.159169 (+   156us) service_pool.cc:224] Handling call
0709 13:15:18.607790 (+1448621us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5400058a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:18.613361 (+  5571us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025432448}
W20260709 13:15:18.615355  7260 rpcz_store.cc:269] 0709 13:15:16.644282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.776963 (+132681us) service_pool.cc:224] Handling call
0709 13:15:18.580917 (+1803954us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400226fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:18.581089 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2657558400}
I20260709 13:15:18.619643  7262 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:18.617383 12213 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.621695  7334 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:18.616160  7180 rpcz_store.cc:276] 0709 13:15:16.575907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.130404 (+554497us) service_pool.cc:224] Handling call
0709 13:15:18.435880 (+1305476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.436256 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.436281 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.436341 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:18.436369 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.436420 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.579965 (+143545us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400257950. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:18.580124 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2910719744}
I20260709 13:15:18.631383  7255 raft_consensus.cc:2368] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12.
I20260709 13:15:18.633212  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:18.633477  7186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 970) took 1469 ms (client timeout 1953 ms). Trace:
I20260709 13:15:18.634018  7187 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:15:18.633910  7186 rpcz_store.cc:269] 0709 13:15:17.164013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.565211 (+1401198us) service_pool.cc:224] Handling call
0709 13:15:18.633416 (+ 68205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.611377 12071 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.636765  7258 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:18.627236  7182 rpcz_store.cc:276] 0709 13:15:16.900319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.112210 (+211891us) service_pool.cc:224] Handling call
0709 13:15:18.568818 (+1456608us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002c4f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:18.568987 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2898367360}
I20260709 13:15:18.637027  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:18.639389  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.640944  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2874) took 2763 ms. Trace:
I20260709 13:15:18.644076  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:18.628525 12197 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:18.645887 12197 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.645924  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:18.647055  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.647296  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.647953  7888 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:18.647830  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:18.649027  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:18.649986  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:18.650215  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.650820 12187 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:18.651257 12187 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:18.651690 12187 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.652228 12296 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:18.652825 12296 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:18.653234  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:18.642305  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2231) took 1469 ms. Trace:
I20260709 13:15:18.654872  7183 rpcz_store.cc:276] 0709 13:15:17.172998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.567400 (+1394402us) service_pool.cc:224] Handling call
0709 13:15:18.642231 (+ 74831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.655853  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:18.657029  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.657397  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.657900  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:18.658813  7890 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:18.658986 12213 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.660382  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:18.661263 12213 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:18.661696  7888 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:18.661796 11431 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:18.662411 11431 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.662834 11431 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.663048  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.663336  7330 raft_consensus.cc:2410] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:15:18.663218 11963 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:18.607375 12332 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.664254  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:18.664687 12344 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:18.665076 12344 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:18.665452 12344 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:18.665577  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.666976  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.667573  7893 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:18.658855  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2232) took 1485 ms. Trace:
I20260709 13:15:18.667948  7183 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:18.668149  7181 rpcz_store.cc:276] 0709 13:15:17.173333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.597150 (+1423817us) service_pool.cc:224] Handling call
0709 13:15:18.658781 (+ 61631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.653898 12296 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.646947  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.670255  7336 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 11: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:18.662443  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2207) took 1876 ms. Trace:
I20260709 13:15:18.668356 12317 raft_consensus.cc:2764] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:15:18.675149  7256 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:18.678489  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:18.680596 11431 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.683056  7187 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:18.684552  7861 leader_election.cc:400] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12.
I20260709 13:15:18.684911  7861 leader_election.cc:403] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:15:18.685010  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:18.680454  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.685055  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2210) took 1873 ms. Trace:
I20260709 13:15:18.687742  7183 rpcz_store.cc:276] 0709 13:15:16.802929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.668683 (+1865754us) service_pool.cc:224] Handling call
0709 13:15:18.669089 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.671713 (+  2624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.671737 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.676311 (+  4574us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:18.676372 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.676464 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.676596 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6953}
I20260709 13:15:18.612591 12327 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.661339 12333 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 9. Current term is 11.
I20260709 13:15:18.690122  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.670774  7184 rpcz_store.cc:276] 0709 13:15:16.785560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.144497 (+358937us) service_pool.cc:224] Handling call
0709 13:15:17.144816 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:17.145006 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.145034 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:17.145456 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:15:17.863389 (+717933us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:17.863444 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.863544 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.587602 (+724058us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b18003a1ec0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:18.625883 (+ 38281us) raft_consensus.cc:1685] finished
0709 13:15:18.625913 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.662268 (+ 36355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58944896,"thread_start_us":308001,"threads_started":1,"wal-append.queue_time_us":695478}
W20260709 13:15:18.691823  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 183269us
I20260709 13:15:18.625579 12322 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.664276 11963 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:18.694545  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.694465  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.703402  7330 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:18.661929 12213 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:18.701138  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.702445  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:18.710570 11431 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:18.642868  7179 rpcz_store.cc:276] 0709 13:15:15.877687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.153128 (+1275441us) service_pool.cc:224] Handling call
0709 13:15:17.153403 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.153583 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:18.337488 (+1183905us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.594213 (+256725us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.609938 (+ 15725us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:18.620310 (+ 10372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.630431 (+ 10121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.640819 (+ 10388us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10468,"prepare.queue_time_us":781823,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":52436,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":5160,"thread_start_us":1250449,"threads_started":2}
I20260709 13:15:18.716317  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.722236  7259 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:18.686218 12198 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:18.703022 11963 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:18.734609  7328 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:18.714521 12205 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:18.732817  7327 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:18.733050  7178 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:18.740839 12232 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.741436  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 966) took 1659 ms. Trace:
I20260709 13:15:18.733232  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.742372  7895 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:18.742859  7329 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:18.742995  7182 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:15:18.743702  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2220) took 1843 ms. Trace:
I20260709 13:15:18.743996  7182 rpcz_store.cc:276] 0709 13:15:16.900061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.714710 (+1814649us) service_pool.cc:224] Handling call
0709 13:15:18.742612 (+ 27902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.743427 (+   815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.743628 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.724153  7890 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:18.741873  7178 rpcz_store.cc:276] 0709 13:15:17.082009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.740387 (+1658378us) service_pool.cc:224] Handling call
0709 13:15:18.740835 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.741051 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.741082 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.741149 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:18.741205 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.741256 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.741350 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.745622 12333 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:18.745822  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2884) took 1614 ms. Trace:
I20260709 13:15:18.746281 12333 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.746251  7178 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:18.737517  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.746207  7182 rpcz_store.cc:276] 0709 13:15:17.131782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.744798 (+1613016us) service_pool.cc:224] Handling call
0709 13:15:18.745218 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.745502 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.745524 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.745566 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:18.745605 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.745660 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.745771 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.751346  7185 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:18.759294  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2887) took 1616 ms. Trace:
I20260709 13:15:18.759747  7178 rpcz_store.cc:276] 0709 13:15:17.132461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.745679 (+1613218us) service_pool.cc:224] Handling call
0709 13:15:18.746025 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.748605 (+  2580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.748780 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:18.761008  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 103199us
W20260709 13:15:18.762732  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.763731  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2209) took 1956 ms. Trace:
I20260709 13:15:18.764211  7185 rpcz_store.cc:276] 0709 13:15:16.802562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.683678 (+1881116us) service_pool.cc:224] Handling call
0709 13:15:18.714066 (+ 30388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.758852 (+ 44786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.759017 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.747867 12327 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.768337  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.749509 12205 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:18.787334 12205 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:18.790964  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 162665us
I20260709 13:15:18.792109  7299 leader_election.cc:400] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16.
I20260709 13:15:18.793447  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:18.779934  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:18.799885  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:18.785931 11963 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.711787 12380 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:15:18.780494  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.780881  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2216) took 1901 ms. Trace:
I20260709 13:15:18.780985 12377 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.806648 12377 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.809188 12377 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.810781  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 965) took 1581 ms. Trace:
I20260709 13:15:18.810956  7887 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:18.811950  7331 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:18.813455 11963 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:18.814265 12135 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.814528  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:18.811229  7253 rpcz_store.cc:276] 0709 13:15:17.197011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.890342 (+693331us) service_pool.cc:224] Handling call
0709 13:15:17.895280 (+  4938us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:18.072112 (+176832us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:18.208505 (+136393us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.433762 (+225257us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:18.479632 (+ 45870us) log.cc:844] Serialized 78 byte log entry
0709 13:15:18.479829 (+   197us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:18.479876 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.570694 (+ 90818us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54001a2554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:18.570747 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.767387 (+196640us) raft_consensus.cc:1685] finished
0709 13:15:18.770074 (+  2687us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.778507 (+  8433us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188275,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":51657,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":419,"spinlock_wait_cycles":403345792,"thread_start_us":305914,"threads_started":2,"wal-append.queue_time_us":270499}
I20260709 13:15:18.804437 12333 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.781404 12343 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.819595 12343 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.822090 12343 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:18.766732 12317 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:18.822754 12317 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:18.823211 12317 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.782723 12385 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:18.783160 12328 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:15:18.831223 12328 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:18.831641 12328 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:18.832628 12328 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.834111 12328 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:18.834849  7179 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:18.835119 12326 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:18.835476 12326 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:18.835603  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 965) took 1754 ms. Trace:
I20260709 13:15:18.835991  7179 rpcz_store.cc:276] 0709 13:15:17.081663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.748338 (+1666675us) service_pool.cc:224] Handling call
0709 13:15:18.804332 (+ 55994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.835318 (+ 30986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.835539 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.836531 12326 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.837728  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 968) took 1684 ms. Trace:
W20260709 13:15:18.838696 12071 consensus_queue.cc:1175] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 11 status { last_received { term: 11 index: 11 } last_committed_idx: 10 last_received_current_leader { term: 11 index: 11 } }
I20260709 13:15:18.840588 12197 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.803910  7893 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 13: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:18.805496  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:18.818598  7254 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:18.822120  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:18.781299 12322 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.841300  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2878) took 2017 ms. Trace:
I20260709 13:15:18.857434  7327 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:18.857241  7181 rpcz_store.cc:276] 0709 13:15:16.823742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.668972 (+1845230us) service_pool.cc:224] Handling call
0709 13:15:18.669344 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.669675 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.669702 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.670184 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:15:18.750942 (+ 80758us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:18.750976 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.751037 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:18.841090 (+ 90053us) raft_consensus.cc:1685] finished
0709 13:15:18.841109 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.841226 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":80322,"threads_started":1,"wal-append.queue_time_us":169097}
I20260709 13:15:18.858866  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.859612  7334 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:18.842582 12340 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:18.862743  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 58421us
W20260709 13:15:18.846009 12387 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:15:18.824049  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61991.2us
W20260709 13:15:18.865466  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 47226.5us
I20260709 13:15:18.785997 12091 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.838146  7179 rpcz_store.cc:276] 0709 13:15:17.152837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.836766 (+1683929us) service_pool.cc:224] Handling call
0709 13:15:18.837165 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.837369 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.837392 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.837467 (+    75us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:18.837495 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.837553 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.837664 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.852416  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 967) took 1704 ms. Trace:
I20260709 13:15:18.867153  7182 rpcz_store.cc:276] 0709 13:15:17.147852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.758679 (+1610827us) service_pool.cc:224] Handling call
0709 13:15:18.797795 (+ 39116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.852081 (+ 54286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.852109 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.852156 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:18.852188 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.852244 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.852360 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.762355 12198 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:18.837664 12326 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:18.841904  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 48610.9us
I20260709 13:15:18.817512 12377 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:15:18.863880  7859 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:18.804773  7187 rpcz_store.cc:276] 0709 13:15:16.879119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.707669 (+1828550us) service_pool.cc:224] Handling call
0709 13:15:18.725461 (+ 17792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.771549 (+ 46088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.771578 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.780598 (+  9020us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:18.780640 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.780706 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.780828 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6887,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":25207}
I20260709 13:15:18.853555 12335 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:18.360597  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:18.868939  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:18.875589  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53606.7us
I20260709 13:15:18.885309  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:18.888064  7327 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:18.834615 12344 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.888980  7080 catalog_manager.cc:5697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 10 to 11, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 11 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.889896  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.890806  7336 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:18.890975  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:18.891637  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:18.892153  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.892302  7181 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
W20260709 13:15:18.892606  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.893014  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2889) took 1689 ms. Trace:
I20260709 13:15:18.893404  7181 rpcz_store.cc:276] 0709 13:15:17.203658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.858856 (+1655198us) service_pool.cc:224] Handling call
0709 13:15:18.892039 (+ 33183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.892763 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.892960 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:18.895102  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 129533us
I20260709 13:15:18.895584  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.896243  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:18.893039  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.897469 12291 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.898222  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.898900  7335 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:18.890733  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.900573 12291 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.902853  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.903033 12340 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:18.903666  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 973) took 1607 ms. Trace:
I20260709 13:15:18.903859  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.904119  7179 rpcz_store.cc:276] 0709 13:15:17.848164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.882106 (+1033942us) service_pool.cc:224] Handling call
0709 13:15:18.903050 (+ 20944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.903299 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.903325 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.903382 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:18.903411 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.903476 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:18.903589 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:18.905812 12344 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:18.907617 12394 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:15:18.907783 12317 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:18.873765 12376 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:18.909830 12376 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.910190 12376 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:18.913009  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49409us
I20260709 13:15:18.913297 12330 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:18.914247  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:18.896291  7185 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:18.903040  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.917409  7260 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:18.917352  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:18.920046  7328 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:18.921347  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 136415us
I20260709 13:15:18.924686  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.932999  7187 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:18.932433  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:18.944001 12291 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:18.946301 12383 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:18.913040 12110 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:18.948129 12110 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.948508 12110 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:18.967962  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.951504  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:18.919569 11799 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:15:18.969066  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 51999.2us
I20260709 13:15:18.975088  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:18.986918  7254 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:18.932484 12069 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:18.932317 12330 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.992669  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:18.996975  7336 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:19.003419  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2888) took 1853 ms. Trace:
I20260709 13:15:18.999871  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:19.001417  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:19.001683  7331 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:19.004227  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:19.005205  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:18.975117 12296 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:19.007683  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 93593.1us
I20260709 13:15:18.998184  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:18.988889 11799 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:18.975452 12322 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:15:18.992218 12069 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:19.002796 12317 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:18.994426 12341 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:19.016304  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.017302  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:19.022879  7187 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
W20260709 13:15:19.024358  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 125787us
I20260709 13:15:18.906191  7080 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.002516 12291 consensus_queue.cc:1243] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:15:19.031687 12135 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.035367 12197 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:19.040045 12069 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.030894 12333 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:19.001165 12330 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.047317 12341 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:19.065315  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.068373 12383 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:19.038817  7182 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:19.083312 12402 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:15:19.084515 12333 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:19.084867 12330 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:19.085000 12333 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:19.075371 11870 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
W20260709 13:15:19.072674  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83162.8us
I20260709 13:15:19.088967  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:19.064611  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:19.025827 12349 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.074060  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:19.077427  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2223) took 2158 ms. Trace:
W20260709 13:15:19.061703  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:19.091378  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.086030 12333 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:19.103457  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.072937 12317 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:19.087169  7889 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:19.062453 12380 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:19.099710  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:19.012912 12296 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.084322 12383 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.091099  7184 rpcz_store.cc:276] 0709 13:15:16.904791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.711496 (+1806705us) service_pool.cc:224] Handling call
0709 13:15:18.769014 (+ 57518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.801668 (+ 32654us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:18.999944 (+198276us) log.cc:844] Serialized 14 byte log entry
0709 13:15:19.063248 (+ 63304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:19.063301 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:19.063342 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.063408 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.063530 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4879,"prepare.queue_time_us":263523,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5826,"raft.queue_time_us":5343,"raft.run_wall_time_us":3044,"spinlock_wait_cycles":2833152,"thread_start_us":224778,"threads_started":2}
W20260709 13:15:19.104760  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 135051us
I20260709 13:15:19.097785 12213 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:19.079592 12377 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:15:19.081176 12135 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:19.139464  7152 leader_election.cc:336] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.626s (SENT)
I20260709 13:15:19.088974 12341 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:19.150836  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 76856.8us
I20260709 13:15:19.156347  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:19.140465 12377 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:19.195551  7336 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:19.195390 11431 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:19.105984 12317 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:19.115476 12402 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:19.127838 12296 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:19.212077  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:19.182232 12385 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12.
W20260709 13:15:19.202867  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.141146 12135 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:19.218791  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.124158 12198 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:19.220578  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:19.131137 12333 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:19.209625  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:19.210476  7333 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:15:19.124433 12400 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:15:19.214073 12402 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.215104  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:19.215476  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 190321us
I20260709 13:15:19.190649 11870 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:19.267331  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:19.288822  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2880) took 2394 ms. Trace:
I20260709 13:15:19.132654 12110 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.124716 12091 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:19.205569 12317 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:19.130761 12349 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.144690 12071 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:15:19.287214 11431 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:15:19.289467  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:19.324054  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.288224  7254 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
W20260709 13:15:19.205379 12187 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.003s
I20260709 13:15:19.288632  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:19.293112  7331 raft_consensus.cc:2368] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14.
I20260709 13:15:19.291365  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:19.291102  7183 rpcz_store.cc:276] 0709 13:15:16.824374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.694194 (+1869820us) service_pool.cc:224] Handling call
0709 13:15:18.730287 (+ 36093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.736004 (+  5717us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:18.940095 (+204091us) log.cc:844] Serialized 14 byte log entry
0709 13:15:19.179617 (+239522us) log.cc:844] Serialized 14 byte log entry
0709 13:15:19.217600 (+ 37983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:19.218280 (+   680us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:19.218357 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.218503 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.218995 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":268799,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":124,"raft.queue_time_us":129684,"spinlock_wait_cycles":10506368,"thread_start_us":381967,"threads_started":3}
I20260709 13:15:19.326949  7330 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:19.213416 11963 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 13:15:19.327020 12187 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.266808 12418 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 13:15:19.329854 12187 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:19.330749  7261 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
W20260709 13:15:19.332736  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44208us
I20260709 13:15:19.291558 12402 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:19.138749 11799 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.343544 11431 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:19.323818 12325 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.700s	user 0.003s	sys 0.010s
I20260709 13:15:19.345598  7336 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:19.357163  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:19.358265 12091 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:19.331375 11870 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:19.360323  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:19.360849 11870 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:19.362249 12401 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:15:19.367539  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2890) took 1018 ms. Trace:
I20260709 13:15:19.367695 12376 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.368019  7185 rpcz_store.cc:276] 0709 13:15:18.349188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.969695 (+620507us) service_pool.cc:224] Handling call
0709 13:15:18.994227 (+ 24532us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:19.015804 (+ 21577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.015850 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:19.067005 (+ 51155us) log.cc:844] Serialized 52 byte log entry
0709 13:15:19.212676 (+145671us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:19.212714 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.212778 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.367285 (+154507us) raft_consensus.cc:1685] finished
0709 13:15:19.367309 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.367473 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6455,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":18528,"thread_start_us":70839,"threads_started":1,"wal-append.queue_time_us":269637}
I20260709 13:15:19.370021  7887 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:15:19.373128  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:19.377463  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:19.378893 12081 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:19.379825 12081 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:19.380257 12081 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.380678 12081 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:19.383148  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:19.393023 12328 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.004s
I20260709 13:15:19.394783 12376 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:19.396535 12349 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:19.402704  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:19.403908 12411 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:19.406050  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:19.406726 12413 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:19.407378 12413 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.407814 12413 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:19.408000  7299 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:19.413412  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3104) took 1012 ms. Trace:
I20260709 13:15:19.414022  7253 rpcz_store.cc:276] 0709 13:15:18.400805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.816490 (+415685us) service_pool.cc:224] Handling call
0709 13:15:18.816877 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.856077 (+ 39200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.856106 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.919065 (+ 62959us) log.cc:844] Serialized 26 byte log entry
0709 13:15:19.105439 (+186374us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:19.120467 (+ 15028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.120544 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.413118 (+292574us) raft_consensus.cc:1685] finished
0709 13:15:19.413146 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.413330 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94455,"raft.queue_time_us":47434,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":8950,"thread_start_us":116748,"threads_started":1,"wal-append.queue_time_us":469250}
I20260709 13:15:19.418938  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:19.428123 12384 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:19.428766 12384 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:19.429889 12384 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.431381 12325 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.432276 12384 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:19.435031  7180 raft_consensus.cc:2368] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12.
W20260709 13:15:19.447427  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:19.457834  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 358202us
W20260709 13:15:19.324173 12386 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.103s	user 0.005s	sys 0.004s
I20260709 13:15:19.434448 12325 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:19.348724  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50929.3us
I20260709 13:15:19.350191  7330 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:19.294895 12198 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:19.475081  7334 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:19.478579  7333 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:19.479393  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:19.475092 11431 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.483778  7893 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:19.484875  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:19.342142 12205 consensus_meta.cc:287] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.541s	user 0.016s	sys 0.003s
I20260709 13:15:19.476792  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:19.463333 12091 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:19.491108  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.429935 12081 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.519218 12205 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.520558  7186 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:19.521737 12205 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:19.495015  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:19.525156  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:19.526145  7330 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:19.528191  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:19.529039  7893 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
W20260709 13:15:19.529896  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 169745us
I20260709 13:15:19.530330  7254 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:15:19.532305  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:19.534925  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.488128 12349 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:19.492995 12376 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:15:19.549542  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 460627us
I20260709 13:15:19.551700  7330 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:15:19.553802  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:19.487064 12213 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:19.551472  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:19.557610  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:19.559104  7893 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:19.561679  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:19.548038 11870 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:19.546208 12325 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:19.552500 12376 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.574862 12376 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.574941 12432 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:15:19.576699  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 437262us
W20260709 13:15:19.577148  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.560467 12328 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:19.579030 12328 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:19.579435 12328 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.579643 12422 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:19.548419 12110 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:19.580780 11804 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:19.581152 12325 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:19.581163 11804 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:19.582015  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 979) took 1113 ms. Trace:
I20260709 13:15:19.582134 12325 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.583065 11804 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.583727 12081 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:19.584365 11804 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:19.586014  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.576594  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:19.586802  7180 rpcz_store.cc:276] 0709 13:15:18.468378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.643377 (+174999us) service_pool.cc:224] Handling call
0709 13:15:19.581773 (+938396us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54001b35d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:19.581922 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812400512}
I20260709 13:15:19.565578  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:19.590315  7890 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:19.590931 12425 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:19.591444 12425 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:19.591848 12425 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:19.594761 12427 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:15:19.003818  7178 rpcz_store.cc:276] 0709 13:15:17.150071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.760490 (+1610419us) service_pool.cc:224] Handling call
0709 13:15:18.779055 (+ 18565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.853343 (+ 74288us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:18.944262 (+ 90919us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.997987 (+ 53725us) log.cc:844] Serialized 14 byte log entry
0709 13:15:18.998146 (+   159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:18.998187 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:19.003132 (+  4945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.003220 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.003354 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47301,"raft.queue_time_us":56989,"spinlock_wait_cycles":5740800,"thread_start_us":59805,"threads_started":2}
I20260709 13:15:19.598979  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:19.600834  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 399259us
I20260709 13:15:19.557823 12205 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:19.608183 12205 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.610049 11870 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:19.615242  7254 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:19.615536 12213 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:19.616967  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.622575 12432 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:19.624054 12081 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:19.624565 12081 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:19.624989 12081 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:19.625576  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3103) took 1225 ms. Trace:
I20260709 13:15:19.622617 12426 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:19.627426  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 50946.7us
I20260709 13:15:19.628816  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:19.629709  7302 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:19.631294  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 45523.2us
W20260709 13:15:19.633327  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 67824.3us
I20260709 13:15:19.574093 12341 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.625955  7262 rpcz_store.cc:276] 0709 13:15:18.400490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.812612 (+412122us) service_pool.cc:224] Handling call
0709 13:15:18.813064 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.838042 (+ 24978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.838074 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:19.218534 (+380460us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:19.286443 (+ 67909us) log.cc:844] Serialized 26 byte log entry
0709 13:15:19.543023 (+256580us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:19.547871 (+  4848us) log.cc:844] Serialized 14 byte log entry
0709 13:15:19.548307 (+   436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.548386 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.586218 (+ 37832us) raft_consensus.cc:1685] finished
0709 13:15:19.625323 (+ 39105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.625506 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10638,"prepare.queue_time_us":4652,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":43652,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":6939,"spinlock_wait_cycles":40422400,"thread_start_us":211828,"threads_started":1,"wal-append.queue_time_us":226651}
I20260709 13:15:19.643508 11431 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:19.644347  7335 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:19.610406 12205 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:19.650050  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.650271  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:19.655167 11431 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:19.657393  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54988.4us
I20260709 13:15:19.661201  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:19.658227  7150 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:19.639683 12333 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:19.667644  7327 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:19.668671  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:19.671788  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:19.658851 12205 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:19.633000 12402 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.683431  7893 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:19.667085 12384 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:19.666987 12091 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:19.667644 12333 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:19.689632  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 249834us
I20260709 13:15:19.690775  7336 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:19.690960  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:19.688369  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:19.671624 11431 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.674438 12205 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.697973  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:19.702973  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44592.1us
I20260709 13:15:19.691205 12291 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:19.689071 12422 raft_consensus.cc:2764] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:15:19.690850 12333 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:19.708443  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:19.696542 12071 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:15:19.704823 12069 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.002s
I20260709 13:15:19.697645 12384 raft_consensus.cc:697] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:19.702797 12205 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:19.721947  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 65430.5us
I20260709 13:15:19.707432 12187 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:19.724265 12071 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:19.727475  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:19.727696  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.728371  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.729103  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.742977  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.744683  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.729252 12344 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:19.729813  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.708949 12291 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:19.730830 12430 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:19.731369 12402 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:19.733111  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:19.730458  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.754346  7335 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:19.754784  7260 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:19.756021  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.756776  7260 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:19.750137 12325 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:19.757757 12325 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:19.758139 12325 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.746193  7255 raft_consensus.cc:2376] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15. Re-sending same reply.
I20260709 13:15:19.748144  7257 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:19.750389  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.759560  7259 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:15:19.759431  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.747464  7256 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:19.702327 12413 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.749923  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.775298  7257 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:19.702391 12434 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:15:19.752496  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.753410  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:19.781299  7254 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:19.781414 12422 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.782112 12422 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.783138 12402 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:19.784511 12422 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:19.750363 12291 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:19.788627 12431 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:19.751211 12430 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.768363  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.789552 12430 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.789655 12431 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:15:19.790539  7083 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47542 (request call id 235) took 16874 ms (client timeout 15000 ms). Trace:
I20260709 13:15:19.799705 12434 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:19.773663 12081 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.775393  7262 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:19.800209 12434 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:19.725064 12213 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:15:19.801087 12213 consensus_queue.cc:1243] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:19.801854 12213 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:19.801149 12434 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.752444 12419 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:19.795014 12341 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:19.791266  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.791590 12071 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.790871  7080 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: config changed from index 4 to 6, term changed from 6 to 7, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to <none>, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:19.804453  7080 catalog_manager.cc:5697] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.806869 12296 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:19.807579 12296 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:19.808634 12296 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.809386 12425 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.810137 12296 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:19.811625 12425 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:19.811856 12081 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:19.710362 12376 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.790841 12380 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:15:19.796653  7083 rpcz_store.cc:269] 0709 13:15:02.916063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.916731 (+   668us) service_pool.cc:224] Handling call
0709 13:15:19.790327 (+16873596us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:10.826040 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:10.826763 (+   723us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:10.826846 (+    83us) write_op.cc:435] Acquired schema lock
0709 13:15:10.826865 (+    19us) tablet.cc:662] Decoding operations
0709 13:15:10.828756 (+  1891us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:10.828866 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:10.828891 (+    25us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:15:10.881926 (+ 53035us) tablet.cc:701] Row locks acquired
0709 13:15:10.881991 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:15:10.882174 (+   183us) write_op.cc:270] Start()
0709 13:15:10.882350 (+   176us) write_op.cc:276] Timestamp: P: 1783602910882106 usec, L: 0
0709 13:15:10.882393 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:15:10.883247 (+   854us) log.cc:844] Serialized 10164 byte log entry
0709 13:15:11.543032 (+659785us) op_driver.cc:464] REPLICATION: finished
0709 13:15:11.886260 (+343228us) write_op.cc:301] APPLY: starting
0709 13:15:11.906096 (+ 19836us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:12.498992 (+592896us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:12.521783 (+ 22791us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:13.849364 (+1327581us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:13.849735 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=0,mrs_lookups=0
0709 13:15:13.849788 (+    53us) write_op.cc:312] APPLY: finished
0709 13:15:13.852861 (+  3073us) log.cc:844] Serialized 228 byte log entry
0709 13:15:14.168361 (+315500us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:14.185598 (+ 17237us) write_op.cc:454] Released schema lock
0709 13:15:14.191195 (+  5597us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:14.279448 (+ 88253us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:14.282504 (+  3056us) write_op.cc:454] Released schema lock
0709 13:15:15.648103 (+1365599us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b180029adc0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
Metrics: {"mutex_wait_us":12877,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":318873,"apply.run_cpu_time_us":72261,"apply.run_wall_time_us":2364074,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112963,"num_ops":26,"prepare.queue_time_us":143288,"prepare.run_cpu_time_us":8485,"prepare.run_wall_time_us":66088,"raft.queue_time_us":90805,"raft.run_cpu_time_us":59827,"raft.run_wall_time_us":141384,"replication_time_us":660454,"spinlock_wait_cycles":7082752,"thread_start_us":601507,"threads_started":5,"wal-append.queue_time_us":448081,"wal-append.run_cpu_time_us":35153,"wal-append.run_wall_time_us":2625562}]]}
I20260709 13:15:19.812731 12380 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:19.813423  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 971) took 2640 ms. Trace:
I20260709 13:15:19.810513  7254 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:19.813951 12376 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:19.813700 12380 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.814404  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3100) took 1414 ms. Trace:
I20260709 13:15:19.811436 12426 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:19.758010  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.709244 12317 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.776317  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.825318  7258 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:19.827406  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.829118  7861 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:19.830050 12376 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:19.814900  7261 rpcz_store.cc:276] 0709 13:15:18.399616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.636465 (+236849us) service_pool.cc:224] Handling call
0709 13:15:18.650988 (+ 14523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.331182 (+680194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.814143 (+482961us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54002279d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:19.814310 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562775424}
I20260709 13:15:19.806951 12384 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.816057  7893 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:19.800529 12413 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:19.817196  7186 rpcz_store.cc:276] 0709 13:15:17.173566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.846831 (+1673265us) service_pool.cc:224] Handling call
0709 13:15:18.847174 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.520953 (+673779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.813169 (+292216us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54000ed3d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:19.813359 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548204416}
I20260709 13:15:19.769217 12344 consensus_queue.cc:1243] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:15:19.782415  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:19.802222 12213 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:19.833042  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50771.8us
I20260709 13:15:19.833300 12402 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:19.833886 12402 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:19.829185  7262 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:19.834532 12402 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.824525  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.835840  7254 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:19.830593 12376 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:19.836812  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:19.837742 12425 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:19.837333 12376 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.838218 12425 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:19.824190  7335 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:19.838799 12425 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.833124 12213 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.840215 12213 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.838323  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:19.842453  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:19.843415 12431 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:19.843847 12431 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:19.844238 12431 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:19.846846 12135 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:19.847483 12135 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:19.848345 12135 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.833093  7253 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:19.857158  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.858017  7254 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.855118  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:19.717777 12069 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.862972  7260 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:19.865226 12317 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:19.868084  7259 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 12. Current term is 13. Ops: []
W20260709 13:15:19.812309 12421 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.676s	user 0.000s	sys 0.012s
W20260709 13:15:19.871737  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 240618us
I20260709 13:15:19.872540 11431 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.873656  7327 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:19.877076 12326 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:19.874364 11431 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.879202 11431 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:19.879998  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.880645  7253 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:19.881841  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:19.862183 12328 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.885100 12328 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:19.808552  7080 catalog_manager.cc:5697] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.876168  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:19.890961  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.887068  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.891213  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.898833  7254 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:19.896065  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.911049  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.911649  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:19.911846  7260 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:19.911775  7261 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:19.914075  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:19.915086  7327 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:19.915181  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:19.916654  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:19.917013  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:19.923316  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:19.931319  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:19.933148  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.934054  7262 raft_consensus.cc:2376] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16. Re-sending same reply.
I20260709 13:15:19.904557 12328 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:15:19.939280  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63738us
I20260709 13:15:19.941896  7180 raft_consensus.cc:2368] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14.
I20260709 13:15:19.941684  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:19.942909  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:19.943393  7179 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:19.946806  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:19.946801  7255 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:19.948036  7185 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:15:19.882488 12325 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.886574 12291 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:19.952821  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:19.889698 12333 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.954025  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:19.953285  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:19.959309  7327 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:19.914345 12326 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:15:19.956602  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:19.961795  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:19.966354  7330 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:19.956496  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:19.970844  7336 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:19.974308  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:19.970533  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:19.975111  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:19.978770  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.953346 12328 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:19.979799  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:19.899312  7080 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.984015  7332 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:15:19.984339 12333 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:19.985914 12409 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:19.998679 12409 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:19.999713 12409 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.000658  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:20.001384  7257 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:19.990427 12445 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:15:20.003142 12445 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:20.003509 12445 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:20.004386 12445 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.005631 12445 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:20.006763  7862 connection.cc:256] RPC call timeout handler was delayed by -1.1258714219998183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 13:15:20.006935  7887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 827) took 1026 ms. Trace:
W20260709 13:15:20.007210 12444 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:15:20.007294  7887 rpcz_store.cc:276] 0709 13:15:18.980242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.980483 (+   241us) service_pool.cc:224] Handling call
0709 13:15:18.999524 (+ 19041us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:19.370454 (+370930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.006604 (+636150us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400551ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:20.006874 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851405696}
I20260709 13:15:20.009784 12325 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:20.015347 12069 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:20.016352 12071 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:20.017694 12428 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:20.017073  7080 catalog_manager.cc:5697] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:20.018100 12428 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:20.019084 12428 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.019753 12291 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:20.020437 12428 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:20.021162  7259 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
W20260709 13:15:20.022485  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 48960.5us
I20260709 13:15:19.986886 12205 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:19.987800  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:20.023990  7890 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:20.024782 12434 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:20.027863 12205 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:19.977778  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:20.028707  7331 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:20.028764  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:19.993798  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:20.029636  7183 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:20.031028  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:20.028005  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.987574 12431 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.035142  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:20.032555  7183 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:15:20.037200  7258 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
W20260709 13:15:20.026542  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.041245  7336 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:20.038138  7895 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:20.043094  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:19.991569  7152 connection.cc:256] RPC call timeout handler was delayed by -1.0069337119998636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 13:15:20.048424  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.049399  7890 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
W20260709 13:15:20.051220  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 76959.6us
I20260709 13:15:20.060065  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:20.063017  7178 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:20.063684  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:20.065194  7890 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:20.072706  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.074090  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.061868  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:20.079581  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:20.080531  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.080533  7335 raft_consensus.cc:2410] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:15:20.082136  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:20.083101  7336 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:20.053211  7228 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:20.084610  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:20.085189  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:19.992727 12081 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:20.086875  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:20.087934  7181 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
W20260709 13:15:20.093187  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:20.093782  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.090000  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:20.095503  7336 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:20.097373  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:20.097697  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:20.097446  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:20.100492  7334 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:20.105446  7896 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:20.106853 11431 raft_consensus.cc:2764] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:15:20.035305 12317 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:20.112118  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:20.113003  7179 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:20.116869  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:20.119220  7334 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:20.120309  7890 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:20.121276  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:20.121810  7333 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:20.126271  7334 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:20.117781  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:20.123420 12344 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.129123  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:20.061204 12443 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.129585  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:20.094921 12291 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:20.131003  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:19.985005 12402 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.135742  7181 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:20.137549  7183 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:20.100108 12377 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:20.136082  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:20.102545 12343 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:20.131800  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:20.138484  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.149015  7179 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:15:20.136255  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.144593  7253 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:20.148221  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.140920  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:20.150100 11431 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:20.150527 11431 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.150990 11431 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:20.151400  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 171675us
I20260709 13:15:20.098474 12326 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:15:20.131062 12213 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.157513  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:20.161666  7336 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:20.157467  7225 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:20.145627 11804 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.005s
I20260709 13:15:20.138252 12081 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:20.166004  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:20.168776  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 115670us
W20260709 13:15:20.168936  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 107175us
I20260709 13:15:20.175338 12431 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:20.176174  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:20.164053 12328 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:20.177842 12414 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:20.181056  7183 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:20.181537  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:20.183120  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:20.183871 12419 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:20.152762 12091 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:20.185770  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50592.3us
I20260709 13:15:20.186180 12135 raft_consensus.cc:2764] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:15:20.186699  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.188234  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:20.189622  7080 catalog_manager.cc:5697] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 9 to 15, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 15 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.192102 12326 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:20.192672 12326 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:20.192026  7080 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 8 to 9, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 9 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:20.193558 12326 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.108142 12430 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.115723 12325 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:15:20.195297 12431 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:20.199270 12442 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:15:20.199687  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:20.200033 12430 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:20.200511  7329 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:20.200855  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:20.201251  7331 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:20.202945 12405 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:20.204018 12326 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:20.206972  7186 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:20.207201 12335 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:20.145833 12377 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:20.208134 12402 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:20.208833 11799 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:20.209123  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 79904.5us
I20260709 13:15:20.203083  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:20.212474  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:20.212881  7328 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:20.213366  7184 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:20.207055  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49674.8us
I20260709 13:15:20.220309  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:20.224893  7336 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:20.222709  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:20.225770  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:20.227250  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:20.156452 12291 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:20.134820 12344 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.164140 12205 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:20.168660 12081 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.146286 12425 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.237547  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:20.247378  7225 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:20.257340  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47472.1us
I20260709 13:15:20.146833 12443 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.224045 12335 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:20.238206 12419 raft_consensus.cc:2764] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:15:20.278400  7183 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:20.233677 12135 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:20.265848 11431 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.285375 12333 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:20.287019  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 98934.6us
I20260709 13:15:20.286060 12333 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.287873  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:20.288719 12198 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:20.289237  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:20.291002 12412 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:15:20.292191 12437 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:15:20.172976 12213 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.296036  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:20.296806  7185 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:20.297564  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.300899  7328 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:20.304132  7333 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:20.246598 12081 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:20.276963 12464 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:20.235046 12431 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:20.318173  7178 raft_consensus.cc:2410] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:15:20.257211 12205 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:20.246748 12426 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:15:20.291056 12249 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:20.304418 12405 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:20.308993 12402 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.314679 12343 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:20.343190 12333 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:20.344106 12443 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:20.346828  7261 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
W20260709 13:15:20.347606  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 124975us
I20260709 13:15:20.293340 12332 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:15:20.356978  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 117963us
I20260709 13:15:20.363713  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.368525  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:20.345094 12431 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:20.370817  7890 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:20.399006  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.407197  7333 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:20.390193 12091 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:20.390393 12333 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:15:20.484074  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 62664.9us
W20260709 13:15:20.486195  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 87270us
I20260709 13:15:20.493414  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.398020 12344 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:20.356103 12402 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.503307  7894 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:15:20.513229 12467 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:15:20.493743 12069 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:20.495558 12333 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:20.534024  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 236529us
W20260709 13:15:20.537298  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 242574us
W20260709 13:15:20.535830  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:20.538340  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.368450 12291 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.527696 12091 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:15:20.540699  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 47381.6us
I20260709 13:15:20.536731  7888 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:20.484179 12205 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.546799  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.548282  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.550103  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:20.533217 12333 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:20.554739 12187 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:20.555171 12187 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:20.556074 12187 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.557318 12187 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:20.559561  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.561357  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.565620  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:20.561460  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:20.569247 12340 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:20.569772 12340 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:20.577683  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.580090 12402 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:20.580864 12402 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:20.581349 12402 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:20.581722 12402 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:20.582813 12069 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:20.583439 12071 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:20.541203 12425 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:20.586351  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.587195 12405 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:20.587450 11431 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:20.589524 12380 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:20.591710  7185 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:20.630187  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:20.592415 12335 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.587960 12340 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.544945 12376 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:20.604985 12434 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.580s	user 0.001s	sys 0.010s
I20260709 13:15:20.614210  7150 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:20.616508  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:20.634037  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.625398  7184 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:20.601542 12377 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.586094 12471 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:15:20.642565 12384 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:15:20.646979  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 60799.1us
I20260709 13:15:20.642427 12376 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.642709 12335 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.648862  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.649619 12471 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.650154 12471 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.626705 12343 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.650938 12091 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:20.651684 12091 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:20.652431 12471 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:20.652729 12091 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:20.653065 11804 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:20.653446 11804 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:20.653849 12213 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:20.626981 12198 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:20.610922 12333 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.650226  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:20.654234 12445 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.001s
I20260709 13:15:20.631453 12135 raft_consensus.cc:2764] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:15:20.654335 11804 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:20.655655 12425 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:20.658435 12335 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:20.671017 12069 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:20.688160  7335 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:20.677995  7327 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:20.686964  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:20.691570  7184 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
W20260709 13:15:20.672271  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 179311us
I20260709 13:15:20.697307  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:20.698653  7183 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:20.703310  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:20.703568  7893 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
W20260709 13:15:20.705247  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 55093us
I20260709 13:15:20.706727  7890 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:20.708962  7889 raft_consensus.cc:2410] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:15:20.704602  7228 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.561s (SENT) [suppressed 22 similar messages]
I20260709 13:15:20.672823 12425 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:20.704219 12296 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.894s	user 0.009s	sys 0.005s
I20260709 13:15:20.693692 12340 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:20.726169  7225 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.706947 11804 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:20.709823 12432 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:20.736668 12462 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
I20260709 13:15:20.744328 12432 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.722360 12425 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:20.750288  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:20.750937  7253 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:20.753666  7258 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:20.754283  7887 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:20.755098 12069 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:20.746518 12432 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:20.761981  7187 raft_consensus.cc:2410] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:15:20.696496 12409 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:15:20.764078  7262 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:20.767136  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:20.767463  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:20.779114  7259 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:20.777010  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:20.792829 12333 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:20.794934  7184 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:20.799670  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:20.800539  7179 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:20.801783  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:20.803268  7182 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:20.803707 12081 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.808903  7330 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:20.731117 12472 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.810500 12472 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.813230 12472 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:20.820255  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 94207.2us
I20260709 13:15:20.821427  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.822359 12069 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:20.825809 12376 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:20.827512  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 62573.2us
I20260709 13:15:20.830232  7184 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:15:20.771498 11799 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.005s
I20260709 13:15:20.806537 12081 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:20.790148 12405 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:20.864518  7894 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:20.888859  7253 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:20.919662 12402 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:20.865767  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:20.923467  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 57780.9us
W20260709 13:15:20.923768  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.924211  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:20.924933  7181 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:20.925123  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:20.866226  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 89288.3us
W20260709 13:15:20.955684  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 251101us
W20260709 13:15:20.942711  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 63950.9us
I20260709 13:15:20.937022  7862 leader_election.cc:400] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12.
I20260709 13:15:20.979012  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:20.967885  7261 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:20.968788  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.840795 12110 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.967967  7259 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:15:20.975637  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45748.3us
I20260709 13:15:20.995596  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:20.996650  7258 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
W20260709 13:15:20.999876  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 438462us
I20260709 13:15:21.000720  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:20.926546 12341 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:15:21.006017  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.927732 12428 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:21.009804  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:21.010703  7257 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:20.929036 12402 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:20.931105 12081 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:15:21.016278  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 47575.2us
I20260709 13:15:20.967484 12432 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:20.864296 12335 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 13:15:20.978605 12405 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.048425  7254 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:15:20.834568 12425 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.053017  7259 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:15:21.051862  7861 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:21.038754  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:21.002591 12069 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.002481 11804 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:21.014802 12445 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:21.000262  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:21.064877  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:21.021998 12432 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.053758 12459 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:21.072929 11431 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:21.035046  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:21.013557 12213 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:15:21.013506 12434 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:15:21.054442 12081 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:21.021701 12412 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:15:21.018229 12296 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:15:21.047164 12341 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:21.002836 12110 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.055526 12249 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:15:21.073659  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 72825.4us
I20260709 13:15:21.075807 11431 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.104411 11431 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:21.079869  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:21.099177  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 120249us
I20260709 13:15:21.029011 12428 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.064484 12405 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.114871  7185 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:21.067152 12069 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:21.082772  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 47882.1us
I20260709 13:15:21.118268  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:21.123230  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:21.074934 12324 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:21.075495 12459 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:21.082652 12445 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:21.075044 12432 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:21.077009 12187 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:21.083587 12376 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:15:21.144182  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 79395.2us
I20260709 13:15:21.149017  7895 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:21.095748 12333 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:21.127207 12291 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:21.129818 12324 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.141780 12459 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:21.156678  7225 leader_election.cc:400] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14.
I20260709 13:15:21.074781 11963 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:15:21.160688  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:21.077189 12475 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:15:21.150323 11804 raft_consensus.cc:2764] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:15:21.128998 12477 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:15:21.135172 12434 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:15:21.181150 12326 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:21.158416 12213 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:15:21.183955  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65770.1us
I20260709 13:15:21.164789 12478 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.186426  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:21.115367 12081 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.165001 12324 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:21.161788 12471 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:21.246663 12471 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.207798  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:21.165131 12291 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:21.154191 12344 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:15:21.214429  7184 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:21.156378 12476 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:15:21.223454  7182 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:21.215843  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:21.230463 12483 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:21.233191 12445 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.206694 12341 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.235196 12425 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:21.239910 12428 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.218757 12478 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.165551 12340 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:15:21.256764  7180 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:21.274760  7186 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:15:21.276152  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:21.276433  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:21.236420 12464 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:21.277158  7254 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:21.277169  7180 raft_consensus.cc:2368] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14.
I20260709 13:15:21.260730 12497 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:21.296417  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:21.298135  7180 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:21.296559 11431 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.299530  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:21.288270 12464 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:21.301476 12464 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.310858  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:21.280103 12490 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:15:21.302373 11431 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.260854 12434 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:15:21.260247 12187 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:15:21.262756 12213 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:15:21.341778  7184 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:21.344976  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:21.303613 12497 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.346688 12464 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:21.355613  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 139865us
I20260709 13:15:21.369095  7254 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:21.354826 12499 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:15:21.400291  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.361651  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83467.2us
W20260709 13:15:21.416525 12486 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:15:21.421326  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 63059.4us
I20260709 13:15:21.422151  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:21.435382  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 144784us
I20260709 13:15:21.356101 12497 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:21.449745  7228 leader_election.cc:400] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14.
I20260709 13:15:21.450088  7228 leader_election.cc:403] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:15:21.455977  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:21.427732 12499 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:21.457620  7182 raft_consensus.cc:2376] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14. Re-sending same reply.
I20260709 13:15:21.409081 12344 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:15:21.453589 12402 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:21.474241  7327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1988) took 1499 ms (client timeout 1950 ms). Trace:
W20260709 13:15:21.474888  7327 rpcz_store.cc:269] 0709 13:15:19.973316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.165674 (+192358us) service_pool.cc:224] Handling call
0709 13:15:21.471920 (+1306246us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540031bfd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:21.472090 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149944064}
I20260709 13:15:21.382933 12291 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:21.492539  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.494681 12478 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.490983 12499 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.513806 12069 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.519769 12405 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:21.486922 12508 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.557341  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:21.558072  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:21.558815  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:21.559937  7335 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:21.566782  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:21.567533  7335 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:21.475497 12402 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:21.578711  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 142290us
I20260709 13:15:21.582780  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:21.519696 12432 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.588456  7333 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:15:21.591809  7152 leader_election.cc:336] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.550s (SENT)
I20260709 13:15:21.593696  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:21.598073  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:21.600199  7335 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:21.609632  7328 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:21.610239  7328 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:21.555531 12506 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:15:21.586463 12518 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:21.618767  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:21.611318  7328 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.623250  7328 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:21.626292 12506 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:15:21.635486  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 203919us
I20260709 13:15:21.604449 12405 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14.
I20260709 13:15:21.606698 12344 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:21.641050  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:21.607206 12504 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:21.642889  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51118.7us
I20260709 13:15:21.568653 12508 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:21.630306 12515 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:15:21.644742  7152 leader_election.cc:336] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.613s (SENT)
I20260709 13:15:21.621125 12518 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.614073 12517 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:21.650660  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:21.642000 12344 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:21.639112 12506 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:21.629367 12069 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:15:21.666518  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:21.669410  7328 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:15:21.671362  7328 pending_rounds.cc:85] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 9
I20260709 13:15:21.672237  7328 pending_rounds.cc:107] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:15:21.643181 12322 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:15:21.653287 12518 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:21.673143  7328 raft_consensus.cc:2889] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:21.679804  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:21.682160  7152 leader_election.cc:336] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.694s (SENT)
I20260709 13:15:21.682880  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:21.684664  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:21.692090  7327 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:15:21.694474  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:21.695024  7334 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:21.698729  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:21.699735  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:21.681996 11804 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:21.702314  7893 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:21.705492  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:21.710162 12534 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:21.652308 12504 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.686807 12405 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:21.713541 12509 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:21.713835 12402 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.714164 12523 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:15:21.715796 12525 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:21.716605 12344 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.718020 12344 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:21.718765 12527 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:15:21.719408  7225 connection.cc:256] RPC call timeout handler was delayed by -1.7112264030001825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 13:15:21.719949  7225 connection.cc:256] RPC call timeout handler was delayed by -1.5240264030001072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 13:15:21.720373  7225 connection.cc:256] RPC call timeout handler was delayed by -1.4745264030000271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
W20260709 13:15:21.720666  7225 connection.cc:256] RPC call timeout handler was delayed by -1.4178264030001628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
I20260709 13:15:21.722021  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:21.723598 12504 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:21.697408 12459 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.001s
I20260709 13:15:21.725189 12469 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:21.725715 12469 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:21.725438 12459 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.727887 12459 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:21.728623 12511 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:15:21.691745 12187 consensus_queue.cc:1243] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:21.704295  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:21.737720  7328 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:21.657807 12517 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.715852 12523 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:21.739485 12521 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:21.762183  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 80086.1us
I20260709 13:15:21.740549 12509 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:21.740497 12525 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:21.744761 12341 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:21.764005  7152 leader_election.cc:336] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.709s (SENT)
I20260709 13:15:21.746182 12445 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:21.762367 12187 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:21.767103 12514 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:15:21.750649 12527 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:21.769599  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:21.758908 12432 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:21.767930 12502 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.291s	user 0.002s	sys 0.000s
I20260709 13:15:21.785845 12508 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.782776 12533 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:21.788363 12527 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:21.800256 12480 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.711s	user 0.003s	sys 0.001s
I20260709 13:15:21.801968  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 839) took 1155 ms. Trace:
I20260709 13:15:21.802395  7888 rpcz_store.cc:276] 0709 13:15:20.646970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.647128 (+   158us) service_pool.cc:224] Handling call
0709 13:15:20.647491 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:20.647928 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:20.647957 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:20.648440 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:15:20.925014 (+276574us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:20.925069 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.925166 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.799276 (+874110us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:21.801572 (+  2296us) raft_consensus.cc:1685] finished
0709 13:15:21.801603 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.801873 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3599,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":2644224,"thread_start_us":276066,"threads_started":1,"wal-append.queue_time_us":405082}
I20260709 13:15:21.803575 12509 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.769225 12341 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.809782 12341 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.771097 12445 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:21.818496  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54503.8us
W20260709 13:15:21.819787  7152 leader_election.cc:336] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.725s (SENT)
I20260709 13:15:21.741726 12469 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.764945 12521 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.825973  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:21.826695  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.834446 12525 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:21.837718 12324 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.577s	user 0.003s	sys 0.007s
I20260709 13:15:21.811717 12533 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:21.839490  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 235558us
W20260709 13:15:21.839896  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 117929us
I20260709 13:15:21.841166  7225 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:21.844080 12445 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.848596  7328 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:21.850841  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:21.851217  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:21.851919  7335 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:21.852213  7328 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:21.853269  7894 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:21.838217 12324 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:21.857731 12536 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:15:21.859253  7225 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:21.862339  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:21.863893  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:21.866360  7150 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:21.867599  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:21.869330  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:21.870036  7258 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:21.872083  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:21.874203  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:21.876588  7261 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:21.876259  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:21.877334  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57606.1us
I20260709 13:15:21.877406  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:21.877504  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:21.879528  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:21.880805  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:21.881371  7258 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:21.860880 12343 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.859268 12187 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:21.858888 12324 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:21.865477 12508 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:21.887552 12535 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:21.888048 12535 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:21.888429 12535 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:21.886073  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:21.889106  7184 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 9.
I20260709 13:15:21.890070  7254 raft_consensus.cc:2393] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:21.886121  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:21.849733 12533 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.890705  7258 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:21.891752 12521 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.892616 12533 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:21.893707 12431 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:21.894116 12431 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.894436 12431 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:21.876096 12425 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:21.895036 12425 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:21.895967 12425 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:21.869665 12341 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:21.898883  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:21.886159 12343 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.904523  7258 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:21.905835  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:21.906738  7258 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:21.906872 12430 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:21.908468  7258 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:21.911926  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:21.907596 12430 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.912642  7328 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:21.914327  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:21.885636 12539 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:21.876242 12472 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:15:21.906795 12445 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:21.923360 12537 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:15:21.925180 12471 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.925844 12430 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.900761 12432 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:21.926712 12432 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.929010  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:21.929039 12432 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.882687 12532 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:15:21.910749 12521 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:21.932019 12521 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:21.932405 12521 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:21.930389  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:21.933971  7255 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:21.935508  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:21.908836 12517 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:21.911257 12341 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.941674 12341 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.921566 12135 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:21.944278 12135 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:21.944705 12135 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:21.952854 12343 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:21.954912  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:21.955878  7335 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:21.957810  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:21.959139 12343 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:21.954152 12431 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:21.961743 12343 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.990052  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:21.937148 12445 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.007416  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:21.996899 12343 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:22.012725  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.014688  7258 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:22.016145  7255 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:22.018162 12535 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.070182 12431 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:22.071480  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:22.071668 12445 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:22.072211  7330 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:22.073370  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:22.075838 12497 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.619s	user 0.020s	sys 0.000s
I20260709 13:15:22.076930 12110 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:22.076273 12497 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.080521 12497 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:22.081795  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2917) took 1391 ms. Trace:
I20260709 13:15:22.082173  7185 rpcz_store.cc:276] 0709 13:15:20.690065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.690216 (+   151us) service_pool.cc:224] Handling call
0709 13:15:20.690521 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.115476 (+424955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.081593 (+966117us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b540036db54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:22.081742 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975249664}
I20260709 13:15:22.086557 12535 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:22.086943 12518 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.089630 12518 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:22.089877 12521 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.090966 12497 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:22.092538  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.082243  7887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 727) took 1977 ms (client timeout 1835 ms). Trace:
W20260709 13:15:22.093839  7887 rpcz_store.cc:269] 0709 13:15:20.104509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.105159 (+   650us) service_pool.cc:224] Handling call
0709 13:15:22.082029 (+1976870us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400641754. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:22.082143 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387969408}
I20260709 13:15:22.096401  7330 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:22.097965  7184 raft_consensus.cc:1217] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Deduplicated request from leader. Original: 14.8->[16.9-16.9]   Dedup: 16.9->[]
I20260709 13:15:22.098907  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:22.100389  7185 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:22.098500  7184 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:15:22.104313  7258 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:22.104717  7258 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:22.109237  7185 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:22.110001  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.111316  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.112737 12343 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.098453 12497 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.116669 12497 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:22.117769  7258 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.118798  7258 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:22.090540 12135 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.123932 12470 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:22.125458  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.126396  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:22.126696  7184 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:22.112356  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:22.128700  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:22.130810  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.132077  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.134475  7894 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:15:22.135576  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.136511  7887 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:15:22.124445 12470 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:22.137938  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.137056  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:22.140007  7894 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:22.140010  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:22.140744  7261 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:22.141701  7180 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:15:22.142400  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:22.136160  7257 raft_consensus.cc:2376] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15. Re-sending same reply.
I20260709 13:15:22.143008  7330 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:15:22.145097  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:22.146060  7333 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:15:22.146546  7257 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:22.147442  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:22.148125  7257 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:22.148439  7258 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:22.149358  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.149879  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:22.150466  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.152719  7259 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:22.152878  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.153726  7894 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:22.152644  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.149003  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:22.159103  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.139375 12518 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:22.163793  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:22.143344 12135 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:22.164575  7185 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:22.169883  7894 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:22.171859  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:22.161875  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.172457  7887 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:22.165198  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.161263 12325 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:15:22.166738  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:22.167109  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:22.138981 12322 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:15:22.179878  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:22.180868  7330 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:15:22.144100 12535 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:22.173048  7262 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:22.174616  7889 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:22.179066  7333 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:22.186908  7185 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:22.187824  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:22.188572  7187 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:22.189112  7258 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:22.158744 12343 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:22.190976  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:22.191444 12535 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:22.192600 12535 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.194890  7887 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
W20260709 13:15:22.195375  7895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 726) took 2150 ms (client timeout 1969 ms). Trace:
W20260709 13:15:22.195778  7895 rpcz_store.cc:269] 0709 13:15:20.049803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.076547 (+ 26744us) service_pool.cc:224] Handling call
0709 13:15:22.195167 (+2118620us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400563e54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:22.195281 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2333966720}
I20260709 13:15:22.196842 12135 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:22.197362  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:22.198927 12531 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:22.199357 12322 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:22.143071 12413 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:15:22.191574  7182 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:22.208436  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:22.205621  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:22.209466  7260 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:22.207448  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:22.252475  7187 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:22.260846  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.214035  7889 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:15:22.263491  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:22.178911 12518 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:22.281534  7262 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:22.214476 12341 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.232172 12527 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:22.265753 12296 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.260007 12445 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.265311 12213 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.261677 12509 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:22.340224  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.210330 12459 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:15:22.348651  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.350907  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.287775 12521 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 10 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:22.296685 12197 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:22.352330  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 164367us
I20260709 13:15:22.213858 12135 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:15:22.313643 12508 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:22.334702 12412 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.299031 12428 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:22.357156  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:22.352496  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:22.392340  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 97130.7us
I20260709 13:15:22.362651  7260 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:22.313349 12344 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:22.397300  7889 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:15:22.397598 12344 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.399076  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:22.399643  7889 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:22.405177  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:22.361452 12291 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:22.412025  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.272887 12470 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.391938 12509 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.414491  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.415319  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.414885  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:22.422246  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.422596  7889 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:22.403538 12508 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.364986 12213 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.423403  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.423652 12518 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.365341 12445 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.414716 12291 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.430254  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:22.403151 12428 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.356590 12296 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.419116 12561 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:22.430353  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 230020us
I20260709 13:15:22.355793 12341 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:22.456225  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.458329 12508 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:22.391582 12197 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.463477  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2924) took 1666 ms. Trace:
I20260709 13:15:22.472026  7181 rpcz_store.cc:276] 0709 13:15:20.797278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.798757 (+  1479us) service_pool.cc:224] Handling call
0709 13:15:20.799132 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.927415 (+128283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.463280 (+1535865us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400258854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:22.463423 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288854272}
I20260709 13:15:22.403132 12412 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.468499  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:22.474785  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:22.455444 12187 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:22.416899 12558 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:15:22.470180 12527 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:22.483552 12535 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:22.485869 12563 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:22.472613 12561 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.535389  7182 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:22.486150 12187 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.520395 12535 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:22.543414  7333 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:15:22.545549 12527 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.532996 12508 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:22.564886  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 179537us
I20260709 13:15:22.566231  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:22.568154 12291 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:22.570971 12187 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:22.571781 12213 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:22.571969 12335 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.572383 12213 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.572475 12335 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.572878 12213 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.575350 12197 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:22.575570  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:22.619366  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.581257 12213 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:22.622661  7262 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:15:22.586585 12575 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.581413 12335 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:22.628518  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:22.633344  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:22.640424  7334 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 10.
I20260709 13:15:22.645347  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:22.615909 12570 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.615590 12509 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:22.583654 12508 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.672895  7258 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:22.679467  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 112205us
I20260709 13:15:22.631496 12569 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:22.631332 12296 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:22.656821 12566 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:22.658358 12445 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:22.733510  7334 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:15:22.716835 12545 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:15:22.730244  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49642.2us
I20260709 13:15:22.644815 12575 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.673691 12428 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:22.735671  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:22.774159  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:22.815701  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:22.631703 12535 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:22.821080 12557 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:15:22.673804 12570 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.844938  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:22.732013 12569 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.891498  7331 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:15:22.871335  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 135717us
W20260709 13:15:22.858748  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 197702us
I20260709 13:15:22.970029  7329 raft_consensus.cc:2410] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:15:22.971066 12568 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.362s	user 0.001s	sys 0.001s
I20260709 13:15:22.890193 12428 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.927637 12518 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:22.971859 12428 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.972566 12518 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.843880 12296 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.974820 12518 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:22.920011  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:22.975499 12296 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:22.872977 12561 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:22.890697 12582 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:22.892771 12506 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:22.865594 12566 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:22.978650  7332 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:22.980232  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2264) took 1101 ms. Trace:
I20260709 13:15:22.974162 12428 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:22.971215  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:23.006412  7180 rpcz_store.cc:276] 0709 13:15:21.879140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.879256 (+   116us) service_pool.cc:224] Handling call
0709 13:15:21.879508 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.142105 (+262597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.930238 (+788133us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54002b4dd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:22.980167 (+ 49929us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602332928}
W20260709 13:15:23.007546  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.007880  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:23.013264 12526 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.183s	user 0.001s	sys 0.019s
I20260709 13:15:23.013471  7335 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:22.834926 12560 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:15:23.019727  7332 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:22.927853 12563 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:23.023988  7335 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:15:22.825088 12570 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:22.843981 12564 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.325s	user 0.002s	sys 0.000s
I20260709 13:15:23.012388  7336 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:23.026312  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:23.038460  7335 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
I20260709 13:15:22.915825 12580 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.979010 12509 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:23.020762 12586 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 13:15:23.028841 12517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.015s	sys 0.018s
I20260709 13:15:23.010391 12577 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:15:23.012097 12582 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:23.030768 12506 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:23.022446 12341 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:23.031313 12569 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:23.042090  7225 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.004s	sys 0.015s
I20260709 13:15:23.048595  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:23.049739 12583 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:23.050060 12517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.015s	sys 0.019s
W20260709 13:15:23.057404  7225 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.004s	sys 0.015s
I20260709 13:15:23.062848  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:23.051324 12508 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.088836  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:23.083474  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.089552  7892 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
W20260709 13:15:23.092028  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 560524us
I20260709 13:15:23.091239  7889 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 11: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:23.097903  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:23.107827 12508 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:23.108069 12530 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.350s	user 0.000s	sys 0.005s
W20260709 13:15:23.109258 12591 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:23.087342 12583 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.090019 12383 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:15:23.045881 12580 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.117594  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:23.120205  7892 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:23.119812  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.123294  7257 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:23.119496  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:23.127723 12508 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:23.128016  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:23.064409 12569 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:23.128022  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:23.054343 12509 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.089625 12341 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:15:23.136952  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:23.120694 12503 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:15:23.141290  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:23.152649  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.132664 12574 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:23.119874 12518 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:15:23.058977 12563 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.140506 12069 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 13:15:23.198062  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 79115.2us
I20260709 13:15:23.141209 12575 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.163693  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:23.065693 12566 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.138950 12508 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:23.248492 12514 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:15:23.266824 12600 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:15:23.164666 12574 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.146029 12527 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:23.281926 12583 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:23.224222 12477 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.288738 12514 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:23.292713 12344 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:23.339929  7180 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:15:23.324983  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 161407us
I20260709 13:15:23.140607 12582 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.320151 12574 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:23.346449  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:23.352607  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:23.353176  7335 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:23.353971 12514 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:23.354214  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:23.357813 12604 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:15:23.355068 12514 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.366396  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:23.366823  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3142) took 1468 ms. Trace:
I20260709 13:15:23.367210  7253 rpcz_store.cc:276] 0709 13:15:21.898321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.899670 (+  1349us) service_pool.cc:224] Handling call
0709 13:15:21.899958 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:21.910209 (+ 10251us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:21.910230 (+    21us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:23.087469 (+1177239us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:23.095289 (+  7820us) log.cc:844] Serialized 52 byte log entry
0709 13:15:23.248099 (+152810us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:23.248138 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.248212 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:23.366483 (+118271us) raft_consensus.cc:1685] finished
0709 13:15:23.366503 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.366766 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9834,"raft.queue_time_us":9962,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":9654,"spinlock_wait_cycles":3715328,"thread_start_us":117075,"threads_started":1,"wal-append.queue_time_us":175780}
I20260709 13:15:23.369938  7328 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:15:23.370211  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:23.372660 12344 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.373380  7328 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:15:23.373654 12580 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.373340 12344 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:23.373935  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:23.373651  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:23.374841  7331 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:15:23.375653 12344 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.375995 12561 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.376652 12561 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:23.383430  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 292444us
I20260709 13:15:23.349874  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:23.386714  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:23.372627  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.392620 12583 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:23.392769 12503 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.393983 12503 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.325840 12527 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:23.401041  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:23.405853  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:23.409614  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:23.328745 12508 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:23.409137  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:23.380450 12071 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.372797 12509 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.421657  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:23.422119 12509 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:23.422809 12587 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:23.422676 12509 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.423321 12587 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:23.424216 12587 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.424896 12509 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.425450 12509 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:23.421657  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:23.407948  7180 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:23.427670 12509 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.428555 12324 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:23.430640  7181 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:23.422461  7891 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:23.440642  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:23.429138 12324 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.403183 12341 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:23.414067 12527 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:23.454663  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:23.431739 12577 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:23.331823 12477 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.463537  7184 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:23.431526 12583 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:15:23.453863 12517 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:23.452044 12324 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:23.452934 12582 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.447386 12445 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:15:23.478962 12578 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:15:23.435458 12071 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.497856 12514 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.497112 12609 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:23.501462 12517 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:23.507261 12577 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:23.541189 12503 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.542598 12577 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:23.543370 12608 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:23.522683 12509 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:23.565995 12506 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.003s
I20260709 13:15:23.572160 12071 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.500447 12566 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:15:23.515146 12582 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.575340 12582 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:23.577263  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:23.535269 12517 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:23.601133 12525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.690s	user 0.001s	sys 0.032s
W20260709 13:15:23.603953 12525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.695s	user 0.002s	sys 0.032s
I20260709 13:15:23.528545 12514 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.605067  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:23.537901 12609 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.518481 12508 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.632203  7891 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
W20260709 13:15:23.636253  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.631523 12503 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:23.594969 12071 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:23.637838  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:23.643404  7255 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:15:23.643085  7254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1955) took 1781 ms (client timeout 1809 ms). Trace:
I20260709 13:15:23.607276 12509 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:23.595242 12582 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:23.643975  7254 rpcz_store.cc:269] 0709 13:15:21.862129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.862241 (+   112us) service_pool.cc:224] Handling call
0709 13:15:23.642864 (+1780623us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5400124654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:23.643023 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29265664}
I20260709 13:15:23.641423 12344 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.646724 12582 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.648694  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 853) took 1171 ms. Trace:
I20260709 13:15:23.649107  7888 rpcz_store.cc:276] 0709 13:15:22.477603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.477720 (+   117us) service_pool.cc:224] Handling call
0709 13:15:22.478101 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.478354 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:22.489547 (+ 11193us) log.cc:844] Serialized 14 byte log entry
0709 13:15:22.493609 (+  4062us) log.cc:844] Serialized 14 byte log entry
0709 13:15:23.648237 (+1154628us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b180019ae60. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287
0709 13:15:23.648333 (+    96us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:23.648388 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:23.648441 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.648510 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.648637 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48954,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":1253,"raft.queue_time_us":89208,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"spinlock_wait_cycles":2475264,"thread_start_us":27910,"threads_started":1}
I20260709 13:15:23.644572 12518 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:23.651258 12518 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.651553 12582 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:23.653261 12518 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:23.654898  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:23.647471 12344 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.629488 12534 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:23.639923 12377 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:23.688818 12617 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:15:23.629918 12506 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.689955  7259 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:23.692394 12514 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.693038 12534 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.668227 12344 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.611163 12561 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:23.658244 12609 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.656589 12587 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:15:23.714922 12514 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.704777  7257 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:15:23.702606  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.716507  7257 pending_rounds.cc:85] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 7
I20260709 13:15:23.708348  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1976) took 1599 ms. Trace:
I20260709 13:15:23.716809  7257 pending_rounds.cc:107] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:15:23.717197  7257 raft_consensus.cc:2889] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:23.708832  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.717908  7253 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:23.719811  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:23.720392  7253 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:23.634536 12525 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:23.713027  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.724959  7256 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:15:23.657835 12583 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:23.727739  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.716998  7259 rpcz_store.cc:276] 0709 13:15:22.108442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.171467 (+ 63025us) service_pool.cc:224] Handling call
0709 13:15:23.689287 (+1517820us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b5800003098. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:15:23.689514 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.708080 (+ 18566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.708291 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14324480}
I20260709 13:15:23.739775  7256 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:23.728386  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:23.729043  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:23.705097 12618 consensus_queue.cc:1059] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:15:23.713658 12506 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.731719  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:23.699502 12621 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:23.706338 12527 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.738914 12609 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:23.703764 12518 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.695715 12582 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:23.751693  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.704035 12610 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:23.663748 12477 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:23.656643 12503 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.690322 12071 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.755931 12582 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.765143 12506 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.765829 12071 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.760666 12609 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.756024 12518 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.715458 12514 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.695451 12509 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.770200  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.763108 12626 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:23.762989 12610 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.764019  7259 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:23.768783  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.770866  7256 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:23.765725 12582 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:23.777805  7257 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:23.779232  7254 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 11.
I20260709 13:15:23.767457 12618 consensus_queue.cc:1243] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:15:23.781688  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.786742  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.782615 12514 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.790541 12527 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:23.769472 12506 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:23.794732  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:23.797048  7334 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:23.797577  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 993) took 2412 ms. Trace:
I20260709 13:15:23.795461  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.795883  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:23.795943  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.795472  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:23.798702  7331 raft_consensus.cc:2410] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:15:23.799741  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:23.801050  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:23.801693  7334 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:23.794902  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.805311  7253 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:23.806703  7257 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:23.813764  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:23.798105  7186 rpcz_store.cc:276] 0709 13:15:21.382332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.382577 (+   245us) service_pool.cc:224] Handling call
0709 13:15:21.775252 (+392675us) spinlock_profiling.cc:243] Waited 965 us on lock 0x7b5400329f28. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee1e0ebc 00007fecee21608c 00007fecee20093b 00007fecee2003d2 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c
0709 13:15:21.775398 (+   146us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:21.775791 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.775818 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:21.779437 (+  3619us) log.cc:844] Serialized 52 byte log entry
0709 13:15:21.848407 (+ 68970us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:21.865863 (+ 17456us) log.cc:844] Serialized 14 byte log entry
0709 13:15:22.570824 (+704961us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b1800469a80. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fececc343c7 00007fece92469a7 00007fece92560bf 00007fece9256038
0709 13:15:22.571062 (+   238us) log.cc:844] Serialized 14 byte log entry
0709 13:15:22.579748 (+  8686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.579832 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:22.723480 (+143648us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b1800469a80. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:23.783583 (+1060103us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b1800469a80. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:23.794118 (+ 10535us) raft_consensus.cc:1685] finished
0709 13:15:23.794150 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.794328 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":693356,"prepare.queue_time_us":725967,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":11252,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":8517,"spinlock_wait_cycles":23757568,"thread_start_us":52621,"threads_started":1,"wal-append.queue_time_us":90446}
I20260709 13:15:23.774914 12525 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.818704  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:23.821951 12445 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:23.825519  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:23.821049  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.826723  7253 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:23.822398 12445 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.800932 12582 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:23.832044 12518 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.832528 12503 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:23.838936 12583 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:23.839627 12583 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.840126 12583 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:23.777572 12626 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.830557  7253 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:23.801172 12506 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.856032 12626 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:23.820783 12569 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:23.856050 12506 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:23.863986  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 797) took 1305 ms. Trace:
I20260709 13:15:23.848096 12618 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:23.848778 12445 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:23.864517  7333 rpcz_store.cc:276] 0709 13:15:22.558225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.558369 (+   144us) service_pool.cc:224] Handling call
0709 13:15:22.558716 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:22.558923 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:15:22.577216 (+ 18293us) log.cc:844] Serialized 14 byte log entry
0709 13:15:23.791150 (+1213934us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b180048da80. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a 00007fece9246a2a
0709 13:15:23.859479 (+ 68329us) log.cc:844] Serialized 14 byte log entry
0709 13:15:23.863607 (+  4128us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:23.863705 (+    98us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:23.863753 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.863818 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:23.863928 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3383,"prepare.queue_time_us":20178,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":7508,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":9327104,"thread_start_us":67695,"threads_started":1}
I20260709 13:15:23.865413 12569 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.869957 12618 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.886289  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:23.887332  7257 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:23.877638 12569 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:23.892844  7178 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:23.898730 12328 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.899355 12328 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.885409 12618 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:23.873633 12574 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.937958 12110 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:23.949620 12517 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:23.891386 12324 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.009670  7256 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 12. Current term is 13. Ops: []
W20260709 13:15:24.031172  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.043849 12558 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.044234 12324 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:24.003785  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 1995) took 1176 ms. Trace:
I20260709 13:15:24.044636 12558 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.045215  7329 rpcz_store.cc:276] 0709 13:15:22.827538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.827702 (+   164us) service_pool.cc:224] Handling call
0709 13:15:24.003573 (+1175871us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54001ffed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:24.003726 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284642560}
W20260709 13:15:24.004931 12581 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.030s	user 0.006s	sys 0.000s
I20260709 13:15:23.941298 12609 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:24.047478 12558 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:24.051682 12588 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.239s	user 0.000s	sys 0.007s
I20260709 13:15:24.002962 12383 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:23.948047 12110 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:24.014792 12534 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:24.081162 12517 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:24.027938 12618 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.099073 12618 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:24.106570 12569 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:23.950611 12509 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:24.112138  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 97838us
I20260709 13:15:24.115885  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:24.116657  7257 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:24.089978 12383 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:24.123829  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:24.110543 12574 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:24.109699 12569 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:24.117513 12324 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:24.128172 12110 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.133694 12639 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:24.135905 12296 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:24.136041 12497 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:24.136831 12412 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:24.146209  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 276997us
I20260709 13:15:24.151053  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:24.153474  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:24.156139  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:24.157598  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:24.158464  7182 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:24.160526  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:24.161386  7894 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:24.170848  7334 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:24.177342  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.178114  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.129794 12583 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.182552  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:24.147701 12497 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:24.183879  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:24.155118 12110 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.155279 12569 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.145036 12324 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.178297 12412 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:15:24.225411  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.230476  7184 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:24.186604  7257 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:24.192718  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:24.231669  7181 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:15:24.193405  7331 raft_consensus.cc:2410] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:15:24.176465 12383 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.238662 12569 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.239538 12383 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:24.241775 12569 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:24.243054 12640 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:15:24.246361  7333 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:24.190554  7187 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:24.194032 12571 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:24.202068  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:24.249276  7182 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:24.197975  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 991) took 2945 ms. Trace:
I20260709 13:15:24.244649 12497 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.257718  7184 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:24.250264  7183 rpcz_store.cc:276] 0709 13:15:21.252506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.252757 (+   251us) service_pool.cc:224] Handling call
0709 13:15:21.253095 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:21.314283 (+ 61188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.314323 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:22.099612 (+785289us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b2c0001afe8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:22.107048 (+  7436us) log.cc:844] Serialized 26 byte log entry
0709 13:15:22.280416 (+173368us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:22.674319 (+393903us) log.cc:844] Serialized 14 byte log entry
0709 13:15:22.919546 (+245227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:23.870302 (+950756us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b180034d6e0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:24.024184 (+153882us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b180034d6e0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:24.197590 (+173406us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b54002b43d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:24.197654 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.197711 (+    57us) raft_consensus.cc:1685] finished
0709 13:15:24.197728 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.197911 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":304838,"prepare.queue_time_us":399168,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":101292,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":46676,"spinlock_wait_cycles":204324608,"thread_start_us":218053,"threads_started":2,"wal-append.queue_time_us":266319,"wal-append.run_cpu_time_us":3837,"wal-append.run_wall_time_us":1423591}
I20260709 13:15:24.262231  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:24.267793  7257 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:24.268419  7257 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:24.268487  7187 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:15:24.219399 12412 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:24.276553  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:24.279273  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:24.280158  7254 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:24.269522  7257 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.287945  7257 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:24.309239  7187 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
W20260709 13:15:24.315448 12641 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:15:24.323200 12643 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:15:24.272281 12497 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:24.333989  7181 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:24.340468  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.350116  7895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 852) took 1872 ms. Trace:
I20260709 13:15:24.351091 12412 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.352721 12324 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:24.354316 12583 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:24.355134  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:24.350592  7895 rpcz_store.cc:276] 0709 13:15:22.477240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.477417 (+   177us) service_pool.cc:224] Handling call
0709 13:15:22.489045 (+ 11628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.533697 (+ 44652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.533744 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:24.006819 (+1473075us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b2c000474b8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:24.007271 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.193881 (+186610us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:24.193917 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.194146 (+   229us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.349832 (+155686us) raft_consensus.cc:1685] finished
0709 13:15:24.349853 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.350056 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93138,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":117,"spinlock_wait_cycles":8404096,"thread_start_us":167979,"threads_started":2,"wal-append.queue_time_us":256906}
W20260709 13:15:24.363003  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 239224us
I20260709 13:15:24.365758  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:24.366925  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 191305us
I20260709 13:15:24.259565 12571 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.370776  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.372064 12646 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:24.369531  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1975) took 2248 ms. Trace:
I20260709 13:15:24.373124  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.375089  7255 rpcz_store.cc:276] 0709 13:15:22.108145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.108271 (+   126us) service_pool.cc:224] Handling call
0709 13:15:23.643078 (+1534807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.643874 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.356279 (+712405us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400124650. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:24.356406 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3528917376}
I20260709 13:15:24.377978  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.379951  7334 raft_consensus.cc:2410] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:15:24.381356  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.357519 12583 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.369531 12558 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.385522  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.388325  7887 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:24.390415  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.391927  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.392645  7334 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:24.393817  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.394462  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:24.395107  7890 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:24.396096  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.366225 12383 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.394487  7255 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:24.400269  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.410930  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.369648 12445 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.384815 12646 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:24.403777  7257 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:15:24.400367  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.425478  7257 pending_rounds.cc:85] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 8
I20260709 13:15:24.426107  7257 pending_rounds.cc:107] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:15:24.426613  7257 raft_consensus.cc:2889] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:24.429450  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:24.430405  7889 raft_consensus.cc:2368] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12.
I20260709 13:15:24.432003  7329 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 12: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:24.432157  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:24.433015  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.433669  7888 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:15:24.434010  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.434461  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:24.435017  7887 raft_consensus.cc:2376] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16. Re-sending same reply.
W20260709 13:15:24.425848 12471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.010s	sys 0.008s
I20260709 13:15:24.395327 12583 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.436784  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:24.439918  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 305596us
I20260709 13:15:24.394060 12558 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.440208  7888 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:24.441393  7895 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10.
I20260709 13:15:24.444796  7887 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:24.443598  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:24.442258  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.446575  7895 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:24.445562  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:24.451750  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.452418  7331 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
W20260709 13:15:24.438259 12471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.010s	sys 0.008s
I20260709 13:15:24.432412 12509 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:15:24.434916 12508 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:15:24.460709 12508 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.461254 12508 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.464069 12445 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:24.464701 12646 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.465168  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.466593  7334 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:24.434309 12383 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.469372 12383 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:24.469596 12558 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:24.470294  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:24.471153  7181 raft_consensus.cc:2410] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:15:24.444257 12506 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:24.472277  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.476523  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.479715  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.480989  7331 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:24.476385 12445 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:24.491421 12508 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:24.491885 12445 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:24.495473  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:24.492426 12445 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:24.463055 12583 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:24.506505  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:24.474013 12506 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.508657  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:24.509195 12506 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.492703 12558 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:24.514909 12558 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.515359 12558 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:24.587975  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.588956  7331 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
W20260709 13:15:24.602911  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.618598  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.619889  7331 raft_consensus.cc:2410] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:15:24.624444  7331 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:24.632314  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.634615  7331 raft_consensus.cc:2410] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:15:24.635104  7895 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:24.636302  7331 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:24.642256  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.637660  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:24.644070  7260 raft_consensus.cc:2376] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17. Re-sending same reply.
I20260709 13:15:24.644251  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.646009  7887 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:24.650470  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.651989  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:24.652875  7259 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:24.653926  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.654560  7260 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:24.657232  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.657820  7260 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:24.635989  7257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:46710
I20260709 13:15:24.659878  7257 raft_consensus.cc:606] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:24.661111  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.661710  7260 raft_consensus.cc:1813] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Handling vote request from an unknown peer 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:24.662164  7260 raft_consensus.cc:2368] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13.
I20260709 13:15:24.663655  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.664361  7260 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:24.674944 12459 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.679291 12069 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:24.679771 12069 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:24.680526 12069 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.681552 12069 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:24.691530  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:24.696491  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:24.698962  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.664877 12580 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:24.701561  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.703676  7225 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:24.705339  7259 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260709 13:15:24.706931  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.707432  7259 pending_rounds.cc:85] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 4
I20260709 13:15:24.707809  7259 pending_rounds.cc:107] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 13:15:24.708144  7259 raft_consensus.cc:2889] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:24.709990  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.702929 12523 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:24.709442 12539 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.711373 12341 raft_consensus.cc:3055] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:24.711203 12539 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.711869 12341 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:24.712785 12341 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.701581 12532 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:24.713946  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.714310 12532 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.717036  7890 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:15:24.717895  7888 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:24.701357 12668 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.687583 12609 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:24.721421  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.731948  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:24.733950  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.733959 12609 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:24.731228  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 287679us
I20260709 13:15:24.735834  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:24.735533 12609 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.736583 12497 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:24.736802 12609 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:24.736992 12497 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:24.737715 12497 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:15:24.743860  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.716636 12532 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:24.745640  7887 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEARNER]: Advancing to term 15
I20260709 13:15:24.679347 12459 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.748386  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.736995  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:24.711158 12523 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.709964 12580 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:24.763809  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.764442 12670 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:24.766741 12523 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:24.764856 12669 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:15:24.768164  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:24.769101 12670 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:24.754194 12609 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:24.771147 12609 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:24.771587 12609 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:24.772404 12670 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:24.773322  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:24.780797  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.783030  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:24.754115 12477 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:24.783717 12662 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:24.789053 12662 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.754249 12664 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:15:24.785776  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 146981us
I20260709 13:15:24.746392 12668 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.760643 12539 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:24.791800  7152 connection.cc:256] RPC call timeout handler was delayed by -1.9959607310001957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 13:15:24.788087 12477 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:24.792196  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 89810us
I20260709 13:15:24.789570 12653 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:24.790181 12662 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:24.794080  7152 connection.cc:256] RPC call timeout handler was delayed by -1.9807117650000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:15:24.790601 12664 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:24.798952  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 353450us
I20260709 13:15:24.801113  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:24.802146  7887 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:15:24.803807  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:24.798537  7152 connection.cc:256] RPC call timeout handler was delayed by -1.9716607310001564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
I20260709 13:15:24.793632  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:24.795815 12459 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:24.796310 12477 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:24.812989  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:24.804353 12664 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:24.817081  7152 connection.cc:256] RPC call timeout handler was delayed by -1.9410607310001069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 13:15:24.821511  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.820343  7301 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:24.820466  7152 connection.cc:256] RPC call timeout handler was delayed by -1.9230607310000778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 13:15:24.822392  7152 connection.cc:256] RPC call timeout handler was delayed by -1.8645607310002106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 13:15:24.822736  7152 connection.cc:256] RPC call timeout handler was delayed by -1.8483607310001844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
W20260709 13:15:24.823060  7152 connection.cc:256] RPC call timeout handler was delayed by -1.8114607310001247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 13:15:24.823328  7152 connection.cc:256] RPC call timeout handler was delayed by -1.6899607310001556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 13:15:24.823559  7152 connection.cc:256] RPC call timeout handler was delayed by -1.6791607310001382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 13:15:24.823782  7152 connection.cc:256] RPC call timeout handler was delayed by -1.6287607310000567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:15:24.824079  7152 connection.cc:256] RPC call timeout handler was delayed by -1.549560731000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
W20260709 13:15:24.824369  7152 connection.cc:256] RPC call timeout handler was delayed by -1.5369607310001356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 13:15:24.824597  7152 connection.cc:256] RPC call timeout handler was delayed by -1.5004426899999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:15:24.824816  7152 connection.cc:256] RPC call timeout handler was delayed by -1.4909003069999471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 13:15:24.825043  7152 connection.cc:256] RPC call timeout handler was delayed by -1.4329426899998907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 13:15:24.825261  7152 connection.cc:256] RPC call timeout handler was delayed by -1.4185426899998674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:15:24.825662  7152 connection.cc:256] RPC call timeout handler was delayed by -1.3390803869999672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 13:15:24.825939  7152 connection.cc:256] RPC call timeout handler was delayed by -1.309164396000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 13:15:24.827664  7152 connection.cc:256] RPC call timeout handler was delayed by -1.0985475100001167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260709 13:15:24.804463 12506 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.832083  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:24.815063 12653 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:24.836038  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:24.826335 12430 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:15:24.826381 12587 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:24.830075 12539 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.847085 12539 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.829253 12459 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:24.849534 12539 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:24.849980 12459 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.851837 12609 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.852505 12459 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:24.853176 12667 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:24.853643 12667 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:24.854009 12667 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:24.854063 12609 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:24.834190 12673 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:15:24.838344  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.841190 12506 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:24.841733  7255 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:24.829944 12665 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:24.873335  7185 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:24.910312 12506 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:24.876360 12668 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:24.911585 12668 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:24.911934 12668 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:24.870594 12667 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.912761 12668 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.914320 12668 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:24.877676 12580 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:24.917322  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:24.877996 12587 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:24.913308  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:24.918998 12587 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.894143  7254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:46710
I20260709 13:15:24.922899 12506 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:24.924575  7225 leader_election.cc:400] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 11 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12.
I20260709 13:15:24.926993  7225 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:24.928114 12667 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:24.932345 12673 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:24.932909 12673 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:24.933930 12673 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.861515 12445 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:24.944605 12590 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.973s	user 0.007s	sys 0.002s
I20260709 13:15:24.945418 12445 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:24.946419  7260 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:24.946887  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 798) took 2367 ms. Trace:
I20260709 13:15:24.947274  7330 rpcz_store.cc:276] 0709 13:15:22.580006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.580194 (+   188us) service_pool.cc:224] Handling call
0709 13:15:22.582511 (+  2317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.582909 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.582939 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:22.583398 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:15:22.747492 (+164094us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:22.747551 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.747654 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.944011 (+2196357us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:24.946555 (+  2544us) raft_consensus.cc:1685] finished
0709 13:15:24.946577 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.946804 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18973,"raft.queue_time_us":78185,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7484,"spinlock_wait_cycles":18289408,"thread_start_us":120728,"threads_started":1,"wal-append.queue_time_us":380664}
I20260709 13:15:24.949280  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.949980  7330 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:24.952013  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.903828  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:24.952476  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.957113  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:24.903589 12558 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.958496  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.960316  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.960533  7327 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:24.879261  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3165) took 1069 ms. Trace:
I20260709 13:15:24.901465  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:24.962926  7893 raft_consensus.cc:2376] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 10. Re-sending same reply.
W20260709 13:15:24.963806  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.904419 12665 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:24.961674  7258 rpcz_store.cc:276] 0709 13:15:23.810265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.810404 (+   139us) service_pool.cc:224] Handling call
0709 13:15:23.814324 (+  3920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.861792 (+ 47468us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:23.927424 (+ 65632us) log.cc:844] Serialized 14 byte log entry
0709 13:15:24.113938 (+186514us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.114011 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:24.114074 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.878977 (+764903us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b5400217ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:24.879024 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.879185 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41451,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":1451,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":14927,"spinlock_wait_cycles":108694272,"thread_start_us":248001,"threads_started":2,"wal-append.queue_time_us":251533}
I20260709 13:15:24.963940 12525 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:24.904893 12497 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:24.966529 12665 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:24.955099 12555 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 2.641s	user 0.009s	sys 0.011s
I20260709 13:15:24.969684  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:24.974079 12613 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.368s	user 0.005s	sys 0.002s
I20260709 13:15:24.974738  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:24.968511 12497 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:24.976394 12650 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.548s	user 0.002s	sys 0.004s
I20260709 13:15:24.980423 12470 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:24.980823  7332 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:24.981971  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:24.983156 12665 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:24.984058  7254 raft_consensus.cc:606] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:24.984401  7254 raft_consensus.cc:614] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:24.987597 12558 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:24.988224  7178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2926) took 4190 ms (client timeout 1749 ms). Trace:
W20260709 13:15:24.988629  7178 rpcz_store.cc:269] 0709 13:15:20.797962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.801445 (+  3483us) service_pool.cc:224] Handling call
0709 13:15:24.988016 (+4186571us) spinlock_profiling.cc:243] Waited 3.09 s on lock 0x7b5400247a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:24.988124 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7106862464}
W20260709 13:15:24.992514  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.994235  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:24.999481 12469 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:24.999702  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:25.000959  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:25.003039  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:25.003307 12573 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:25.002475  7183 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:25.004407  7181 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:25.004669  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:25.005247  7185 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:25.008409  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:25.009323  7333 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:15:25.009528  7336 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:25.010468  7333 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
W20260709 13:15:25.017484  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.011291 12341 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:25.038079  7332 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:25.070927 12412 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:24.986558  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 265667us
I20260709 13:15:24.953225 12662 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.080312  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:25.080902 12322 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:25.081151 12291 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:25.081666  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:25.082530  7890 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:25.082828 12291 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:25.084542 12571 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:25.085376  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:25.081595 12477 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.062839  7861 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:25.086583  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:25.011600 12563 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:25.087844  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:25.087726 12563 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:25.088912 12660 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:25.089326 12660 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.089656 12660 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:25.089733  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:25.092555 12532 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:25.093014 12532 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:25.052641  7334 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:15:25.021354  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:25.094489  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.094954  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:25.049969 12328 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:25.137347 12477 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:25.137952 12563 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:25.020341  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:25.024909  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:25.139878  7253 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:25.140235  7330 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:25.029763  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:25.012871  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:25.140767  7895 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:25.010716 12582 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.036486  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 807) took 1242 ms. Trace:
I20260709 13:15:25.144531  7328 rpcz_store.cc:276] 0709 13:15:23.793768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.793923 (+   155us) service_pool.cc:224] Handling call
0709 13:15:24.007455 (+213532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.007628 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:24.032185 (+ 24557us) log.cc:844] Serialized 14 byte log entry
0709 13:15:24.273416 (+241231us) log.cc:844] Serialized 14 byte log entry
0709 13:15:24.287452 (+ 14036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.287504 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:24.287547 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.287620 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.975835 (+688215us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:25.035203 (+ 59368us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b180033a5a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4
0709 13:15:25.036304 (+  1101us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54001ffed0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:25.036425 (+   121us) inbound_call.cc:177] Queueing success response
0709 13:15:25.041118 (+  4693us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b180033a5a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
Metrics: {"mutex_wait_us":14460,"prepare.queue_time_us":24821,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":3365,"raft.queue_time_us":49459,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":32487,"spinlock_wait_cycles":560991488,"thread_start_us":226178,"threads_started":1,"wal-append.queue_time_us":354903}
W20260709 13:15:25.010563  7336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2006) took 1637 ms (client timeout 1795 ms). Trace:
W20260709 13:15:25.032632  7261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1987) took 2893 ms (client timeout 1584 ms). Trace:
W20260709 13:15:25.148505  7261 rpcz_store.cc:269] 0709 13:15:22.138833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.144344 (+  5511us) service_pool.cc:224] Handling call
0709 13:15:25.032375 (+2888031us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54002d3f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:25.032528 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569357696}
I20260709 13:15:25.060889  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:25.150166  7185 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:25.072119  7332 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:25.073123 12664 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.093670  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:25.154644  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:25.095549  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:25.096102  7327 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:25.095578  7334 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:25.053279  7335 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:25.114387  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:24.899712  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:25.130364  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:25.157097  7262 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
W20260709 13:15:25.147490  7336 rpcz_store.cc:269] 0709 13:15:23.372979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.373416 (+   437us) service_pool.cc:224] Handling call
0709 13:15:25.010410 (+1636994us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540038c7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:25.010513 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3758390144}
W20260709 13:15:25.131089  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 188101us
I20260709 13:15:25.093789 12532 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:25.014042  7862 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.160881  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:25.155117  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 323071us
I20260709 13:15:25.159157  7861 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:25.161386  7336 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:15:25.160303  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 324333us
I20260709 13:15:25.155280  7329 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:25.155126  7890 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 10.
I20260709 13:15:25.158555  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.161008  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:25.141876  7150 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.163810  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.165257  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:25.167665  7334 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:15:25.168012  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.170166  7260 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:15:25.170674  7260 pending_rounds.cc:85] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 10
I20260709 13:15:25.170961  7260 pending_rounds.cc:107] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:15:25.171234  7260 raft_consensus.cc:2889] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:25.155323  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:25.178036  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 164264us
I20260709 13:15:25.167224  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:25.220623  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44307.7us
I20260709 13:15:25.221690  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:25.214494  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.225281  7255 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:25.226943  7895 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
W20260709 13:15:25.221908  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 59466.1us
I20260709 13:15:25.229014  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:25.229494  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:25.229854  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 88069.1us
I20260709 13:15:25.237818  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:25.241904  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.242654  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:25.227792 12470 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:15:25.227985 12069 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:15:25.245304 12620 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:25.249609 12620 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:25.249775 12609 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:25.250061 12620 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:25.220418 12213 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:25.252015 12213 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:25.252456 12213 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:25.179219 12328 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:15:25.255147 12677 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:15:25.154253 12469 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:25.155627 12333 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:25.160028 12081 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.178573 12509 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:25.220515 12508 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:25.232363 12525 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:25.220243 12661 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:25.164919 12662 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:25.274752  7335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2000) took 1908 ms (client timeout 1761 ms). Trace:
I20260709 13:15:25.176085 12666 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:25.245314 12506 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:25.243299 12665 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:25.272867  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:25.274881  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.178292 12673 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:15:25.176389 12477 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:15:25.255808 12478 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:25.275220  7335 rpcz_store.cc:269] 0709 13:15:23.365997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.366154 (+   157us) service_pool.cc:224] Handling call
0709 13:15:25.274534 (+1908380us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b540020fdd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:25.274677 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3877689088}
I20260709 13:15:25.179163  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.257393 12532 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:25.160000 12583 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 13:15:25.281672  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:25.282229 12523 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:25.281718 12664 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:25.350447  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 68854.7us
I20260709 13:15:25.264531 12081 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.247378 12605 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:15:25.246924 12587 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:15:25.160266 12582 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.297561  7329 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:15:25.351188  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.351258  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:25.264839 12333 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:25.258749 12559 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:15:25.278088 12666 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.277757 12563 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:25.279948 12506 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:25.289531 12610 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:25.483974  7894 raft_consensus.cc:2410] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:15:25.402081  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.400457  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48920.3us
W20260709 13:15:25.497330  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 146146us
I20260709 13:15:25.345383 12661 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.154s
I20260709 13:15:25.373926  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:25.496449 12291 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:25.499619 12412 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:25.355993 12478 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:25.500460 12412 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:15:25.380970 12682 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 13:15:25.501472 12412 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:25.432133  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 187514us
W20260709 13:15:25.353602  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 174499us
W20260709 13:15:25.381326  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 157959us
W20260709 13:15:25.367530  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 74142.6us
I20260709 13:15:25.504774  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:25.367259  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.501678  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:25.501972  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 128008us
I20260709 13:15:25.505936  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:25.504340  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:25.362175  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 117681us
I20260709 13:15:25.508215  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:25.502995 12412 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:25.355837 12383 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:25.393524 12081 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:25.376569 12664 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:25.516884  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:25.503522 12506 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:25.462575 12668 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.518679  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:25.532191  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:25.517977 12610 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:25.518343 12662 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:15:25.527009  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.536712  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.504720 12666 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:25.500438  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:25.539331  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.515197 12683 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:15:25.350812 12535 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.166s
I20260709 13:15:25.512216 12573 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:25.352206 12325 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.171s
I20260709 13:15:25.503458 12620 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:25.534261 12685 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:25.535109 12081 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:25.533344  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:25.520231  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.470906 12660 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:25.526681 12583 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:25.540266 12384 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:25.464396 12213 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.525694 12563 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:25.541199  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.394877 12646 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.132s
I20260709 13:15:25.528234 12605 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:15:25.547008 12662 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:25.569600  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.536280  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:25.544067 12610 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:25.561075  7887 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:25.566877  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:25.560318  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:25.543938 12651 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:25.533110 12664 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.538092 12673 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:15:25.538208 12291 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:15:25.544868 12573 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:25.546883 12685 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.548259  7225 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:25.561370 12081 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:25.556185 12583 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:25.567051 12563 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:25.575634  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.564821 12661 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:25.540409 12668 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.556779 12509 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:25.580399  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.572428 12322 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:25.576385 12071 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:25.576490 12383 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:25.576545 12523 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:25.580271 12685 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:25.602530 12523 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:25.599642 12539 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:25.603072 12523 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:25.603138 12539 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.603642 12539 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:25.604522  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 79455.2us
I20260709 13:15:25.605340  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:25.582998 12525 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:25.581822 12573 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:25.582705 12384 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:15:25.595960 12325 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:25.601904 12620 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:25.596900 12322 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:25.606738 12333 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:25.596663  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:25.613474  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:25.584692 12583 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:25.617303 12471 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:25.585768 12563 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:25.592235 12509 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:25.632995  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:25.631345  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51658.9us
I20260709 13:15:25.608263 12383 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.636297  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:25.637770  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:25.626176 12681 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:15:25.639626 12333 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:25.739470 12333 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.739879 12333 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:25.740440 12664 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:25.741034 12664 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.741477 12664 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.742679 12325 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:25.617316 12081 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.747207 12213 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:25.746958 12685 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.750144 12685 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:25.635205 12660 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:25.638433  7335 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:25.613420 12525 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:25.752964 12525 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:25.642970  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:25.755004  7333 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:25.634819 12509 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:25.632061 12610 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.723922 12668 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:25.724869 12688 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:15:25.637539 12383 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:25.629142 12662 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:25.627218 12322 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:25.757167  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 120941us
I20260709 13:15:25.776196  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:25.764750  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 131831us
I20260709 13:15:25.623921 12071 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:25.768651  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2955) took 1620 ms. Trace:
I20260709 13:15:25.638463 12478 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:25.768175 12459 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:25.793407  7260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:46710
I20260709 13:15:25.794270  7260 raft_consensus.cc:606] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:25.794737  7260 raft_consensus.cc:614] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:25.766510 12674 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:25.779206  7327 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:15:25.781160  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:25.788950  7228 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.761s (SENT) [suppressed 22 similar messages]
I20260709 13:15:25.789829  7333 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:25.814548  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:25.774075  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:25.815034  7328 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 13:15:25.815595  7335 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:25.799147  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:25.783358  7180 rpcz_store.cc:276] 0709 13:15:24.148171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.148295 (+   124us) service_pool.cc:224] Handling call
0709 13:15:24.148682 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:24.155578 (+  6896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.155630 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:24.177781 (+ 22151us) log.cc:844] Serialized 52 byte log entry
0709 13:15:25.065203 (+887422us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b18003f3f40. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:15:25.312407 (+247204us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:25.312504 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.313147 (+   643us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.755600 (+442453us) raft_consensus.cc:1685] finished
0709 13:15:25.755625 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.768552 (+ 12927us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7557,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5247,"spinlock_wait_cycles":12228864,"thread_start_us":211688,"threads_started":1,"wal-append.queue_time_us":1304460}
I20260709 13:15:25.801786  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:25.793707  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:25.820716  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:25.821316  7335 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:25.811055 12508 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:25.827088 12508 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.822139  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:25.829672 12291 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:15:25.831243 12609 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:25.831686 12609 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:25.832041 12609 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:25.796020 12325 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:15:25.817363 12384 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:15:25.841604 12573 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:25.843506 12322 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.844605 12539 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:25.848472  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46736.4us
W20260709 13:15:25.855439  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 295166us
I20260709 13:15:25.856315  7887 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:25.792166 12471 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:25.862756  7335 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:25.863186  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:25.864662  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:25.788436 12478 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:25.861529 12470 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:15:25.873709  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 268436us
I20260709 13:15:25.874814 12695 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:15:25.875262  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.868204  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:25.868829  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.877398  7891 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:25.878448  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:25.855185 12532 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.002s
I20260709 13:15:25.850519 12587 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:25.775089 12523 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:25.859087 12328 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:25.812199 12580 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:15:25.887795  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:25.879114 12325 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:25.806667 12333 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:25.876128 12525 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.888012 12428 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:25.924964  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 64307.1us
I20260709 13:15:25.871380 12459 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:15:25.914647 12580 consensus_queue.cc:1243] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:15:25.920902 12695 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:25.953202  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 88575.3us
W20260709 13:15:25.953969  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:25.954981 12695 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.956151 12508 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:25.956686 12523 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:25.957342 12523 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:25.959599 12081 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:25.960126 12081 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:25.963922 12509 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.965158 12081 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:25.967557 12582 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:25.975144  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.978719  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.980252  7152 leader_election.cc:400] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13.
I20260709 13:15:25.919849 12436 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:15:25.981367  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:25.989571 12699 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:25.983183 12692 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 13:15:25.983883 12506 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:25.935524 12535 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:15:25.991354 12535 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:25.991717 12535 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:25.992038 12506 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:25.981930 12509 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:25.992560 12535 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.993630 12609 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.994022 12535 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:25.990316  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:25.995793  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:25.996680  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:25.996694  7184 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:25.997851  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:25.999066  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.002374  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:25.978022 12700 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:26.003830  7184 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:15:25.974838 12428 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:15:26.008904  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:25.990074 12699 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:26.022820  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.009949 12525 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:26.000136 12532 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:25.930945 12071 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:25.989835 12580 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:26.024592  7181 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:26.008632  7178 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:15:26.035377 12693 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:15:25.974465 12478 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.023463 12700 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:26.003005 12325 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:26.045591 12325 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:26.046087 12325 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:26.046089 12700 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.032986 12580 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.047773 12580 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:26.028219 12699 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:26.051021 12539 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:26.051921 12539 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:26.052547 12539 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:26.053447 12322 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:26.054840 12333 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:26.055403 12383 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.030539 12532 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:26.056824 12532 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:26.059818  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56854.6us
I20260709 13:15:26.061156 12383 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:26.008622  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.064575  7182 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:26.068318  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.081028  7184 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:26.067736 12587 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:26.090548 12587 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:26.099803  7182 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:26.104423 12573 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:26.106925 12478 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:26.029738  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 161648us
W20260709 13:15:26.069254 12666 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 13:15:26.112210  7336 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:26.114583  7255 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:15:26.116144  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:26.116329  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.117133  7260 raft_consensus.cc:2410] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:15:26.118724  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:26.119551  7260 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:26.132892  7260 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
W20260709 13:15:26.135232  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 135861us
I20260709 13:15:26.136358  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:26.110718 12583 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.150708  7330 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:26.164825  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.166608  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.167376  7259 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:26.111018 12666 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.170288  7257 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:26.171234 12699 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.136905 12470 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:26.149361 12701 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:26.205137  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 68905.3us
W20260709 13:15:26.173738 12563 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:15:26.208621  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:26.203681  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 270302us
I20260709 13:15:26.213114  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.213753  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:26.210708  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.215207  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:26.216002  7887 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:26.219388  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:26.221735  7178 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:26.225821  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.231037  7187 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:26.232918  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.233824  7181 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:26.234848  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.202234 12705 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.214594 12291 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:26.233179  7887 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:26.244213  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.217747 12701 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.246407 12666 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:26.221630 12563 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.194149 12384 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:15:26.217764 12571 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.252844  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:26.253444  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.193804 12577 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:15:26.257635  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.246328 12699 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:26.296939 12333 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:26.313308  7183 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:26.313148 12325 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.314481  7182 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:26.314752 12571 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.316207 12325 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:26.316901 12571 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:26.228642 12723 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:26.321245  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:26.323376 12471 raft_consensus.cc:3055] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:26.323792 12471 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:26.326505  7894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 733) took 1958 ms (client timeout 1787 ms). Trace:
W20260709 13:15:26.326960  7894 rpcz_store.cc:269] 0709 13:15:24.368410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.370417 (+  2007us) service_pool.cc:224] Handling call
0709 13:15:26.326277 (+1955860us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540056cf54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:26.326438 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2553556736}
I20260709 13:15:26.328712 12583 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:26.227437 12428 consensus_queue.cc:1243] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:26.225692 12706 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:26.335049  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.335289 12706 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:26.335883 12706 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:26.264292  7187 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.335901  7258 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:26.338074  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:26.259186  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.340857  7184 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.342133  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.339565  7262 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:26.351763  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.355664  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:26.357309  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.358402  7259 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:26.359184  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:26.359952  7253 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:26.362183  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.363997  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:26.364710 12609 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:26.365139  7258 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:26.362313  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.367707  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.368261  7256 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:26.368417  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.373301  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.373858  7253 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:26.375998  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.377776  7257 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:26.367327 12291 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:15:26.381562 12563 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:26.250674 12383 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 13:15:26.383643 12660 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:26.383993 12660 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:26.385668  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:26.385810  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.386932  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.387066  7180 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:15:26.390573  7181 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:26.392580  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.387609  7179 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.353888 12333 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:26.405112  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.415132 12333 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.384812 12660 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.255453 12705 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:26.418092 12680 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260709 13:15:26.438232  7253 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:26.432711  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.457666 12704 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:26.458024  7179 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:26.458397 12704 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.459044  7257 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:26.440953  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.403600 12563 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:26.403389 12580 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.488636  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.491022 12701 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:26.493235  7187 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:26.492740  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 276989us
I20260709 13:15:26.469092  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.469584  7256 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:26.470618  7861 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:26.478770  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.494486  7186 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:15:26.503798 12665 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:26.481173 12563 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:26.508360 12580 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:26.511339 12713 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 13:15:26.511504 12705 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:26.516110  7184 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.518461  7185 raft_consensus.cc:2410] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:15:26.518710  7302 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:26.322477 12587 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.561565  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:26.525077  7179 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:26.523774 12735 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:26.526649  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.524538 12665 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:26.532650 12660 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:26.533565 12706 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.535447 12471 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.540743  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.572363  7187 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
W20260709 13:15:26.565182  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46572.4us
W20260709 13:15:26.522789  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52206.7us
I20260709 13:15:26.589547  7887 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:26.588862  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:26.591214  7894 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:15:26.567338  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.588274  7891 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:15:26.587275  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.594110  7181 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:26.595417  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.595757  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.596388  7181 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.596530  7179 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.599637  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.596341  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:26.602566 12668 consensus_queue.cc:1059] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:26.602802 12685 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:26.603627  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:26.603853 12668 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:26.604907 12610 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:26.605005 12668 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:26.605298 12610 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:26.605615 12668 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:26.606336 12610 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.607712 12610 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:26.607515 12668 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.609131 12668 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:26.610857 12685 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:26.610971 12710 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:26.611348 12685 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:26.611690 12710 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:26.612366 12685 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.612629 12710 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.613647 12685 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:26.602888  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.615283  7181 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.615927  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.616108  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.616573  7179 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:26.616755  7181 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:26.617574  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.618471  7179 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.568485 12213 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:26.646919 12213 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.647342 12213 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:26.648895  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.649494  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.651567  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.654929  7891 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:15:26.655081  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.656138  7187 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.619879  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.658171 12328 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:26.621953 12587 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:26.622217  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.664893  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:26.665200  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:26.665763  7257 raft_consensus.cc:2410] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:15:26.665714  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.623081 12471 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:26.623612 12706 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:26.572852 12735 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.680171  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:26.624894 12322 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:26.624586 12563 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.625075 12665 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.617712  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.687446  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:26.688685  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:26.688756  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.593784 12646 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:15:26.641929 12697 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.675s	user 0.000s	sys 0.011s
W20260709 13:15:26.642614  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46366.2us
I20260709 13:15:26.693708  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:26.695210  7302 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:26.642827  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 417850us
I20260709 13:15:26.660547  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:26.697391  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:26.674340 12470 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:26.664330  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:26.601094 12712 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:15:26.667901  7328 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:26.712929  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:26.668766  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:26.669003  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:26.670014  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:26.671064  7262 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:26.671094  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:26.671387  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:26.672869  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:26.720743  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:26.720947  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.724084  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:26.725165  7335 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:26.725286  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:26.675894  7186 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.678118  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.715160  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.676754  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:26.680200  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:26.727303  7179 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.716349  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.727909  7261 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:26.683650  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.684849  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.685156  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 88388.1us
I20260709 13:15:26.690335  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.678494 12580 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:26.692363 12665 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:26.683171 12735 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:26.698606  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.674585 12341 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:26.661080  7893 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:26.703538  7258 raft_consensus.cc:2368] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17.
W20260709 13:15:26.710547  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.766155  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.714138 12587 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:15:26.732525 12720 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:26.714932 12583 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:26.734180  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.728485  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:26.682843 12322 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:26.736326  7327 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 13:15:26.736673  7331 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:26.777814  7331 raft_consensus.cc:1217] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 12.7->[14.8-15.9]   Dedup: 14.8->[15.9-15.9]
I20260709 13:15:26.768631  7253 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:26.778359  7331 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: [14.8-15.9]
I20260709 13:15:26.736564  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.737703  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.780211  7262 raft_consensus.cc:2410] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:15:26.739069  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:26.726109  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:26.755273 12649 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:26.739846  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.787810  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.788681  7179 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:26.789765  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.739984  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.792017  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.792832  7186 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:26.793872  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.740957  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:26.743758  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:26.660622 12328 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:15:26.756835  7330 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:15:26.796447  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:26.676231 12559 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:15:26.702718 12610 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:26.805842  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 66879.4us
I20260709 13:15:26.764076  7332 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:26.732532 12701 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:26.712007 12646 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:26.773723  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:26.774930  7261 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:26.775301  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46919.3us
W20260709 13:15:26.795030  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 54154.9us
I20260709 13:15:26.852962  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:26.740563 12580 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:26.799400  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.858904  7186 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.859823  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.767885 12716 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.800000  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.800652  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.803337  7335 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:26.804592  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:26.811113  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.734974 12709 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:15:26.806903  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:26.757525 12674 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:15:26.771154 12341 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.851244  7262 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:26.890918  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:26.795439  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51793.8us
I20260709 13:15:26.780617 12673 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:26.898795  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.899374 12673 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:26.899917 12673 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:26.900168  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.890686 12716 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.775337 12703 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:26.903445 12703 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:26.904867 12727 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:15:26.904577 12703 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:26.905985 12703 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:26.856813  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 88081us
I20260709 13:15:26.877436  7186 raft_consensus.cc:2368] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15.
W20260709 13:15:26.850109  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65815.3us
I20260709 13:15:26.798012 12384 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:26.805205 12609 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:26.805312 12583 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:26.879259  7257 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:26.885823  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 79001.8us
I20260709 13:15:26.814280 12328 consensus_queue.cc:1243] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:15:26.888900  7261 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:26.922277  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.922998  7186 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:26.924136  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.893448  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:26.891844  7181 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:26.907474  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:26.832194 12333 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:26.928609  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.929677  7181 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:26.852339 12720 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:26.920281  7259 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: [12.7-15.9]
I20260709 13:15:26.880260 12587 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:26.937062  7255 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [15.9-16.10]
I20260709 13:15:26.935026  7261 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: [11.10-12.11]
I20260709 13:15:26.940352  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:26.934865  7861 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:26.833190 12610 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.939239  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:26.947356  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 94489.2us
I20260709 13:15:26.906811 12717 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:26.903395 12716 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:26.854745 12701 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:26.951753  7186 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:26.952463  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 99185.3us
W20260709 13:15:26.984766  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.951447  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.003188  7257 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:27.006067  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:27.006927  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:26.935827 12725 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:26.918701 12695 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:27.015175  7255 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:26.943925 12587 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.948691 12728 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:27.012668  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.948721 12670 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:27.039479  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:26.935006 12609 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:26.879057 12718 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:15:27.004412 12333 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:27.014680 12744 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:15:26.987888 12747 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:27.052386  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:27.054126  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 109877us
I20260709 13:15:26.910559 12322 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:27.067809  7335 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:27.045536 12587 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:27.072187  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:27.076558  7335 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 13:15:27.063861  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:27.048475 12670 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:26.948293 12580 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.054979 12728 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:15:27.105867  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 99877.9us
I20260709 13:15:27.063664 12752 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:15:27.069191 12738 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:15:27.067757 12745 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:27.078819 12695 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:27.057724 12747 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.104768  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:27.100209  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.078096 12328 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.057866 12751 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:27.073939  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:27.069676 12341 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.119848  7257 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:15:27.102866 12739 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:15:27.078776 12384 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.8, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:15:27.117213  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 223861us
I20260709 13:15:27.015087 12646 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.119608  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:27.128752  7152 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:27.099721  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 148349us
I20260709 13:15:27.111807  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:27.102779 12291 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.128151  7255 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:27.114666 12580 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:27.112948 12664 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:27.057448 12583 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.133014  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.117223 12752 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:27.138310  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.135658  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:27.139261  7335 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:27.130069 12291 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.070137 12609 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.126605 12745 raft_consensus.cc:697] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:15:27.133697 12737 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:15:27.125823 12328 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.143826  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:27.144228  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:27.144584  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 209782us
I20260709 13:15:27.133716 12532 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:27.139690  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.085953 12720 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.130788 12384 consensus_queue.cc:1243] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:27.137879  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.159889  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.158277  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3184) took 1018 ms. Trace:
I20260709 13:15:27.137760 12718 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:27.137719 12716 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:27.132297 12753 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:27.161022  7260 rpcz_store.cc:276] 0709 13:15:26.139956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.140127 (+   171us) service_pool.cc:224] Handling call
0709 13:15:26.166160 (+ 26033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:26.173432 (+  7272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.173466 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:26.192337 (+ 18871us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.616823 (+424486us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b180038cbc0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:15:26.804726 (+187903us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:26.804765 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.805314 (+   549us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.150074 (+344760us) raft_consensus.cc:1685] finished
0709 13:15:27.150095 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.158208 (+  8113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6922,"raft.queue_time_us":24166,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":18173,"spinlock_wait_cycles":3844480,"thread_start_us":187709,"threads_started":1,"wal-append.queue_time_us":714239}
I20260709 13:15:27.170096  7181 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:27.170856 12718 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:27.171873 12718 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.164667  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.165738  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:27.123840 12695 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.176874  7335 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:27.178547  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.136420 12717 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:15:27.187539 12765 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:27.164330 12758 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:27.169448 12664 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:15:27.183013 12668 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.572s	user 0.005s	sys 0.009s
W20260709 13:15:27.182912 12740 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:15:27.172534 12760 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.200436  7181 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:27.191747 12717 consensus_queue.cc:1243] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:27.183410 12674 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:27.177501 12754 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:15:27.189895 12752 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:27.218221  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 53609.5us
I20260709 13:15:27.237614  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.182003 12716 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:27.142772 12670 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.211730 12664 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.195705 12761 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:27.258769  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 67656.4us
W20260709 13:15:27.259426  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:27.263871  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.227459 12760 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.270511 12760 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:27.259056 12670 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:27.272984 12673 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:27.232384  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 76761us
W20260709 13:15:27.214417  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 74764.2us
I20260709 13:15:27.227644  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2271) took 1006 ms. Trace:
I20260709 13:15:27.227787 12701 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.226310 12765 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:15:27.265911 12213 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.004s
I20260709 13:15:27.243729 12328 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:27.247644  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 450286us
I20260709 13:15:27.336410  7186 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:27.161212 12728 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.252405  7331 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:27.253813  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.276049  7181 rpcz_store.cc:276] 0709 13:15:26.221145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.182595 (+961450us) service_pool.cc:224] Handling call
0709 13:15:27.200251 (+ 17656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.227303 (+ 27052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.227574 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.277387  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:27.341559  7332 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:27.275039 12747 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.280009  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:27.345887  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2978) took 1352 ms. Trace:
W20260709 13:15:27.313670  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.346334  7180 rpcz_store.cc:276] 0709 13:15:25.993511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.995554 (+  2043us) service_pool.cc:224] Handling call
0709 13:15:27.345654 (+1350100us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54002c4f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:27.345820 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897745280}
I20260709 13:15:27.348495  7180 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:27.253925 12664 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:27.336982  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2274) took 1115 ms. Trace:
I20260709 13:15:27.351249  7186 rpcz_store.cc:276] 0709 13:15:26.221925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.335920 (+1113995us) service_pool.cc:224] Handling call
0709 13:15:27.336232 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.336778 (+   546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.336940 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:27.338187  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.278023  7228 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:27.344393  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 90670.8us
I20260709 13:15:27.345120  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:27.353143  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.349393  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2993) took 1006 ms. Trace:
I20260709 13:15:27.346408  7895 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:27.354538  7181 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:27.354655  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:27.225704 12745 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.355785  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2992) took 1093 ms. Trace:
I20260709 13:15:27.357070  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2280) took 1068 ms. Trace:
I20260709 13:15:27.353605  7180 rpcz_store.cc:276] 0709 13:15:26.342587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.347422 (+1004835us) service_pool.cc:224] Handling call
0709 13:15:27.347711 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.349154 (+  1443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.349341 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:27.356144  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 80148.8us
I20260709 13:15:27.357512  7181 rpcz_store.cc:276] 0709 13:15:26.288437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.341225 (+1052788us) service_pool.cc:224] Handling call
0709 13:15:27.354363 (+ 13138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.356792 (+  2429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.357012 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.357187  7187 rpcz_store.cc:276] 0709 13:15:26.262369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.338927 (+1076558us) service_pool.cc:224] Handling call
0709 13:15:27.355380 (+ 16453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.355549 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.355573 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.355610 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:27.355629 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.355674 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.355743 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.369407  7180 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:15:27.369721  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.371675  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.348464 12328 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:27.352558 12765 consensus_queue.cc:1243] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:27.384037  7186 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:15:27.385842  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2290) took 1068 ms. Trace:
I20260709 13:15:27.386114  7181 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:27.386256  7184 rpcz_store.cc:276] 0709 13:15:26.317620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.357062 (+ 39442us) service_pool.cc:224] Handling call
0709 13:15:27.385651 (+1028589us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54002724d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:27.385781 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363376000}
I20260709 13:15:27.387816  7184 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:27.389109  7184 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:15:27.389431  7184 pending_rounds.cc:85] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 13
I20260709 13:15:27.389638  7184 pending_rounds.cc:107] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:15:27.389856  7184 raft_consensus.cc:2889] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:27.339238 12213 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.394999  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.414794  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:27.382019 12674 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:27.415736  7333 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:27.417986  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.423204  7334 raft_consensus.cc:2368] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13.
I20260709 13:15:27.431386 12213 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:27.436503 12772 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:27.437060 12772 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:27.393782 12291 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:27.440500  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56019.7us
I20260709 13:15:27.412109 12765 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:27.382211 12754 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:15:27.446394  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.437425 12772 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:27.441645  7186 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:27.450421 12752 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:27.425010 12695 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.421514 12775 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:27.468371  7255 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:15:27.471017  7255 pending_rounds.cc:85] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 9
I20260709 13:15:27.471356  7255 pending_rounds.cc:107] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:15:27.471649  7255 raft_consensus.cc:2889] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:27.471877  7186 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:27.473049  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:27.473810  7255 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:27.475481  7255 pending_rounds.cc:85] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 6
I20260709 13:15:27.475823  7255 pending_rounds.cc:107] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:15:27.476132  7255 raft_consensus.cc:2889] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:27.483495  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:27.445456 12766 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:27.451323 12701 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.490573  7260 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
W20260709 13:15:27.497689 12665 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.740s	user 0.008s	sys 0.001s
I20260709 13:15:27.497786 12704 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.444761 12328 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:15:27.498870 12766 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:27.499105  7257 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:15:27.499442  7257 pending_rounds.cc:85] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 7
I20260709 13:15:27.499666  7257 pending_rounds.cc:107] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:15:27.499902 12766 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.499917  7257 raft_consensus.cc:2889] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:27.512367  7895 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:15:27.512835  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 60822.9us
I20260709 13:15:27.514768 12674 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:27.514878 12779 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:27.516248 12674 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.523360  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.540105  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.487931 12291 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:27.543557  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.510529 12673 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:27.550541  7228 leader_election.cc:400] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15.
I20260709 13:15:27.551924  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:27.537472 12735 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.761s	user 0.008s	sys 0.004s
I20260709 13:15:27.554921  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.558065  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:27.561398  7186 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:27.482602 12717 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:15:27.564071  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.556697 12720 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.521250 12770 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:27.544816 12665 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:27.547041 12704 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:27.580374 12774 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:15:27.582329  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.557369 12291 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:27.583289  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2986) took 1581 ms. Trace:
I20260709 13:15:27.583675  7178 rpcz_store.cc:276] 0709 13:15:26.001615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.034354 (+ 32739us) service_pool.cc:224] Handling call
0709 13:15:26.055782 (+ 21428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:26.222353 (+166571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.583049 (+1360696us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540039d0d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:27.583222 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381073792}
I20260709 13:15:27.583801 12291 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.584962  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:27.586249  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:27.587131  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 2979) took 1593 ms. Trace:
I20260709 13:15:27.587599  7185 rpcz_store.cc:276] 0709 13:15:25.993846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.996455 (+  2609us) service_pool.cc:224] Handling call
0709 13:15:27.586938 (+1590483us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54002b52d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:27.587074 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1197831552}
I20260709 13:15:27.588631  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:27.509595 12701 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.561455 12752 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:27.591871 12752 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:27.592278 12752 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:27.592710 12701 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:27.593807 12703 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.687s	user 0.006s	sys 0.003s
I20260709 13:15:27.593381  7178 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 5. (term mismatch)
I20260709 13:15:27.595890  7178 pending_rounds.cc:85] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 4
I20260709 13:15:27.596307  7178 pending_rounds.cc:107] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 12.5
I20260709 13:15:27.596720  7178 raft_consensus.cc:2889] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:27.565850  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:27.544513 12767 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:27.564957 12673 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:27.599056 12767 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.568681 12720 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.601303 12720 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:27.571116  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:27.574740 12665 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:27.575340  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.602591 12665 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:27.605815  7333 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:27.606977 12704 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:27.607239  7332 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
W20260709 13:15:27.575415 12773 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:15:27.567234 12770 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.608744 12770 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:27.553692 12775 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:27.576646  7225 leader_election.cc:400] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13.
I20260709 13:15:27.621279  7225 leader_election.cc:403] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:15:27.576570  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:27.609527  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 43751.1us
I20260709 13:15:27.611316 12758 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:27.604769 12471 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.927s	user 0.007s	sys 0.003s
I20260709 13:15:27.601303 12767 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.567200 12695 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:27.576376 12717 consensus_queue.cc:1243] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:15:27.614900 12761 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:27.615900  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:27.619243 12587 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 13:15:27.653069  7185 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:15:27.630172  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 53696.4us
I20260709 13:15:27.630295  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:27.641919  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65413.4us
I20260709 13:15:27.605245 12649 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.564028 12735 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.673105  7333 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 13:15:27.673875  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.639806 12754 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:27.656261 12701 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:27.660353 12523 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:15:27.669154 12775 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:27.668936 12649 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:27.677719 12771 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:15:27.684146 12695 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:27.653484 12587 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.670835 12767 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:15:27.671087 12717 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:15:27.690188 12291 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:27.695935 12735 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:27.696130  7261 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 13:15:27.704533  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2028) took 1012 ms. Trace:
I20260709 13:15:27.705040  7261 rpcz_store.cc:276] 0709 13:15:26.691871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.938170 (+246299us) service_pool.cc:224] Handling call
0709 13:15:26.938469 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:27.695880 (+757411us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400315220. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece923e1c0 00007fece923f231 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c
0709 13:15:27.704120 (+  8240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.704452 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314173312}
I20260709 13:15:27.696939  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2009) took 1032 ms. Trace:
I20260709 13:15:27.706496  7258 rpcz_store.cc:276] 0709 13:15:26.664265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.664406 (+   141us) service_pool.cc:224] Handling call
0709 13:15:27.691213 (+1026807us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54002d4454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:27.696869 (+  5656us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43482368}
I20260709 13:15:27.697549 12718 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:27.677977 12754 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.684782  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.595767 12772 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.696192 12664 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.678808 12758 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:15:27.714728  7228 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:27.714759 12674 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.718072 12674 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.723002 12649 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:27.725485  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 602024us
I20260709 13:15:27.726940 12583 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:27.727643 12583 consensus_queue.cc:1243] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:27.727705 12674 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.729154 12649 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:27.729754 12649 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.730201 12649 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.731941  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:27.732308 12753 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:27.727077  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.737047  7187 raft_consensus.cc:2410] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 22 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:15:27.732972 12753 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:27.732374 12649 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:27.739009 12753 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.740073 12753 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:27.703099 12291 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:27.755952  7186 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
W20260709 13:15:27.752684 12733 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.060s	user 0.005s	sys 0.000s
W20260709 13:15:27.753054  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.709252 12718 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:27.733223 12775 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:27.711655 12754 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:27.757856  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.759756  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.767266 12213 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:27.768002 12704 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:27.769122  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:27.770449  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:27.774945 12754 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.776049 12772 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.776898 12674 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.777529 12754 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:27.777458 12674 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.778996  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:27.779698  7893 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:15:27.781863  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:27.782044  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:27.784648  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.787838 12665 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.799573 12762 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:27.786952 12605 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.791111 12469 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:27.791662 12752 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.746277 12383 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:27.793227 12718 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.799254 12291 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.789450 12664 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.802004  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.762868  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:27.753087 12703 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:15:27.806437 12703 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:27.806886 12703 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:27.807253 12665 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:27.781283 12673 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:27.814234  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.816958  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:27.817667  7258 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:27.801414 12709 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:27.815464  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:27.803556 12754 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:27.802145 12469 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:27.820120 12754 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.820385 12469 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:27.820633 12754 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:27.810214 12383 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.824819 12383 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:27.807956 12770 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.827768 12610 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.827805  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3193) took 1498 ms. Trace:
I20260709 13:15:27.829547 12770 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.828678  7254 rpcz_store.cc:276] 0709 13:15:26.329839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.335991 (+  6152us) service_pool.cc:224] Handling call
0709 13:15:26.336332 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:26.336740 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.336766 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:26.337355 (+   589us) log.cc:844] Serialized 52 byte log entry
0709 13:15:26.543105 (+205750us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:26.543156 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.543250 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.752019 (+1208769us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:27.827461 (+ 75442us) raft_consensus.cc:1685] finished
0709 13:15:27.827487 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.827731 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39390,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":6040,"spinlock_wait_cycles":22139776,"thread_start_us":205359,"threads_started":1,"wal-append.queue_time_us":350267}
I20260709 13:15:27.808038 12765 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:27.813087 12583 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:15:27.810726 12471 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.832062 12471 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.833300  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.834295 12471 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.834853 12761 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:27.836232  7152 leader_election.cc:400] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17.
I20260709 13:15:27.836627 12770 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:27.839723 12718 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:27.840519  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:27.841063  7186 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:27.858008  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 2997) took 1158 ms. Trace:
I20260709 13:15:27.841387  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:27.858711  7887 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:27.841653  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:27.841795  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.841904  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:27.842724  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:27.806618 12587 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:27.850148  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:27.860829  7889 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:27.861038  7893 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:27.838424 12322 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:27.854001  7152 leader_election.cc:403] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:27.855376  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:27.852381  7888 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:27.858417  7181 rpcz_store.cc:276] 0709 13:15:26.700000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.387414 (+687414us) service_pool.cc:224] Handling call
0709 13:15:27.416860 (+ 29446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:27.730492 (+313632us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b1800294e20. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fece9234060 00007fece9234bfb 00007fece923f64b
0709 13:15:27.730673 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:27.731014 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.802233 (+ 71219us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:27.805345 (+  3112us) log.cc:844] Serialized 26 byte log entry
0709 13:15:27.808307 (+  2962us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:27.808597 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.808839 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.808912 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.857741 (+ 48829us) raft_consensus.cc:1685] finished
0709 13:15:27.857765 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.857951 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2649,"prepare.queue_time_us":2144,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":81,"raft.queue_time_us":27381,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":10232,"spinlock_wait_cycles":55041792,"thread_start_us":117006,"threads_started":2,"wal-append.queue_time_us":91955}
I20260709 13:15:27.864192  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:27.808364 12605 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.870497  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.871147 12213 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:27.871740 12213 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:27.872225  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:27.872473 12605 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:27.872644 12213 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.807782 12703 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:27.879418 12703 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:27.880324  7186 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:27.864315  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:27.885658  7187 raft_consensus.cc:2410] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:15:27.884431  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48355us
I20260709 13:15:27.889496  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:27.893322  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:27.895040  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:27.886157 12762 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:27.858382 12291 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:27.892203 12478 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17.
I20260709 13:15:27.904881 12587 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:27.905575 12587 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.895735  7181 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:27.885195 12622 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:27.907966  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:27.890461 12666 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:15:27.883821 12709 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:27.915027  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:27.915027  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:27.886371 12570 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:27.891489 12665 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:27.953696  7262 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:27.911208  7261 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:27.894374 12765 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:27.954275  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.907971  7862 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:27.944386  7889 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:27.920780  7258 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: [12.7-18.10]
I20260709 13:15:27.922483  7254 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:27.915433  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:27.928781  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:27.968451  7260 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:27.965981  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:27.967028  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 59135.3us
I20260709 13:15:27.956404 12673 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.955281 12767 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.901850 12610 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:27.906929 12704 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:15:27.911738 12752 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:27.965394 12765 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:28.004086  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:27.972863 12748 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:27.977957  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:27.995179  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:28.013782  7182 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:28.015923  7182 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:15:27.995607 12563 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:27.996682 12710 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:27.997534 12674 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:27.998750 12767 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:27.980669 12762 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:28.000376  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.001905  7259 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:28.004850  7889 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:27.988042 12610 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:28.006286  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:27.989902  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3202) took 1042 ms. Trace:
I20260709 13:15:28.034255  7257 rpcz_store.cc:276] 0709 13:15:26.947417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.130148 (+182731us) service_pool.cc:224] Handling call
0709 13:15:27.130514 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.503282 (+372768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.989576 (+486294us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54002279d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:27.989831 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846821632}
I20260709 13:15:27.962528 12570 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:28.025771  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 47927.1us
I20260709 13:15:27.964953 12665 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.005414 12071 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:28.049062 12071 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:28.054436  7179 raft_consensus.cc:2410] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:15:28.013325 12705 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:28.058423  7182 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:28.020525  7260 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:28.023550 12710 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:28.023119 12775 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.039018 12762 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.011402 12765 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:27.987469 12673 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.027848 12609 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:28.001580 12469 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.044755  7889 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:28.012364 12748 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.046465 12610 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:28.050076 12071 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.083576  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:28.070943 12762 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:28.098140  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:28.093271 12767 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.088443 12665 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.065222 12705 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.087352 12609 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:28.094066 12469 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:28.076678 12701 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13.
I20260709 13:15:28.126753  7186 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 13:15:28.145771  7186 pending_rounds.cc:85] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 6
I20260709 13:15:28.146063  7186 pending_rounds.cc:107] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:15:28.146319  7186 raft_consensus.cc:2889] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:28.149094  7186 pending_rounds.cc:107] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:15:28.149439  7186 raft_consensus.cc:2889] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:28.127125 12322 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:28.070850 12775 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.147418  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.135784  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.085616 12748 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:28.110013 12766 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.118883 12587 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.121397 12752 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.157135 12609 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.128649 12570 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.161377 12705 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.162081 12322 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:28.163080 12799 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:15:28.163172 12322 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.165726 12673 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:28.096618 12754 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:28.172855  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.171705  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:28.178557  7184 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:28.131467 12710 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.167371 12752 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.180392 12710 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:28.181810 12752 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.182437 12766 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.183147  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.169581 12775 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.184788 12587 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:28.185381 12587 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.189052 12587 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.191263  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:28.192173  7187 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:28.192668 12716 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.193348 12716 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.196121 12716 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:28.207370  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:28.208379  7184 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:28.216316  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.223901  7256 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
W20260709 13:15:28.225055  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.227028  7184 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:28.221145 12712 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.243921  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1013) took 2247 ms. Trace:
I20260709 13:15:28.244570  7183 rpcz_store.cc:276] 0709 13:15:25.996913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.023979 (+ 27066us) service_pool.cc:224] Handling call
0709 13:15:26.030321 (+  6342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:26.313820 (+283499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.243576 (+1929756us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54000ed8d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:28.243835 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646291328}
I20260709 13:15:28.247852 12735 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:28.249034 12735 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:28.249406 12735 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:28.251426 12705 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.251996 12705 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.238675 12754 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.250232 12735 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.278599 12570 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:28.283098 12570 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.285287 12570 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.289415 12705 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:28.291158 12735 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:28.246215 12712 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.297206 12712 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:28.297518 12587 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:28.298154 12587 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.300653 12587 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.300693 12610 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.280457 12765 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.310815  7254 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:28.311995 12765 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.313103  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:28.313740  7891 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:28.316354 12748 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:28.318099  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.305825 12762 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.320297 12762 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:28.321419  7891 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:28.323019  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:28.324317 12775 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:28.324467 12610 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.324868 12775 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:28.325487 12762 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:28.325850 12775 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.327692 12710 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.328092  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:28.328729  7183 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:28.327524 12610 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:28.329285 12610 consensus_queue.cc:1243] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:28.330080  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:28.333544  7895 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:28.326072 12762 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.334682  7084 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 6 to 4, term changed from 7 to 6, leader changed from <none> to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132), VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) added. New cstate: current_term: 6 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:28.336298  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:28.336489 12384 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.336879  7180 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:28.337044 12384 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.339859  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:28.341866  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:28.342453  7259 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:28.343012  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:28.343895  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:28.344494  7180 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:28.345268  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:28.345777  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:28.346122  7228 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:28.346410  7253 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:28.346923 12757 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:28.347296 12768 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:28.347513 12757 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:28.347749 12539 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.347987 12768 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:28.348208 12539 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.348529 12757 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.350373 12539 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:28.352672  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:28.353613 12610 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:28.354125 12752 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:28.354255 12610 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:28.355254 12772 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:28.346261 12751 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:28.356324 12762 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.356530 12772 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:28.357645  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:28.348558 12768 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:28.339892 12695 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:28.359272 12695 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:28.359951 12610 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:28.360066 12695 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.359470  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:28.361271  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:28.361519  7179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2330) took 1618 ms (client timeout 2095 ms). Trace:
I20260709 13:15:28.376164  7184 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
W20260709 13:15:28.375998  7179 rpcz_store.cc:269] 0709 13:15:26.743379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.899885 (+156506us) service_pool.cc:224] Handling call
0709 13:15:28.361315 (+1461430us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400270bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:28.361456 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2651897600}
I20260709 13:15:28.364369  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.377081  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:28.377393  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.378110  7327 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:28.378332  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.368531  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.379455  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:28.369196  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.380015  7179 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:28.380645  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.381263  7887 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:28.381402  7180 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:28.370843  7261 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:28.382009  7891 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:28.369853  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.367720  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.373366  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:28.374454  7253 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:28.366991  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.398156  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.403132  7889 raft_consensus.cc:2368] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14.
I20260709 13:15:28.371824  7890 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:28.382843  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:28.403775  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.404021  7185 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:28.383843  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.385687  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:28.386296  7260 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:28.387122  7178 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:28.390446  7186 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:15:28.379757  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:28.390481  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:28.407473  7334 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:28.392892  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:28.409126  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:28.410213 12707 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:28.410753 12707 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:28.411296 12470 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:28.411594 12707 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.413136 12470 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:28.393827  7183 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:28.395370  7259 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:28.417788  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:28.418247  7179 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
W20260709 13:15:28.399034  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 248701us
I20260709 13:15:28.404515  7887 raft_consensus.cc:2368] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17.
I20260709 13:15:28.392045  7180 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:15:28.361557 12781 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.911s	user 0.003s	sys 0.000s
W20260709 13:15:28.344519 12797 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
I20260709 13:15:28.429674  7258 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:28.430377  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:28.428886  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:28.433013  7327 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:15:28.433588  7257 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:28.434592  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:28.435196  7257 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:28.436090  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:28.436651  7260 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:28.437089  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:28.446134  7185 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:28.328351 12710 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.419569  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.449951  7333 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
W20260709 13:15:28.417351  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44428.3us
I20260709 13:15:28.421293  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:28.427120  7262 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:28.419211 12470 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:28.451105  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:28.453598  7334 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:28.451781  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:28.420524 12610 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:15:28.465126  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.422293 12765 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:28.492803  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.417174 12762 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:15:28.462530  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.432125 12752 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:28.497083  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:28.497555  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.503211  7333 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:28.497857  7328 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: []
I20260709 13:15:28.450376 12751 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:28.487006 12573 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:28.457756 12695 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:28.486842 12767 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:28.490101 12610 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.492527 12765 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.452243 12673 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:15:28.457617 12701 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:15:28.495218 12661 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:15:28.502311 12752 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.501463 12748 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:28.493085 12577 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:15:28.516844 12573 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.523917 12610 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:28.527280 12765 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:28.522043 12751 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:28.485883 12768 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.560763 12751 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.539211 12752 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:28.535218 12766 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.540477 12760 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:15:28.552425 12710 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.580776 12752 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.583608 12752 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.585876 12765 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.588960 12765 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:28.628003  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 235874us
I20260709 13:15:28.629871  7255 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:28.450235  7260 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:28.633303  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:28.641978  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:28.646420  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:28.648233  7181 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:28.651033  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:28.651317  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:28.652128  7185 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:28.656390  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.657398  7329 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:15:28.657483  7327 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:28.659534  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.661237  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.664191  7330 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:28.664570 12428 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.665041 12469 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:28.665642  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.500270  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:28.666061 12469 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.667248  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:28.667733  7331 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:28.668849  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.669359  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:28.669190 12470 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.670311  7331 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:15:28.655222  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:28.664584 12291 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:28.695514 12291 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.695828  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.696045 12291 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:28.687764  7330 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:28.665776 12428 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
W20260709 13:15:28.698235  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.699764  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.702962  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:28.738102  7181 raft_consensus.cc:2368] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17.
I20260709 13:15:28.739081 12384 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.739549  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:28.739857  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46805.1us
I20260709 13:15:28.743057 12779 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:28.744985 12779 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:28.747108 12469 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:28.747619  7183 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:28.748929  7328 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:28.750789 12573 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:28.754985  7185 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:28.755227 12618 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:28.756165 12618 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.759196 12618 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:28.761265 12428 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:28.742612  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:28.762234 12735 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:28.742434  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:28.762669 12735 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:28.763738  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:28.763521 12662 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:15:28.764358 12735 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.765236 12662 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:28.763561 12762 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:28.765765 12662 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:28.766253 12762 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:28.766755 12762 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:28.767145 12539 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:28.767760 12539 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:28.769054 12539 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.772598 12523 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:28.773054 12523 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.775157  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:28.791587  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 137872us
I20260709 13:15:28.800473 12757 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:28.790544 12587 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:15:28.808331  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:28.802820 12765 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:28.740041 12384 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:15:28.817613 12384 consensus_queue.cc:1243] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:28.820163  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:28.737515 12609 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.827363 12609 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.831310 12707 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:28.785799 12523 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:28.816630  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:28.813789  7179 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:28.832129 12707 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.850483 12428 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.850683  7862 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:28.851456  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.851495 12428 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.853708 12661 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:28.853977  7895 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:15:28.854702 12577 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:28.856752  7184 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:15:28.857460  7330 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:28.858083  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:28.858942  7185 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:28.861526 12610 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.862869 12775 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:28.863721 12775 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.864792 12428 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:28.866921 12765 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:28.867095 12665 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:28.867640 12765 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.868288 12665 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:28.868607  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:28.854368 12661 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:28.871790  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:28.872026 12765 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:28.873019 12661 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:28.871624  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:28.866255 12775 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:28.856799  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:28.830396 12609 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:28.868738 12665 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:28.881914  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 86231.1us
I20260709 13:15:28.903448  7331 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:28.890107  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:28.850760  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 300664us
I20260709 13:15:28.789969 12705 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.114s
I20260709 13:15:28.907148 12428 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:28.934408  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:28.948038  7332 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:28.920593  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:28.966475  7183 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:28.907506 12587 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:15:28.979298  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.977154  7327 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:15:28.981747  7327 pending_rounds.cc:85] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 9
I20260709 13:15:28.982393 12587 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:28.982961 12587 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:28.982043  7327 pending_rounds.cc:107] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:15:28.985865 12587 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.986253 12665 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.987481 12587 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:28.987953 12665 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:28.990739  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:28.992240  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 101896us
W20260709 13:15:28.993543  7334 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.005s
I20260709 13:15:28.994068  7334 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:28.995247 12610 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:28.997028 12770 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:28.997821 12770 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:28.999257  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.000168  7262 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:28.984498  7327 raft_consensus.cc:2889] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:29.006567  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:29.012789 12622 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:15:29.013631  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.014659  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:29.017707 12775 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:29.019171 12666 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:29.019470  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 58080.4us
I20260709 13:15:29.019995 12766 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:29.020694  7299 leader_election.cc:400] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14.
I20260709 13:15:29.020749 12766 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:29.012825 12809 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:15:29.025182 12609 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:29.021281  7299 leader_election.cc:403] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:29.034468 12770 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:29.034754  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:29.036571  7299 leader_election.cc:400] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17.
I20260709 13:15:29.037005  7299 leader_election.cc:403] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:29.038269  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.038530 12469 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14.
I20260709 13:15:29.039705 12666 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:15:29.040868 12695 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.000s
I20260709 13:15:29.043819  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:29.044629  7184 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:29.049614  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 151611us
I20260709 13:15:29.052130  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:29.053571  7150 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:29.055068  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.055879  7258 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:29.056012  7257 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:15:29.056450  7257 pending_rounds.cc:85] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 8
I20260709 13:15:29.056717  7257 pending_rounds.cc:107] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:15:29.056945  7257 raft_consensus.cc:2889] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:29.055121  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 127909us
I20260709 13:15:29.056463  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:28.976680 12662 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.059329 12707 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:29.060072 12662 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:29.060915 12707 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:29.061600  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:29.062422 12469 consensus_queue.cc:1175] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9a54ecc9fb4541df915f9f8c01e19429" responder_term: 15 status { last_received { term: 14 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:29.063416 12712 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:29.064396  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.064735 12573 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.065243  7259 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:29.065620 12712 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:28.968546 12428 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.018183 12775 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:29.083968 12622 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:29.084457  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:29.085805  7181 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:29.086012  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.086009 12666 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17.
I20260709 13:15:29.088114 12428 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:29.088739  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:29.090056  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:29.020512 12605 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:29.091257 12757 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:29.092563  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:29.117172  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:29.098316  7330 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:15:29.056862  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.110962  7185 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:27.333280  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:29.119467  7262 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:29.121534 12333 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:15:29.124272  7184 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:29.102675 12775 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:29.173988  7259 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:29.177675  7183 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:29.180048  7259 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 13:15:29.204052  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 150580us
W20260709 13:15:29.208417  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 146947us
I20260709 13:15:29.209962  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:29.116263 12770 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.154894 12622 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:29.212072  7889 raft_consensus.cc:2410] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEARNER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:15:29.114962 12605 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:29.215711 12605 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.216809  7253 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:29.216352 12622 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.217387 12605 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:29.122403 12704 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.219131 12704 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.220145 12766 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:29.220578 12770 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.221510 12704 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:29.112713 12563 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:15:29.222891 12770 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:29.113162 12384 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:15:29.190160 12333 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:29.186810  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 66043us
I20260709 13:15:29.223878 12333 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:29.199507  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.224723  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:29.226213 12333 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:29.226944  7185 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:29.161183 12539 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:29.223026 12563 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:29.198959  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:29.226279  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:29.210995 12587 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:29.239784  7179 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:29.234277 12563 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:29.252017 12563 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.254081 12563 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:29.255576 12577 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:29.256419 12577 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:29.257347  7859 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:29.254087 12766 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.234553 12587 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.258690 12766 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.259315 12587 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:29.261158 12766 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:29.261979 12383 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:29.262538 12383 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:29.263649 12383 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:29.234730 12291 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.003s
I20260709 13:15:29.266049 12748 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:15:29.266129 12291 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.267585 12748 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:15:29.268074 12748 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:29.268953 12291 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:29.269176 12748 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.274603 12666 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.275170 12666 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.277738 12735 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:29.278977 12759 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:29.288671  7184 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:29.289430 12759 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:29.290845 12760 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:29.291354 12760 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:29.292464 12760 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.294057 12759 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:29.295042 12759 raft_consensus.cc:3055] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:29.295385 12759 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:29.296666 12759 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.298774 12469 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.299552 12469 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.257659 12577 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:29.307260 12577 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:29.308136 12695 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:29.309576  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 153292us
I20260709 13:15:29.310572  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:29.311563 12762 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
I20260709 13:15:29.312171  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:29.314610 12701 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:29.315390 12701 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:29.315747 12751 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:29.316505 12751 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:29.318095 12704 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:29.318847 12610 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:29.319519 12610 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:29.316788 12701 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.317807 12751 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.323676  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:29.342064  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 83459.8us
I20260709 13:15:29.343688  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:29.345342 12815 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:29.361865 12748 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:29.314894 12573 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:29.308797 12577 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:29.369993 12823 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:15:29.375396 12760 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:29.379772  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.380875  7259 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:29.320700 12610 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:29.331442 12822 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.305s	user 0.001s	sys 0.007s
W20260709 13:15:29.331995 12808 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.303s	user 0.004s	sys 0.004s
I20260709 13:15:29.330842  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:29.332549 12814 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.333s	user 0.004s	sys 0.004s
W20260709 13:15:29.333226 12817 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.306s	user 0.002s	sys 0.006s
W20260709 13:15:29.333827 12811 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.348s	user 0.001s	sys 0.005s
I20260709 13:15:29.381330 12539 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:29.412021  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 174888us
W20260709 13:15:29.332484  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:29.389058  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 45467.6us
I20260709 13:15:29.379962  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.405650  7335 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:29.302516 12469 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:29.312090 12762 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.392653 12577 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:29.399959 12666 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:29.430855  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 413432us
I20260709 13:15:29.415867 12759 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:29.440778  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:29.441412  7258 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:29.418231 12539 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:29.448974  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:29.454119  7332 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:29.454206  7259 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:15:29.468025  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47273.5us
I20260709 13:15:29.445056 12766 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:29.467265 12712 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:29.426573 12707 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:15:29.502345  7302 leader_election.cc:400] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17.
I20260709 13:15:29.473937  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:29.512864  7890 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:29.460964 12333 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.474197 12712 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.527156  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:29.528396  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.528920 12478 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:29.529294 12805 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.532s	user 0.001s	sys 0.001s
W20260709 13:15:29.535156 12523 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.004s
I20260709 13:15:29.518953 12765 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.539990 12766 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.542852 12322 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:29.560514  7327 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:29.560859  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:29.467348 12428 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:15:29.560588  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:29.564075  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:29.567956  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 96687.2us
I20260709 13:15:29.568271  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:29.551600 12712 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:29.570775  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:29.564179 12523 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.572190  7329 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:29.572423 12333 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.573076 12523 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:29.573985  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 71845.5us
I20260709 13:15:29.574834 12322 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.576534  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:29.577616 12765 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:29.579772 12828 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:15:29.580893 12662 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:29.581014  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:29.581349 12662 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:29.581817 12662 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:29.581765  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:29.571537 12478 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.584947 12478 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:29.587572 12762 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:29.588027  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1078) took 1160 ms. Trace:
I20260709 13:15:29.588441  7888 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:29.588600  7255 rpcz_store.cc:276] 0709 13:15:28.428019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.429240 (+  1221us) service_pool.cc:224] Handling call
0709 13:15:28.429489 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.630879 (+201390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.587719 (+956840us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b540009a1d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:29.587941 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459107072}
I20260709 13:15:29.577163 12322 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:29.592547 12766 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:29.593107  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:29.595393 12765 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:29.595932  7259 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:29.599097 12333 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:29.604475  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:29.604775  7894 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:29.605733  7182 raft_consensus.cc:2410] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:15:29.608032 12665 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
I20260709 13:15:29.640187  7181 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:15:29.641682  7178 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:29.559592  7253 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:29.672842  7327 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:29.677373  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:29.678795  7255 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: []
I20260709 13:15:29.636114 12779 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:29.699604  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:29.711038  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:29.721508  7336 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 20 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:15:29.722213  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:29.757200  7332 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:29.760816  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:29.761260  7334 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:29.761615  7334 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:29.797088  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.797421  7178 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:15:29.806862  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:29.802089 12775 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.002s
I20260709 13:15:29.816905  7184 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:29.795789 12765 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:29.824998  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:29.825904  7336 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:29.834017  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:29.836391  7332 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: []
W20260709 13:15:29.845232  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.838016  7334 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.859215  7333 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:15:29.859416  7253 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:29.852859  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:29.834723 12661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.002s	sys 0.024s
I20260709 13:15:29.824262 12775 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.848701 12470 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.874571  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:29.870143  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 446034us
W20260709 13:15:29.869155  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 355855us
W20260709 13:15:29.870329 12748 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.504s	user 0.002s	sys 0.009s
W20260709 13:15:29.869871 12661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.002s	sys 0.024s
I20260709 13:15:29.888212  7255 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: []
W20260709 13:15:29.889430  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.860064 12707 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.895684  7334 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:29.850471 12539 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.901805  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:29.921746  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:29.860499 12765 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:29.906975 12587 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.001s
I20260709 13:15:29.935137  7261 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:29.941622  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.939878  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:29.925740 12622 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:29.925926 12766 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:29.953404  7888 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
W20260709 13:15:29.951736 12759 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.003s
I20260709 13:15:29.914498 12707 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.962262  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.962934  7253 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:29.957279 12570 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:15:29.967901 12841 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:15:29.967547 12830 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:15:29.969543 12840 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.970180 12840 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.971041 12662 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:29.922348 12470 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.972393 12840 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:29.973091 12829 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
I20260709 13:15:29.973251 12662 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:29.974216 12707 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:29.974412  7887 raft_consensus.cc:2410] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:15:29.949611 12428 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:15:29.974711  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:29.975016  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:29.975618  7260 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:29.975780 12840 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:29.976162 12840 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.976503 12840 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:29.968138 12570 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:15:29.954982 12577 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.001s
I20260709 13:15:29.925606 12469 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:15:29.971698 12775 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:29.952561 12766 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.937047 12587 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.957809 12563 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:15:29.990310 12563 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:29.990767 12563 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:29.991919 12765 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:29.991734 12563 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.992985 12563 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:29.996570 12712 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:29.998802 12766 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:30.000841 12587 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:30.002928 12469 consensus_queue.cc:1243] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:15:30.003115 12824 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.274s	user 0.002s	sys 0.000s
W20260709 13:15:30.020848  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 77023.5us
I20260709 13:15:29.983563 12570 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:30.028319  7260 pending_rounds.cc:85] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 6
I20260709 13:15:30.038854  7260 pending_rounds.cc:107] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:15:30.039135  7260 raft_consensus.cc:2889] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:29.963979 12762 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:15:30.044008  7334 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:30.049999 12478 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.052433 12478 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.055747  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2354) took 1200 ms. Trace:
W20260709 13:15:30.059677  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 111888us
I20260709 13:15:30.057710 12478 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:30.056149  7187 rpcz_store.cc:276] 0709 13:15:28.855229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.858921 (+  3692us) service_pool.cc:224] Handling call
0709 13:15:28.859315 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.877464 (+ 18149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.877500 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.878147 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:15:29.100570 (+222423us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:29.631624 (+531054us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.631910 (+   286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.631991 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.002151 (+370160us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:30.055296 (+ 53145us) raft_consensus.cc:1685] finished
0709 13:15:30.055402 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.055563 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17493,"prepare.queue_time_us":489074,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":33694,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":26738,"spinlock_wait_cycles":60873088,"thread_start_us":719380,"threads_started":2,"wal-append.queue_time_us":733494}
I20260709 13:15:30.072431 12570 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.073833 12570 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:30.074723 12709 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:15:30.057529 12712 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:30.098785 12539 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:30.100958 12470 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:30.127245  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3232) took 1074 ms. Trace:
W20260709 13:15:30.129302 12838 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:15:30.123974 12563 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.128168  7262 rpcz_store.cc:276] 0709 13:15:29.053078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.120196 (+ 67118us) service_pool.cc:224] Handling call
0709 13:15:29.120558 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.121146 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.121173 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:29.195798 (+ 74625us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b18003ea940. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:30.030706 (+834908us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:30.031317 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 13:15:30.102043 (+ 70726us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:30.102084 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.102155 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.126900 (+ 24745us) raft_consensus.cc:1685] finished
0709 13:15:30.126984 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.127177 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111613,"raft.queue_time_us":34386,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":153,"spinlock_wait_cycles":123302528,"thread_start_us":70312,"threads_started":1,"wal-append.queue_time_us":89299}
W20260709 13:15:30.143687 12847 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:15:30.147022 12840 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.154165 12840 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:30.155521  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.163004  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:30.163735  7262 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:30.135882 12071 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:30.171339  7262 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:30.172823  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.174064  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.175482  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.176607  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.177652  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.178309  7262 raft_consensus.cc:2393] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:30.178509  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:30.179167  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.179294  7253 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:30.180382  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.181026  7262 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:30.182648  7262 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:30.184087  7262 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:15:30.185491 12851 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:15:30.187851  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:30.188966  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52551.1us
I20260709 13:15:30.189222 12858 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:30.189749 12858 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:30.192682 12810 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.165s	user 0.009s	sys 0.012s
I20260709 13:15:30.194022 12563 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.195557  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3224) took 1181 ms. Trace:
I20260709 13:15:30.196127  7261 rpcz_store.cc:276] 0709 13:15:29.014102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.296837 (+282735us) service_pool.cc:224] Handling call
0709 13:15:30.195273 (+898436us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b5400218ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:30.195478 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1167483136}
I20260709 13:15:30.196880 12563 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:30.197983 12852 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:30.198400 12852 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:30.198589  7259 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:30.199416 12852 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.200482 12852 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:30.201682 12469 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:15:30.202260 12469 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:30.215027  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3237) took 1160 ms. Trace:
W20260709 13:15:30.190619  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.192549 12858 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:30.233122  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:30.235082 12570 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.235183  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:30.235668 12570 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:30.237788  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 192298us
I20260709 13:15:30.237962 12707 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.238514 12707 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.238983  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:30.240656 12707 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:30.241396  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.241325 12857 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:30.241961 12661 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:30.242167 12857 consensus_queue.cc:1243] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:15:30.243510  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:30.244534  7896 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:30.245433  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:30.235992  7888 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:30.234357  7150 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:30.249436  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:30.215732  7258 rpcz_store.cc:276] 0709 13:15:29.099006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.180800 (+ 81794us) service_pool.cc:224] Handling call
0709 13:15:29.181142 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.448127 (+266985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.214676 (+766549us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400217ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:30.214937 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576637184}
I20260709 13:15:30.189764  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.255120 12710 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:30.255555 12710 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.255643  7895 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:30.257336  7253 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:30.242733 12605 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:30.261801  7180 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:30.267122  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.263103  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.255966 12710 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:30.237810 12570 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:30.273584  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 851) took 1210 ms. Trace:
I20260709 13:15:30.279181 12857 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:30.281057 12857 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:30.281563 12857 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:30.276362  7335 rpcz_store.cc:276] 0709 13:15:29.055461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.056210 (+   749us) service_pool.cc:224] Handling call
0709 13:15:30.265420 (+1209210us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540032aad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:30.265571 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238455040}
W20260709 13:15:30.287217  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 97558.7us
I20260709 13:15:30.256356 12770 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:30.282440  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:30.255789 12666 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:30.288775  7331 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
W20260709 13:15:30.366166  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.256589 12563 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:30.361322  7895 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:15:30.369453  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:30.369014  7888 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:30.370520 12707 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:15:30.371075 12707 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.362103 12384 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:30.364728  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.372160  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:15:30.301710 12859 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:15:30.373651 12563 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:30.242584 12661 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.283896 12843 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.360535 12605 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.377162 12563 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:30.397116 12333 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.397655 12333 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.398833 12605 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:30.361063 12770 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:30.402951 12770 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:30.384372  7261 pending_rounds.cc:85] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 9
I20260709 13:15:30.406939  7261 pending_rounds.cc:107] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:15:30.407220  7261 raft_consensus.cc:2889] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:30.375721 12384 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.410907 12384 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:30.413789  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3225) took 1399 ms. Trace:
I20260709 13:15:30.414384  7257 rpcz_store.cc:276] 0709 13:15:29.014487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.039473 (+ 24986us) service_pool.cc:224] Handling call
0709 13:15:29.039822 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.057633 (+ 17811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.413469 (+1355836us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b540021a2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:30.413710 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35233152}
I20260709 13:15:30.385751 12852 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:30.419166 12563 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.375064 12837 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:15:30.420521 12865 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:15:30.420890 12837 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:30.421295 12837 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:30.308405 12858 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.422847  7334 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:30.425140  7187 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:30.387434  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.426786  7187 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:15:30.427191 12705 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:30.375543 12840 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:30.287896 12762 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:30.428143 12840 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:30.371429 12707 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:30.429257 12840 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:30.431052 12821 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.432s	user 0.012s	sys 0.002s
I20260709 13:15:30.422304 12837 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.428118 12770 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.434815  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:30.435427  7178 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:30.435590 12770 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:30.425946 12563 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:30.437686  7184 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:15:30.429628  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:30.365890 12666 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:30.440850  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2353) took 1586 ms. Trace:
I20260709 13:15:30.436717  7185 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:15:30.440661  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.457196  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:30.462433  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:30.464706  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:30.453037  7186 rpcz_store.cc:276] 0709 13:15:28.854790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.856729 (+  1939us) service_pool.cc:224] Handling call
0709 13:15:28.857127 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.857651 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.857677 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.858240 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.948232 (+ 89992us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:15:29.394590 (+446358us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.414455 (+ 19865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.414582 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.430484 (+1015902us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:30.438134 (+  7650us) raft_consensus.cc:1685] finished
0709 13:15:30.440656 (+  2522us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.440796 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22727,"prepare.queue_time_us":602431,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":39135,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":9698,"spinlock_wait_cycles":182033152,"thread_start_us":505728,"threads_started":2,"wal-append.queue_time_us":140006}
I20260709 13:15:30.282521 12857 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.452965 12837 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:30.449949 12818 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:30.488067  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.441339 12748 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:15:30.474392 12762 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:30.439175 12843 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.471269 12757 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.530768 12662 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:30.532771  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57813.7us
I20260709 13:15:30.537545  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:30.441870 12469 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.554359  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:30.532531 12609 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.495208 12818 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.609488 12666 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.562054 12770 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.567036 12673 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:30.611275  7178 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:30.613454  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.614779  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:30.615047  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:30.615598  7259 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:30.615901  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.599489  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:30.616482  7257 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:30.619932  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.615378  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.620615  7257 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:30.621258  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.623986 12843 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:30.625530 12770 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.628054 12770 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:30.628512  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1080) took 1089 ms. Trace:
I20260709 13:15:30.630090 12383 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:30.591080 12709 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:30.630559 12818 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:30.542693 12765 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:30.592417  7260 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:15:30.599680 12812 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.574s	user 0.015s	sys 0.004s
I20260709 13:15:30.602912 12469 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:30.611711 12673 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.654054 12673 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:30.605477 12766 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 13:15:30.607213  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:30.607362  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:30.658106  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:30.608290  7181 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:15:30.658896  7335 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:30.628911  7254 rpcz_store.cc:276] 0709 13:15:29.538897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.583873 (+ 44976us) service_pool.cc:224] Handling call
0709 13:15:29.584236 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:29.611430 (+ 27194us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:30.010568 (+399138us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.360456 (+349888us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:30.384104 (+ 23648us) log.cc:844] Serialized 52 byte log entry
0709 13:15:30.384330 (+   226us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:30.384381 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.384473 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.628281 (+243808us) raft_consensus.cc:1685] finished
0709 13:15:30.628304 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.628457 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39808,"prepare.queue_time_us":378483,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":60411,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":16150,"thread_start_us":649217,"threads_started":2,"wal-append.queue_time_us":315057}
I20260709 13:15:30.630719 12709 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:30.597265 12661 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:30.669569  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:30.639604  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:30.672645  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:30.673514  7332 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:30.568183 12333 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:30.643371 12666 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:30.643447  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:30.630524 12383 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:30.608664 12322 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:30.543144 12757 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.608711  7887 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:30.671455  7185 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:15:30.644111  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:30.631572 12765 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.677047  7182 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:30.543443 12662 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.661446  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:30.692284  7180 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:30.698781  7181 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:30.688136  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.696147  7184 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:15:30.671366 12709 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:30.670574 12766 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:30.705925  7187 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:15:30.716544  7335 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:30.660225 12609 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.728996  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.731526  7259 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:30.732692  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:30.732749  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:30.735679  7332 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:30.737149  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:30.737771  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:30.738602  7255 raft_consensus.cc:2393] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:30.753537  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:30.754797  7335 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:30.700863 12322 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.757349  7260 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
W20260709 13:15:30.757476  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 227000us
W20260709 13:15:30.759706  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.763075  7184 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:30.761837  7178 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:30.704770 12707 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.778532  7335 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:30.782050  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.784539  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:30.782754  7254 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:30.789575  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2038) took 2428 ms. Trace:
W20260709 13:15:30.799105  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 100694us
I20260709 13:15:30.798810  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:30.802968  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.799773  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:30.815743  7335 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:30.760413 12710 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.798758 12757 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:30.790019  7256 rpcz_store.cc:276] 0709 13:15:28.369232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.370604 (+  1372us) service_pool.cc:224] Handling call
0709 13:15:28.370940 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.371300 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.371331 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.371782 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.964772 (+592990us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:28.971975 (+  7203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.979388 (+  7413us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.598651 (+1619263us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:30.762225 (+163574us) raft_consensus.cc:1685] finished
0709 13:15:30.762249 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.770044 (+  7795us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20092,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":13230,"spinlock_wait_cycles":114249088,"thread_start_us":366665,"threads_started":1,"wal-append.queue_time_us":652899}
I20260709 13:15:30.819140 12858 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:30.819252  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:30.820500  7888 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:15:30.823401 12587 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:30.827708  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:30.816705  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.829525  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:30.833540 12766 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:30.840904  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.832976 12322 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:30.859372 12765 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:30.846098  7327 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [14.13-16.14]
I20260709 13:15:30.854908 12874 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.860790 12874 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.863013 12874 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:30.863777  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 47164.2us
I20260709 13:15:30.865027  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:30.844455  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:30.854167  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.768585 12383 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:30.859560 12872 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:15:30.845993  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 308557us
I20260709 13:15:30.853657 12858 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.871423  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:30.874112  7335 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 12.
I20260709 13:15:30.855651 12840 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.866493 12291 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:30.889566  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:30.868544 12322 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:30.849427 12587 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.881474 12470 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:15:30.879009 12858 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.895344  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:30.897836  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.901413  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:30.902221  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:30.911028  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.900679 12383 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:30.916615  7181 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:30.917603  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:30.882164 12766 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:30.918372  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.918227  7332 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:30.922456  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.896747 12322 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:30.924083  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:30.923425  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 71870.9us
I20260709 13:15:30.926313  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.914856 12662 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:30.919876 12333 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:30.928328  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:30.919521 12609 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:30.924549 12071 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:30.938794 12662 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:30.920825 12873 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:30.919349 12770 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:30.927206 12322 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:30.942327 12704 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:30.944070 12818 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:30.944550 12818 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.946698 12879 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:15:30.947106 12673 raft_consensus.cc:3055] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:30.947482 12673 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:30.924703 12766 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.932819 12563 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:30.948313 12673 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.949129 12837 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.949620 12837 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:30.950500  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:30.907356 12840 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:30.964998  7182 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:30.966579  7225 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:30.967566  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:30.968338  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:30.975868  7225 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:30.977377 12664 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:30.979640 12664 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:30.946573 12818 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:30.990403  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 433483us
W20260709 13:15:30.992075  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63795.2us
I20260709 13:15:30.930450 12881 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:30.982584 12873 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:30.970021 12609 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:30.969693 12757 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
W20260709 13:15:31.017865  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50384.2us
I20260709 13:15:31.017481  7332 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:31.001731 12874 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:31.036552  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:31.039251  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:31.039407  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 63622.3us
I20260709 13:15:31.001526 12710 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:31.043781  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 116194us
I20260709 13:15:31.040630  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:31.045149  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:31.031494 12664 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.042761 12333 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:31.036691 12768 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:31.048840  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:31.031271 12837 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:31.032338 12770 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:31.037143 12563 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.062883 12563 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.064321  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:31.064471 12886 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:31.065217 12563 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:31.002450 12882 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:15:31.041455 12712 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:31.041991 12874 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.061980 12384 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:31.062990 12889 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:31.051682  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:31.044754 12881 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:31.054222 12664 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:31.065936 12886 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:31.052211 12879 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:31.062418 12840 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.041306 12762 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:15:31.056116 12333 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:31.070218 12837 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:31.112864  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.079210 12384 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.070995 12874 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:31.093835 12570 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:15:31.121798  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 56245.3us
I20260709 13:15:31.071630 12766 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.095538 12888 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:31.066404 12609 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:15:31.110390 12587 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:31.097687 12885 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:31.084692 12818 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:15:31.116529 12333 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:31.094273 12322 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.136636  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.097035 12710 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:15:31.121838 12384 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:31.123364 12837 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.149317  7181 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:31.149951  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:31.117065 12765 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:15:31.129132 12570 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:31.172546  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.127465 12662 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:15:31.180812  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 77652us
I20260709 13:15:31.185757 12895 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:31.199393 12895 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.201751 12895 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.191538 12818 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:15:31.204196 12666 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:31.204563 12322 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:31.193037 12887 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:15:31.205780 12673 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:31.184574 12881 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.205313 12666 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:31.162685 12885 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:31.216634  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:31.217729  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:31.218561  7332 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:31.183641 12890 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:15:31.231413  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.132314 12873 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:31.232836  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 192279us
I20260709 13:15:31.237473  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.239790  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.212636 12889 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.243314  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.243974  7327 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:31.244349  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:31.237008  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.245147  7256 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:31.245697  7334 raft_consensus.cc:2410] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:15:31.248701  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:31.214015 12666 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:31.254233  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.256574  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.257891  7261 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:15:31.265774  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.266491  7327 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:31.258471  7261 pending_rounds.cc:85] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 7
I20260709 13:15:31.267716  7329 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:31.267827  7261 pending_rounds.cc:107] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:15:31.268339  7261 raft_consensus.cc:2889] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:31.249579  7892 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:31.188581 12884 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:15:31.271190  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.234488  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:31.277590  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.251003 12889 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.281598  7253 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:15:31.253036 12322 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.282442 12322 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.284183  7150 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:31.284605 12322 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.285251 12779 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:31.285769 12779 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:31.286617 12779 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:31.292953  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.294031  7862 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:31.286731 12322 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:31.295204 12322 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.287111  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:31.298000  7888 raft_consensus.cc:2410] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:15:31.298985 12322 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:31.299299  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.275825  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:31.282748 12889 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:31.308574  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 74232.4us
I20260709 13:15:31.311821  7332 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:31.229620 12894 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.318084  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.320363  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:31.327440  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:31.326990  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:31.333211  7183 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:31.329625  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.334074  7181 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:31.336091 12587 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:31.334867  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 98418.6us
I20260709 13:15:31.333024  7184 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:31.273063 12898 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:31.346504  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:31.344563  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:31.320667 12469 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:31.227144 12885 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.334714 12882 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.328229 12839 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:31.358018  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:31.360563  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:15:31.375502  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.403656  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50477.2us
W20260709 13:15:31.406450  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56057.7us
I20260709 13:15:31.406766 12912 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:31.407753  7150 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:31.348492 12889 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:31.356360 12766 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:31.411813 12735 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:31.303520 12570 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.393116 12759 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:31.416282  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.423897 12383 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.005s
I20260709 13:15:31.425618 12664 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:31.427065 12897 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:15:31.434260  7256 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:31.405051 12837 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:31.395248 12881 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:31.403146 12839 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.350754 12843 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:15:31.439505 12735 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.351060 12903 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:15:31.442780 12759 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.440462 12766 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:31.411103 12882 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.356669 12898 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.446730 12539 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:31.450662 12839 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:31.355829 12894 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:31.524797  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 117552us
I20260709 13:15:31.526834  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:31.527370  7887 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:31.440075 12889 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.465893 12735 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:31.536638 12779 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:31.554919 12779 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.555377 12779 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:31.554919 12469 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:31.557546 12469 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:31.542217 12904 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.219s	user 0.002s	sys 0.001s
I20260709 13:15:31.543427  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.561192 12469 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:31.563665 12908 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:15:31.565439 12816 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.566301 12816 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.569243 12779 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.569859  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.570802  7255 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:31.572023 12779 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.572127  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.573594 12857 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:31.574329 12857 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.578357 12857 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.579222 12857 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.551877 12478 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:31.582127 12816 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:31.587014  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.511876 12766 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:31.512567 12759 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:31.524448 12897 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:15:31.596302  7184 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:31.514313 12539 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.598541  7262 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:31.606030  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.606791  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.610016  7181 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:31.582363 12898 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.452328 12881 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:31.601949 12865 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:15:31.627597  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 504918us
I20260709 13:15:31.631871 12885 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.635463 12664 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.643447 12858 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:31.645380 12882 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:31.648137 12894 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:31.597312 12857 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.650797 12469 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:31.651216 12857 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.651396 12469 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.653496 12469 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:31.656484  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:15:31.653726 12709 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.925s	user 0.007s	sys 0.007s
I20260709 13:15:31.613477 12539 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:31.683095  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.690438  7183 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:31.683683  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.691135  7181 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:31.600126 12710 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:15:31.651089 12880 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.692045  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:31.692364 12880 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.666932 12912 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:31.693464 12707 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:31.698228  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:31.704614  7888 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:15:31.703997  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.692045  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.696399  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:31.705996  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 179280us
I20260709 13:15:31.706406  7892 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:31.707862  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:31.708892  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:31.681877 12852 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.003s	sys 0.007s
W20260709 13:15:31.679493 12874 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
I20260709 13:15:31.710932  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.711547  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.713902  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.606547 12333 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.716414  7255 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:31.718187  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.715472  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.679205 12816 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.719002  7256 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:31.716517  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.716003  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.722163  7332 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:31.721175  7327 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:15:31.720125  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:31.722786  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:31.722196  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:31.723485  7258 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:31.727082  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:31.728412  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.730752  7179 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:15:31.731016  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.731884  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.732089  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.732486  7179 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:31.701959 12898 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.694592 12880 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:31.733886 12898 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.721717  7329 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:15:31.736253  7329 pending_rounds.cc:85] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 7
I20260709 13:15:31.733191  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.736543  7329 pending_rounds.cc:107] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:15:31.733258  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.736855  7329 raft_consensus.cc:2889] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:31.736028  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:31.738389  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:31.738358  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.739894  7332 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
W20260709 13:15:31.714279 12852 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.003s	sys 0.007s
I20260709 13:15:31.739140  7894 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:31.743129  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:31.700309 12884 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:31.741803  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:31.746268  7336 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:31.721110  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:31.748451  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.749472  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.719480 12919 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:31.750869  7178 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:31.750861  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:31.754823  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:31.755388  7894 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:31.756916  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:31.694831 12886 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:15:31.759218 12886 consensus_queue.cc:1243] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:15:31.754354 12587 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:31.762861  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.694299 12912 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.744975 12816 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.773029 12816 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.754073 12919 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.773437 12333 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.773730 12919 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:31.774933  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:31.775578  7336 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:31.776608  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:31.777232  7254 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:15:31.753242 12757 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:31.774480 12898 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.704475 12709 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.784315  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:31.754261 12843 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:31.722242 12874 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.803942  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:31.806016 12384 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.655s	user 0.002s	sys 0.008s
I20260709 13:15:31.717216 12735 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.807024 12920 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:31.802805  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:31.811651 12759 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.812579  7894 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:15:31.813346  7336 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:31.781239 12884 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.814002 12469 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.783246 12894 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:31.817129 12705 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.825676 12895 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:15:31.826514  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 55888.4us
I20260709 13:15:31.872042  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:31.868342  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 117145us
I20260709 13:15:31.827942  7331 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 12. Current term is 13. Ops: []
W20260709 13:15:31.829918  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.836730  7258 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:31.817214 12839 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.870064  7329 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:15:31.873437  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.878196  7256 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:31.877476  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:31.879381  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.882285  7891 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: [13.12-15.13]
I20260709 13:15:31.887487  7260 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:31.878646 12843 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:31.889062 12889 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:31.890769  7890 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:31.887912  7260 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:31.893239 12837 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:31.893687 12837 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:31.893855 12735 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:31.895812 12916 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:15:31.875439 12894 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:31.847710 12384 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.869406 12469 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:31.885406  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:31.880205 12705 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.908118  7260 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.899915 12885 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:31.913203  7254 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:31.921087  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:31.916683  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:31.901513 12587 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:31.943631  7260 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:31.929939 12885 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.928648 12775 raft_consensus.cc:2764] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:15:31.963224  7254 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:31.894613 12837 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.966055 12885 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:31.919139 12919 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:31.996685 12705 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:31.993680 12709 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:31.997874 12384 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:31.972143 12837 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:32.004863  7895 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:32.030110  7260 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:15:32.030544  7260 pending_rounds.cc:85] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 12
I20260709 13:15:32.030805  7260 pending_rounds.cc:107] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:15:32.031057  7260 raft_consensus.cc:2889] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:32.028620  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 225892us
I20260709 13:15:32.012779 12874 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:32.033458 12759 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:32.047503  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:32.049563  7332 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:15:32.052757  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:31.970235 12894 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.034034 12884 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:32.058261  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:32.022316 12766 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.075294 12469 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:32.077646 12766 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:32.078969  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:32.079926  7896 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:15:32.059541  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:32.086894 12930 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.120s	user 0.003s	sys 0.000s
I20260709 13:15:32.025403 12587 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.089305 12735 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.090116 12735 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.093215 12735 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:32.093305  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:32.096369 12885 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:32.063083 12926 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:15:32.059060 12839 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:32.108777 12927 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:15:32.058601 12709 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.118659 12709 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:32.121146 12709 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:32.124274  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 64842.1us
I20260709 13:15:32.125207  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:32.124352 12928 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:15:32.126410  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:32.129190 12906 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.721s	user 0.000s	sys 0.004s
I20260709 13:15:32.130651  7299 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.131474 12707 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:32.131871 12707 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:32.132237 12707 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:32.105904 12539 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:32.133788  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:32.141724  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.139612  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2170) took 1468 ms. Trace:
I20260709 13:15:32.149081  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:32.142840  7333 rpcz_store.cc:276] 0709 13:15:30.665454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.665610 (+   156us) service_pool.cc:224] Handling call
0709 13:15:31.209080 (+543470us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b5800094b98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:15:31.209343 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:31.209849 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:31.209890 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:31.210494 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:15:31.348617 (+138123us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:31.348667 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.348740 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:32.128564 (+779824us) spinlock_profiling.cc:243] Waited 9.11 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:32.133173 (+  4609us) raft_consensus.cc:1685] finished
0709 13:15:32.133195 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.133329 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1842,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":26959104,"thread_start_us":103407,"threads_started":1,"wal-append.queue_time_us":180081}
I20260709 13:15:32.140161 12469 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:32.145205 12874 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:32.145474 12709 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:32.145197 12705 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:32.155339  7330 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:32.157055  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:32.158736  7329 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:32.153357 12852 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:15:32.162701 12852 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:32.163699 12852 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.153270 12759 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:32.166857 12759 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:32.167286 12759 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:32.169589  7861 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.171411 12929 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:32.172465 12929 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:32.156514 12885 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:32.160279  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:32.175150  7333 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:32.190600 12881 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:32.187098 12539 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:32.200637  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:32.200860  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:32.203804  7887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 781) took 1409 ms (client timeout 1660 ms). Trace:
W20260709 13:15:32.204346  7887 rpcz_store.cc:269] 0709 13:15:30.794185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.794407 (+   222us) service_pool.cc:224] Handling call
0709 13:15:32.203603 (+1409196us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b540043a154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:32.203711 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447938816}
I20260709 13:15:32.203739  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:32.209956 12768 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
W20260709 13:15:32.211881  7861 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.575s (SENT) [suppressed 15 similar messages]
W20260709 13:15:32.224957  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 339611us
I20260709 13:15:32.231191  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:32.232597  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:32.233575  7887 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:32.236846  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:32.239460  7334 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:32.231608 12884 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:15:32.233196 12704 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:32.249217 12704 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.250774 12775 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.251462 12704 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:32.251312 12775 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:32.252007 12704 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.252434 12704 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:32.253407 12775 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:32.253939 12775 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:32.261637  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 102400us
I20260709 13:15:32.259639  7225 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:32.277793  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:32.257263  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:32.278818  7254 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:15:32.279775  7887 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:32.255098  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:32.275126  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:32.282440  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:32.282809  7261 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:32.242599 12881 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:15:32.254429 12704 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:32.246760 12884 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.293278 12884 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:32.304034 12666 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.305574 12666 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:32.254350 12775 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:32.311180  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:32.309064  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 97213.4us
I20260709 13:15:32.311856  7254 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:32.287012  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:32.256021 12759 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.313736  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:32.283293 12885 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:32.324705  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:32.325867  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:32.275606 12895 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:15:32.291827 12383 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:32.334875 12383 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.335320 12383 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:32.342504 12885 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:32.326359  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:32.290645 12881 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.347929  7255 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:32.360178  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:32.361497 12925 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.457s	user 0.002s	sys 0.000s
I20260709 13:15:32.309804 12894 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:15:32.362663 12894 consensus_queue.cc:1243] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:15:32.363168 12894 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:32.363502 12894 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:32.369684  7257 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:32.285226 12707 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.292472 12929 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:15:32.384406  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:32.364924 12936 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:32.366858 12881 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:32.343981 12885 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:32.364291 12894 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.397794  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:32.401151  7258 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:15:32.399793  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:32.401961  7253 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:32.412935  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:32.419181  7258 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:32.385617 12666 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:32.393149 12570 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:32.395990 12936 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.403549 12735 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:32.428221 12894 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:32.430182 12936 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:15:32.447646 12902 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.105s	user 0.004s	sys 0.000s
I20260709 13:15:32.452682  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3058) took 1302 ms. Trace:
I20260709 13:15:32.453078  7185 rpcz_store.cc:276] 0709 13:15:31.149923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.150040 (+   117us) service_pool.cc:224] Handling call
0709 13:15:31.175921 (+ 25881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:31.176387 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:31.176427 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:31.182479 (+  6052us) log.cc:844] Serialized 26 byte log entry
0709 13:15:31.232413 (+ 49934us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:31.232473 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.232574 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:31.298597 (+ 66023us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b4800003fd8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:15:32.446985 (+1148388us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:32.452463 (+  5478us) raft_consensus.cc:1685] finished
0709 13:15:32.452484 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.452621 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":627,"raft.run_cpu_time_us":2027,"raft.run_wall_time_us":120111,"spinlock_wait_cycles":15998976,"thread_start_us":29346,"threads_started":1,"wal-append.queue_time_us":63551}
I20260709 13:15:32.430402 12666 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.441409 12775 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:32.468602 12707 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:32.470551 12896 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:32.483467 12896 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:32.484089 12857 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:32.484542 12666 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:32.470993  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:32.474074 12383 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.486514 12896 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:32.480422  7261 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:32.484606 12857 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:32.487773 12857 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.489101  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:32.489354  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:32.490010  7256 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:32.491385 12919 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:32.491479  7861 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:32.492563  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:32.493304  7336 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:32.493460 12929 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:32.494056 12929 raft_consensus.cc:697] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:32.494992 12929 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.433950 12570 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:32.499090 12759 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:32.499668  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:32.501479 12932 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.529s	user 0.002s	sys 0.001s
I20260709 13:15:32.454154 12884 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.507115 12837 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:32.507661  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3053) took 1372 ms. Trace:
I20260709 13:15:32.538221  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:32.508132  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:32.510214  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3052) took 1375 ms. Trace:
I20260709 13:15:32.510298 12383 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:32.511148 12903 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:15:32.511247  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 803391us
I20260709 13:15:32.511935  7180 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
W20260709 13:15:32.511821  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 765118us
I20260709 13:15:32.545303  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:32.511024  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:32.546304  7184 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:32.491300  7259 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:15:32.528046  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.528636  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:32.529486  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:32.549185  7258 raft_consensus.cc:2376] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14. Re-sending same reply.
I20260709 13:15:32.530668  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:32.534183  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.534250  7256 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:32.535135  7327 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:32.536500  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:32.551677  7333 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:32.540098  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:32.553344  7178 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:32.540520  7186 rpcz_store.cc:276] 0709 13:15:31.135302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.135436 (+   134us) service_pool.cc:224] Handling call
0709 13:15:31.138817 (+  3381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.139036 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:31.144497 (+  5461us) log.cc:844] Serialized 14 byte log entry
0709 13:15:31.689347 (+544850us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b1800447dc0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a
0709 13:15:32.509852 (+820505us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:32.509910 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:32.509960 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.510030 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.510143 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":852679,"prepare.queue_time_us":5847,"prepare.run_cpu_time_us":3632,"prepare.run_wall_time_us":20240,"raft.queue_time_us":821313,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"spinlock_wait_cycles":3678976,"thread_start_us":40477,"threads_started":1,"wal-append.queue_time_us":140628,"wal-append.run_cpu_time_us":1043,"wal-append.run_wall_time_us":1005862}
I20260709 13:15:32.555979  7185 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:32.556614  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:32.538164  7182 rpcz_store.cc:276] 0709 13:15:31.135653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.139455 (+  3802us) service_pool.cc:224] Handling call
0709 13:15:31.177206 (+ 37751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.177461 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:31.214388 (+ 36927us) log.cc:844] Serialized 14 byte log entry
0709 13:15:31.539586 (+325198us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b1800447fa0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db
0709 13:15:31.541644 (+  2058us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:31.546587 (+  4943us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b1800447fa0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:31.599018 (+ 52431us) log.cc:844] Serialized 14 byte log entry
0709 13:15:32.507094 (+908076us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b1800447fa0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:15:32.507290 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:32.507353 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:32.507406 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.507472 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.507590 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32150,"prepare.queue_time_us":42158,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":92,"raft.queue_time_us":943886,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":41210,"spinlock_wait_cycles":53888384,"thread_start_us":351013,"threads_started":2,"wal-append.queue_time_us":108446}
W20260709 13:15:32.571820  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 43853.9us
I20260709 13:15:32.575232  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:32.580765  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.585041  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:32.585717  7185 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:32.583227  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:32.597254  7184 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:32.598831 12858 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:32.599422 12858 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:32.600688  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.601722  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:32.606827  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:32.608253  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 146312us
I20260709 13:15:32.576752 12896 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:32.610740  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:32.611090  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.616283  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.577658 12920 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:15:32.617965  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.583423 12662 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:32.583534 12709 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:32.586585 12852 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:32.579217 12707 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:15:32.611937  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:32.639003  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:32.653988  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.653822  7185 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:32.662297  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:32.663092  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:32.663929  7184 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:15:32.655751 12961 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:15:32.656172 12818 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:15:32.706101  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 58865.7us
I20260709 13:15:32.657079 12705 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:32.657763  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:32.640393  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:32.654407 12874 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:32.716676 12705 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:32.667150  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 121951us
I20260709 13:15:32.632444 12662 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.667827 12903 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:32.717410 12705 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:32.668987  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 124717us
I20260709 13:15:32.681316  7184 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
W20260709 13:15:32.690124  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 73941.5us
I20260709 13:15:32.692234  7185 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:32.739300  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.695851  7186 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:15:32.697294  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:32.626338 12915 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:32.740515  7150 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.615207 12470 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:32.709462  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49519.6us
I20260709 13:15:32.716797  7182 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:32.718150  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:32.668030 12857 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:32.745693  7180 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:32.686431 12666 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:32.754426  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:32.756345  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:32.757257  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:32.613946 12885 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.099s
I20260709 13:15:32.759931  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:32.798291  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 55665.5us
I20260709 13:15:32.798619  7184 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:15:32.730168 12895 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:15:32.707376  7080 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47556 (request call id 255) took 43040 ms (client timeout 15000 ms). Trace:
I20260709 13:15:32.686453 12920 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:32.728406 12662 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:32.727273 12903 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:32.731621 12818 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:32.813441  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56268us
W20260709 13:15:32.814555  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 76985us
I20260709 13:15:32.756526 12478 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:32.819375  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:32.819720 12953 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:15:32.820477  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:32.807098 12291 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:32.756156 12333 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:32.762297 12666 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:32.821735 12923 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:32.829562 12919 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:32.817983  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.815968 12895 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.840458  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:32.826391 12903 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:32.806062 12469 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:15:32.813587 12874 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:15:32.851617  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:32.868927  7182 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:32.845295 12666 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:32.831501  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:32.835760 12478 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:32.847339 12915 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:32.932092  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 100688us
I20260709 13:15:32.861210  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:32.821242 12523 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:15:32.868140 12587 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:32.886129 12816 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:32.893769  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2381) took 1164 ms. Trace:
I20260709 13:15:32.871922 12333 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:32.899034 12818 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.909507 12884 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:32.858500 12919 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:32.937208 12478 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:32.995702 12949 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:15:32.944169 12587 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:32.936489 12071 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:32.935091  7178 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:32.855515 12895 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:32.847047 12923 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:32.813410 12858 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:32.854254  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:32.946853  7181 rpcz_store.cc:276] 0709 13:15:31.729205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.751981 (+ 22776us) service_pool.cc:224] Handling call
0709 13:15:31.779150 (+ 27169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:32.539165 (+760015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:32.539197 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:32.581446 (+ 42249us) log.cc:844] Serialized 26 byte log entry
0709 13:15:32.808593 (+227147us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:32.808641 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.808709 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:32.893482 (+ 84773us) raft_consensus.cc:1685] finished
0709 13:15:32.893511 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.893695 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":808772,"raft.queue_time_us":800019,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6143,"thread_start_us":99627,"threads_started":1,"wal-append.queue_time_us":221164}
I20260709 13:15:32.950299  7333 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
W20260709 13:15:32.998164  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 357839us
I20260709 13:15:32.944994 12918 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:32.925274 12570 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:33.013901  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 213995us
W20260709 13:15:32.935724  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 74621.1us
I20260709 13:15:32.932998  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:32.948807 12333 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:33.031566  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 177393us
I20260709 13:15:33.039894  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:33.028291  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 318740us
I20260709 13:15:33.041070  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:33.042502  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 109585us
I20260709 13:15:33.044523  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:33.042554  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:33.017184 12587 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:32.993815 12816 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.027524 12563 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:15:33.050781  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 201054us
I20260709 13:15:33.057330  7334 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:15:33.048584  7183 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:33.074142  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:33.045379 12333 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:33.028574 12923 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:33.032828 12071 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:33.076105  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:33.077294  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:33.058749  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 258690us
I20260709 13:15:33.079445  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:33.045228 12735 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:33.092687  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:33.053535  7862 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:32.944676 12920 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.085980  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:33.097369  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:33.048681 12912 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:15:33.105789  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 345944us
I20260709 13:15:33.075011 12892 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:33.058041 12975 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:33.131228  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:33.133932  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.146379  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:33.087001 12913 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:33.083374 12874 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:33.102949 12852 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:33.159688  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 106221us
W20260709 13:15:33.154179  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56283us
I20260709 13:15:33.102538 12770 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:33.129405 12892 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.175127  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.088296 12384 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:15:33.167629  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:33.175699  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83131.8us
I20260709 13:15:33.176203  7186 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 13: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:33.176514  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:33.178103  7150 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:33.084144 12967 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:15:33.144382 12914 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:33.305258  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:33.189894  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:33.306116  7888 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:33.199450 12735 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:33.200558 12840 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:33.308184  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:33.179802 12892 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:33.150882 12913 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:33.323877  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.184813 12915 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:33.332033  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 153997us
I20260709 13:15:33.308404  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.308766  7894 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:33.313534  7891 raft_consensus.cc:2376] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12. Re-sending same reply.
I20260709 13:15:33.176852 12709 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:32.816220  7080 rpcz_store.cc:269] 0709 13:14:49.587323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.587619 (+   296us) service_pool.cc:224] Handling call
0709 13:15:32.610536 (+43022917us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:21.085704 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:21.241439 (+155735us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:21.241490 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:15:21.241511 (+    21us) tablet.cc:662] Decoding operations
0709 13:15:21.242620 (+  1109us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:21.242784 (+   164us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:21.242816 (+    32us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:15:21.243850 (+  1034us) tablet.cc:701] Row locks acquired
0709 13:15:21.243917 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:15:21.244115 (+   198us) write_op.cc:270] Start()
0709 13:15:21.244278 (+   163us) write_op.cc:276] Timestamp: P: 1783602921244042 usec, L: 0
0709 13:15:21.244321 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:15:21.245110 (+   789us) log.cc:844] Serialized 3970 byte log entry
0709 13:15:21.912739 (+667629us) op_driver.cc:464] REPLICATION: finished
0709 13:15:21.978867 (+ 66128us) write_op.cc:301] APPLY: starting
0709 13:15:21.979009 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:22.085761 (+106752us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:22.085886 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:23.258373 (+1172487us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:23.279566 (+ 21193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:15:23.279647 (+    81us) write_op.cc:312] APPLY: finished
0709 13:15:23.280098 (+   451us) log.cc:844] Serialized 97 byte log entry
0709 13:15:23.495296 (+215198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:23.503606 (+  8310us) write_op.cc:454] Released schema lock
0709 13:15:23.519203 (+ 15597us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:23.541705 (+ 22502us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:23.541741 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2335404,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":63871,"apply.run_cpu_time_us":40513,"apply.run_wall_time_us":1559015,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45987,"num_ops":10,"prepare.queue_time_us":535020,"prepare.run_cpu_time_us":68984,"prepare.run_wall_time_us":324685,"raft.queue_time_us":49838,"raft.run_cpu_time_us":8173,"raft.run_wall_time_us":112454,"replication_time_us":636924,"thread_start_us":770165,"threads_started":5,"wal-append.queue_time_us":504099,"wal-append.run_cpu_time_us":17782,"wal-append.run_wall_time_us":2421885}]]}
I20260709 13:15:33.184868 12384 consensus_queue.cc:1243] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:15:33.303614 12884 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:33.310838 12852 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:33.187141 12983 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:33.353420 12983 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:33.353878 12983 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:33.358023 12523 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:33.359107 12735 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.179965 12770 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:33.330353 12970 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.382s	user 0.001s	sys 0.001s
I20260709 13:15:33.329470 12913 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:33.341663  7186 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:33.344560  7336 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 12. Current term is 13. Ops: []
W20260709 13:15:33.346493  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 156850us
I20260709 13:15:33.381289  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:33.351547 12982 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:15:33.352807 12980 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:33.374775 12976 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:33.365396 12757 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:33.346591 12884 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:33.396749  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:33.373138 12705 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.576s	user 0.004s	sys 0.007s
I20260709 13:15:33.402818  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:33.342972  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.193008  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:33.387051 12936 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.941s	user 0.005s	sys 0.007s
I20260709 13:15:33.313736 12914 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:33.418692  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 85221.3us
I20260709 13:15:33.422561  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:33.361848 12709 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.368274 12852 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:33.395073 12768 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:33.428465  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.445863 12478 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:33.447845 12919 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:33.448786 12478 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:33.450250  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.450948  7181 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:33.451301 12291 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:33.451713 12291 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:33.452060  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.452531 12291 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.453466  7181 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:33.455950 12770 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:33.448869 12759 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:33.456620 12759 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:33.457927 12762 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:33.458461 12762 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:33.460582 12762 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:33.461091 12762 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.461526 12762 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.395018 12666 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:33.464210  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2382) took 1734 ms. Trace:
I20260709 13:15:33.465575 12666 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:33.464716  7179 rpcz_store.cc:276] 0709 13:15:31.729491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.767764 (+ 38273us) service_pool.cc:224] Handling call
0709 13:15:31.789822 (+ 22058us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:32.557214 (+767392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:32.557244 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:32.575148 (+ 17904us) log.cc:844] Serialized 52 byte log entry
0709 13:15:32.680179 (+105031us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:32.680245 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.680351 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:33.463937 (+783586us) raft_consensus.cc:1685] finished
0709 13:15:33.463963 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:33.464137 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":822741,"raft.queue_time_us":779602,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":47846,"threads_started":1,"wal-append.queue_time_us":245746}
I20260709 13:15:33.467317  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:33.415527 12705 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:33.439604  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.457564 12759 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.401511 12884 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:33.471292  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:33.402392 12912 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:33.415732 12915 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:33.468540  7186 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:33.409610 12980 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:33.478830 12886 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:33.486042  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:33.490451  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.491883  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.450117 12333 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:33.501573  7257 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:33.487309  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:33.515641  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:33.519646  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:33.519950  7182 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:15:33.479015 12967 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.472059 12757 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:33.362239 12071 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:33.531574  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:33.539793  7261 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:15:33.479180 12816 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:33.538281  7179 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:15:33.547920  7179 pending_rounds.cc:85] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 10
I20260709 13:15:33.548291  7179 pending_rounds.cc:107] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:15:33.548674  7179 raft_consensus.cc:2889] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:33.552949  7891 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:15:33.422374 12936 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.494612 12898 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:33.556926 12563 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:33.401263 12976 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.523425 12291 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:33.502096 12768 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:33.582980  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:33.589620  7895 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:33.544085 12915 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:15:33.592953  7335 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
W20260709 13:15:33.599860  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 73498.3us
I20260709 13:15:33.594774 12997 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.484189 13002 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 13:15:33.605585  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:33.618300  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:33.598145 12885 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.013s	sys 0.052s
I20260709 13:15:33.635069  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:33.637758  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:33.587318 12563 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:33.635985  7335 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:33.652637  7890 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:33.605104 12915 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:15:33.654649  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49161.5us
I20260709 13:15:33.656458  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:33.641880 12885 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.013s	sys 0.053s
I20260709 13:15:33.669291  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:33.667260 12966 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 13:15:33.605327 12768 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:33.712790 12852 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:33.713789 12852 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:33.548321 12967 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:33.734970 12967 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:33.667997 12975 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.660022 12915 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:33.807139 12954 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:33.807478  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:33.680876 12885 consensus_queue.cc:1243] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:15:33.812444  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:33.808115  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:33.668332 12858 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:33.704995 12587 consensus_meta.cc:287] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.000s
I20260709 13:15:33.654369 12770 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:33.831636  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:33.909474 12770 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:33.914433  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:33.640453 12980 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.616643 12997 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:33.858081  7253 raft_consensus.cc:2368] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
I20260709 13:15:33.928450  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:33.700176 13006 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.813655 12839 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:33.897202 12985 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:15:33.901546 12991 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:15:33.902100 12988 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:33.902611 12986 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:33.903044 12987 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.261s
I20260709 13:15:33.646867 12912 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:33.914531  7262 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:33.829666 12762 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:33.828416 12899 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:33.666838 12994 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:33.830732  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 148131us
I20260709 13:15:33.853497 12975 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.905817 12885 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.942508  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2384) took 2200 ms. Trace:
I20260709 13:15:33.903975 12981 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:33.949157  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 292772us
I20260709 13:15:33.957792  7253 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 12. Current term is 13. Ops: []
W20260709 13:15:33.942448 12974 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:15:33.942133 12839 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:33.911929 12587 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:33.910674 12858 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:33.943418 12985 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:33.960414 12705 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:34.025734  7187 rpcz_store.cc:276] 0709 13:15:31.730017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.826955 (+ 96938us) service_pool.cc:224] Handling call
0709 13:15:31.827325 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:32.557368 (+730043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:32.557412 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:32.574269 (+ 16857us) log.cc:844] Serialized 26 byte log entry
0709 13:15:32.630785 (+ 56516us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:32.630847 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.630969 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:33.930436 (+1299467us) raft_consensus.cc:1685] finished
0709 13:15:33.930457 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:33.930595 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":788496,"raft.queue_time_us":755829,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":18893,"thread_start_us":19723,"threads_started":1,"wal-append.queue_time_us":412596}
W20260709 13:15:33.971361 12923 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.868s	user 0.009s	sys 0.013s
I20260709 13:15:34.042208  7262 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:33.965580 12993 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.952724 12969 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.421s
I20260709 13:15:34.064453  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:34.021425 12709 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.090584  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:34.054767 12839 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:33.959146 12988 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.102203 12979 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:34.105589 12662 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.268s	user 0.010s	sys 0.000s
I20260709 13:15:33.961527 12915 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:34.106524 13015 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:15:34.090108 12923 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.107828  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:34.142642 12997 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.142472 12662 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.143748  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:34.144680 12662 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:34.144876  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:34.146075 13029 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:15:34.096979 12993 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:34.147105 13013 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:15:34.148093 12977 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.148761  7332 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:34.148622 12977 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.086091 12818 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.149855 12818 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:34.151005  7891 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:15:34.112569 12881 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.698s	user 0.006s	sys 0.007s
I20260709 13:15:34.074774 12985 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:33.961048 12770 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.074702 13016 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.180948 13016 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.181958 12923 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.085536 12976 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.183099  7185 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:34.183251 13016 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.119197 12839 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.039824 12885 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:34.164620 13020 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:15:33.952100 13006 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.164901 12881 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.185355 12839 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.185549 12768 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.164294 12818 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.191943 12975 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:34.194411 12858 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.026542 12994 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.159583 12979 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.228366 12979 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.231338 12994 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.232492 12587 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:34.235682 13006 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.237475 12986 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:34.237975 12986 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:34.238309 12881 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.239379  7328 raft_consensus.cc:2368] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23.
I20260709 13:15:34.244132  7887 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:34.120604 12874 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.105s
I20260709 13:15:34.266680  7253 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 16: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:34.202049 12977 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:34.242445 12735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.041s	sys 0.040s
W20260709 13:15:34.296851 12992 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:15:34.262034 12770 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:34.268311 12903 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.393s	user 0.015s	sys 0.000s
I20260709 13:15:34.326943 12985 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.329929 12985 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.319216 12587 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:34.331425 12964 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.515s	user 0.008s	sys 0.000s
I20260709 13:15:34.331245 12587 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.323875 12986 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:34.284224 12735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.042s	sys 0.040s
I20260709 13:15:34.351595 12587 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:34.359092 12988 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.352907 12779 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:34.362022  7332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2189) took 1286 ms (client timeout 1576 ms). Trace:
I20260709 13:15:34.362408 12779 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.399544  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.401924  7336 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:34.399027  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.423544  7187 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:34.374675  7328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 882) took 1861 ms (client timeout 1999 ms). Trace:
I20260709 13:15:34.421711  7183 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:34.336736 12977 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:34.424875  7328 rpcz_store.cc:269] 0709 13:15:32.513665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.513844 (+   179us) service_pool.cc:224] Handling call
0709 13:15:34.374410 (+1860566us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54003868d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:34.374589 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3884072320}
I20260709 13:15:34.429356  7336 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:34.396310 12995 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:34.431764  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.432844  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:34.433104  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:34.434105 12291 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.817s	user 0.015s	sys 0.007s
I20260709 13:15:34.436242 12986 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.436867  7257 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
W20260709 13:15:34.362529  7332 rpcz_store.cc:269] 0709 13:15:33.075683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.075864 (+   181us) service_pool.cc:224] Handling call
0709 13:15:34.361803 (+1285939us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540031bad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:34.361962 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2447994112}
I20260709 13:15:34.439985 12993 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.442741 12333 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:34.427387 12563 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.002s
I20260709 13:15:34.458082  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.458581 12563 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.460366 12995 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.462028 12563 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.395136 13008 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:34.463305  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.463603 13008 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.465041  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:34.465312 13000 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.636s	user 0.001s	sys 0.000s
W20260709 13:15:34.393867 12913 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.997s	user 0.016s	sys 0.014s
W20260709 13:15:34.381068 12884 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.887s	user 0.011s	sys 0.011s
W20260709 13:15:34.379926 12895 consensus_meta.cc:287] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.336s	user 0.007s	sys 0.013s
I20260709 13:15:34.485241  7336 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:34.470752  7332 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:34.486016 12995 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:34.365384 12779 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.493600  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:34.494839  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:34.391039 12885 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.496695  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:34.499505  7328 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:34.467679 12892 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.128s	user 0.014s	sys 0.013s
I20260709 13:15:34.483565 12563 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:34.526762 12563 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.502135  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3087) took 1087 ms. Trace:
I20260709 13:15:34.530472  7181 rpcz_store.cc:276] 0709 13:15:33.414829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.461935 (+ 47106us) service_pool.cc:224] Handling call
0709 13:15:33.462261 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:33.462657 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.462689 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:33.463250 (+   561us) log.cc:844] Serialized 52 byte log entry
0709 13:15:33.600060 (+136810us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:33.600114 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.600209 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.501886 (+901677us) raft_consensus.cc:1685] finished
0709 13:15:34.501911 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.502070 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1118,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":136378,"threads_started":1,"wal-append.queue_time_us":1023716}
I20260709 13:15:34.503427 13008 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:34.333860 12903 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.539181  7180 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:34.540270 12903 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.541776  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3084) took 1502 ms. Trace:
I20260709 13:15:34.497287 12895 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.542155  7180 rpcz_store.cc:276] 0709 13:15:33.038916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.039038 (+   122us) service_pool.cc:224] Handling call
0709 13:15:33.050890 (+ 11852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.539570 (+1488680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.541556 (+  1986us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400271ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:34.541710 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3422315904}
I20260709 13:15:34.543768 12914 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.544375 12895 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.501317  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:34.483100 12977 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.547881 12977 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.528301  7329 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:34.529457  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:34.550822  7336 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:34.497754 12983 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.138s	user 0.009s	sys 0.014s
I20260709 13:15:34.536269  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:34.555174  7331 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:34.537402  7330 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [14.13-16.14]
I20260709 13:15:34.537566 12563 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.492091 12913 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.491729 12884 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.580735  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:34.529193 12969 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:34.583843  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:34.588106 12986 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:15:34.591817  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.599741  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.593389  7180 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:34.602908  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:34.598141  7328 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:34.646175  7183 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:34.649431 13003 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:34.650926  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:34.607120  7181 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:34.654385  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.655162  7186 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:34.655267  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:34.658540  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 58493.8us
I20260709 13:15:34.660275  7332 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:34.606367 12762 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.669355 13024 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:34.669888 12762 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.670125 13024 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.528384 12892 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.606909  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.674870 12570 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:34.650092 13003 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.683635  7182 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:34.679713  7330 pending_rounds.cc:85] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 9
I20260709 13:15:34.684399  7330 pending_rounds.cc:107] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:15:34.684321  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:34.684787  7330 raft_consensus.cc:2889] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:34.607820 12704 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:34.695573  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:34.699095  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:34.599568 12986 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.660424 12995 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:34.703972  7184 raft_consensus.cc:2368] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16.
I20260709 13:15:34.704392  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:34.692304  7328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:15:34.712395  7328 raft_consensus.cc:606] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:34.712268  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:34.717684  7336 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
W20260709 13:15:34.724083  7259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.037s	sys 0.099s
I20260709 13:15:34.676067 12858 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.725513  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:34.682859 12469 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:34.730505  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:34.739110  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:34.745379  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:34.746189  7186 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:34.673605 12987 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:15:34.720379 12986 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:34.577419 12983 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:34.731701  7259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.037s	sys 0.100s
I20260709 13:15:34.794966  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3292) took 1286 ms. Trace:
I20260709 13:15:34.775938  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.736819 12469 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:34.736542 12587 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.802240 12587 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.802769  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3076) took 2103 ms. Trace:
I20260709 13:15:34.803153  7185 rpcz_store.cc:276] 0709 13:15:32.698921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.862778 (+163857us) service_pool.cc:224] Handling call
0709 13:15:32.863153 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.183590 (+1320437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.802507 (+618917us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400117454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:34.802709 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3035114880}
I20260709 13:15:34.804296  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.804430 12587 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.804921  7185 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:34.607451 12969 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.792750  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.777892  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 921) took 1643 ms. Trace:
W20260709 13:15:34.809638  7261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.000s	sys 0.027s
I20260709 13:15:34.800323 13024 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.726508 12995 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:34.800165 12469 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:34.786141  7184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2393) took 1621 ms (client timeout 1999 ms). Trace:
I20260709 13:15:34.774613 12840 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:34.707412 12704 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.827858  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:34.812052  7261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.000s	sys 0.027s
I20260709 13:15:34.813777  7186 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:15:34.809795  7890 rpcz_store.cc:276] 0709 13:15:33.127510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.146020 (+ 18510us) service_pool.cc:224] Handling call
0709 13:15:33.146328 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.656479 (+510151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.758472 (+1101993us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400552b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:34.770827 (+ 12355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163926784}
I20260709 13:15:34.829475  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2088) took 1122 ms. Trace:
I20260709 13:15:34.830425  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:34.788421 12980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.005s
I20260709 13:15:34.822189  7335 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:34.819519  7182 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
W20260709 13:15:34.824616  7184 rpcz_store.cc:269] 0709 13:15:33.153380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.469272 (+315892us) service_pool.cc:224] Handling call
0709 13:15:34.771357 (+1302085us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002b57d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:34.774476 (+  3119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2757335808}
I20260709 13:15:34.835520  7179 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:34.746703 12858 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:34.837502  7860 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.049s	sys 0.079s
W20260709 13:15:34.839561  7860 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.049s	sys 0.079s
I20260709 13:15:34.832054  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.838948  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.841827  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:34.830011  7261 rpcz_store.cc:276] 0709 13:15:33.707016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.929583 (+222567us) service_pool.cc:224] Handling call
0709 13:15:33.929908 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.930119 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:33.946774 (+ 16655us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.829027 (+882253us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:34.829107 (+    80us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:34.829165 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.829253 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.829406 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15384,"prepare.queue_time_us":21756,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":123785,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":867278,"threads_started":2,"wal-append.queue_time_us":269780}
I20260709 13:15:34.842064  7183 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:34.795565  7259 rpcz_store.cc:276] 0709 13:15:33.508890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.532619 (+ 23729us) service_pool.cc:224] Handling call
0709 13:15:33.565311 (+ 32692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.565533 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:33.602194 (+ 36661us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.794493 (+1192299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:34.794567 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:34.794650 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.794744 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.794892 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17471,"prepare.queue_time_us":38508,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":62074,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3257,"thread_start_us":1191510,"threads_started":2,"wal-append.queue_time_us":340182}
I20260709 13:15:34.846881 12999 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.850183  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:34.833922 12980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.000s	sys 0.006s
I20260709 13:15:34.851831  7328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:15:34.861971  7328 raft_consensus.cc:606] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:34.862468  7328 raft_consensus.cc:614] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:34.852116  7179 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:15:34.853116  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.853435  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:34.807626 12383 consensus_queue.cc:1175] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 13 status { last_received { term: 12 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:34.875953  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:34.878264  7183 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:34.881127  7862 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:34.851393 12469 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:34.894600  7180 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:34.871215 13024 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:34.897845  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.838089 12840 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:34.899632  7226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.009s	sys 0.023s
W20260709 13:15:34.908938  7226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.009s	sys 0.023s
I20260709 13:15:34.899632 13024 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.903234  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:34.887228 12735 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:34.904228 12858 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.907184  7182 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:34.911319  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:34.923307  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:34.924259  7254 raft_consensus.cc:2368] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14.
I20260709 13:15:34.903611 13003 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.892258 12837 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:34.931640  7259 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:15:34.932021  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:34.918814  7302 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:34.907894 12762 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.926249  7183 raft_consensus.cc:2410] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
W20260709 13:15:34.927196  7256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.030s	sys 0.012s
I20260709 13:15:34.933147  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:34.933837  7182 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:15:34.850768 12999 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:34.936769  7254 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:34.937083  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:34.937711  7256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.030s	sys 0.013s
W20260709 13:15:34.956153  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.001s	sys 0.035s
W20260709 13:15:34.956534  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.001s	sys 0.035s
I20260709 13:15:34.921808 12971 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:34.935098  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:34.923117 12735 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:34.920109 12884 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.932082 12837 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.961228  7182 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:34.962282  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:34.965062  7253 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:15:34.934784  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:34.960925  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:34.974745  7259 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:34.955246 12570 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:34.960539 12762 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:34.959009 12662 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:34.963872 12892 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:34.993094 12704 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.934741 12993 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:15:34.993343 12969 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:34.964807 12971 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.968518 12735 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:34.959740 12980 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:15:34.976495 12900 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:34.977006 12837 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:35.009513  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.013329  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.013630  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:35.014048  7259 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
I20260709 13:15:35.014453  7328 raft_consensus.cc:2410] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 18 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:15:35.002599 12971 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:35.017910  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:35.018476  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:35.018715  7260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.019s	sys 0.015s
W20260709 13:15:35.025851  7260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.019s	sys 0.015s
W20260709 13:15:35.018966  7861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.006s	sys 0.027s
W20260709 13:15:35.026437  7861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.006s	sys 0.028s
I20260709 13:15:35.032014  7253 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
W20260709 13:15:34.935211  7859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.010s	sys 0.038s
W20260709 13:15:35.035420  7859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.010s	sys 0.038s
I20260709 13:15:35.035769  7301 leader_election.cc:400] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14.
I20260709 13:15:35.036257  7301 leader_election.cc:403] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:15:35.038398  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:35.038398  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.040210  7262 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
W20260709 13:15:35.035840  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 965765us
I20260709 13:15:35.043687  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.047266  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:35.051580  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:35.052420  7336 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:35.053488  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:35.055181  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:35.056624  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:35.063555  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:35.064955  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:35.066068  7328 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:35.001180 13004 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:15:35.070830  7331 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:15:35.072557  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49783us
I20260709 13:15:35.073585  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:35.010681 12900 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:35.079043  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:35.080926  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2090) took 1373 ms. Trace:
I20260709 13:15:35.101572  7887 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:35.085245  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:35.033187 12934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.007s	sys 0.015s
W20260709 13:15:35.033393 12071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.010s	sys 0.014s
I20260709 13:15:35.119853  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:35.120406  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:35.102770  7328 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:35.098304  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:35.104146  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:35.107601  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:35.101465  7260 rpcz_store.cc:276] 0709 13:15:33.707606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.945945 (+238339us) service_pool.cc:224] Handling call
0709 13:15:33.965181 (+ 19236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.965393 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:34.047323 (+ 81930us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.080576 (+1033253us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.080636 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:35.080683 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.080763 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.080871 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69196,"prepare.queue_time_us":78337,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":5976,"raft.queue_time_us":54144,"thread_start_us":978641,"threads_started":1}
W20260709 13:15:35.114307  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.123481  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.121534  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:35.107970  7894 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: [16.15-18.16]
I20260709 13:15:35.120702  7331 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:35.127470  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.128170  7260 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
W20260709 13:15:35.106781 12934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.008s	sys 0.015s
I20260709 13:15:35.002952 13032 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 13:15:35.017161 12291 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:15:35.096747 12707 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:35.117583 12977 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.117636 12570 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:15:35.133534 13035 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:15:35.185956  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:35.185662  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:35.137832 12931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.001s	sys 0.031s
I20260709 13:15:35.108733 12587 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:15:35.104687 12662 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:15:35.193846  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.209308  7260 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:15:35.210418  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:35.120532 12071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.010s	sys 0.015s
I20260709 13:15:35.226892  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:35.234706  7172 tablet_service.cc:1558] Processing DeleteTablet for tablet 242a63190870450082200759c7f513ab with delete_type TABLET_DATA_TOMBSTONED (TS 2ecdd7dc4a144f5aa0f2f91c7b94434d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47650
I20260709 13:15:35.173844 12884 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:35.198232 12931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.001s	sys 0.031s
W20260709 13:15:35.241757  7228 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.020s	sys 0.014s
W20260709 13:15:35.247562  7228 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.020s	sys 0.014s
I20260709 13:15:35.187642 12570 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.191676 12999 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:35.248024  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 602901us
W20260709 13:15:35.257361  7257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3297) took 1747 ms (client timeout 2198 ms). Trace:
I20260709 13:15:35.257686  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:35.257803  7257 rpcz_store.cc:269] 0709 13:15:33.510349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.519283 (+  8934us) service_pool.cc:224] Handling call
0709 13:15:35.257161 (+1737878us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54002161d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:35.257266 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2107386240}
W20260709 13:15:35.263358  7187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.015s	sys 0.019s
W20260709 13:15:35.263800  7187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.015s	sys 0.019s
I20260709 13:15:35.238345 12858 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.268950  7186 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:15:35.237924 12840 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:35.192760 12977 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:35.276454  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.287250  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:35.249567 13024 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:35.244551 13004 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:35.293833  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.287151  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:35.243552 12993 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:35.295003  7260 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:35.296880  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:35.259683 12762 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.255764 12570 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:35.259979 13025 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:35.303156  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.308804 12977 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:35.313237 12837 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:35.249785 12884 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:35.356062  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:35.267951 12912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.009s	sys 0.024s
I20260709 13:15:35.359499  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.360188  7257 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 11.
I20260709 13:15:35.361155  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.362274  7257 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:35.347168 12934 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:35.369918  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:35.291673 12858 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:35.365347 12470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.030s	sys 0.026s
I20260709 13:15:35.368289  7891 raft_consensus.cc:2368] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15.
I20260709 13:15:35.375650  7257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:46710
I20260709 13:15:35.345773 12993 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:35.352819 12977 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:35.384501  7257 raft_consensus.cc:606] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:35.391594  7334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.010s	sys 0.035s
I20260709 13:15:35.351171 13025 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:35.301688 13004 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:35.386531 12470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.031s	sys 0.026s
I20260709 13:15:35.386637 13042 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:35.347776 12762 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:35.361068 12912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.009s	sys 0.025s
I20260709 13:15:35.381664 12704 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:15:35.381826 13038 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:15:35.374454 13030 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:35.368168 13040 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:35.374205 12837 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:35.392212  7334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.011s	sys 0.035s
W20260709 13:15:35.408883  7332 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.016s	sys 0.047s
W20260709 13:15:35.430850  7332 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.016s	sys 0.047s
W20260709 13:15:35.401031 12986 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.000s
W20260709 13:15:35.402463 13047 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:15:35.381283 12934 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:35.406376 12889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.017s	sys 0.035s
I20260709 13:15:35.443665  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:35.455024  7257 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:15:35.429589 12920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.014s	sys 0.033s
I20260709 13:15:35.457111  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2121) took 1055 ms. Trace:
I20260709 13:15:35.458066  7335 rpcz_store.cc:276] 0709 13:15:34.401616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.404867 (+  3251us) service_pool.cc:224] Handling call
0709 13:15:34.426683 (+ 21816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.837556 (+410873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.456793 (+619237us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b540031abd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:35.457034 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907637120}
I20260709 13:15:35.465654  7260 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:35.398350 12977 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:35.433234 12980 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:35.454591 12889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.017s	sys 0.035s
I20260709 13:15:35.438998 13032 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:35.478192  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:35.460567 12920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.014s	sys 0.033s
W20260709 13:15:35.491850  7330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.023s	sys 0.054s
W20260709 13:15:35.493748  7330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.023s	sys 0.054s
I20260709 13:15:35.447731 12986 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:35.499003  7150 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.019s	sys 0.034s
I20260709 13:15:35.433622 13030 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:35.503896  7150 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.019s	sys 0.034s
W20260709 13:15:35.504473  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 851212us
W20260709 13:15:35.491061 13022 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.077s	sys 0.103s
I20260709 13:15:35.508932  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.489760 13032 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:35.545753  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:35.550889 13030 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:35.551499 13030 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:35.551985 13030 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:35.554028 13030 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:35.555310 13045 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:35.555881  7887 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:35.555240  7890 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEARNER]: Advancing to term 17
I20260709 13:15:35.557600 12934 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:35.558909 13025 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:35.559597 12884 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:35.564724  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:35.566001 13004 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:35.567117 12858 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:35.554032 12707 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14.
I20260709 13:15:35.568873 12977 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:35.569868 13032 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:35.571111 13032 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:35.503153 12929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.055s	user 0.021s	sys 0.037s
W20260709 13:15:35.575043 12929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.021s	sys 0.037s
I20260709 13:15:35.576089  7333 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
W20260709 13:15:35.547128  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 45011us
W20260709 13:15:35.576107  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.581161  7260 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:35.565059 12735 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.000s
I20260709 13:15:35.627065  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:35.542784 13022 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.081s	sys 0.107s
I20260709 13:15:35.596398  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:35.642405  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.491369 12980 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:35.648125  7895 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:35.648888  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:35.651782  7260 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 11.
W20260709 13:15:35.649452  7179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.043s
W20260709 13:15:35.653379  7179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.004s	sys 0.043s
I20260709 13:15:35.595435 12977 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:35.624491 12766 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.510538 12971 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:35.658449  7861 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:35.695044 12895 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:35.695868 12895 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:35.698613 12895 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:35.699793 12913 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:35.714982 12895 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:15:35.710496  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.720942  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:35.722856  7184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.012s	sys 0.020s
W20260709 13:15:35.723223  7184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.012s	sys 0.020s
I20260709 13:15:35.631626 12884 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:15:35.671366 12989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.014s	sys 0.027s
I20260709 13:15:35.730553  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:35.643585 12735 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:35.733798  7329 raft_consensus.cc:2368] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15.
W20260709 13:15:35.726058  7302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.015s	sys 0.087s
I20260709 13:15:35.646870 12071 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
W20260709 13:15:35.736351  7302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.016s	sys 0.087s
I20260709 13:15:35.690502 12929 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:35.666508 12840 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:15:35.763497  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2119) took 1365 ms. Trace:
I20260709 13:15:35.764078  7334 rpcz_store.cc:276] 0709 13:15:34.398135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.400383 (+  2248us) service_pool.cc:224] Handling call
0709 13:15:34.400789 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.465528 (+ 64739us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:34.465836 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.434722 (+968886us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.434795 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:35.434856 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.763153 (+328297us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b54001f4ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:35.763218 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.763420 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3908,"prepare.queue_time_us":16818,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":4048,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5495,"spinlock_wait_cycles":148330368,"thread_start_us":964487,"threads_started":1}
I20260709 13:15:35.725440 13008 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:15:35.745144  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 785549us
I20260709 13:15:35.727536 12898 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:35.757793  7258 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
W20260709 13:15:35.759387 13050 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:15:35.767659  7257 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
W20260709 13:15:35.771852  7261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.035s	sys 0.063s
W20260709 13:15:35.731542 12989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.014s	sys 0.028s
W20260709 13:15:35.795012  7261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.035s	sys 0.063s
I20260709 13:15:35.750293  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:35.730073 12993 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:35.719228 12895 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:15:35.678999 12977 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:35.687546 12766 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:35.788437  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.739606 12762 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:35.773396 13008 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:35.764164 12936 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:35.749187 12929 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:35.787961 12995 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:35.791280  7262 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:15:35.783017 12971 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:35.795713  7333 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:35.795779  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:35.855207  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 59513.7us
I20260709 13:15:35.857802  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:35.858433  7254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.018s	sys 0.019s
W20260709 13:15:35.865626  7254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.019s	sys 0.019s
I20260709 13:15:35.869434 12884 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:35.869925 12884 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:35.866737 12707 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:15:35.870908 12884 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:35.871546 12707 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:35.872738 12766 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:35.872481 12707 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:35.797390 12898 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:35.876549 12898 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:35.854362 12929 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:35.881194 12735 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:35.863843 13036 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:35.866986 12981 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:15:35.858779 12762 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:15:35.883746 12766 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:35.929018  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:35.931876  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:35.932335  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:35.932847  7181 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:35.933288  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:35.933519  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:35.933911  7183 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:35.937666  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2207) took 1260 ms. Trace:
W20260709 13:15:35.938105 12570 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.002s
I20260709 13:15:35.922510 13036 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:35.938177  7330 rpcz_store.cc:276] 0709 13:15:34.677300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.677535 (+   235us) service_pool.cc:224] Handling call
0709 13:15:34.679485 (+  1950us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:34.698175 (+ 18690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.698217 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:34.699108 (+   891us) log.cc:844] Serialized 52 byte log entry
0709 13:15:35.498281 (+799173us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:35.498345 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.498459 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:35.937452 (+438993us) raft_consensus.cc:1685] finished
0709 13:15:35.937472 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.937606 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5672,"raft.queue_time_us":20791,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":750676,"threads_started":1,"wal-append.queue_time_us":1209618}
I20260709 13:15:35.949384  7185 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:35.950176  7183 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
W20260709 13:15:35.955498  7301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.013s	sys 0.056s
I20260709 13:15:35.959462  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:35.913412 12971 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:15:35.966486  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:35.916812 12858 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:15:35.968355  7301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.013s	sys 0.056s
I20260709 13:15:35.951225 12762 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:35.983042 13063 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:35.950440 12570 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:35.939859 12766 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:35.963480 12291 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:36.018738  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 944099us
I20260709 13:15:35.985535 12840 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:35.985642  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:35.994390  7859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.009s	sys 0.032s
W20260709 13:15:35.995043  7172 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.009s	sys 0.032s
I20260709 13:15:36.000584  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3114) took 1099 ms. Trace:
I20260709 13:15:35.925454 13008 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:35.976799 12931 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:35.990276 12980 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:36.003710 12989 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:36.063776  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:36.053906  7172 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.009s	sys 0.032s
I20260709 13:15:36.051730 12858 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:36.017438 13063 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.017762 12762 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:36.042443  7859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.009s	sys 0.032s
W20260709 13:15:36.049737  7332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.016s	sys 0.018s
I20260709 13:15:36.052124  7184 rpcz_store.cc:276] 0709 13:15:34.900728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.901006 (+   278us) service_pool.cc:224] Handling call
0709 13:15:34.901375 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.901755 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.901790 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.902278 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.723576 (+821298us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:35.723620 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.723693 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.000245 (+276552us) raft_consensus.cc:1685] finished
0709 13:15:36.000280 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.000496 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8788,"raft.queue_time_us":7813,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3239,"thread_start_us":820369,"threads_started":1,"wal-append.queue_time_us":1095466}
I20260709 13:15:36.056977 12766 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:36.026166 12977 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:36.060474  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:36.060853 12912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.015s	sys 0.001s
W20260709 13:15:36.014360  7228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.011s	sys 0.019s
W20260709 13:15:36.105805  7228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.011s	sys 0.019s
W20260709 13:15:36.106213  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 724826us
W20260709 13:15:36.083191  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 448569us
I20260709 13:15:36.008929 13036 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:36.065214 12889 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.000s	sys 0.034s
W20260709 13:15:36.061733 13042 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.033s	sys 0.007s
W20260709 13:15:36.091495  7332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.016s	sys 0.019s
I20260709 13:15:36.105064  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.052066 12291 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.110426  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2206) took 1438 ms. Trace:
W20260709 13:15:36.063416 13038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.007s	sys 0.034s
I20260709 13:15:36.110818  7891 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 12.
W20260709 13:15:36.131023 13038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.007s	sys 0.035s
I20260709 13:15:36.130950  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.130364  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.132901  7896 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:36.132709  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.134007  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3296) took 2624 ms. Trace:
I20260709 13:15:36.134210  7894 raft_consensus.cc:2410] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:15:36.040194 12840 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.133385  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.135210  7889 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
W20260709 13:15:36.111200 13042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.034s	sys 0.008s
I20260709 13:15:36.136301 13042 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:36.134403  7256 rpcz_store.cc:276] 0709 13:15:33.510068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.547195 (+ 37127us) service_pool.cc:224] Handling call
0709 13:15:33.588739 (+ 41544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.070839 (+482100us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:34.119290 (+ 48451us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.938428 (+819138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:34.938500 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:34.938563 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.956648 (+1018085us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b1800153a00. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419
0709 13:15:36.133795 (+177147us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54002e7a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:36.133842 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.133955 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1333,"prepare.queue_time_us":81319,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":21391,"raft.queue_time_us":95,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":15028,"spinlock_wait_cycles":1131616640,"thread_start_us":818626,"threads_started":1,"wal-append.queue_time_us":1274601}
W20260709 13:15:36.108541 12889 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.034s
I20260709 13:15:36.137231 13042 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:36.138911 13068 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:15:36.139528 12889 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:36.139953 12889 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:36.140233 13051 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:15:36.141252 13064 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:15:36.142051  7178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2387) took 3008 ms (client timeout 2013 ms). Trace:
I20260709 13:15:36.142575  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3306) took 1227 ms. Trace:
W20260709 13:15:36.142448  7178 rpcz_store.cc:269] 0709 13:15:33.133430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.133684 (+   254us) service_pool.cc:224] Handling call
0709 13:15:36.141771 (+3008087us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b540039d0d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:36.141958 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5303594368}
I20260709 13:15:36.143098  7261 rpcz_store.cc:276] 0709 13:15:34.914875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.915362 (+   487us) service_pool.cc:224] Handling call
0709 13:15:34.915769 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.916198 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.916243 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.917859 (+  1616us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.795530 (+877671us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:35.795571 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.795632 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.142378 (+346746us) raft_consensus.cc:1685] finished
0709 13:15:36.142397 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.142522 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":522,"raft.queue_time_us":98,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5324,"thread_start_us":827972,"threads_started":1,"wal-append.queue_time_us":1071242}
I20260709 13:15:36.145390  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 895) took 1015 ms. Trace:
I20260709 13:15:36.111541  7332 rpcz_store.cc:276] 0709 13:15:34.671612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.707952 (+ 36340us) service_pool.cc:224] Handling call
0709 13:15:34.708361 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.708842 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:35.431446 (+722604us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.109117 (+677671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.110119 (+  1002us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:36.110168 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.110236 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.110368 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4127,"prepare.queue_time_us":113899,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":2347,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":1332445,"threads_started":2}
I20260709 13:15:36.149474 12983 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:36.145831  7329 rpcz_store.cc:276] 0709 13:15:35.129577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.129741 (+   164us) service_pool.cc:224] Handling call
0709 13:15:36.145202 (+1015461us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b540036b854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:36.145337 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239729024}
I20260709 13:15:36.141211 12889 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.153136 13070 tablet_replica.cc:333] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:15:36.130878  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:36.156370  7890 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:36.111398  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:36.157588  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:36.158223  7187 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:36.130501  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:36.162765  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54729.5us
I20260709 13:15:36.167943  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:36.157514  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46228.3us
I20260709 13:15:36.170042  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.169509  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.171424  7181 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 11.
I20260709 13:15:36.091125 12570 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:36.105594 12912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.015s	sys 0.001s
I20260709 13:15:36.098794 12858 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:36.174430  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.172112  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:36.178841  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:36.178942  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.180099  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:36.061322 12931 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.126967  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:36.181641  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:36.176141  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.171334  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.176085  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.065603 12989 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.184794  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:36.082340 13063 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:36.186980  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.187278  7185 raft_consensus.cc:2368] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16.
W20260709 13:15:36.187414  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 60546.1us
I20260709 13:15:36.188254  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:36.170351 12988 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:36.106006 13066 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:36.106153 12980 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:36.179804 13067 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:15:36.172495 12889 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:36.177052 13038 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:15:36.191494  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.198094  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.189235  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:36.220256  7182 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:36.200023  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:36.204094  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.211714  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:36.221977  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.206916  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.223371  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:36.225095  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:36.226291 12735 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:36.212711  7859 leader_election.cc:400] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23.
I20260709 13:15:36.201133  7890 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:15:36.217319  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:36.228856  7859 leader_election.cc:403] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:15:36.229086  7889 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:15:36.198141  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3318) took 1235 ms. Trace:
I20260709 13:15:36.230304  7254 rpcz_store.cc:276] 0709 13:15:34.962496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.963455 (+   959us) service_pool.cc:224] Handling call
0709 13:15:34.963766 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.969897 (+  6131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.969931 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.986984 (+ 17053us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.866237 (+879253us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:15:35.866300 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.866473 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.197856 (+331383us) raft_consensus.cc:1685] finished
0709 13:15:36.197888 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.198063 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2826,"raft.queue_time_us":4429,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":17002,"thread_start_us":861542,"threads_started":1,"wal-append.queue_time_us":1046947}
W20260709 13:15:36.233592  7260 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.030s	sys 0.049s
W20260709 13:15:36.199491 13032 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.003s
I20260709 13:15:36.189535 13030 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:36.214859  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:36.258484  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 69355.8us
I20260709 13:15:36.257190  7185 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:36.303539  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.349532  7182 raft_consensus.cc:2410] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:15:36.189713 13039 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:36.198930 12995 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:36.218988 12986 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:36.197508 12977 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:36.375612 12931 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:36.323232 12470 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:36.377899  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1088) took 1305 ms. Trace:
W20260709 13:15:36.258213  7150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.009s	sys 0.008s
W20260709 13:15:36.378878  7150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.009s	sys 0.011s
W20260709 13:15:36.328104  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 168541us
W20260709 13:15:36.341670  7260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.035s	sys 0.050s
W20260709 13:15:36.380299  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 144379us
I20260709 13:15:36.381136  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1134) took 1329 ms. Trace:
W20260709 13:15:36.381438  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 166782us
I20260709 13:15:36.381503  7260 rpcz_store.cc:276] 0709 13:15:35.051725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.670385 (+618660us) service_pool.cc:224] Handling call
0709 13:15:35.670656 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.380770 (+710114us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:36.380801 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.380856 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:36.380888 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.380956 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.381084 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":186877,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3630,"thread_start_us":709585,"threads_started":1}
W20260709 13:15:36.344194  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 131679us
I20260709 13:15:36.383795  7228 leader_election.cc:400] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16.
I20260709 13:15:36.384156  7228 leader_election.cc:403] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:36.210983 13071 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:36.384657  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:36.387725  7182 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:36.354453  7181 pending_rounds.cc:85] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 9
I20260709 13:15:36.281602 12976 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23.
I20260709 13:15:36.216099 12898 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:15:36.358490  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.208527 13066 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.359673 13081 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:36.355541 13039 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:36.212924 12980 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.411338  7895 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:36.412568 12980 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:36.365338 13063 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.281371 13077 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:36.413552 13077 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:36.414149 13077 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:36.414932 13063 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:36.368558 12989 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:36.340942 12570 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.417508 13066 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:36.417781 12570 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.397037 12874 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:15:36.420346 13081 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.420814 12570 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:36.373162 12929 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:36.379415  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 725904us
I20260709 13:15:36.422821  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:36.423180 13039 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:36.382448  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:36.424659 12071 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:36.401974 13080 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:36.426776 12071 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:36.427266 13080 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:36.352451  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:36.427764 13080 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:36.428284  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 77734.6us
I20260709 13:15:36.429303 12759 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:36.378404  7179 rpcz_store.cc:276] 0709 13:15:35.072324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.074877 (+  2553us) service_pool.cc:224] Handling call
0709 13:15:35.075220 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:35.075550 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.075575 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:35.103848 (+ 28273us) log.cc:844] Serialized 52 byte log entry
0709 13:15:35.653802 (+549954us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:35.653873 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.653961 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.377625 (+723664us) raft_consensus.cc:1685] finished
0709 13:15:36.377650 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.377826 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":330,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10923,"thread_start_us":546047,"threads_started":1,"wal-append.queue_time_us":814776}
I20260709 13:15:36.397797 12735 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:36.386308  7187 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:36.431337 12735 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:36.431905 12735 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:36.432273 12929 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:36.432842 12735 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.388278  7181 pending_rounds.cc:107] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:15:36.435356  7181 raft_consensus.cc:2889] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:36.436717  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:36.383705  7889 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:36.392290  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:36.440784  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48592.6us
I20260709 13:15:36.441530  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:36.442763 13069 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:36.443074 12915 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:36.443642  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:36.444911  7859 leader_election.cc:400] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15.
I20260709 13:15:36.445161  7859 leader_election.cc:403] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:36.397485  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.387952 12766 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:36.446923 12766 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.449158 12766 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:36.358906 12995 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:36.452628 12995 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:36.443181 13069 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.453732 13069 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:36.453670 13077 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.348500  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:36.455024  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 106621us
I20260709 13:15:36.455555 12987 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:36.455937  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:36.456017 12987 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:36.456621 12987 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:36.453140 12884 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:36.458719 13004 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.459282 13004 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.461027 12968 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:36.461473 12968 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.461791 12968 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:36.398286 12931 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:36.462742 13004 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:36.463217 12931 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.465372 12931 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:36.462863  7887 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:36.456066 13077 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:36.471271 12704 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:36.471702 12704 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:36.472568 12704 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.473944 12704 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:36.456902  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:36.425022 13076 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:15:36.235767 12858 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:36.496742  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51969.1us
I20260709 13:15:36.515007  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.540537  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:36.541424  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.557078  7187 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:36.517921  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:36.560717  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 177031us
I20260709 13:15:36.563788  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:36.569463  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:36.569494  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 187143us
W20260709 13:15:36.570358  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 113538us
I20260709 13:15:36.571534  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:36.578541  7187 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:36.580122 13074 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16.
I20260709 13:15:36.580473 12903 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:36.580891 12903 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:36.580897 13084 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.142s	user 0.001s	sys 0.019s
I20260709 13:15:36.581835 12903 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.583333  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:36.584160 12989 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:36.584462  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:36.585146 12894 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:36.585574  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:36.585672 12894 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.586998 13003 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:36.587409 13003 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:36.587735  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:36.588511 12885 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:36.589138 12885 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:36.589238 13070 raft_consensus.cc:2243] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.589623 12885 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.590816 12470 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:36.591439 13077 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:36.591812 13063 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:36.592257 13063 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.592520 13077 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:36.592623 13063 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:36.595044 12896 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:15:36.595441  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.595831  7895 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:15:36.580185 12874 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:15:36.597340 13072 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.239s	user 0.001s	sys 0.001s
I20260709 13:15:36.597669 12874 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:36.598356  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.598670 12874 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.599578 12895 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:36.600003 13081 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:36.600107 12895 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.601583  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:36.580837  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:36.591557 12470 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:36.604341 12470 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:36.604423  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:36.604766 12470 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:36.605126  7261 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:36.606654  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:36.607304  7256 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:36.606990 12762 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:36.609447  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.610172 12903 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:36.610848 12881 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:36.611589 12291 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:36.611408 12881 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.613308  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.613747  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:36.615229 13086 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.177s	user 0.009s	sys 0.009s
I20260709 13:15:36.616577  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:36.550197 13036 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:15:36.610884 13004 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:15:36.618368 13004 consensus_queue.cc:1243] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:15:36.618446 12983 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:36.619143 13004 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:36.619546 13004 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:36.620416 13004 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.621738 12983 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.621948 12987 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.623523 13033 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15.
I20260709 13:15:36.568393 12976 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:36.567924 13079 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:36.624401 12900 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.625620  7894 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:36.625849 12900 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:36.625169 13079 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.643818  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:36.646957  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.614540  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:36.642340  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 70876.6us
I20260709 13:15:36.629493  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.649914  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:36.651047  7333 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:36.655349 12894 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:36.595456 12896 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:36.655777 13008 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:36.657516  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.645983  7183 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:15:36.659708  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:36.657573  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:36.654129 13089 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.285s	user 0.006s	sys 0.014s
I20260709 13:15:36.660642  7861 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:36.650557 12931 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:36.664956  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.665128  7186 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:15:36.625236 12987 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:36.668907  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:36.668887  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:36.669359  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:36.671862  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.673913  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.691393  7185 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:36.675169  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.646927 13074 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:36.651389 12469 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:36.677106  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:36.621701 13004 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:36.672346  7256 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:36.732299  7332 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:36.593009 13077 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:36.679746  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:36.680214  7254 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
W20260709 13:15:36.669684 13082 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.267s	user 0.000s	sys 0.010s
W20260709 13:15:36.725958  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.694424  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:36.669471 13085 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.192s	user 0.000s	sys 0.008s
I20260709 13:15:36.757973  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:36.731470  7327 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:36.739216  7861 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:36.731657  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.690497  7330 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:36.743000  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:36.676306 13022 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.209s	user 0.005s	sys 0.005s
W20260709 13:15:36.669579 13091 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.267s	user 0.000s	sys 0.010s
W20260709 13:15:36.676180 13092 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.272s	user 0.007s	sys 0.003s
W20260709 13:15:36.743505  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 63862.9us
I20260709 13:15:36.768862  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:36.682871 13070 raft_consensus.cc:2272] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.682837 12931 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:36.691299  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 267332us
I20260709 13:15:36.749666  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.749918  7182 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:36.751848  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:36.768460 12914 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:36.761113  7329 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:36.684368 12840 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:36.770321  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:36.669263 13041 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.234s	user 0.011s	sys 0.003s
I20260709 13:15:36.684664 13032 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:36.689837 12936 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:36.772161  7150 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:36.737378 12885 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:36.771335 13036 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:36.747839  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:36.780120  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:36.733381 12469 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:36.684401 12766 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:15:36.783788  7332 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:36.752489 12889 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:15:36.754997 13074 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:36.870230  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 122521us
I20260709 13:15:36.756044 13030 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:15:36.825911  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.808338  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:36.872699  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:36.874330  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 102216us
I20260709 13:15:36.879029  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2109) took 1386 ms. Trace:
W20260709 13:15:36.883262  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 113079us
I20260709 13:15:36.924609  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:36.925516  7225 leader_election.cc:400] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15.
I20260709 13:15:36.925940  7225 leader_election.cc:403] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:36.897049  7254 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:15:36.776124 12931 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:36.780498 12912 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.025s	sys 0.050s
I20260709 13:15:36.924280  7257 rpcz_store.cc:276] 0709 13:15:35.492778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.870139 (+377361us) service_pool.cc:224] Handling call
0709 13:15:35.870523 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:35.913395 (+ 42872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.913446 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:35.914219 (+   773us) log.cc:844] Serialized 52 byte log entry
0709 13:15:36.325900 (+411681us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:36.326051 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.326328 (+   277us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.878614 (+552286us) raft_consensus.cc:1685] finished
0709 13:15:36.878675 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.878917 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28573,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4751,"spinlock_wait_cycles":18432,"thread_start_us":374598,"threads_started":1,"wal-append.queue_time_us":455547}
W20260709 13:15:36.946300  7179 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.009s	sys 0.018s
W20260709 13:15:36.950188  7179 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.010s	sys 0.018s
I20260709 13:15:36.818300 13079 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:36.802400 12983 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:36.963136  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 154841us
I20260709 13:15:36.976025  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:36.976958  7888 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
I20260709 13:15:36.811856 12762 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:36.760581 13069 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.813323 13063 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.678406 13003 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:36.966506  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:36.891800 12469 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:36.984120  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:36.817384 12895 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:36.865288 12936 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:36.742558 12896 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.897562 12885 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:36.889988 13071 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:36.886061 12892 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:36.774719 13037 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.171s
W20260709 13:15:36.990850  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44898.6us
W20260709 13:15:36.957301 12912 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.026s	sys 0.051s
W20260709 13:15:37.009057  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 342245us
W20260709 13:15:37.085863  7181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.011s	sys 0.024s
W20260709 13:15:37.087373  7181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.011s	sys 0.024s
W20260709 13:15:37.089752  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:36.988986 12884 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.003s
I20260709 13:15:36.870151 13032 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.779775 12914 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:36.947222 13030 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:36.892269 12976 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:15:37.016758  7889 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:15:36.978384 13096 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:36.984649 12894 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15.
I20260709 13:15:37.020121  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:37.027051  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 57034.7us
W20260709 13:15:37.088913 13067 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:15:37.048386  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:37.024633 12977 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:37.022174 12996 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:37.084283  7335 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:15:36.983385 12840 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:15:37.039355  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:36.944792 12881 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:36.983790 13081 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:15:37.034291 13080 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.606s	user 0.012s	sys 0.000s
I20260709 13:15:37.025460 13079 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:36.997644 13038 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:15:37.107744  7253 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:37.106467  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:37.034943 12936 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:36.989876 12988 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:15:37.123582  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:37.012524 13051 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:37.247009  7332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb0912958bd849238a8f104a7916c427"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:15:37.125008  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:37.125079  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:37.127846  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 107815us
I20260709 13:15:37.249660  7225 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:37.215552 12996 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:37.130251 13087 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.453s	user 0.000s	sys 0.003s
I20260709 13:15:37.133004 12884 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:37.280171  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 156661us
I20260709 13:15:37.134625 13063 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:37.137212  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.286450  7262 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:37.282146  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:37.145059 12914 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:37.153116 13070 ts_tablet_manager.cc:1916] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:37.126221 13096 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:37.157307 12995 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.704s	user 0.005s	sys 0.003s
I20260709 13:15:37.122602 13030 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:37.160315 12757 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:15:37.161067 12989 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.000s
I20260709 13:15:37.082978 13071 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:37.244722 13079 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:37.168318 13069 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:37.168938  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2424) took 1003 ms. Trace:
I20260709 13:15:37.172362  7894 raft_consensus.cc:2410] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 13:15:37.176553 12915 consensus_meta.cc:287] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.733s	user 0.009s	sys 0.001s
W20260709 13:15:37.180236 12900 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 13:15:37.188721  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.188622 12931 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:37.017627 12929 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
W20260709 13:15:37.179576 13008 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.004s
W20260709 13:15:37.200124 12704 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.005s
W20260709 13:15:37.140741 12968 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.678s	user 0.007s	sys 0.001s
W20260709 13:15:37.231926  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 183613us
I20260709 13:15:37.237912  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.241526 12983 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:37.241935 13003 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:37.243045 12858 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.244700 13074 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:37.245896 12976 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:15:37.033069 13039 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.001s
I20260709 13:15:37.244786  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:37.271829 12977 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:37.103560 13077 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:37.293251  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.418259  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:37.300724  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:37.419791  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.419925  7328 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:37.273866 12996 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:37.302296  7181 rpcz_store.cc:276] 0709 13:15:36.165800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.336748 (+170948us) service_pool.cc:224] Handling call
0709 13:15:36.354267 (+ 17519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.435956 (+ 81689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.435987 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:36.436422 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:15:37.087782 (+651360us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:37.119966 (+ 32184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.120074 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:37.168730 (+ 48656us) raft_consensus.cc:1685] finished
0709 13:15:37.168750 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.168880 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":651029,"threads_started":1,"wal-append.queue_time_us":730374}
I20260709 13:15:37.314546  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:37.321190  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:37.225448 13080 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:37.290371 12892 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:37.290140 12986 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:37.291378 13036 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:37.284238 12981 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.361521  7260 raft_consensus.cc:2410] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:15:37.286466 12840 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:37.362993  7327 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:15:37.468091  7327 pending_rounds.cc:85] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 8
I20260709 13:15:37.294039 12757 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:37.297278 13071 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:37.297497 12989 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:37.367142  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:37.471959  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 227291us
I20260709 13:15:37.361099  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:37.470978  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.472824  7329 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:37.372722  7331 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:37.373561  7258 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:37.378247  7896 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:15:37.378945 12469 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.383445 12874 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:37.479370 12981 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.458738 12983 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:37.490916 12981 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:37.491549 12971 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.491463 12983 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.492240 12971 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.494617 13066 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:37.495290 13066 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.495898 12971 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:37.468441  7327 pending_rounds.cc:107] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 14.9
I20260709 13:15:37.496587  7327 raft_consensus.cc:2917] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Aborting config change with OpId 14.9: Aborted: Op aborted by new leader
I20260709 13:15:37.387140 12071 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:37.497328 12071 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:37.497534 13066 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:37.498328 12071 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.498849 13036 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:37.417762 13039 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.498677 12469 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:37.504141 13039 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:37.398132  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:37.400879  7336 raft_consensus.cc:2368] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15.
W20260709 13:15:37.370381 12470 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.005s
I20260709 13:15:37.508491 12470 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:37.509686  7329 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:37.297029 12995 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.512538 12995 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:37.375543 12903 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.001s
I20260709 13:15:37.416462  7887 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:37.513144  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:37.513720  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:37.409780 12900 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:37.391070 12968 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:37.514889  7253 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:37.514680 12900 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.409684 12881 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.516784 12881 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.519214 12881 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:37.467013  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.519310  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:37.409615 12976 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:37.521169 12470 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:37.469906  7261 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:37.293704 13096 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:37.524283 12900 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:37.472962  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:37.527259 13108 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 13:15:37.527467  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 54604.9us
I20260709 13:15:37.528529  7299 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:37.529503 12881 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:37.408306 12291 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:15:37.467777 12852 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:37.531230 13111 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:15:37.531133 12852 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:37.533464 12852 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:37.465240 12986 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:37.534376 13106 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:15:37.535637 12986 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:37.499269  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.536033 13030 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:37.536603 13080 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:37.537092  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:37.538146  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:37.538332 13030 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:37.401461  7179 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:15:37.538146  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.539296  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.510462  7333 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:37.509922  7334 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:37.540434  7262 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:37.521735 12976 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:37.541719 12976 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:37.395843  7225 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:37.539490  7328 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:37.457479  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 55235.3us
I20260709 13:15:37.543882 12931 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:37.531277 12470 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:37.515036  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.530290  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:37.548465  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.514104  7888 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:37.560174  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:37.560473  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 164733us
I20260709 13:15:37.562845  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:37.564369  7255 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:37.572818  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:37.408870 12858 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.580209  7330 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:37.580619  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:37.580518  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.582564  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:37.583849  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.473526 13101 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.590744  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.482429 13042 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.507606 12896 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:37.593894  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:37.483414 12707 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:37.538017 12757 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.610117  7887 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:15:37.613968  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.569979 13073 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.636518  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.641772  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:37.600056  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.642398  7262 raft_consensus.cc:2376] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16. Re-sending same reply.
I20260709 13:15:37.642486  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:37.643122  7329 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:37.643472  7328 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:37.576313 13080 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:37.647838  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 128565us
I20260709 13:15:37.649037  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:37.636586  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:37.652129  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:37.644992  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:37.656316  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:37.591035 12986 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:37.591054 12470 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:37.636713 12903 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:37.636138 12981 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:37.660820  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.607406 13039 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:37.460146 13079 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.674402  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:37.685554  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:37.672845  7152 leader_election.cc:336] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.615s (SENT)
I20260709 13:15:37.570923 12996 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:37.659278  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:37.678464  7329 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:37.691606  7181 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:15:37.691802  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.660020 12757 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:37.663820 12704 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:37.694468  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:37.701475  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:37.641158 13033 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:15:37.697289  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:37.656584 13030 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.698575  7225 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:37.696651  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.706403  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:37.637228 13042 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:37.711694  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:37.695885 12766 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:37.697714 13003 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.675580 12903 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:37.712703  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:37.715406  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.716138  7891 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:37.639634 13101 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.740427  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:37.742367  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:37.702903  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 205082us
I20260709 13:15:37.651223 13073 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.700009 13080 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:37.721454 12981 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.723635  7894 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:15:37.724310  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:37.660914 13071 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.757121  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:37.828318  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 71264.1us
I20260709 13:15:37.704027 12986 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:37.760268  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:37.822031 12931 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:15:37.839228  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:37.733469 12704 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:37.760695 12900 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:37.717499 13030 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.797766  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:37.802021  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.854051  7328 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:37.807582  7255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2092) took 3982 ms (client timeout 1753 ms). Trace:
I20260709 13:15:37.822576  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.787567  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1145) took 1190 ms. Trace:
I20260709 13:15:37.825502  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 807) took 1232 ms. Trace:
I20260709 13:15:37.739202 12903 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:37.738798 13033 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:37.761070 12914 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:37.712901 12995 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.123s
I20260709 13:15:37.761901 12766 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:37.767755  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 906) took 1073 ms. Trace:
I20260709 13:15:37.855176  7260 rpcz_store.cc:276] 0709 13:15:36.596863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.601307 (+  4444us) service_pool.cc:224] Handling call
0709 13:15:37.787295 (+1185988us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54002d4454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:37.787488 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658301184}
I20260709 13:15:37.734208 13116 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.857313  7254 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:37.857210  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2138) took 1180 ms. Trace:
I20260709 13:15:37.855315  7889 rpcz_store.cc:276] 0709 13:15:36.593051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.594733 (+  1682us) service_pool.cc:224] Handling call
0709 13:15:36.595062 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.111110 (+516048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.825218 (+714108us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b540043a154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:37.825435 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969034112}
I20260709 13:15:37.913655  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:37.913893  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.769692  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.914660  7254 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:37.914415  7260 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:37.913399  7335 rpcz_store.cc:276] 0709 13:15:36.676699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.677540 (+   841us) service_pool.cc:224] Handling call
0709 13:15:36.682693 (+  5153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.208596 (+525903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.856835 (+648239us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540031a6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:37.857130 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922671488}
I20260709 13:15:37.833930 12981 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.844136 12704 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:37.903339  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.829349  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:37.872893  7887 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:37.760517 13003 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:37.840129 12987 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:37.911129  7336 rpcz_store.cc:276] 0709 13:15:36.693929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.694096 (+   167us) service_pool.cc:224] Handling call
0709 13:15:37.767433 (+1073337us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b540016c1d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:37.767666 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489546624}
I20260709 13:15:37.949347  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:37.844691 12971 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:15:37.854899  7255 rpcz_store.cc:269] 0709 13:15:33.825792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.904578 (+ 78786us) service_pool.cc:224] Handling call
0709 13:15:37.807241 (+3902663us) spinlock_profiling.cc:243] Waited 3.41 s on lock 0x7b54002265d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:37.807435 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7849041664}
I20260709 13:15:37.948616  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:37.831295 12840 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:38.012008  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 182700us
I20260709 13:15:38.013615  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:37.998437  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.016675  7335 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:37.969280  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:37.903892 13122 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:15:38.015424  7892 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:38.019332  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.027199  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:37.839371 12881 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:38.033701  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.027382  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:37.852428 13124 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:38.028321  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.038101  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.029026  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:38.040834  7183 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:38.007087  7328 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:38.034684  7181 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:37.857091 13038 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:38.060454  7258 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:37.902860 12986 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:38.057062  7260 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:38.050351  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:37.900528 12977 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:37.919085 12915 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.068897  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.010460 12914 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:38.009981 12704 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:38.063110  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.077375  7255 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 12: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:38.065193  7183 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:15:38.063910  7331 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [15.9-17.10]
W20260709 13:15:38.066599  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.969895 13080 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:37.919560 12968 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.086409 12996 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:38.048571 13120 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:15:38.015717 12971 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:38.034655 13085 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:15:38.073081  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:38.097254  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.074397  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.017930 13131 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:38.080183  7254 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:38.062357 12840 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:38.106237  7260 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:38.082111 12662 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:38.068650 12470 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:15:38.035002 12858 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:38.134047  7335 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:15:38.076779 12570 raft_consensus.cc:993] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower efc9ee9e1d86480790fa83f6ad0c295c to start an election
I20260709 13:15:38.073253 13079 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.084587 12766 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.072428 12977 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:37.909356 13033 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:38.120029 13121 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.280s	user 0.000s	sys 0.000s
I20260709 13:15:38.060783 12987 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:38.048681 13124 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:38.031077 13128 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:37.916608 13116 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:38.076673 13117 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
I20260709 13:15:38.111632 13134 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:38.095410 13080 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:38.120579 13127 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:15:38.113727  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.117977 12884 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.171358 12884 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:38.172315 13096 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.000s
I20260709 13:15:38.172590  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:38.172758 13096 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.173566 12884 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.173853  7187 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:38.174899  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1152) took 1497 ms. Trace:
I20260709 13:15:38.175318  7261 rpcz_store.cc:276] 0709 13:15:36.677753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.677959 (+   206us) service_pool.cc:224] Handling call
0709 13:15:36.678318 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.522292 (+843974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.174640 (+652348us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b540009abd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:38.174839 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820022656}
I20260709 13:15:38.176657  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:38.081979  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 341605us
I20260709 13:15:38.177980  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:38.110900  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.069167 13038 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.075126 12986 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:38.092327  7859 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.540s (SENT) [suppressed 21 similar messages]
I20260709 13:15:38.080068 12915 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:38.119050 12662 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.196466  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:38.197197  7256 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:15:38.139096 13126 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:15:38.198957 12469 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:38.200553 12662 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:38.162896  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.164484 12981 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.109781 12971 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.164997 13139 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:38.166050 12976 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 13:15:38.169754 13073 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.108130 13131 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:38.290591 12757 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 13:15:38.114248 12840 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.104780 12995 raft_consensus.cc:2764] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:15:38.178004  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.121383 13074 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:38.184275  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:38.187165  7261 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:38.147105 12858 raft_consensus.cc:1081] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Signalling peer efc9ee9e1d86480790fa83f6ad0c295c to start an election
W20260709 13:15:38.293345 12936 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.040s	user 0.008s	sys 0.005s
W20260709 13:15:38.195312 13130 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:15:38.110400  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:38.297981  7255 raft_consensus.cc:2410] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:15:38.289292 12981 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:38.147548 13124 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:38.198372 13080 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:38.256630 13126 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:15:38.267596 13136 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:15:38.256232 13121 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:15:38.256968 13129 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
I20260709 13:15:38.158926 13071 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.268599  7258 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:38.170049 13039 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:38.173213  7254 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:38.189050 12291 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:38.144718 13079 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.339112 12291 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:38.215091 12996 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.164991 12977 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:38.299248  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.341356  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.287283 13144 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.287375 13113 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.305655  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.346833  7261 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:38.343242 12609 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:38.347765  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:38.348346  7261 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:38.303884  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 119684us
I20260709 13:15:38.273259  7256 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:38.349858  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:38.350106  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:38.293583 13030 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.357333 12291 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.357925  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:38.357364  7861 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:38.295343 12071 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:38.308241 12936 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.179750 13134 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.346240 12996 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.312079  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:38.295881 13073 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:38.315330 12840 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.309487 13074 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.306268 13137 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:38.323691 13131 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.324503  7327 raft_consensus.cc:2889] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:38.324738 13138 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:15:38.325770 13032 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:38.327913  7330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 907) took 1565 ms (client timeout 2025 ms). Trace:
W20260709 13:15:38.377885  7330 rpcz_store.cc:269] 0709 13:15:36.762378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.762538 (+   160us) service_pool.cc:224] Handling call
0709 13:15:38.327681 (+1565143us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b540038d6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:38.327840 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633579264}
I20260709 13:15:38.330538 13096 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:38.333659  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 240756us
I20260709 13:15:38.386055  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:38.386735  7895 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:38.389550  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.390218  7330 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:38.394315  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:38.395591  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.396867  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.374838 13073 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:38.334092  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.404695 13077 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:38.404929 13073 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.405872 13033 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.308434 12971 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:38.343693  7254 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:38.411588  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.351076  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:38.351445 12609 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.355567  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:38.414817  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63814.2us
I20260709 13:15:38.415608  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:38.355942 13113 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.360857  7861 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:38.419775  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 58993.6us
I20260709 13:15:38.300405 13003 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.362257  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:38.363868 12470 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:38.368882  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3338) took 1176 ms. Trace:
I20260709 13:15:38.367600  7261 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:38.426066  7260 rpcz_store.cc:276] 0709 13:15:37.192474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.311812 (+1119338us) service_pool.cc:224] Handling call
0709 13:15:38.368778 (+ 56966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.369316  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.347815 13144 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.429015 12609 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.429891 13144 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.362063 13069 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:38.375775 13074 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.296921 13139 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.360379 12766 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:38.368534 12896 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.727s	user 0.006s	sys 0.006s
I20260709 13:15:38.432418  7332 raft_consensus.cc:606] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:38.432792  7332 raft_consensus.cc:614] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:38.378780  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2218) took 1079 ms. Trace:
I20260709 13:15:38.433002 12470 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:38.379731 12762 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.433593 12470 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:38.433902 12762 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:38.433259  7327 rpcz_store.cc:276] 0709 13:15:37.299875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.300286 (+   411us) service_pool.cc:224] Handling call
0709 13:15:37.360684 (+ 60398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.324422 (+963738us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b4c000bc040. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7508a20 00007fece7519a29 00007fece74df644 00007fece7506f2d 00007fece7506b93 00007fece923718b 00007fece9237cb5 00007fece9246fde 00007fece92467bf 00007fece925881f 00007fece92587b8
0709 13:15:38.378484 (+ 54062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.378727 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45179136}
I20260709 13:15:38.347355 13070 ts_tablet_manager.cc:1929] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 13:15:38.439013 13070 log.cc:1199] T 242a63190870450082200759c7f513ab P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Deleting WAL directory at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/wals/242a63190870450082200759c7f513ab
I20260709 13:15:38.440447 13070 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47650 (request call id 0) took 3529 ms. Trace:
I20260709 13:15:38.440817 13070 rpcz_store.cc:276] 0709 13:15:34.919329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.987878 (+ 68549us) service_pool.cc:224] Handling call
0709 13:15:36.152718 (+1164840us) ts_tablet_manager.cc:1151] Deleting tablet 242a63190870450082200759c7f513ab
0709 13:15:36.152816 (+    98us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:15:38.197438 (+2044622us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:38.342701 (+145263us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:38.440338 (+ 97637us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":340380,"tablet-delete.queue_time_us":916871,"thread_start_us":829076,"threads_started":1}
I20260709 13:15:38.407397  7335 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:15:38.375110 13116 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:38.442886 12987 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.443552 12987 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.450793  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3332) took 1267 ms. Trace:
I20260709 13:15:38.451433  7255 rpcz_store.cc:276] 0709 13:15:37.183047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.110620 (+927573us) service_pool.cc:224] Handling call
0709 13:15:38.450475 (+339855us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54001a2a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:38.450701 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272702848}
I20260709 13:15:38.454329 13069 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:38.455507 13069 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:38.455868 13069 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:38.456756 13069 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.458282 13069 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:38.459015 13042 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.460145 13042 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:38.422574 13096 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:38.425588 13131 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:38.464206 13131 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:38.465143 13131 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.465667 12735 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:38.466096 12735 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:38.467005 12735 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.468035 13139 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.468266 12735 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:38.425841 13079 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.444967  7335 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:15:38.425769 12874 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:38.470527 13146 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:15:38.475471 12903 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.559s	user 0.013s	sys 0.000s
I20260709 13:15:38.475961 12903 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.477026  7178 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:38.478999 12903 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.480320 12996 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.412309  7330 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:38.418553  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.420091  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:38.423511  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 61362.4us
I20260709 13:15:38.312824 12981 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.426842  7256 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:38.427994  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:38.377506 13038 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.442704  7072 catalog_manager.cc:5028] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): tablet 242a63190870450082200759c7f513ab (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
W20260709 13:15:38.598119  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 178091us
W20260709 13:15:38.599249  7072 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 156687us
I20260709 13:15:38.599280  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.599455  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:38.599756  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.597795  7261 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:38.600704  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:38.601480  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:38.603296  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:38.483350  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.606026  7260 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:38.483351  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:38.508826  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:38.606581  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 71660.4us
I20260709 13:15:38.608930  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:38.610033  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 927021us
W20260709 13:15:38.499683 13125 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 13:15:38.618366  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:38.615403  7254 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:38.612834 13139 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:38.617087  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:38.622394  7256 raft_consensus.cc:2368] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15.
I20260709 13:15:38.617491 12071 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:38.626889  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:38.481822 12936 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.636816  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:38.637090  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1157) took 1425 ms. Trace:
I20260709 13:15:38.637533  7256 rpcz_store.cc:276] 0709 13:15:37.211928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.623046 (+1411118us) service_pool.cc:224] Handling call
0709 13:15:38.636504 (+ 13458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.636709 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.636740 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.636785 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:38.636819 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.636876 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.637032 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.638938 12874 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:38.639523 12874 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.598021 12986 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.500383  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3333) took 1317 ms. Trace:
W20260709 13:15:38.488864  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.512104  7336 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:15:38.508703  7333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 904) took 1850 ms (client timeout 1550 ms). Trace:
I20260709 13:15:38.620855  7150 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:38.650063  7333 rpcz_store.cc:269] 0709 13:15:36.658249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.658361 (+   112us) service_pool.cc:224] Handling call
0709 13:15:38.508514 (+1850153us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b5400253854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:38.508621 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858464128}
I20260709 13:15:38.499842  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1156) took 1587 ms. Trace:
I20260709 13:15:38.650950  7150 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:38.652446  7150 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:38.539924  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.641759  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:38.617092 12900 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:38.611233  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 102500us
W20260709 13:15:38.501134 13142 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:15:38.628751  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:38.662560  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:38.629400  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.671278  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.633908  7262 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:38.452491 13113 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.634656  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.640686  7260 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:38.619856  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3331) took 1437 ms. Trace:
I20260709 13:15:38.640986  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.610213 12903 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:38.644218  7895 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
W20260709 13:15:38.697377  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.680558  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.648985  7261 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:15:38.613534 12889 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:38.648429  7253 rpcz_store.cc:276] 0709 13:15:37.183316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.233065 (+ 49749us) service_pool.cc:224] Handling call
0709 13:15:38.500219 (+1267154us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54002279d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:38.500327 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327284992}
I20260709 13:15:38.655921  7150 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:38.442919 13137 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:38.526104  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.657590  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.651273  7259 rpcz_store.cc:276] 0709 13:15:36.912333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.912601 (+   268us) service_pool.cc:224] Handling call
0709 13:15:36.913089 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.913483 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:37.215401 (+301918us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.456946 (+241545us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.458173 (+  1227us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.565098 (+106925us) log.cc:844] Serialized 26 byte log entry
0709 13:15:37.565378 (+   280us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:37.565803 (+   425us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.579873 (+ 14070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.579971 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:37.814588 (+234617us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b1800405ca0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:37.858136 (+ 43548us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b1800405ca0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:38.445919 (+587783us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b1800405ca0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:38.499594 (+ 53675us) raft_consensus.cc:1685] finished
0709 13:15:38.499621 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.499785 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6607,"prepare.queue_time_us":443388,"prepare.run_cpu_time_us":191,"prepare.run_wall_time_us":13511,"raft.queue_time_us":23278,"raft.run_cpu_time_us":439,"raft.run_wall_time_us":29902,"spinlock_wait_cycles":110646656,"thread_start_us":533889,"threads_started":2,"wal-append.queue_time_us":496965}
I20260709 13:15:38.647773 12968 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:38.622907 13042 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:15:38.426964 13033 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:38.614437 13063 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:38.613423 13039 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:38.750070  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:38.750991  7181 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:38.659497 13003 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:38.664062  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:38.698396  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3335) took 1514 ms. Trace:
I20260709 13:15:38.699244  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.753866  7333 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 13: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:38.754297  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 90325.8us
I20260709 13:15:38.753489  7260 rpcz_store.cc:276] 0709 13:15:37.183912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.615466 (+1431554us) service_pool.cc:224] Handling call
0709 13:15:38.636063 (+ 20597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.698059 (+ 61996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.698334 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.656677 13074 raft_consensus.cc:2764] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:15:38.641958 13139 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:38.660351 13069 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.654824 12936 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.656085 12766 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:38.732366  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1160) took 1516 ms. Trace:
I20260709 13:15:38.763973  7253 rpcz_store.cc:276] 0709 13:15:37.216364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.720792 (+1504428us) service_pool.cc:224] Handling call
0709 13:15:38.731766 (+ 10974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.731982 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.732007 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.732050 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:38.732080 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.732133 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.732282 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.720623  7183 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:38.766027  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.698776  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3336) took 1514 ms. Trace:
I20260709 13:15:38.711922  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.697055  7254 rpcz_store.cc:276] 0709 13:15:37.182751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.614847 (+1432096us) service_pool.cc:224] Handling call
0709 13:15:38.615219 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.619596 (+  4377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.619796 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.768862  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.656206 12759 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:38.727689  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 71825.3us
I20260709 13:15:38.735622  7335 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:38.699627 13116 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:38.781737 13116 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:38.740965  7330 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:38.699461 12996 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:38.660673 13123 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:38.699733 12988 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:38.775200  7254 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:38.775580  7261 rpcz_store.cc:276] 0709 13:15:37.184532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.427744 (+1243212us) service_pool.cc:224] Handling call
0709 13:15:38.698706 (+270962us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.776254  7183 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:38.776684  7253 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:38.671403 12976 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 13:15:38.675784 13024 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:38.779619  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.734921 13113 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:38.785046  7262 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:15:38.786351  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:38.823829  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:38.759181 13038 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:38.762231 12858 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:38.759406 12889 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:38.784425  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:38.836628  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:38.837499  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:38.837859  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 177510us
I20260709 13:15:38.763805 12968 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:38.802191  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2111) took 1550 ms. Trace:
I20260709 13:15:38.840606  7253 rpcz_store.cc:276] 0709 13:15:37.251744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.765071 (+1513327us) service_pool.cc:224] Handling call
0709 13:15:38.776506 (+ 11435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.801912 (+ 25406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.802123 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:38.809317  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.810577  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2130) took 1516 ms. Trace:
I20260709 13:15:38.842549  7254 rpcz_store.cc:276] 0709 13:15:37.294320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.767637 (+1473317us) service_pool.cc:224] Handling call
0709 13:15:38.775016 (+  7379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.800178 (+ 25162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.810515 (+ 10337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.844172  7254 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:38.844897  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1162) took 1448 ms. Trace:
I20260709 13:15:38.845288  7254 rpcz_store.cc:276] 0709 13:15:37.396744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.843560 (+1446816us) service_pool.cc:224] Handling call
0709 13:15:38.843932 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.844619 (+   687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.844829 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.671350 12900 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.815528  7333 raft_consensus.cc:2410] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 18 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:15:38.816082  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.850347  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3343) took 1369 ms. Trace:
W20260709 13:15:38.814054  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 152233us
I20260709 13:15:38.824415  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:38.832254  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:38.796170  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:38.853103  7895 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
W20260709 13:15:38.838958  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 57906.9us
I20260709 13:15:38.839260  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:38.779018 12936 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.828244 13030 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:38.788477 13039 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:15:38.810185 12988 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.796977 12986 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:15:38.852394  7893 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:38.768968 13069 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:38.840015 12704 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.000s
I20260709 13:15:38.827775 13038 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.862854  7328 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:38.811247 13073 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.789237 12759 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.837894 13096 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:38.812633 12840 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:15:38.810815 13079 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:15:38.868993 12988 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:38.859933 13032 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:38.848574 12858 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:38.861991 13101 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:38.878746 13038 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:38.879137 12981 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.869959 12919 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:15:38.823439 13139 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:38.887023 13148 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:15:38.886572 13032 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.898880 13032 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:38.900547 12892 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:38.900974 12892 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:38.902560 13134 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.904738 12915 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.897176 12968 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:38.906168 13077 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.005s
I20260709 13:15:38.906693 13144 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.907217 13144 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.909138 12900 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.909934 13144 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.910555 12936 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:38.881771 13073 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.920640 13123 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:38.920219 12892 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:38.924798 12892 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:38.925879 13038 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.928872 13069 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.893548 12889 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.894040 12874 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:38.884764 13116 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.923247 13032 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.936195 13032 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.930747 12988 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.946517 13038 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.946549 12988 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.949280 13003 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:38.949967 13124 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.001s
I20260709 13:15:38.951046 13124 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:38.953796 13124 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:38.988057  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.818305  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.995055  7186 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:38.994804  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.996372  7182 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:38.996527  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:38.997081  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.993932  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:38.998822  7179 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:38.999392  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:38.999667  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.000277  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.002136  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.002542  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.002869  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.003080  7179 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:39.004148  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.006807  7187 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:38.854514  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:38.849740  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1161) took 1472 ms. Trace:
I20260709 13:15:39.039145  7253 rpcz_store.cc:276] 0709 13:15:37.377534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.841669 (+1464135us) service_pool.cc:224] Handling call
0709 13:15:38.849054 (+  7385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.849312 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.849351 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.849408 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:38.849455 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.849527 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.849665 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:39.041155  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 186606us
I20260709 13:15:39.041894  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:38.850929  7254 rpcz_store.cc:276] 0709 13:15:37.478395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.846171 (+1367776us) service_pool.cc:224] Handling call
0709 13:15:38.846548 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.846933 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.846991 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.847044 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:38.847088 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.847168 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.847571 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.840126  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2110) took 1588 ms. Trace:
I20260709 13:15:39.043965 13077 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:38.869827  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:39.047729  7333 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
W20260709 13:15:38.865782  7334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 902) took 2213 ms (client timeout 1540 ms). Trace:
W20260709 13:15:39.051158  7334 rpcz_store.cc:269] 0709 13:15:36.648986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.649676 (+   690us) service_pool.cc:224] Handling call
0709 13:15:38.862186 (+2212510us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b5400421b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:38.862332 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972750208}
I20260709 13:15:38.878527 12704 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:39.053785  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:38.874950  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:38.877103  7896 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:38.865479 12291 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:39.066411 12291 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.073688 12759 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:38.881819 12470 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:39.087340  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.088305  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56808 (request call id 44) took 1844 ms. Trace:
I20260709 13:15:39.088402  7179 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:39.089286 12470 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:39.024261  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 911) took 1381 ms. Trace:
I20260709 13:15:39.090998  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2222) took 1781 ms. Trace:
I20260709 13:15:39.091511  7336 rpcz_store.cc:276] 0709 13:15:37.309278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.020320 (+711042us) service_pool.cc:224] Handling call
0709 13:15:38.511774 (+491454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.649641 (+137867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.090490 (+440849us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400253850. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:39.090783 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1129380608}
I20260709 13:15:39.092164  7253 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:39.093732  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:39.095233  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.044001  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:39.098320  7254 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:39.099730  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:39.100822  7254 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:39.102847 12903 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:39.063709  7225 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:39.106106 13038 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:39.107003  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 116862us
I20260709 13:15:39.109483  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 941) took 1650 ms. Trace:
W20260709 13:15:39.106479  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 63862.1us
I20260709 13:15:39.109974  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:39.111930 12976 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:39.113139 12976 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.113986 12976 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:39.035306  7894 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:39.036540 12858 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.050091  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:39.055039 12840 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:39.044440  7259 rpcz_store.cc:276] 0709 13:15:37.251316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.721720 (+1470404us) service_pool.cc:224] Handling call
0709 13:15:38.722067 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.725718 (+  3651us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:38.726272 (+   554us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.830533 (+104261us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.836053 (+  5520us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.836111 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:38.836156 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.839938 (+  3782us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.840067 (+   129us) inbound_call.cc:177] Queueing success response
0709 13:15:38.937805 (+ 97738us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b18000241c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
Metrics: {"mutex_wait_us":5122,"prepare.queue_time_us":5532,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2068,"raft.queue_time_us":13766,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":15235,"spinlock_wait_cycles":13177344,"thread_start_us":103430,"threads_started":1,"wal-append.queue_time_us":166881}
I20260709 13:15:39.059209  7334 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:39.074978  7889 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:39.021893  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2133) took 1653 ms. Trace:
I20260709 13:15:39.077409  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:39.079025 12892 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:39.112627  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:39.081938  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.083102  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2144) took 1612 ms. Trace:
I20260709 13:15:39.085160  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:39.107880  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 937) took 1802 ms. Trace:
I20260709 13:15:39.070478 12291 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:39.114331  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:39.054855 13069 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:39.106067  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:39.109978  7892 rpcz_store.cc:276] 0709 13:15:37.459250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.459426 (+   176us) service_pool.cc:224] Handling call
0709 13:15:37.462838 (+  3412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.032535 (+569697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.108891 (+1076356us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b540049cd54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:39.109291 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1270072064}
I20260709 13:15:39.088946  7332 rpcz_store.cc:276] 0709 13:15:37.244207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.246789 (+  2582us) service_pool.cc:224] Handling call
0709 13:15:39.087760 (+1840971us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540038c7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9236853 00007fecee20460a 00007fece778a7d4 00007fece778a762 00007fece778a691 00007fece778a60c 00007fece77898c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:39.088021 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2724090752}
I20260709 13:15:39.125870 12884 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:39.090276  7327 rpcz_store.cc:276] 0709 13:15:37.643065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.436687 (+793622us) service_pool.cc:224] Handling call
0709 13:15:38.437012 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.437389 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.437419 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:38.437857 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:15:38.720392 (+282535us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:38.720432 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.720492 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.023566 (+303074us) raft_consensus.cc:1685] finished
0709 13:15:39.023612 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.023958 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1140,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":282162,"threads_started":1,"wal-append.queue_time_us":385926}
I20260709 13:15:39.129225  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:39.131377  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.133616  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3346) took 1561 ms. Trace:
I20260709 13:15:39.141202 12840 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:39.142431  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:39.119047  7261 rpcz_store.cc:276] 0709 13:15:37.368227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.800721 (+1432494us) service_pool.cc:224] Handling call
0709 13:15:38.801116 (+   395us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:15:38.811923 (+ 10807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.811981 (+    58us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:15:38.832619 (+ 20638us) log.cc:844] Serialized 104 byte log entry
0709 13:15:39.019200 (+186581us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:39.020254 (+  1054us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.020783 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.021032 (+   249us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.021136 (+   104us) raft_consensus.cc:1685] finished
0709 13:15:39.021157 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.021504 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11569,"prepare.queue_time_us":35353,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":89,"raft.queue_time_us":23826,"raft.run_cpu_time_us":552,"raft.run_wall_time_us":3583,"spinlock_wait_cycles":212864,"thread_start_us":170460,"threads_started":1,"wal-append.queue_time_us":64865}
I20260709 13:15:39.143863  7333 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:39.140659  7259 rpcz_store.cc:276] 0709 13:15:37.571747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.132277 (+1560530us) service_pool.cc:224] Handling call
0709 13:15:39.132765 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.133189 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.133221 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.133287 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:39.133323 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.133382 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.133517 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:39.143949  7890 raft_consensus.cc:2368] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14.
I20260709 13:15:39.145339  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:39.151934  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:39.152221  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:39.152711 12840 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:39.121615  7891 rpcz_store.cc:276] 0709 13:15:37.305124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.305955 (+   831us) service_pool.cc:224] Handling call
0709 13:15:37.362404 (+ 56449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.739497 (+377093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.107139 (+1367642us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54006608d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:39.107656 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808781056}
I20260709 13:15:39.153786 12912 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:39.153947  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:39.154311 12912 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:39.154872 12912 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:39.145357 13069 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.155447 13038 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:39.155970 13137 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:15:39.156101  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 43752.7us
I20260709 13:15:39.156492 13137 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:39.158213 13069 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:39.142567  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:39.144399  7330 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:39.120782  7328 rpcz_store.cc:276] 0709 13:15:37.470760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.060892 (+590132us) service_pool.cc:224] Handling call
0709 13:15:38.862610 (+801718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.876668 (+ 14058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.082672 (+206004us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b5400421b50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:39.082914 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842973056}
W20260709 13:15:39.163772  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 110221us
I20260709 13:15:39.165774  7889 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:39.167038  7891 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:39.110906  7257 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:39.079104 12704 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:39.136920 12884 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:39.155987 13038 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.176932 13038 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:39.174602  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:39.169920 12291 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:39.181684  7892 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:39.181867  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1108) took 1477 ms. Trace:
I20260709 13:15:39.182610  7178 rpcz_store.cc:276] 0709 13:15:37.689867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.690015 (+   148us) service_pool.cc:224] Handling call
0709 13:15:37.690341 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.477448 (+787107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.160424 (+682976us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b5400248454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:39.167413 (+  6989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808724736}
I20260709 13:15:39.183595  7330 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:39.158555 13137 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:39.185292 12840 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:39.186507 13137 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:39.186275 12840 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.189898 12840 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:39.178499  7336 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:15:39.184945  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.181072 12291 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.203063  7893 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:39.205272  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:39.211337 12662 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.010s	user 0.006s	sys 0.019s
I20260709 13:15:39.212242 12662 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:39.216476  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.219038  7261 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:39.204321  7187 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:39.221796  7260 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:15:39.227052  7333 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:39.227205  7892 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:15:39.230075  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3347) took 1648 ms. Trace:
I20260709 13:15:39.238106  7259 rpcz_store.cc:276] 0709 13:15:37.581497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.170659 (+1589162us) service_pool.cc:224] Handling call
0709 13:15:39.206079 (+ 35420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.229636 (+ 23557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.229668 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.229720 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:39.229773 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.229841 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.229978 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:39.205929 13069 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:15:39.206761 12291 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:39.242372  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3348) took 1656 ms. Trace:
I20260709 13:15:39.242883  7261 rpcz_store.cc:276] 0709 13:15:37.581806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.205650 (+1623844us) service_pool.cc:224] Handling call
0709 13:15:39.218687 (+ 13037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.237681 (+ 18994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.237892 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:39.241074  7178 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:15:39.251678  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:39.252497  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3354) took 1108 ms. Trace:
I20260709 13:15:39.252905  7262 rpcz_store.cc:276] 0709 13:15:38.143791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.355307 (+211516us) service_pool.cc:224] Handling call
0709 13:15:39.252176 (+896869us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54002d3554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:39.252324 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504130304}
W20260709 13:15:39.254508 12735 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.786s	user 0.014s	sys 0.010s
I20260709 13:15:39.251579  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:39.277048  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3345) took 1715 ms. Trace:
I20260709 13:15:39.281780  7887 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:39.281708  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:15:39.282997  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 92552.3us
I20260709 13:15:39.286973 12704 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:39.288931 12884 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:39.292590  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:39.293426  7334 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:15:39.295073  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:39.295234  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:39.293298  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:39.280081  7254 rpcz_store.cc:276] 0709 13:15:37.561839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.102052 (+1540213us) service_pool.cc:224] Handling call
0709 13:15:39.116879 (+ 14827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.248647 (+131768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.248681 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.276687 (+ 28006us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:39.276733 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.276799 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.276983 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50592}
I20260709 13:15:39.297698  7333 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:39.306171  7335 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 19: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:39.308211  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:39.307229 12735 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:39.310153 12735 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.310588 12735 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:39.312783  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:39.323761 12884 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:39.325024  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 73770.4us
I20260709 13:15:39.325897 13104 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:39.304610  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3344) took 1819 ms. Trace:
I20260709 13:15:39.328226 13033 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.327591  7259 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:39.322039 12976 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.329605  7328 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:39.327591 13073 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:39.337873  7333 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:39.341277  7334 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
W20260709 13:15:39.341666  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 65129.3us
W20260709 13:15:39.345857  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 191272us
I20260709 13:15:39.286209 12912 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.346418  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2135) took 1648 ms. Trace:
I20260709 13:15:39.305244 12892 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:39.347055  7259 rpcz_store.cc:276] 0709 13:15:37.698284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.260454 (+1562170us) service_pool.cc:224] Handling call
0709 13:15:39.327325 (+ 66871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.346042 (+ 18717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.346344 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:39.352274 13139 consensus_queue.cc:1059] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:39.354925  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:39.355387  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.356099  7331 raft_consensus.cc:2368] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16.
I20260709 13:15:39.358599 13038 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:39.368017  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:39.369323  7330 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
W20260709 13:15:39.371219  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.371958 13033 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.372740 12912 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:39.374590 13037 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:39.375232 13037 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:39.378005 12840 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.378857 12840 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:39.379231  7257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3324) took 2288 ms (client timeout 1876 ms). Trace:
W20260709 13:15:39.379860  7257 rpcz_store.cc:269] 0709 13:15:37.091221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.091931 (+   710us) service_pool.cc:224] Handling call
0709 13:15:39.378868 (+2286937us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400058554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:39.379099 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4097620864}
I20260709 13:15:39.381371  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:39.385339  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:39.393981  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:39.386368  7336 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:39.394310  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2132) took 2068 ms. Trace:
I20260709 13:15:39.362231 13038 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:39.396996  7260 rpcz_store.cc:276] 0709 13:15:37.325520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.779294 (+1453774us) service_pool.cc:224] Handling call
0709 13:15:38.813247 (+ 33953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.279199 (+465952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.393983 (+114784us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400349ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:39.394227 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935125760}
W20260709 13:15:39.403784  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 52044.9us
I20260709 13:15:39.406431 12609 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:39.407032 12609 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:39.407007  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:39.408761  7257 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:39.408236 12609 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.409526 12609 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:39.336010  7253 rpcz_store.cc:276] 0709 13:15:37.485044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.093505 (+1608461us) service_pool.cc:224] Handling call
0709 13:15:39.094067 (+   562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.101525 (+  7458us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:15:39.112229 (+ 10704us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.304243 (+192014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.304297 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:39.304342 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.304410 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.304536 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47426,"prepare.queue_time_us":1756,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":55531,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9172,"thread_start_us":81085,"threads_started":1}
I20260709 13:15:39.412406  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:39.420873  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:39.381376 12840 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:39.425876  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:39.426589  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.400031 13033 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:39.431072  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:39.431725  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:39.437423  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.413746 13073 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:39.445827  7180 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
I20260709 13:15:39.455492  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:39.457470  7260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:55506
I20260709 13:15:39.458321  7260 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:39.458753  7260 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:39.460709  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:39.465673  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:39.438727 12892 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:15:39.473163  7889 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:39.478982  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:39.479561 13038 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.466233 13139 consensus_queue.cc:1243] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:15:39.480270  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:39.480816 13139 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:39.480372 13038 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.481236 13139 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:39.483309 13038 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:39.483805 12892 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:39.484158 12840 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:39.485065 12840 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:39.485489 12840 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:39.486809  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 84036.8us
I20260709 13:15:39.487673  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:39.484238 12892 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.488517  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:39.488968 12892 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:39.489979  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:39.488409  7329 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:39.491945 12976 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:39.477931  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.494170  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:39.510881  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.479933  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:39.487792 12840 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.537950  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:39.538172  7328 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
W20260709 13:15:39.545220  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65419.7us
I20260709 13:15:39.537092  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:39.549813  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55757us
I20260709 13:15:39.551127  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:39.552413 13123 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:39.553313 13003 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:39.554184 13003 consensus_queue.cc:1243] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:39.533196 13104 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:15:39.554683  7184 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:15:39.557628 13073 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:39.558238 13073 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.559712  7253 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:15:39.577661  7253 pending_rounds.cc:85] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 8
I20260709 13:15:39.578063  7253 pending_rounds.cc:107] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:15:39.578459  7253 raft_consensus.cc:2889] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:39.560400 12913 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:39.564956 13038 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.568809 13003 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:39.569257  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.554605 13123 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:39.482470 13139 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.574373 13073 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:39.603399  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:39.612479  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.615238  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.615679  7889 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:39.600632 12704 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:39.614928  7182 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:39.612803  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:39.618527  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.591672 13123 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:39.628808  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 98273.6us
I20260709 13:15:39.605224  7329 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:39.593668 13038 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:39.648805  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1164) took 1836 ms. Trace:
I20260709 13:15:39.609694 12912 consensus_queue.cc:1059] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:15:39.649415  7257 rpcz_store.cc:276] 0709 13:15:37.812372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.409509 (+1597137us) service_pool.cc:224] Handling call
0709 13:15:39.409986 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.410331 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:39.413992 (+  3661us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.648320 (+234328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.648381 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:39.648427 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.648592 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.648738 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":164,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":80,"raft.queue_time_us":109,"thread_start_us":177593,"threads_started":1}
I20260709 13:15:39.652310  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:39.635533  7253 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:39.663878  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.666080  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.660933  7184 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:39.677418  7179 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:39.680330 12988 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:15:39.680920 13176 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:15:39.682746 12977 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:39.683782 13124 raft_consensus.cc:1064] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:15:39.683583 12977 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.684273  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1159) took 2468 ms. Trace:
I20260709 13:15:39.684720  7256 rpcz_store.cc:276] 0709 13:15:37.215931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.638560 (+1422629us) service_pool.cc:224] Handling call
0709 13:15:39.660551 (+1021991us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b5800003098. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:15:39.683406 (+ 22855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.683792 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.683819 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.683865 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:15:39.683893 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.683956 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.684105 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12353280}
I20260709 13:15:39.685561 13160 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:15:39.686137 12889 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:39.672158  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:39.695674  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:39.703181  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:39.686507 13160 consensus_queue.cc:1243] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:15:39.706262  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 164132us
W20260709 13:15:39.714968  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 70326.6us
I20260709 13:15:39.690339 13104 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.686388 13124 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:39.716436  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 147484us
I20260709 13:15:39.723416  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:39.726589  7179 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:39.729353  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 118297us
I20260709 13:15:39.712611 12858 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:39.694811 12291 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.742396  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:39.744653  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:39.746822  7185 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:39.749079  7257 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:39.739181 12762 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:39.744342 13123 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:39.741158 12858 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.765012  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:39.761355  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:39.766232  7185 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:15:39.767275  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:39.772827  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:39.735807 13104 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:39.784240 12977 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:39.784511  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:39.785864 12919 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:39.786357 12968 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:39.787177 12968 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:39.787705 12968 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:39.787619 12976 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:39.788769 12662 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:39.789122 12976 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.789597 12976 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:39.791533  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3166) took 1267 ms. Trace:
I20260709 13:15:39.792392 13181 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:39.792143  7186 rpcz_store.cc:276] 0709 13:15:38.523906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.524056 (+   150us) service_pool.cc:224] Handling call
0709 13:15:38.524310 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.995899 (+471589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.791074 (+795175us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54000eddd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:39.791438 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081141632}
I20260709 13:15:39.793325 13181 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.795001 12987 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:39.796633  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.797616  7186 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:39.786444 12919 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.764307 12858 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:39.810297 13184 consensus_queue.cc:1175] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 17 status { last_received { term: 14 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [16.9-16.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:39.813483  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:39.821671  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.824558  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3162) took 1266 ms. Trace:
I20260709 13:15:39.824888 12976 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.827790 12976 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:39.828490 12976 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:39.828881  7331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2158) took 1648 ms (client timeout 1726 ms). Trace:
I20260709 13:15:39.829084 12976 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:39.829614  7331 rpcz_store.cc:269] 0709 13:15:38.180672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.332167 (+151495us) service_pool.cc:224] Handling call
0709 13:15:39.828493 (+1496326us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b540013db54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:39.828750 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108360064}
I20260709 13:15:39.825032  7181 rpcz_store.cc:276] 0709 13:15:38.505049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.505211 (+   162us) service_pool.cc:224] Handling call
0709 13:15:38.519124 (+ 13913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.752648 (+233524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.739488 (+986840us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400247a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:39.771535 (+ 32047us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532594048}
I20260709 13:15:39.831873  7181 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:39.834728 12976 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:39.843770  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.844635  7894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 948) took 1029 ms. Trace:
I20260709 13:15:39.845047  7894 rpcz_store.cc:276] 0709 13:15:38.815174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.815741 (+   567us) service_pool.cc:224] Handling call
0709 13:15:39.844413 (+1028672us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540043b2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:39.844557 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444937984}
I20260709 13:15:39.848662 12889 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:39.849220 12889 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:39.852877 13038 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:39.853766  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:39.855125  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:39.855885  7253 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:15:39.862756 13177 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 13:15:39.863086  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:39.863493  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 58775.4us
I20260709 13:15:39.864547  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:39.865149  7259 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:39.867039  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:39.807027 12919 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:39.885147  7260 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.783237 12884 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.098s
W20260709 13:15:39.888191  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.886272  7254 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
W20260709 13:15:39.900226  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 77598.9us
I20260709 13:15:39.886808  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:39.785903 12892 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:39.892958  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:39.886679  7256 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:39.905779  7260 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:39.892812  7179 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:39.812230 13184 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:15:39.923367  7327 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:39.939661  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:39.894191 13137 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.707s	user 0.016s	sys 0.000s
I20260709 13:15:39.978578  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:55506 (request call id 3359) took 1584 ms. Trace:
I20260709 13:15:39.979212  7260 rpcz_store.cc:276] 0709 13:15:38.323827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.439561 (+1115734us) service_pool.cc:224] Handling call
0709 13:15:39.907989 (+468428us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:39.922250  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 57262.4us
I20260709 13:15:39.780742 12735 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:39.993932  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 231904us
W20260709 13:15:39.994938  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 74003.4us
I20260709 13:15:39.906821 13038 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:39.988325  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:39.999397 13178 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.205s	user 0.000s	sys 0.002s
W20260709 13:15:39.999930 13182 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
I20260709 13:15:40.035200  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:40.039294  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:40.040675  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:40.041082  7260 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 12.
W20260709 13:15:40.042784  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 257325us
I20260709 13:15:40.041576  7256 raft_consensus.cc:2376] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14. Re-sending same reply.
I20260709 13:15:40.055371  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:40.046553  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:40.060168  7260 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:40.042172 12976 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:40.066004  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:40.067266  7256 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:40.045392 12470 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:40.082175  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 86355.2us
I20260709 13:15:40.059429 12977 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:40.088124  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:40.089491  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.043522 12662 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
W20260709 13:15:40.098726  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 63668.8us
I20260709 13:15:40.064702 12291 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:40.106906  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 214009us
I20260709 13:15:40.109050  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:40.101322  7258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2119) took 2752 ms (client timeout 2134 ms). Trace:
W20260709 13:15:40.113086  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.113021  7258 rpcz_store.cc:269] 0709 13:15:37.254013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.068594 (+814581us) service_pool.cc:224] Handling call
0709 13:15:39.933233 (+1864639us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400125054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:40.005960 (+ 72727us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453188352}
I20260709 13:15:40.089002 12976 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:15:40.122340  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:40.125533  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.126971  7260 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
W20260709 13:15:40.130311  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 372613us
I20260709 13:15:40.131918  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:40.132700  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.133134  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.133452  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.136951  7887 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:15:40.140326  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:40.112385 13104 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:40.094942 12470 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.146554  7258 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:40.144133  7894 raft_consensus.cc:2368] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16.
I20260709 13:15:40.145138  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:40.135757 13038 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:15:40.163785  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 64052.4us
I20260709 13:15:40.156960  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:40.144143  7253 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:40.170320  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:40.172480  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69426.2us
I20260709 13:15:40.143488 12977 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:40.145323 12976 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:40.178561  7895 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:40.171666 12766 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.332s	user 0.010s	sys 0.013s
I20260709 13:15:40.156536 12609 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:40.144924 13197 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:40.163869 13038 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.184748  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:40.172163 13181 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:40.186187  7260 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:40.179181 12704 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:15:40.224900  7184 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.523s	user 0.003s	sys 0.006s
I20260709 13:15:40.225401  7184 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:40.192499 12766 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:40.189749 12976 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:40.228528 13179 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:15:40.230954  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1163) took 2648 ms. Trace:
I20260709 13:15:40.231827  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:40.231616 13037 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.232594  7861 leader_election.cc:400] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15.
I20260709 13:15:40.232947  7861 leader_election.cc:403] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:15:40.230805  7150 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:40.234360  7183 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:40.236261  7258 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:40.185511 12884 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:40.251665 12735 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.252601 12976 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.252667 13200 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:40.251744 13188 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.192824 12892 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:40.257947  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.231451  7262 rpcz_store.cc:276] 0709 13:15:37.582950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.253975 (+1671025us) service_pool.cc:224] Handling call
0709 13:15:39.254432 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.394955 (+140523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.394989 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.395546 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.638261 (+242715us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:39.638289 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.638342 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.230710 (+592368us) raft_consensus.cc:1685] finished
0709 13:15:40.230733 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.230882 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37784,"raft.queue_time_us":39263,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":242211,"threads_started":1,"wal-append.queue_time_us":410426}
I20260709 13:15:40.260250 13188 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.241413 12884 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.188613 13038 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:40.199481 13104 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:15:40.198983 12609 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.251741 12988 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:40.279119 12988 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.280042 12609 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.280782 12609 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:40.281329 12609 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:40.281512 12988 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.191833 13197 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:40.273635  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 84280.1us
W20260709 13:15:40.274287  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 86500.7us
W20260709 13:15:40.275768  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 87998us
I20260709 13:15:40.268788 12884 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:40.252110 13205 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:40.253386 13200 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:40.273666  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 89012.6us
I20260709 13:15:40.285822  7256 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:40.288957 13198 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:15:40.289674 13077 raft_consensus.cc:2764] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:15:40.291850  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:40.293136  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:40.271999 12704 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:40.294762 13205 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.304580 13197 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.305644 12470 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.307046  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.307274 12987 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:40.307159 12884 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.307607 12892 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:40.311424  7259 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:40.321264 13188 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.323319 13200 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.282378 12609 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.298300 12291 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:40.329727  7225 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:40.331194 12987 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:40.343271 13073 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.718s	user 0.002s	sys 0.010s
I20260709 13:15:40.338725  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.351912  7327 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:40.354516  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2175) took 1062 ms. Trace:
I20260709 13:15:40.355484  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.355533  7327 rpcz_store.cc:276] 0709 13:15:39.292400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.781148 (+488748us) service_pool.cc:224] Handling call
0709 13:15:40.354456 (+573308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:40.339296  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.359130  7331 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:40.364207 13209 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.364975 13209 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.367444 13209 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.352917 12987 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:40.372068  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.347352 13198 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:40.372251  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:40.387908  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:40.376474 12852 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:15:40.377274 13191 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:40.379940  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.355310 12892 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:40.384109  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:40.384629  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:40.386127 13205 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:40.386737 12858 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.001s
I20260709 13:15:40.387032  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.408990  7329 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:40.387849 13160 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:40.388351 13204 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.389026  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2139) took 1094 ms. Trace:
I20260709 13:15:40.389111 13200 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:40.389640 12919 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.390254 13042 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:40.376207 12704 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.392642  7333 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
W20260709 13:15:40.384308 12889 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.007s
W20260709 13:15:40.393534  7185 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.611s	user 0.008s	sys 0.002s
I20260709 13:15:40.443393  7185 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:40.396382 13191 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.360086 13073 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.397961  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:40.455350  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57550.8us
I20260709 13:15:40.456281 13073 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.457619  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:40.398291  7225 leader_election.cc:400] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14.
I20260709 13:15:40.398516 13139 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:40.458463  7225 leader_election.cc:403] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:40.459445  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 61319us
I20260709 13:15:40.460386  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:40.441754 13042 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:40.398739  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:40.462383  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:40.462991  7332 raft_consensus.cc:2376] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14. Re-sending same reply.
I20260709 13:15:40.462438 13042 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.463752 13217 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:40.464497  7896 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:40.464721 13217 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:40.465929 13217 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:40.466234 12919 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.466830 12889 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.468276 13191 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.398065 13198 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.469169 12889 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.469913 12889 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14.
I20260709 13:15:40.470878 13198 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.398989 13211 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:40.399338  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:40.396520  7887 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:40.404301  7299 leader_election.cc:400] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16.
I20260709 13:15:40.404435  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.411836  7254 rpcz_store.cc:276] 0709 13:15:39.294496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.354389 (+ 59893us) service_pool.cc:224] Handling call
0709 13:15:40.388831 (+1034442us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54002d3f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:40.388953 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859087104}
W20260709 13:15:40.412998  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 123467us
I20260709 13:15:40.421481 13212 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:15:40.411021 12858 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.422650 12892 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.423233  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:40.478245  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.478147  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55000.1us
I20260709 13:15:40.479277  7861 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:40.423874 13204 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.425782 12852 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:40.427071  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:40.427688  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:40.427752 13188 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:40.477425 12977 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:40.487707  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:40.429144  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3349) took 2847 ms. Trace:
I20260709 13:15:40.493499  7261 rpcz_store.cc:276] 0709 13:15:37.582055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.250220 (+1668165us) service_pool.cc:224] Handling call
0709 13:15:39.980110 (+729890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.052657 (+ 72547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:40.052704 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:40.052777 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:40.052828 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.052929 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.428916 (+375987us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b5400125050. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:40.429048 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494535552}
W20260709 13:15:40.429337 12968 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.001s
I20260709 13:15:40.431262 12988 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.408349 12735 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:40.434546 12913 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:40.411327 13160 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:40.396746 12884 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.430002 13038 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.443614  7895 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:40.444911 13184 raft_consensus.cc:2764] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:15:40.446987  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.509996  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:40.509984 12988 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.458039  7336 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:40.472270  7299 leader_election.cc:403] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:40.473232  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 125687us
I20260709 13:15:40.511716  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:40.512481 12988 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.512756 13220 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:40.513145 12988 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:40.513236 13220 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:40.513695 13220 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:40.485559 13124 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:40.496515 12919 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:40.477022  7894 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEARNER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:40.463809 13042 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:40.441151 13213 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:40.484308 13211 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:40.491541  7259 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:40.528198  7184 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:40.491308  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:40.470590 12889 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:15:40.463899 13104 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:15:40.500296  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.476293 13073 raft_consensus.cc:2764] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:15:40.508378  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:40.508668  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.532220  7256 raft_consensus.cc:2410] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:15:40.509183 13201 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:40.532562  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:40.505589 12913 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:40.482426  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.486850 12852 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:40.525671 13204 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:40.526690 13192 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.305s	user 0.000s	sys 0.002s
W20260709 13:15:40.527365  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 123212us
I20260709 13:15:40.528661  7184 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:40.529217  7889 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:15:40.502240 13205 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:40.539599 13195 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.539983 12766 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:40.540397 13123 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:40.540247 13195 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.529982 13213 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:40.542958  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.517707 12976 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15.
I20260709 13:15:40.530431  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:40.548245  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.502475 12968 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.549382  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:40.550211  7187 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:40.550859  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.542493 12852 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.532886 13217 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:15:40.555166 12852 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:40.557281 13204 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:40.558847  7335 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:40.558943  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:40.560433  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.561242  7185 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:40.553570 13160 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.554606 12968 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.568141 13160 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:40.552532 13205 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:40.532768 12919 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:40.587993 13205 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.589071 12919 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.568140 13195 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.568338  7184 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.565050 13201 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:40.569298 12766 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:40.565788  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:40.591167  7184 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:40.591610 13201 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.591811 12987 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:40.571139  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.571162 13191 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.579926 13218 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.580050 12858 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:40.536732 13137 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:40.594547  7180 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:40.598169  7887 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:40.599500  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:40.532428 13211 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.607753  7187 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:40.609028  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.609032  7181 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:40.538555 13124 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.622903  7184 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:15:40.628990 12903 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:15:40.629078 13073 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.629724 13073 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.606896 13077 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:40.630733 13077 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.631925 13073 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.632989 13077 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.633184  7179 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:15:40.633569  7179 pending_rounds.cc:85] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 8
I20260709 13:15:40.629323 12913 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.633659 13038 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.607277 13104 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:40.634352 12913 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:40.639816 13203 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.410s	user 0.002s	sys 0.000s
I20260709 13:15:40.640359 13124 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.615197 13137 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.642678 12889 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:40.643206  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 43746.9us
I20260709 13:15:40.643410 12889 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.644805  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:40.645922 12889 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.633807  7179 pending_rounds.cc:107] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:15:40.647069  7179 raft_consensus.cc:2889] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:40.648049 12852 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:40.649119  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.649775  7331 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:40.650275  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:40.651348  7329 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:15:40.651207 12852 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:40.652513 12852 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.653077  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:40.652593  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.656977  7327 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:40.646550  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:40.665681  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:40.666365  7332 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:40.597193 13200 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:15:40.623277 12968 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:40.675547  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:40.679661  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.679937  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.680553  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.682349  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:40.602631 13191 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.659605 12858 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.700973  7327 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:40.628362 13139 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:40.705770  7187 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:40.724102  7179 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:40.724283  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.725155  7184 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:40.678107 13104 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:40.737663  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:40.681308 13073 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.745285  7254 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:40.742552  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:40.742734  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:40.743557  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:40.743773  7330 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:40.747314  7329 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:40.747495  7179 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:40.745296  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:40.751082  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 75936.3us
I20260709 13:15:40.627185 13218 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.759896  7255 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:40.748629  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:40.766325  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:40.766692  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.767280  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:40.772104  7260 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:40.750433  7258 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:40.736958 12892 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:40.775395  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.775578  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:40.777601  7180 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:40.775979  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 106990us
I20260709 13:15:40.615382 13213 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.779624  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:40.780221  7184 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:40.742609  7257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:46710
I20260709 13:15:40.788589  7254 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:40.827531  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:40.828483 13221 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:15:40.788228 13211 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:15:40.843099  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.845429  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:40.776176 13073 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.849398 13073 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.850389 12766 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:40.788923 13038 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:15:40.852145 13199 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:40.852337 13123 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.852768 13199 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:40.852947 13123 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.854000 13218 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.854693 12892 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:40.855661 12892 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.856527  7328 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:40.859592 13191 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.860163 13191 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:40.860555  7331 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:40.860607 13191 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.756852 13124 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:40.862920 13124 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.863596 12987 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:40.748939 13139 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.867110 13139 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:40.865072 13003 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:40.868583  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 89217us
I20260709 13:15:40.870154  7262 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:40.732882 12858 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.890460  7179 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:40.749533 13160 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:15:40.936367  7180 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:40.781530 12704 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:40.939592  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:40.952261  7184 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:40.921460  7258 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
W20260709 13:15:40.942166  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 158690us
W20260709 13:15:40.942863  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.947594  7333 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:40.953636  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:40.955515  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:40.964908  7179 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:40.965526  7255 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:40.965174  7329 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:15:40.967603  7329 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:40.969322  7329 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:40.965709  7301 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:40.977748  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:40.889941 13211 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:40.947238 13123 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.986799  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1125) took 1268 ms. Trace:
I20260709 13:15:40.948496 12704 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.777433 13220 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.035455  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:41.036098  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 70468.9us
W20260709 13:15:41.038798  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.038115  7181 rpcz_store.cc:276] 0709 13:15:39.718539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.832681 (+114142us) service_pool.cc:224] Handling call
0709 13:15:39.832994 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.612517 (+779523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.978477 (+365960us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b540039cbd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:40.986703 (+  8226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762012928}
I20260709 13:15:40.936704 12912 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:15:40.854048 13199 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:40.851013 12766 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:40.947707 13139 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:40.865125 13124 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:41.045006  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 60413.9us
W20260709 13:15:41.074040  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 288496us
I20260709 13:15:40.977394 12977 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:41.079445  7332 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:41.081612  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:41.031966 13184 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:15:41.042928 13214 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:15:41.081730  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:41.046298 12852 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:41.046663 13228 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:15:41.095314  7178 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:15:41.052790 13042 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 13:15:40.958323 12762 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.119s
W20260709 13:15:41.057313 13217 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.006s
I20260709 13:15:41.047183 13131 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:15:41.059101 12704 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:41.045900 13077 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:41.071797 13191 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:40.973294 13003 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.133832  7184 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:41.134409  7184 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:41.116113  7179 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:41.113065  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.046110 12470 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:41.090969 12840 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:41.125244  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.137300  7262 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:41.140287 13220 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:41.141667 12987 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:41.142244 12987 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.142719 12987 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:41.143158 13187 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:15:41.144886  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.146796  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:41.147642  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.148231  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:41.148564  7259 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:41.149322 13160 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:41.149930  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.151099 13211 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.151723  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:41.152828  7334 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:41.153962  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.155170  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.115263 13184 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:41.157357 12852 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.157492 13184 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.159799 12852 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:41.160420 13189 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.121460 13201 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.107592 13123 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:41.150157 13160 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:41.170954 13191 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:41.172076  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:41.136250  7255 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
W20260709 13:15:41.175354  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 221771us
I20260709 13:15:41.122090 13217 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16.
I20260709 13:15:41.180104  7332 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:41.124971 13205 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:41.121622 13131 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:41.187568  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.194567  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.130348 13215 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 13:15:41.204679  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:41.218420  7257 raft_consensus.cc:606] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:41.221211  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.111914 12977 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.230654  7334 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:41.117206 13139 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.232942 13131 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:41.220243 13205 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.234727 13003 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.236016  7184 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.176741 13220 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:41.262830  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 181335us
I20260709 13:15:41.263947  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:41.133617 12662 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:15:41.181087 13160 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:41.273555  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:41.224821 13042 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.277830  7184 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:41.283417  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 201790us
I20260709 13:15:41.313019  7334 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:41.135561 13077 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:41.318547  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.267227 13191 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:41.182442 13123 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.275369 13205 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:41.324311  7258 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:41.283125 13160 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:41.325939  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.179476 13189 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.180518 13201 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.356503  7254 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:41.357941 13201 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:41.325234  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 120667us
I20260709 13:15:41.312132 13220 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.366986 13220 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.368449 12766 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:41.369822 12766 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:41.337607  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.376323  7256 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:41.338300  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:41.342898  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.281279 13038 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:15:41.319820 12470 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:41.347167 12852 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:41.330067 12913 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.002s
I20260709 13:15:41.315081 13003 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:41.322080 13191 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:41.377220  7253 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:41.378194  7184 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:15:41.383422  7262 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:41.355967 12977 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.395807  7184 pending_rounds.cc:85] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 9
I20260709 13:15:41.403436  7184 pending_rounds.cc:107] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:15:41.403891  7184 raft_consensus.cc:2889] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:41.387748  7255 raft_consensus.cc:2376] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20. Re-sending same reply.
I20260709 13:15:41.356004 13077 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.418116  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.330493 13042 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.421131  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.398659 13191 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:41.417459 13240 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:15:41.391208 12852 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.436841  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:41.430827  7262 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
W20260709 13:15:41.417739  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 224561us
I20260709 13:15:41.410272 12470 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:41.458866  7256 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:41.460427  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:41.391338 13243 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:15:41.446592  7255 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:41.456617  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:41.462462  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:41.486927 13236 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:15:41.491475  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:41.491946 13238 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:15:41.494498  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:41.495384  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 135295us
I20260709 13:15:41.496409  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:41.503760  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.503964  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:41.525180  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.500594 13201 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:41.526298  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 69765.2us
I20260709 13:15:41.499109 12759 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:41.557147 13201 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:41.557740  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 917) took 1263 ms. Trace:
I20260709 13:15:41.558131  7335 rpcz_store.cc:276] 0709 13:15:40.294003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.294165 (+   162us) service_pool.cc:224] Handling call
0709 13:15:40.294526 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.559360 (+264834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.557471 (+998111us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b540038bdd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:41.557674 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607396096}
I20260709 13:15:41.524161 13247 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:41.559408 13247 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:41.560370 13247 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.513234 13243 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:41.562949 13243 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:41.562126  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.499445 13248 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.564105 13248 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:41.565078  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.536357  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:41.566574 13248 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:41.567685 13139 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.568548 13042 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:41.568998  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:41.569199 13042 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:41.569705 13042 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.570137 13042 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:41.537160  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:41.487207 12470 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:41.542119 13227 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.695s	user 0.004s	sys 0.000s
I20260709 13:15:41.543440 13189 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.544920 13131 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.545326  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.521692 13218 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:41.592747  7261 raft_consensus.cc:2410] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:15:41.536185 13033 raft_consensus.cc:2764] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
W20260709 13:15:41.552016 13249 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:15:41.552232  7183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2470) took 1914 ms (client timeout 1712 ms). Trace:
I20260709 13:15:41.563323 13243 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:41.533120  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:41.501092 13003 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:41.607482 13003 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.569454 12889 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:41.570279  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:41.611435 13245 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:15:41.612047 12889 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:41.612107  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:41.612962 13218 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.610323 13003 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:41.615857  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 121458us
I20260709 13:15:41.572315  7179 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:41.565479  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3183) took 1059 ms. Trace:
I20260709 13:15:41.520713 13077 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.647815  7182 rpcz_store.cc:276] 0709 13:15:40.506415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.544575 (+ 38160us) service_pool.cc:224] Handling call
0709 13:15:40.544924 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.638842 (+ 93918us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:40.749962 (+111120us) log.cc:844] Serialized 14 byte log entry
0709 13:15:41.071984 (+322022us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:41.072084 (+   100us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:41.072158 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.565224 (+493066us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b54002b57d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:41.565276 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.565421 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25816,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":73987,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"spinlock_wait_cycles":215299968,"thread_start_us":245723,"threads_started":3,"wal-append.queue_time_us":420572}
I20260709 13:15:41.648988 13077 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.650049  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.650740  7254 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:41.651535  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.652202  7261 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:15:41.653330  7261 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:41.651526 13077 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.660436 12889 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:41.661739  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:41.663630 13243 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.666121 13243 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.666992  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:41.668114  7185 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:41.566030 12704 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.669760  7861 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:41.671056 13189 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:41.671612 13189 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.672102 13189 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:41.672503  7262 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:41.678045  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:41.564687 13037 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:41.679498 13033 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:41.679962 13033 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.562124 13205 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.680326 13033 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:41.682178 13205 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:41.583305  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:41.683069  7184 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:41.584012 12987 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.687247 13137 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.585318  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:41.688324  7334 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:41.586035  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.689092  7335 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:41.690135 12570 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:15:41.579241  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.690585 12570 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:41.690304  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.691606 12570 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.688470 12987 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:41.692612 12570 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:41.570154 13073 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:41.574949 12977 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:15:41.537518  7255 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
W20260709 13:15:41.597707  7183 rpcz_store.cc:269] 0709 13:15:39.637636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.637831 (+   195us) service_pool.cc:224] Handling call
0709 13:15:41.551964 (+1914133us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54002b4dd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:41.552127 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284751104}
I20260709 13:15:41.603402 13131 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:41.605376  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:41.696398 12858 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:41.697327  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:41.698652  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.591820  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:41.696352  7333 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 13: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:41.700524 12987 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:41.701103  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.701664 12852 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:41.649410  7894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 959) took 1095 ms. Trace:
I20260709 13:15:41.702782  7894 rpcz_store.cc:276] 0709 13:15:40.553580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.559595 (+  6015us) service_pool.cc:224] Handling call
0709 13:15:40.560131 (+   536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:40.560515 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:40.560547 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:40.561628 (+  1081us) log.cc:844] Serialized 564 byte log entry
0709 13:15:40.668591 (+106963us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:40.668645 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.668734 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:41.541299 (+872565us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:41.644320 (+103021us) raft_consensus.cc:1685] finished
0709 13:15:41.644346 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.649337 (+  4991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46769536,"thread_start_us":106575,"threads_started":1,"wal-append.queue_time_us":183644}
I20260709 13:15:41.704077  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46710 (request call id 4) took 1041 ms. Trace:
I20260709 13:15:41.679340  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:41.704509  7257 rpcz_store.cc:276] 0709 13:15:40.674768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.680295 (+  5527us) service_pool.cc:224] Handling call
0709 13:15:41.703868 (+1023573us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54002274d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9236853 00007fecee20460a 00007fece778a7d4 00007fece778a762 00007fece778a691 00007fece778a60c 00007fece77898c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:41.703977 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992464256}
I20260709 13:15:41.706254  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 919) took 1377 ms. Trace:
I20260709 13:15:41.702319  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.706728  7336 rpcz_store.cc:276] 0709 13:15:40.329010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.332687 (+  3677us) service_pool.cc:224] Handling call
0709 13:15:41.706074 (+1373387us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400421654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:41.706193 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233876352}
I20260709 13:15:41.708074  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.708703  7336 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:41.709712  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.710318  7336 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:41.692648  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:41.534873 13239 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:15:41.716508 13206 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:41.698733  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:41.753326  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54733us
I20260709 13:15:41.754106  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:41.717329  7329 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:41.719362 13124 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:41.720062 13131 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:41.720207 12291 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.723201  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.765986 12291 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.723444 13243 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.671819 12704 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.572723 13250 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:15:41.644824  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.724054  7261 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
W20260709 13:15:41.724243  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 77360.9us
I20260709 13:15:41.776804  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.724400 13252 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.723583  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:41.729637  7184 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:41.729957  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.730001  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:41.780485  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:41.781155  7183 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:41.781198  7331 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:41.743886  7254 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:41.781800 12291 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:41.755138  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:41.755584 13206 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:41.757547  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:41.758106 13200 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:41.762184  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.761054 13137 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:15:41.763667  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:41.764456  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2257) took 1099 ms. Trace:
I20260709 13:15:41.795207  7255 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:41.795339  7332 rpcz_store.cc:276] 0709 13:15:40.668225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.096320 (+428095us) service_pool.cc:224] Handling call
0709 13:15:41.096828 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.203381 (+106553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.764077 (+560696us) spinlock_profiling.cc:243] Waited 79.5 ms on lock 0x7b5400191ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:41.764375 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182827264}
I20260709 13:15:41.768215  7334 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:41.771993  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:41.726339  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.797869  7887 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:41.776185  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:41.731169  7335 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:41.728272 13033 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.755194  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2256) took 1090 ms. Trace:
I20260709 13:15:41.785991 12291 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:41.780071 12987 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:41.787806  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:41.762610  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.763201 12858 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:41.758827 13124 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:41.784222 13250 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:41.783460  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 59952.4us
I20260709 13:15:41.786670  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.794647 13200 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:41.804757  7329 rpcz_store.cc:276] 0709 13:15:40.664877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.970932 (+306055us) service_pool.cc:224] Handling call
0709 13:15:40.971297 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.713830 (+742533us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400185220. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece923e1c0 00007fece923f231 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c
0709 13:15:41.754902 (+ 41072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.755124 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368455424}
I20260709 13:15:41.804940  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:41.817102  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.792189  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:41.846226  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 43900.3us
I20260709 13:15:41.846400  7330 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:41.847376  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.847929  7254 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:41.848109  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:41.848616  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:41.849016  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.850078 13218 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:41.837024  7180 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
I20260709 13:15:41.853471  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:41.854945  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:41.730001 13042 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.858417 13042 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.809422  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:41.862740  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.865787  7262 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:41.780470 13104 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:15:41.850940 13211 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:41.817515 12766 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.868458  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:15:41.913344  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 155856us
I20260709 13:15:41.869578 13123 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:41.872206  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.915411  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:41.927912  7253 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:41.872696  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.881803 13191 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.781056 13131 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.824121 13252 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.802591 12470 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:41.789234 13243 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.892068 13209 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:41.838157  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:41.904479 13258 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:41.893525  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:41.893473 12291 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:41.850140  7330 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:15:41.826308  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 184376us
I20260709 13:15:41.850275  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.851073 13250 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:41.906392  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 97107.8us
I20260709 13:15:41.951447  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:41.908092  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65701.4us
I20260709 13:15:41.925104  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:41.931339  7331 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:41.929111 13104 consensus_queue.cc:1243] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:15:41.889878 13124 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:41.892838 13200 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:41.929992  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:41.949283  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.057318  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:42.064779  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:41.955607  7331 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:15:41.932204  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:41.946018  7330 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:41.992192  7255 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:41.935614 13191 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:41.938768 13253 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.207s	user 0.005s	sys 0.000s
I20260709 13:15:41.944634 12291 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.080883 13124 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:41.951347 13218 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:42.048717  7254 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:15:42.049675 12919 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.993587  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:42.099203  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 105728us
I20260709 13:15:41.933900  7253 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:15:41.943289  7186 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:41.942970  7187 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:42.101325  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:41.931272 13201 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.153s
I20260709 13:15:41.933060  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:41.948226 13189 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.069914  7256 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:15:42.071753  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:42.072490  7330 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:15:41.931420 12766 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:41.932528  7887 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:15:41.982117 12858 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:42.065886 13131 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:41.936560 13205 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.139s
I20260709 13:15:42.076038  7328 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:42.061446 13123 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:42.061635 13073 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.943931  7179 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:41.941747 13209 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.941083 13243 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:41.939976 13199 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:42.095118  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:42.203516 12570 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.006s
I20260709 13:15:41.938664 13252 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:41.939103 12470 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:42.101513  7331 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:15:41.943464 13258 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.246785  7185 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
W20260709 13:15:42.103400  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 158040us
I20260709 13:15:42.105098  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:42.072997 13137 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:42.108294  7329 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:42.109465  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:41.929400 12892 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:42.110313  7184 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
W20260709 13:15:42.266906  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 161899us
W20260709 13:15:42.267436 13259 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 13:15:42.267975  7184 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:42.268082  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:42.270133  7184 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
W20260709 13:15:42.111883  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.270876 13243 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:42.271453  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:42.271776 13243 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:42.084343 12840 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.273000 12840 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.274979 12892 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:15:42.275360 13266 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:42.275548 12840 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:42.275740 12892 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:42.276990 12892 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.093900 13218 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.278955 13218 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:42.114343 12913 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.132s
I20260709 13:15:42.260731 12470 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.284312 12913 consensus_queue.cc:1243] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:15:42.103223 13160 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.712s	user 0.012s	sys 0.000s
I20260709 13:15:42.288209 13160 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.108242 12919 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.289915 13189 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:42.290887  7182 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:42.244524 13073 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.067260 13184 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:15:42.291616 12919 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:42.292630 13258 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:42.293439 13073 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:42.108112 13191 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:42.294126 13191 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:42.207165  7889 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:42.294565 13191 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:42.246780  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:42.205641 13123 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:42.296252 13123 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:42.241387  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:42.300493  7327 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:42.247081  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:42.226825 13253 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:15:41.937320  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:42.244133 13209 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:42.260748  7179 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:15:42.261107  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:42.320505  7331 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:42.261765 13137 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.085685 13187 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:42.288821 13033 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:42.114118 12903 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
W20260709 13:15:42.331590  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 77730us
I20260709 13:15:42.332706  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:42.335528  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:42.330129 13037 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.005s
I20260709 13:15:42.328076 13187 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.347685 13187 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:42.347831  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:42.348630  7331 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:42.349987  7331 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:15:42.351382 12976 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.352041 12976 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.330494 13137 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:42.354817  7887 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:42.328835 13184 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.359144 13184 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.360821 13160 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:42.361393 13184 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:42.364084  7331 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:42.325543  7329 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
W20260709 13:15:42.364406  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46452.2us
I20260709 13:15:42.202399 12858 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.369017  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:42.326932  7328 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:15:42.386063  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:42.369526  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 272310us
I20260709 13:15:42.333341 12291 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:15:42.365495  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 197083us
I20260709 13:15:42.367867  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:42.393901  7332 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:15:42.394745  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:42.395967  7187 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:15:42.389185  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:42.399499  7184 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:42.399940  7184 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:42.398701  7182 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:42.392436  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:42.402467  7183 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:42.404953  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.409540  7331 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:15:42.419483  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:42.399441 13073 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:42.367614 13037 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:15:42.445282  7184 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.415855  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:42.446928  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2494) took 1370 ms. Trace:
I20260709 13:15:42.416379  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:42.401572  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:42.387531 13184 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.424198  7261 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:42.411213 13189 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:42.432016  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:42.438129  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:42.460294  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44022.9us
I20260709 13:15:42.461030  7185 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:42.440918  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:42.448776  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 47291.2us
I20260709 13:15:42.407967 12977 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.467015  7185 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:15:42.467540  7185 pending_rounds.cc:85] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 7
I20260709 13:15:42.467806  7185 pending_rounds.cc:107] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:15:42.468102  7185 raft_consensus.cc:2889] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.467043 12291 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:15:42.466701 13257 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:42.473706  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:42.476289  7254 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:42.480299  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:42.450688  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:42.409180 13213 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:42.457427  7184 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:42.447567  7181 rpcz_store.cc:276] 0709 13:15:41.076689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.077053 (+   364us) service_pool.cc:224] Handling call
0709 13:15:41.107732 (+ 30679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:41.122695 (+ 14963us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:41.176436 (+ 53741us) log.cc:844] Serialized 14 byte log entry
0709 13:15:41.433758 (+257322us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:41.436546 (+  2788us) log.cc:844] Serialized 26 byte log entry
0709 13:15:41.436701 (+   155us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:41.436732 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.436798 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:42.446592 (+1009794us) raft_consensus.cc:1685] finished
0709 13:15:42.446657 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:42.446847 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7239,"prepare.queue_time_us":56459,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":14422,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":14547,"thread_start_us":172298,"threads_started":1,"wal-append.queue_time_us":345063}
W20260709 13:15:42.487507  7180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.023s
W20260709 13:15:42.487896  7180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.007s	sys 0.023s
I20260709 13:15:42.462144  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:42.462314  7150 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:42.464155  7262 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:42.450464  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:42.488687  7256 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:42.408174 13160 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:15:42.494552  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 425225us
I20260709 13:15:42.501664  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:42.501698 12291 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:42.502799 12291 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:42.505832  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:42.500732  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:42.507694  7258 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:42.459586 13189 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.413399 13218 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.465065 13252 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:42.517143  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:42.470809 13247 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:42.527766  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:42.494840 13213 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:42.519068 13124 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:15:42.536731 12976 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:42.516465 12840 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:42.519001 13257 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:15:42.540571  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:42.483386 12977 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:42.544469 13269 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.340s	user 0.002s	sys 0.000s
I20260709 13:15:42.499054 13212 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.513657 12759 raft_consensus.cc:2764] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:15:42.484894 13033 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.043s
W20260709 13:15:42.548974  7862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.034s	sys 0.025s
W20260709 13:15:42.549038  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 75422.5us
W20260709 13:15:42.564261  7862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.034s	sys 0.025s
W20260709 13:15:42.564621  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 612887us
I20260709 13:15:42.549284  7184 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:15:42.566164  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:42.566906  7184 pending_rounds.cc:85] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 8
I20260709 13:15:42.567333  7184 pending_rounds.cc:107] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:15:42.567672  7184 raft_consensus.cc:2889] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.508809 13250 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.465675 13258 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.517982 13189 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:42.464423 13184 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.554510  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:42.516459 13211 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:42.557454  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:42.587766  7254 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:42.557861  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:42.589068  7261 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:42.551574 13213 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:42.568019  7256 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:42.571643  7862 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:42.574658  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:42.575613  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:42.592089  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:42.569626 12766 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:42.527889 13104 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
W20260709 13:15:42.585490  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 62072.8us
I20260709 13:15:42.597621  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:42.585907  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 120069us
I20260709 13:15:42.591470 12470 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:42.593066  7889 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
I20260709 13:15:42.605224  7892 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:42.595804 12919 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:42.612841 13104 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:42.613648 13256 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:15:42.614140 13256 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:42.599704 13042 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.615058 13042 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.615127 13256 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.616153 12852 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:42.616693 13256 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:42.617120 12852 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:42.617524 12852 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:42.617772 13042 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:42.564502 13212 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.571545 13033 consensus_queue.cc:1243] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:15:42.619235 12977 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:42.619884 12977 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:42.620303 12977 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.620718 12977 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:42.620389 13206 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.576588  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:42.620429 13212 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:42.622217  7887 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
W20260709 13:15:42.596915 13248 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.004s	sys 0.016s
I20260709 13:15:42.582463 13250 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:42.623023 13248 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.004s	sys 0.016s
I20260709 13:15:42.593982 13279 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:42.623780  7891 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:42.626358  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:42.594902  7895 raft_consensus.cc:2368] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17.
I20260709 13:15:42.569041 13257 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:42.556695 13037 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:15:42.599663  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:42.547736 13247 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.621635 13206 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:42.594369  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:42.636427  7893 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
W20260709 13:15:42.635759  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 173521us
I20260709 13:15:42.623243 13217 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:42.595268  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:42.603904  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:42.637509  7150 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:42.642892  7861 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:42.648062  7895 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:15:42.650156  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:42.654520  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:42.655459  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 51698.2us
I20260709 13:15:42.623827 13279 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:42.666770  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 161022us
I20260709 13:15:42.668411  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:42.670342  7180 raft_consensus.cc:1217] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Deduplicated request from leader. Original: 13.12->[15.13-15.13]   Dedup: 15.13->[]
W20260709 13:15:42.670696  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 75553.3us
I20260709 13:15:42.671259  7180 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
W20260709 13:15:42.674376  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.674754  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:42.639434 13217 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:42.683369  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:42.678124  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:42.649403 13139 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:42.610438 13191 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.618422 12852 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.685904  7895 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 16: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:15:42.728703  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 50689.7us
I20260709 13:15:42.693128  7262 pending_rounds.cc:85] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 11
I20260709 13:15:42.658597 13104 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:42.656540 12840 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:42.601189 13211 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:42.732080  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:42.733304  7262 pending_rounds.cc:107] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:15:42.652664 12766 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:15:42.795121  7262 raft_consensus.cc:2889] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.796082  7262 pending_rounds.cc:107] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:15:42.796583  7262 raft_consensus.cc:2889] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.748970  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:42.683813 12919 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:15:42.799491  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 131207us
I20260709 13:15:42.799719  7186 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:42.692312 13124 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:42.693429 12759 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:42.666494 13279 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:42.674292 13258 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:42.676724 12570 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
W20260709 13:15:42.798522 13282 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.200s	user 0.001s	sys 0.001s
I20260709 13:15:42.683928 13217 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:42.738086 13257 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:42.819387  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:42.807416 13124 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:42.831223  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 93307.6us
W20260709 13:15:42.841110  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.806072 13252 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:42.729331 13280 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:15:42.808918 12852 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:42.708806 13123 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:42.824985 13243 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.001s
W20260709 13:15:42.833770 13200 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.753s	user 0.013s	sys 0.000s
I20260709 13:15:42.740504 13284 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:15:42.852239  7887 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:15:42.728461 12976 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:15:42.866849 13211 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:42.868430  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:42.876801  7893 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:42.823992 13218 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:42.833046 13272 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:42.837419 13257 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.841610 13124 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:42.886652  7178 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:42.857963 12470 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.860749 13243 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:42.812914 13291 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:15:42.868167 13200 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.831777 13273 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:15:42.902698 13252 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.904094 13211 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:42.906327 12291 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:42.817770 12759 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:42.847309 13258 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:15:42.876535 13286 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:42.921177 13242 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
W20260709 13:15:42.913102 13187 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.565s	user 0.014s	sys 0.000s
I20260709 13:15:42.894767 13290 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:42.901955 13257 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:42.955886 13288 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:42.960819  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:42.967010  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:42.967341  7891 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:15:42.963758  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:42.926614 13184 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:42.983151  7258 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:42.985512  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:42.986306  7893 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:42.958941 13247 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:42.957479 13290 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.916839 12470 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:43.029819  7327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2262) took 1443 ms (client timeout 1723 ms). Trace:
W20260709 13:15:43.031874  7327 rpcz_store.cc:269] 0709 13:15:41.586364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.698290 (+111926us) service_pool.cc:224] Handling call
0709 13:15:43.029472 (+1331182us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b540031b5d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:43.029609 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382139136}
I20260709 13:15:42.971725 13250 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:42.980995 12919 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:42.972849 13288 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:42.983770 13243 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:43.038499  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 168759us
W20260709 13:15:43.036347 13137 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.681s	user 0.005s	sys 0.006s
W20260709 13:15:43.029687  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 403380us
I20260709 13:15:42.942170 13187 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:43.050172  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 216100us
I20260709 13:15:42.942464 13286 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:43.052070  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 65255.7us
W20260709 13:15:43.039201 13209 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.687s	user 0.008s	sys 0.004s
I20260709 13:15:43.057595  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:43.062832  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:43.053535 13137 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:43.065626 13293 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:15:43.049758 13139 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:43.059955  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:43.034034 13191 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:43.031195 13290 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:43.064199 13287 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.148s
I20260709 13:15:43.058749 13243 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.093609  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:43.094040 13300 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:43.061775 13104 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:43.060489 13291 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:43.128320  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 70823us
I20260709 13:15:43.137871  7182 raft_consensus.cc:2410] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 13:15:43.134656  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 81549us
I20260709 13:15:43.138448  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.139290  7327 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:43.139452  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 89740.6us
I20260709 13:15:43.070773 13209 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.143179  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.140213  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:43.149987 13137 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:43.151104  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.151671 13304 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:43.152563 13307 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:15:43.152891  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.153625  7327 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:43.154322 13307 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:43.155177 13104 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.155916 13297 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:43.156824 13308 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:43.157409 13308 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:43.157963 13308 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.158895 13298 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:15:43.158732 13139 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.154567  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:43.151327 13302 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:15:43.236061  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:43.241959  7335 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.088831 13218 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:15:43.240293  7331 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:43.244760  7255 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:43.147076 12903 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.142251 13284 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:43.251178  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 108590us
I20260709 13:15:43.271942  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.284584  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:43.272769  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 523888us
I20260709 13:15:43.285503  7889 raft_consensus.cc:2368] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17.
I20260709 13:15:43.127339 13291 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.282217  7893 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:15:43.284706  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:43.279428  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:43.120401 13288 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.130465 13299 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.362s
I20260709 13:15:43.316463  7299 leader_election.cc:400] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17.
I20260709 13:15:43.316725  7187 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:15:43.316968  7299 leader_election.cc:403] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:15:43.303723  7331 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:43.126988 12919 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.272701 13298 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:43.286370 12903 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.323089  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:43.328290  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 43677.2us
I20260709 13:15:43.282878 13200 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.330137  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.338989  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.334941  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:43.348170  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:43.349972  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.323665 12759 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:43.351970  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:43.300860 13042 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:15:43.356964  7892 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.357400  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:43.295238 13273 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:43.355878  7225 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.132:39125 timed out after 1.978s (SENT) [suppressed 18 similar messages]
I20260709 13:15:43.336037 13305 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:43.363195 13322 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:15:43.363891 13305 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:43.364408 13291 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.365381 12858 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.365051 13305 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.365787 12987 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:43.366180 12903 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:43.366266 12987 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:43.350248 12470 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.334844 13298 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.367115 13131 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:43.383263 12903 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:43.385344  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:43.388679  7892 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:43.353363 13288 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:43.399967  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.300169 13284 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.363299 13317 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:43.407685  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.434172  7892 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:43.378152 13187 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:43.442725  7084 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47554 (request call id 235) took 63020 ms (client timeout 15000 ms). Trace:
I20260709 13:15:43.448890  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:43.450039 13309 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 13:15:43.451376 13315 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
W20260709 13:15:43.448978 13296 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 13:15:43.448895 13310 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:43.404064 13291 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:43.450233 13312 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:43.389997 13131 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:43.462253  7892 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:43.388713 13306 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:43.428020 13294 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.294s
W20260709 13:15:43.466904 13316 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:15:43.467679 13298 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:43.469159 13284 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:43.470764 13213 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.843s	user 0.013s	sys 0.000s
I20260709 13:15:43.462311 13286 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:43.475119  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.500435  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:43.485069 12977 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.864s	user 0.015s	sys 0.003s
I20260709 13:15:43.478725 13310 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:43.480577 13217 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.001s
W20260709 13:15:43.484272  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 128422us
I20260709 13:15:43.522095 13217 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.523375  7334 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:43.524911 13217 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.428099 13191 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:43.488261  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:43.497220  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:43.498221  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.540185  7182 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:43.541219  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:43.463667  7335 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:43.476234  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:43.443518  7084 rpcz_store.cc:269] 0709 13:14:40.223082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.223412 (+   330us) service_pool.cc:224] Handling call
0709 13:15:43.235734 (+63012322us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:32.832387 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:32.915283 (+ 82896us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:32.915346 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:15:32.915383 (+    37us) tablet.cc:662] Decoding operations
0709 13:15:32.950236 (+ 34853us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:33.014895 (+ 64659us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:33.015442 (+   547us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:33.133044 (+117602us) tablet.cc:701] Row locks acquired
0709 13:15:33.159229 (+ 26185us) write_op.cc:260] PREPARE: finished
0709 13:15:33.312966 (+153737us) write_op.cc:270] Start()
0709 13:15:33.361786 (+ 48820us) write_op.cc:276] Timestamp: P: 1783602933303256 usec, L: 0
0709 13:15:33.374227 (+ 12441us) op_driver.cc:348] REPLICATION: starting
0709 13:15:33.524562 (+150335us) log.cc:844] Serialized 599 byte log entry
0709 13:15:35.995166 (+2470604us) op_driver.cc:464] REPLICATION: finished
0709 13:15:36.456807 (+461641us) write_op.cc:301] APPLY: starting
0709 13:15:36.456926 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:36.458523 (+  1597us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:36.458663 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:36.459402 (+   739us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:36.459657 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:15:36.459700 (+    43us) write_op.cc:312] APPLY: finished
0709 13:15:36.459968 (+   268us) log.cc:844] Serialized 25 byte log entry
0709 13:15:36.618898 (+158930us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54000aa354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923932a 00007fece91bef14 00007fece91beec3 00007fece91bee38 00007fece91bedf3 00007fece91be0dc 00007fece91e7e16 00007fece91cfcbb 00007fece91ba39d 00007fece91bdd75
0709 13:15:36.578410 (+-40488us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:36.646695 (+ 68285us) write_op.cc:454] Released schema lock
0709 13:15:36.656616 (+  9921us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:36.731981 (+ 75365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:36.750178 (+ 18197us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6963832,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":453651,"apply.run_cpu_time_us":4235,"apply.run_wall_time_us":211961,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":220710,"prepare.run_cpu_time_us":88434,"prepare.run_wall_time_us":1187317,"raft.queue_time_us":1394843,"raft.run_cpu_time_us":16060,"raft.run_wall_time_us":691082,"replication_time_us":2577134,"spinlock_wait_cycles":23861120,"thread_start_us":1790038,"threads_started":4,"wal-append.queue_time_us":748787,"wal-append.run_cpu_time_us":211227,"wal-append.run_wall_time_us":3445622}]]}
I20260709 13:15:43.496194 13308 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.463603 12987 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.509837 13290 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.516366  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1194) took 1072 ms. Trace:
I20260709 13:15:43.511459  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:43.503017 13199 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.247s	user 0.014s	sys 0.006s
I20260709 13:15:43.517937 13131 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.551766 13287 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:43.478410 13279 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.001s
I20260709 13:15:43.612708  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:43.612434 13287 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.613248 13279 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.560153 13318 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:43.615373 13318 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.560185 13212 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:43.616811 13212 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.617259 13212 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:43.618083 13318 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:43.543716 13322 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:43.618899  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2175) took 1114 ms. Trace:
I20260709 13:15:43.531081  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:43.620029 13131 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:43.620362  7257 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:43.621821  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.482086 13291 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.560142  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:43.623598  7256 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:15:43.533203  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:43.538847 12977 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.626192 13297 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:43.549741  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.552374  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.544256  7185 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:43.622530  7893 raft_consensus.cc:2376] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17. Re-sending same reply.
I20260709 13:15:43.542586  7890 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:43.615980 13279 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:43.692004 13248 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.720850 13248 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.722077  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.626796 12977 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.529032 13213 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.522456 13243 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.554548  7260 rpcz_store.cc:276] 0709 13:15:42.444414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.459146 (+ 14732us) service_pool.cc:224] Handling call
0709 13:15:42.492710 (+ 33564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:42.657519 (+164809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:42.657557 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:42.668023 (+ 10466us) log.cc:844] Serialized 26 byte log entry
0709 13:15:43.039205 (+371182us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:43.039257 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.039444 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.516102 (+476658us) raft_consensus.cc:1685] finished
0709 13:15:43.516129 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.516295 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8260,"raft.queue_time_us":84554,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7431,"thread_start_us":388480,"threads_started":2,"wal-append.queue_time_us":376456}
I20260709 13:15:43.619345  7254 rpcz_store.cc:276] 0709 13:15:42.504603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.595785 (+ 91182us) service_pool.cc:224] Handling call
0709 13:15:42.635778 (+ 39993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:42.821573 (+185795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:42.821608 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:42.872134 (+ 50526us) log.cc:844] Serialized 564 byte log entry
0709 13:15:43.128457 (+256323us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:43.128501 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.370583 (+242082us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54002166d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:43.370651 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.618513 (+247862us) raft_consensus.cc:1685] finished
0709 13:15:43.618535 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.618828 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424218880,"thread_start_us":256004,"threads_started":1,"wal-append.queue_time_us":288662}
I20260709 13:15:43.608650 13290 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:43.671221  7333 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:43.650645 13291 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.528218 13310 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.528585 13298 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:43.687916  7257 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:43.536661 13284 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:43.606567 12858 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:15:43.520184 13209 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.544003 13304 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17.
I20260709 13:15:43.651854  7336 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:43.652778  7258 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:43.648963 13312 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:43.694904  7256 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:15:43.810128  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:43.616024 13308 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.652073 13297 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:43.538018 13042 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:43.654011  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:43.649375  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.707819 12470 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:43.700414 13218 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.667466 12889 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:43.713507 13189 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.120s	user 0.011s	sys 0.000s
I20260709 13:15:43.714982  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.717586  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1196) took 1050 ms. Trace:
I20260709 13:15:43.726758  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.838557  7893 raft_consensus.cc:2376] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20. Re-sending same reply.
I20260709 13:15:43.839946  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:43.723485 12852 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.862s	user 0.006s	sys 0.006s
I20260709 13:15:43.843451  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:43.837607  7888 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:43.723158  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:43.731578  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.735357  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:43.847664  7254 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:43.704901 13199 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.736325 13248 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.725993 13279 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:43.736923 13205 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:43.737819 13124 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.820s	user 0.008s	sys 0.008s
I20260709 13:15:43.740789  7261 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:43.731935  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:43.741322 13257 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.759s	user 0.014s	sys 0.000s
W20260709 13:15:43.741789 13256 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.125s	user 0.011s	sys 0.008s
I20260709 13:15:43.619316 13322 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.747370 13213 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:43.747232  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:43.747905 13206 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.106s	user 0.011s	sys 0.001s
I20260709 13:15:43.553898 13191 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.874406  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:43.875509  7260 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:43.876015 13191 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.876535  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:43.877215  7330 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:15:43.751547 13212 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.752609 13217 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.878997 13217 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.753854  7335 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:15:43.883790  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.885301  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:43.753542 13187 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:43.754669  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.887025  7328 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:43.888307  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:43.890018 13311 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.407s	user 0.000s	sys 0.002s
I20260709 13:15:43.755988  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.754552  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.890831 13319 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:43.891114  7332 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:43.891283 13319 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:43.757267  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.892230 13319 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.893230  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.893977  7327 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:43.759020 13287 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.772816 13211 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.895422 13211 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.774489  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3210) took 1708 ms. Trace:
I20260709 13:15:43.856101 13199 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.898967  7178 rpcz_store.cc:276] 0709 13:15:42.066253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.277856 (+211603us) service_pool.cc:224] Handling call
0709 13:15:42.278135 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:42.900823 (+622688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.774144 (+873321us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54002b57d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:43.774401 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381396352}
I20260709 13:15:43.900884 13199 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:43.901216  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:43.799902  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:43.800071  7894 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:43.784468 13073 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:43.801865 13298 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.787727 13299 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.902933 13299 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.904624 13298 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.818888  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:43.905772 13299 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:43.827391  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.905956  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.906344 13298 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:43.862332 13257 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:43.907023  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 88275.9us
I20260709 13:15:43.907166  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.907342  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.908129  7888 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 16: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:43.908344  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.908612 13257 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:43.848940  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 125870us
I20260709 13:15:43.908974  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:43.909318  7180 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:43.843281 13201 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:15:43.842499  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:43.828138 13294 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:43.910584  7183 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:43.854267 13243 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:43.846859 12759 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:43.911540  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:43.911880 13298 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:43.863251 13205 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.866802 13124 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.911345  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:43.889870  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:43.891999 13328 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:15:43.901549 13199 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.800899 12291 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:43.837483  7262 rpcz_store.cc:276] 0709 13:15:42.667569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.667823 (+   254us) service_pool.cc:224] Handling call
0709 13:15:42.692843 (+ 25020us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:43.297081 (+604238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.297135 (+    54us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:43.299995 (+  2860us) log.cc:844] Serialized 78 byte log entry
0709 13:15:43.429305 (+129310us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:43.429346 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.429436 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.717230 (+287794us) raft_consensus.cc:1685] finished
0709 13:15:43.717263 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.717493 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6875,"raft.queue_time_us":99070,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":558681,"threads_started":2,"wal-append.queue_time_us":168453}
I20260709 13:15:43.911960 12759 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:43.804973 13284 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.892232  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:43.849118 12889 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.915179  7335 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:43.908977  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.848706 13189 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.920643  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:43.882367 13217 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:43.923606  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 234298us
I20260709 13:15:43.815017 13312 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:43.926069  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 200484us
I20260709 13:15:43.843142 13042 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.844008 13218 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:43.911410 13243 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.921872  7183 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:43.948701  7892 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:43.950484  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:43.951061  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.931905  7254 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:43.902508 13073 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:43.913126 13195 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.961602  7896 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 14: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:43.936108  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:43.936048  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:43.962695  7257 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.910602 13201 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:43.937776  7185 raft_consensus.cc:2368] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18.
I20260709 13:15:43.938328  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:43.944509  7225 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:43.952308  7260 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:43.973913  7257 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:43.919529 13213 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:43.925453 13299 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:43.968058  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:43.952905  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.959751  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:43.964874  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:43.863554 13279 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:15:43.984140  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.984804  7888 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.985695 13279 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:43.987035  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:43.988078 12889 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.988390  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:43.989631  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:43.918953 13287 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:15:43.980718  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:43.982858  7328 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:43.980350 12968 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:44.012104  7895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 969) took 1168 ms. Trace:
I20260709 13:15:43.989689 13124 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:43.952709  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:43.957525 13243 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:43.945927 13209 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:43.991504  7329 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:43.986399 13279 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:43.991124  7178 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:44.021303  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:44.021669  7182 raft_consensus.cc:2410] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:15:44.017359  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.012647  7895 rpcz_store.cc:276] 0709 13:15:42.843429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.844305 (+   876us) service_pool.cc:224] Handling call
0709 13:15:42.868691 (+ 24386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:42.869092 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:42.869121 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:42.878110 (+  8989us) log.cc:844] Serialized 52 byte log entry
0709 13:15:43.050072 (+171962us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:43.050143 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.050237 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.889255 (+839018us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:43.990771 (+101516us) raft_consensus.cc:1685] finished
0709 13:15:43.990794 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.012026 (+ 21232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":14376,"spinlock_wait_cycles":7666560,"thread_start_us":120080,"threads_started":1,"wal-append.queue_time_us":473211}
I20260709 13:15:43.961031 13211 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:44.024583  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:44.001654  7335 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:44.124107  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.124459  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:44.125548  7335 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:43.929417 13199 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.977250 13201 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:15:44.004096 13303 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:15:44.055131  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 236011us
W20260709 13:15:44.135530  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.136036  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.025918 13209 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.964932 13248 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:15:44.025554 12977 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:44.161638  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 182011us
I20260709 13:15:44.110236  7184 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:15:44.162914  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:44.012195 13299 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:44.116338  7181 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:43.975961 13195 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:43.976140 13191 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:44.129473  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:43.939958 13298 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:44.077775 13250 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:44.004197 13213 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.108966 12852 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:15:44.152716 13209 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:44.151547 13257 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:44.164465 12919 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:44.207567 13287 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.202414 13201 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:44.208492 13338 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:15:44.208356 13287 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.208881 13201 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:44.175287 12976 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:44.078011 13073 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.134115  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:44.026427 13307 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 13:15:44.108039 13124 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.173081  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.178319  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.227761  7892 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:44.160014  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:44.121719 13123 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:44.204608  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.234675  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.236272  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.219063  7335 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:44.239010  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.247982  7335 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:44.249989  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:44.146878  7328 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
W20260709 13:15:44.225014  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 62290.1us
I20260709 13:15:44.254261  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:44.255051  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:44.255285  7335 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:44.177423 13291 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.210850 13287 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:44.226717  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 205718us
W20260709 13:15:44.222414 13336 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:15:44.267318  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:44.280730  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:44.189389 13191 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.135905 12759 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:44.213786 12968 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:44.259020  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:44.364665  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.195953 13250 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:44.364560  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 109631us
I20260709 13:15:44.380347  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:44.376284  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 95710.8us
I20260709 13:15:44.378167  7179 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:15:44.382534  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:44.384727  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.386010  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.365381 13284 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:44.386781  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.379465  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:44.212404 13257 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:44.392970  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 134023us
I20260709 13:15:44.393916  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:44.394137  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:44.213265 12919 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:44.404897  7888 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:44.217259 12976 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:44.250556 13312 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:44.367997 13341 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:44.368877 13322 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:44.251062 13124 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.407718 13284 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:44.365971 13346 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:44.414955 13287 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:44.540699  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.541635  7892 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:44.319126 13189 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:44.515631  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 334231us
I20260709 13:15:44.397797 13348 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:44.408567  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:44.591280 13340 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.468s	user 0.000s	sys 0.001s
I20260709 13:15:44.428821 13353 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:44.591892  7887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1071) took 1621 ms (client timeout 2094 ms). Trace:
I20260709 13:15:44.591609  7078 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:15:44.592391  7887 rpcz_store.cc:269] 0709 13:15:42.960303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.960474 (+   171us) service_pool.cc:224] Handling call
0709 13:15:44.580979 (+1620505us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54005537d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:44.581127 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272474496}
I20260709 13:15:44.593848  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.593591  7078 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 7 to 14, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 14 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:44.595846 13352 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:15:44.595969 13250 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:44.596112  7078 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 12 to 17, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 17 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:44.597910  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:44.598585  7254 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.597994  7078 catalog_manager.cc:5697] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 12 to 13, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 13 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:44.600023  7078 catalog_manager.cc:5697] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:44.601454  7078 catalog_manager.cc:5697] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 12 to 15, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 15 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:44.603269  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.604261 13124 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:44.591388  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:44.606209  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:44.606739 12968 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.608091  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:44.611617  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:44.563860  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:15:44.612514  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 48760.6us
I20260709 13:15:44.568141 13212 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:44.573865 13268 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.614012 13268 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:44.551440  7333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2196) took 2889 ms (client timeout 1682 ms). Trace:
W20260709 13:15:44.615828  7333 rpcz_store.cc:269] 0709 13:15:41.661991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.702042 (+ 40051us) service_pool.cc:224] Handling call
0709 13:15:44.550996 (+2848954us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54001f4854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:44.551233 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4516402560}
I20260709 13:15:44.574841  7183 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
I20260709 13:15:44.566224  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:44.617301  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:44.617522 13358 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:44.618088 13358 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:44.575758 13312 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:44.618414 13351 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.415834 13218 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:44.387804 13299 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.576874 13258 raft_consensus.cc:2955] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 5 to 11, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:44.618489 13358 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.620455  7332 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:44.618595  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:44.611701 13191 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:44.627054  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:44.431200 13341 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:44.637006  7333 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:44.623591  7254 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:44.639485  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:44.641848  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:44.652058  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.538760 13104 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:44.536958 13349 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.580034 13042 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:44.660111 13243 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.001s
I20260709 13:15:44.528632 13354 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:44.666895  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:44.656242  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:44.622231 13248 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:44.619293 13218 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:44.686065  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:44.624091 13257 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:44.629221 13287 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:44.639889 13348 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:44.655228 13291 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:44.668839 12852 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:44.669135 13322 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:44.618923 13312 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:44.759685  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.773756  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.678375 13104 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:44.619061 13351 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.708554 13199 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:44.716892 13248 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:44.821967  7333 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:44.724041 13213 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:44.616557  7078 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 13, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 13 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.831557  7332 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:44.714385 13243 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.736160 13341 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.846581  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1192) took 2399 ms. Trace:
I20260709 13:15:44.847108  7253 rpcz_store.cc:276] 0709 13:15:42.443330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.452738 (+  9408us) service_pool.cc:224] Handling call
0709 13:15:42.486195 (+ 33457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:42.659319 (+173124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:42.659351 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:42.659392 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:15:42.659418 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.841931 (+2182513us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002f7954. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:44.842011 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.842203 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397691776}
W20260709 13:15:44.835098  7262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.000s	sys 0.014s
I20260709 13:15:44.674814 13349 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:44.835778  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 441679us
W20260709 13:15:44.841336 13310 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.039s	user 0.011s	sys 0.002s
W20260709 13:15:44.862113  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.799371 13322 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:44.854151  7262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.000s	sys 0.014s
I20260709 13:15:44.864090  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3408) took 1182 ms. Trace:
W20260709 13:15:44.864513  7259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.007s	sys 0.015s
W20260709 13:15:44.874902  7259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.007s	sys 0.015s
I20260709 13:15:44.874279  7262 rpcz_store.cc:276] 0709 13:15:43.681414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.951262 (+269848us) service_pool.cc:224] Handling call
0709 13:15:43.975770 (+ 24508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.976026 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:44.229596 (+253570us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.863662 (+634066us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.863728 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:44.863778 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.863855 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.864009 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":334471,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":10600,"raft.queue_time_us":96,"thread_start_us":839667,"threads_started":2}
I20260709 13:15:44.876194  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3409) took 1194 ms. Trace:
I20260709 13:15:44.876823  7259 rpcz_store.cc:276] 0709 13:15:43.681694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.949665 (+267971us) service_pool.cc:224] Handling call
0709 13:15:43.950008 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.950254 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:44.154923 (+204669us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.875533 (+720610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.875600 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:44.875654 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.875957 (+   303us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.876123 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":261807,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"thread_start_us":899682,"threads_started":2}
I20260709 13:15:44.873183  7332 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
W20260709 13:15:44.852808 12977 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.000s
I20260709 13:15:44.884635 13257 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:44.881244 13290 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:44.881119 13299 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:44.903389  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:44.904166  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 276382us
I20260709 13:15:44.913108  7253 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:44.839037 13287 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.896731 12977 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:44.878705 13310 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:44.842023 13348 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:44.930891  7178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.015s	sys 0.041s
W20260709 13:15:44.931392  7178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.016s	sys 0.042s
I20260709 13:15:44.932538  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1141) took 1116 ms. Trace:
I20260709 13:15:44.856923 13104 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:44.914909  7078 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 11, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 11 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.939734  7187 raft_consensus.cc:2368] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17.
I20260709 13:15:44.901434 13257 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:44.928779 13189 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:44.937836  7178 rpcz_store.cc:276] 0709 13:15:43.815760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.124116 (+308356us) service_pool.cc:224] Handling call
0709 13:15:44.124415 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.124630 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:15:44.135209 (+ 10579us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.931933 (+796724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.931991 (+    58us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:15:44.932039 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.932107 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.932475 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5599,"prepare.queue_time_us":12105,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":4414,"raft.queue_time_us":87,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":3439,"thread_start_us":772721,"threads_started":1}
I20260709 13:15:44.957382  7078 catalog_manager.cc:5697] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.938601 13312 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:44.980882  7078 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 12 to 16, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 16 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:44.908003 13248 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:44.918231 13299 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:44.975258  7253 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:44.984102  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3226) took 1043 ms. Trace:
W20260709 13:15:44.963935 13355 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.150s	user 0.002s	sys 0.000s
I20260709 13:15:44.991442  7178 rpcz_store.cc:276] 0709 13:15:43.940612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.982799 (+1042187us) service_pool.cc:224] Handling call
0709 13:15:44.983286 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.983574 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.983620 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.983690 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:44.983735 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.983832 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.984012 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:44.994760  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:44.996188  7253 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:45.000579 13351 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:45.002936 13201 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.794s	user 0.014s	sys 0.000s
I20260709 13:15:45.003465 12987 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:45.004415  7895 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
W20260709 13:15:45.005231 13297 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.156s	user 0.014s	sys 0.000s
I20260709 13:15:45.006120  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1143) took 1186 ms. Trace:
I20260709 13:15:45.005844 13297 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:45.007428 13363 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:15:45.008759  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2517) took 1949 ms. Trace:
I20260709 13:15:45.009217  7331 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:15:45.009455  7889 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:15:45.009855  7335 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:15:45.010031  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2212) took 1252 ms. Trace:
I20260709 13:15:45.010697  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2269) took 3331 ms. Trace:
I20260709 13:15:45.011302 13247 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:45.011687 13297 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:45.011831  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 970) took 2168 ms. Trace:
I20260709 13:15:45.010413  7331 rpcz_store.cc:276] 0709 13:15:43.758050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.008471 (+1250421us) service_pool.cc:224] Handling call
0709 13:15:45.008850 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.009761 (+   911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.009971 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.012322  7891 rpcz_store.cc:276] 0709 13:15:42.843779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.844392 (+   613us) service_pool.cc:224] Handling call
0709 13:15:42.871979 (+ 27587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:42.973482 (+101503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.011549 (+2038067us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b540043b2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:45.011732 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158972288}
I20260709 13:15:45.013777 12976 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.010299  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 845) took 1536 ms. Trace:
W20260709 13:15:45.018220  7896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1065) took 2422 ms (client timeout 2152 ms). Trace:
I20260709 13:15:45.010581  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2213) took 1252 ms. Trace:
I20260709 13:15:45.022269  7335 rpcz_store.cc:276] 0709 13:15:43.758325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.009301 (+1250976us) service_pool.cc:224] Handling call
0709 13:15:45.009626 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.010327 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.010526 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:45.026247  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.009177  7180 rpcz_store.cc:276] 0709 13:15:43.059440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.059654 (+   214us) service_pool.cc:224] Handling call
0709 13:15:45.008549 (+1948895us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54002b52d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.008690 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914533632}
I20260709 13:15:45.028237  7335 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:15:45.029153  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2218) took 1269 ms. Trace:
I20260709 13:15:45.029577  7335 rpcz_store.cc:276] 0709 13:15:43.759845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.027472 (+1267627us) service_pool.cc:224] Handling call
0709 13:15:45.027985 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.028775 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.029078 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:45.018740  7896 rpcz_store.cc:269] 0709 13:15:42.593942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.594086 (+   144us) service_pool.cc:224] Handling call
0709 13:15:45.015654 (+2421568us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540043a154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.015847 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3046736128}
I20260709 13:15:45.011722 13247 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:45.011137  7330 rpcz_store.cc:276] 0709 13:15:41.679012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.265597 (+586585us) service_pool.cc:224] Handling call
0709 13:15:42.266018 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.877732 (+1611714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.010421 (+1132689us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540036b854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:45.010586 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3704230784}
I20260709 13:15:45.034125  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 847) took 1543 ms. Trace:
I20260709 13:15:45.037107  7891 rpcz_store.cc:276] 0709 13:15:43.474251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.013879 (+1539628us) service_pool.cc:224] Handling call
0709 13:15:45.014233 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.014455 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.014485 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.014530 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:45.014563 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.017517 (+  2954us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.017671 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.038674  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.040113  7253 raft_consensus.cc:2410] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:15:45.006511  7181 rpcz_store.cc:276] 0709 13:15:43.819945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.179415 (+359470us) service_pool.cc:224] Handling call
0709 13:15:44.183051 (+  3636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.183448 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:44.183477 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.193475 (+  9998us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.455910 (+262435us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:44.455972 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.456076 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.005848 (+549772us) raft_consensus.cc:1685] finished
0709 13:15:45.005877 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.006041 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":468,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"thread_start_us":261787,"threads_started":1,"wal-append.queue_time_us":479708}
I20260709 13:15:44.983151 13364 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:45.016542  7889 rpcz_store.cc:276] 0709 13:15:43.473689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.008775 (+1535086us) service_pool.cc:224] Handling call
0709 13:15:45.009094 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.010003 (+   909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.010212 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.034957 13312 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:45.016539 13243 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.036720 13205 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:45.063849  7335 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:15:45.080953 13364 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.081512  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1083) took 1235 ms. Trace:
W20260709 13:15:45.043833 13367 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:15:45.085744 13299 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:45.087796 13209 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.872s	user 0.012s	sys 0.000s
I20260709 13:15:45.089263 13322 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:45.091348 13310 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:45.092216  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.045063 13368 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:15:45.130995  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:45.097353  7889 rpcz_store.cc:276] 0709 13:15:43.846372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.054929 (+1208557us) service_pool.cc:224] Handling call
0709 13:15:45.080676 (+ 25747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.080997 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.081039 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.081122 (+    83us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:45.081173 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.081255 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.081432 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.082922 13247 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:44.988193 13189 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:45.115712  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2219) took 1355 ms. Trace:
W20260709 13:15:45.120028  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 723375us
I20260709 13:15:45.137215  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:45.142606  7335 rpcz_store.cc:276] 0709 13:15:43.760206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.030588 (+1270382us) service_pool.cc:224] Handling call
0709 13:15:45.063407 (+ 32819us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.115220 (+ 51813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.115613 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.121424 13349 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:45.148550  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.149492  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.052543 13257 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:45.092204 13312 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.153566  7335 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:15:45.144891 13247 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:45.128119 13209 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.165725  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:45.162362  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2225) took 1400 ms. Trace:
I20260709 13:15:45.167577  7335 rpcz_store.cc:276] 0709 13:15:43.762431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.152741 (+1390310us) service_pool.cc:224] Handling call
0709 13:15:45.153264 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.161846 (+  8582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.162257 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.169363  7335 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:15:45.144959 13322 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:15:45.171768  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 120999us
I20260709 13:15:45.176231  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2284) took 1365 ms. Trace:
I20260709 13:15:45.176819  7335 rpcz_store.cc:276] 0709 13:15:43.807121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.168671 (+1361550us) service_pool.cc:224] Handling call
0709 13:15:45.169090 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.172510 (+  3420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.172780 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.180155  7254 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:45.178509  7335 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:15:45.181449  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2286) took 1373 ms. Trace:
W20260709 13:15:45.174307 13258 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.550s	user 0.013s	sys 0.001s
I20260709 13:15:45.181882  7335 rpcz_store.cc:276] 0709 13:15:43.807768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.177749 (+1369981us) service_pool.cc:224] Handling call
0709 13:15:45.178172 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.181088 (+  2916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.181376 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.051239  7078 catalog_manager.cc:5697] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 14 to 16, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 16 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:45.186818  7335 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:15:45.187834  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2287) took 1379 ms. Trace:
I20260709 13:15:45.188352  7335 rpcz_store.cc:276] 0709 13:15:43.808088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.185834 (+1377746us) service_pool.cc:224] Handling call
0709 13:15:45.186291 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.187454 (+  1163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.187753 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.188894  7078 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 14 to 18, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 18 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.191311  7078 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:45.193008  7078 catalog_manager.cc:5697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 14 to 17, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 17 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:45.194422  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.198335 13358 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.543s	user 0.014s	sys 0.001s
I20260709 13:15:45.217466 13358 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:45.270514  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.307823  7892 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:45.309610 13358 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:45.310415  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.310912 13364 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:45.311247  7253 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:45.311923  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2186) took 1060 ms. Trace:
I20260709 13:15:45.312292  7253 rpcz_store.cc:276] 0709 13:15:44.251734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.182813 (+931079us) service_pool.cc:224] Handling call
0709 13:15:45.311844 (+129031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.313685  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.315001  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1075) took 1470 ms. Trace:
I20260709 13:15:45.316238 13312 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.315464  7896 rpcz_store.cc:276] 0709 13:15:43.844434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.032543 (+1188109us) service_pool.cc:224] Handling call
0709 13:15:45.033010 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.033451 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.033484 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.043214 (+  9730us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.157201 (+113987us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:45.157242 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.157333 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.314778 (+157445us) raft_consensus.cc:1685] finished
0709 13:15:45.314802 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.314934 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4736,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":32927,"thread_start_us":113536,"threads_started":1,"wal-append.queue_time_us":269422}
W20260709 13:15:45.323468  7257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3418) took 1637 ms (client timeout 1956 ms). Trace:
W20260709 13:15:45.324019  7257 rpcz_store.cc:269] 0709 13:15:43.685634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.799616 (+113982us) service_pool.cc:224] Handling call
0709 13:15:45.323239 (+1523623us) spinlock_profiling.cc:243] Waited 60.3 ms on lock 0x7b54003499d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.323396 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138804096}
I20260709 13:15:45.310269 13209 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.330760 13322 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:45.332399  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1078) took 1487 ms. Trace:
I20260709 13:15:45.336047 13189 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.337913  7333 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:45.311093  7078 catalog_manager.cc:5697] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 11, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 11 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:45.333041  7891 rpcz_store.cc:276] 0709 13:15:43.845222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.038923 (+1193701us) service_pool.cc:224] Handling call
0709 13:15:45.052138 (+ 13215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.052476 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:15:45.157185 (+104709us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.331884 (+174699us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.331956 (+    72us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:45.332007 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.332195 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.332336 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":262396,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"thread_start_us":275688,"threads_started":2}
I20260709 13:15:45.339160  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.373742  7253 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:15:45.338606  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2230) took 1079 ms. Trace:
I20260709 13:15:45.345042 12968 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.351799 13290 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:45.381013 13290 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:45.381836  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1197) took 1843 ms. Trace:
W20260709 13:15:45.376407  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.360653  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2289) took 1551 ms. Trace:
I20260709 13:15:45.379127  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:45.361269  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:45.377991  7333 rpcz_store.cc:276] 0709 13:15:44.258924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.337246 (+1078322us) service_pool.cc:224] Handling call
0709 13:15:45.337557 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.338353 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.338551 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.392958  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:45.405730  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.382261  7260 rpcz_store.cc:276] 0709 13:15:43.538914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.877854 (+338940us) service_pool.cc:224] Handling call
0709 13:15:43.952101 (+ 74247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.976213 (+ 24112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.381596 (+1405383us) spinlock_profiling.cc:243] Waited 73.9 ms on lock 0x7b54001e05d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.381752 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169869696}
I20260709 13:15:45.412940  7253 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:45.412987  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.414299  7260 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:45.387778  7335 rpcz_store.cc:276] 0709 13:15:43.808753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.190029 (+1381276us) service_pool.cc:224] Handling call
0709 13:15:45.190560 (+   531us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:45.191862 (+  1302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.191912 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:45.192766 (+   854us) log.cc:844] Serialized 52 byte log entry
0709 13:15:45.313937 (+121171us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:45.313991 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.314065 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.360280 (+ 46215us) raft_consensus.cc:1685] finished
0709 13:15:45.360315 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.360548 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":148,"thread_start_us":120643,"threads_started":1,"wal-append.queue_time_us":121047}
I20260709 13:15:45.378670 13252 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:45.426225  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.428722  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.429824 12912 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.435817 12912 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.438117 12912 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.435078 13252 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:45.439709  7895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 862) took 1674 ms (client timeout 2197 ms). Trace:
W20260709 13:15:45.440258  7895 rpcz_store.cc:269] 0709 13:15:43.765739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.238482 (+472743us) service_pool.cc:224] Handling call
0709 13:15:45.439492 (+1201010us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b540056cf54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.439630 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1757977984}
I20260709 13:15:45.440218  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2187) took 1188 ms. Trace:
I20260709 13:15:45.445606  7260 rpcz_store.cc:276] 0709 13:15:44.252035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.425889 (+1173854us) service_pool.cc:224] Handling call
0709 13:15:45.440142 (+ 14253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.364670 13374 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.446164  7253 raft_consensus.cc:2410] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:15:45.358016 13268 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.446056  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:45.449487  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:45.451548  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:45.414469 12852 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:45.452744  7181 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:45.452877  7180 raft_consensus.cc:2410] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 16 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 5.
I20260709 13:15:45.453330  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.379325 13322 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.380133 12968 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.459894  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:45.460139  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:45.457909  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.447631 13258 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.462836  7180 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:45.470438  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:45.471920  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:45.472105  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:45.472702  7181 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:45.476325  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:45.477000  7180 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:45.478943  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3412) took 1791 ms. Trace:
I20260709 13:15:45.479324  7260 rpcz_store.cc:276] 0709 13:15:43.682351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.473476 (+1791125us) service_pool.cc:224] Handling call
0709 13:15:45.473717 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.473852 (+   135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.473866 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.473895 (+    29us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:45.473912 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.473945 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.474014 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.480785  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3413) took 1798 ms. Trace:
I20260709 13:15:45.481073  7260 rpcz_store.cc:276] 0709 13:15:43.682562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.480143 (+1797581us) service_pool.cc:224] Handling call
0709 13:15:45.480413 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.480554 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.480569 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.480599 (+    30us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:45.480618 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.480651 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.480742 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.455883 13374 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:45.478334  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3411) took 1792 ms. Trace:
I20260709 13:15:45.471410 13258 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.492089  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:45.485388  7253 rpcz_store.cc:276] 0709 13:15:43.682136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.474133 (+1791997us) service_pool.cc:224] Handling call
0709 13:15:45.474335 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.474442 (+   107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.474456 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.474482 (+    26us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:45.474500 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.474533 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.474594 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.347657  7078 catalog_manager.cc:5697] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 19, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 19 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.459296 12852 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:45.487106 13211 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:45.499913  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:45.485875 13374 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.502343  7180 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:15:45.488932 13252 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.500622  7181 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:45.503482  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:45.466588 13290 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.495788 13284 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:15:45.506721 13383 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:15:45.507400  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:45.508733  7253 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:45.510090 13322 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:45.510419  7329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2210) took 1756 ms (client timeout 2069 ms). Trace:
W20260709 13:15:45.511106 13377 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:15:45.512992  7078 catalog_manager.cc:5697] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:45.511112  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2214) took 1752 ms. Trace:
I20260709 13:15:45.497848 13312 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:45.500279 13211 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:45.520082  7329 rpcz_store.cc:269] 0709 13:15:43.754005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.755560 (+  1555us) service_pool.cc:224] Handling call
0709 13:15:45.510202 (+1754642us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400191ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.510349 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231524608}
I20260709 13:15:45.521235  7180 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:15:45.523069  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:45.531541  7180 pending_rounds.cc:85] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 10
I20260709 13:15:45.531922  7180 pending_rounds.cc:107] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:15:45.532207  7180 raft_consensus.cc:2889] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:45.524304  7331 rpcz_store.cc:276] 0709 13:15:43.758644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.013755 (+1255111us) service_pool.cc:224] Handling call
0709 13:15:45.014160 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.014670 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:45.319715 (+305045us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.453385 (+133670us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.458531 (+  5146us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.458763 (+   232us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:45.459097 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.459567 (+   470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.459658 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.510852 (+ 51194us) raft_consensus.cc:1685] finished
0709 13:15:45.510881 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.511043 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":398495,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":5338,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":12615,"spinlock_wait_cycles":17524736,"thread_start_us":423021,"threads_started":2,"wal-append.queue_time_us":175438}
I20260709 13:15:45.529628  7253 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:45.516603 13284 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:45.536331  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.537902  7181 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:45.532573 13211 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:45.540143 13284 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:45.551050  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:45.550237 12852 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:45.547443  7078 catalog_manager.cc:5697] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 15, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 15 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:15:45.553829  7255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1195) took 3103 ms (client timeout 1776 ms). Trace:
I20260709 13:15:45.531731 13312 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:45.554288  7255 rpcz_store.cc:269] 0709 13:15:42.450307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.450433 (+   126us) service_pool.cc:224] Handling call
0709 13:15:45.553611 (+3103178us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540009abd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.553757 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1752452992}
I20260709 13:15:45.557734 13290 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.560141 13073 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:45.564091  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2283) took 1757 ms. Trace:
I20260709 13:15:45.564555  7332 rpcz_store.cc:276] 0709 13:15:43.806842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.636470 (+829628us) service_pool.cc:224] Handling call
0709 13:15:45.563879 (+927409us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540031b5d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.564019 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366776704}
I20260709 13:15:45.566188 13319 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:45.567972  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2231) took 1308 ms. Trace:
I20260709 13:15:45.568512  7333 rpcz_store.cc:276] 0709 13:15:44.259207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.410230 (+1151023us) service_pool.cc:224] Handling call
0709 13:15:45.426890 (+ 16660us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.428857 (+  1967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.428906 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.440294 (+ 11388us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.485404 (+ 45110us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:45.485456 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.485544 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.567580 (+ 82036us) raft_consensus.cc:1685] finished
0709 13:15:45.567606 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.567790 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1295,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":12881,"threads_started":1,"wal-append.queue_time_us":71525}
I20260709 13:15:45.566398 13312 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.569867  7262 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:45.573719  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:45.574832  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:45.575452  7332 raft_consensus.cc:2376] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19. Re-sending same reply.
I20260709 13:15:45.575865  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:45.577211 13312 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:45.579027  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:45.580036  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:45.582861  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:45.578145  7254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2188) took 1321 ms (client timeout 1705 ms). Trace:
I20260709 13:15:45.586503  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:45.590999  7254 rpcz_store.cc:269] 0709 13:15:44.257158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.639215 (+382057us) service_pool.cc:224] Handling call
0709 13:15:45.577956 (+938741us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400226ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.578087 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241444224}
I20260709 13:15:45.590973  7333 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:45.592100  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:45.595163  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:45.595826  7896 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:45.598042  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.601691  7301 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:45.604058  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:45.600029  7861 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:45.581490  7078 catalog_manager.cc:5697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 15, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 15 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.613363  7335 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:15:45.613417  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.609953  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.627880  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:45.627562  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:45.628659  7889 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:15:45.615084  7262 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:45.591553 13321 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.636013  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:45.638049  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:45.596813 13206 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:45.599324 12912 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.606412 12852 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:45.612358 13252 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:45.606524 13187 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:45.658417  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:45.599478 13374 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:15:45.627554 13104 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:45.677222  7261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2180) took 2144 ms (client timeout 1867 ms). Trace:
W20260709 13:15:45.677723  7261 rpcz_store.cc:269] 0709 13:15:43.532831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.532962 (+   131us) service_pool.cc:224] Handling call
0709 13:15:45.676970 (+2144008us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400058054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.677144 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267520768}
I20260709 13:15:45.663216  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.661201  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:45.679000  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.679167  7889 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:45.675945  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:45.679910  7261 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:45.681336  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.683423  7260 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:45.682160  7261 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
W20260709 13:15:45.685642  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 50710.2us
I20260709 13:15:45.636564 13257 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:45.594741 13312 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.687790  7261 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:15:45.636739 13310 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:45.635874 13354 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:15:45.699461  7262 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:15:45.701719  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:45.707996  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 62868.8us
I20260709 13:15:45.657979 13299 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:15:45.676178 13374 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:45.660902 12759 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:15:45.723474  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:45.659950 13321 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.662571 12912 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:45.727489  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.727900  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:45.709781 13104 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:45.727788  7335 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:15:45.731127  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 72849.6us
I20260709 13:15:45.734956  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:45.727528  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 83972.1us
I20260709 13:15:45.741130 13406 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:45.744360 13406 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:45.744951 13406 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:45.746919 13304 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:45.747741 13299 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:45.748319 13299 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:45.749171  7078 catalog_manager.cc:5697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 15, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 15 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.703627 13257 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.735029 13189 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:15:45.725553 13284 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.752610 13257 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.706785 13310 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.754617 13284 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.754729 13310 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.756031 12912 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.725322 13374 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:45.764323 13321 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.755944  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:45.726248 12852 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:45.769660  7896 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:45.769157 12852 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:45.772624  7889 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:45.734149 13104 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.750406 13299 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:45.775367 13104 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:45.777717 13312 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.779969  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:45.780836 13273 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.786540  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:45.787004 13273 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:45.787899  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:45.789068 12968 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:45.789268 13273 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:45.790263  7180 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:45.791316  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:45.791949  7180 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:45.791584  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:45.792786  7896 raft_consensus.cc:2376] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17. Re-sending same reply.
I20260709 13:15:45.751880  7078 catalog_manager.cc:5697] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 14, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 14 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:45.800379  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.801421  7262 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:45.789090  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:45.802968  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 61439.6us
I20260709 13:15:45.804271  7335 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:15:45.803045  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:45.798225 13312 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.812551  7253 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:15:45.835140  7253 pending_rounds.cc:85] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 11
I20260709 13:15:45.835500  7253 pending_rounds.cc:107] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:15:45.835845  7253 raft_consensus.cc:2889] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:45.813351 13195 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:45.807128 12987 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:15:45.814782  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:45.815878 13279 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:45.816483  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:45.819607 13374 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:45.820456  7889 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:45.827651 13258 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.827971 13206 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:45.829131 13360 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.754391 13257 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:15:45.830386  7078 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 16, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 16 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.831369 13211 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.831260 13406 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:45.844229  7180 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:45.866739  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:45.845417  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:45.864307  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47910.6us
W20260709 13:15:45.865870  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 125537us
W20260709 13:15:45.865007  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.871817  7335 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:45.875571 13211 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.866267 13360 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.877363  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:45.877254  7078 catalog_manager.cc:5697] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 8 to 12, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 12 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.878840  7257 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:45.875466 13406 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:45.870945  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:45.840459 13252 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:45.841218 13279 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:45.903059  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:45.866266 13354 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:45.901949  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:45.904565  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:45.894172  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.909153  7254 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 13.
W20260709 13:15:45.909883  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 70422.8us
I20260709 13:15:45.910786  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:45.840590 13312 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:45.912635  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:45.911952  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:45.894747 13252 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.915017  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:45.895036 12919 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.916127 13211 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:15:45.919507  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:45.917897  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:45.907966 13195 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.926985  7334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 941) took 2784 ms (client timeout 2740 ms). Trace:
W20260709 13:15:45.927502  7334 rpcz_store.cc:269] 0709 13:15:43.142755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.142888 (+   133us) service_pool.cc:224] Handling call
0709 13:15:45.926773 (+2783885us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b540036ae54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.926906 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872649088}
I20260709 13:15:45.928411  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:45.929080  7181 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:45.929068  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:45.930377  7327 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:45.930927  7334 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:15:45.918465 12987 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.932448  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:45.917374 13252 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:45.933384  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:45.918511 13310 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:45.919108 13406 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:45.920197 13322 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:45.937057  7334 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:45.932217 13195 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:45.938795 13290 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:45.935539 13310 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.941481 13310 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:45.945422  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:45.946539  7893 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:15:45.947553 13290 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:45.937927 13299 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:45.948678 13299 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.923763 13073 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:15:45.949129 13290 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.950973 13195 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:45.935706 13406 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.952168 13406 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:45.952536  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1147) took 2039 ms. Trace:
I20260709 13:15:45.953163  7186 rpcz_store.cc:276] 0709 13:15:43.912855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.866788 (+953933us) service_pool.cc:224] Handling call
0709 13:15:44.894865 (+ 28077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.992524 (+ 97659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.992568 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.992617 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:44.992650 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.952174 (+959524us) spinlock_profiling.cc:243] Waited 97.4 ms on lock 0x7b5400117e54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:45.952246 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.952450 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223937792}
I20260709 13:15:45.930445 13104 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.956074 12987 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:45.957001 13104 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:45.958074  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:45.958892 13312 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:45.959172 13322 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:45.959640 13322 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:45.959868  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:45.962554  7183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2531) took 2240 ms (client timeout 2246 ms). Trace:
W20260709 13:15:45.963120  7183 rpcz_store.cc:269] 0709 13:15:43.722699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.950198 (+227499us) service_pool.cc:224] Handling call
0709 13:15:45.962344 (+2012146us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b540039cbd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.962485 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433775488}
I20260709 13:15:45.963933 13374 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:45.964622  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:45.932014 13211 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:45.968518 13211 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:45.971022  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:45.971843  7890 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:45.972441  7261 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:45.973450  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3416) took 2290 ms. Trace:
I20260709 13:15:45.974004  7260 rpcz_store.cc:276] 0709 13:15:43.683422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.481801 (+1798379us) service_pool.cc:224] Handling call
0709 13:15:45.683148 (+201347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.684015 (+   867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.973132 (+289117us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400058050. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:45.973339 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462317312}
I20260709 13:15:45.976231  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:45.976796  7260 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:15:45.977794 13397 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.356s	user 0.003s	sys 0.000s
I20260709 13:15:45.978807  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2177) took 2449 ms. Trace:
I20260709 13:15:45.979238  7258 rpcz_store.cc:276] 0709 13:15:43.529891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.530060 (+   169us) service_pool.cc:224] Handling call
0709 13:15:43.530414 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.803798 (+273384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.978494 (+2174696us) spinlock_profiling.cc:243] Waited 97.6 ms on lock 0x7b54002d3f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:45.978733 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224510208}
W20260709 13:15:45.984463  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49272.3us
I20260709 13:15:45.973825  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:45.984325  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:45.999903  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.001335  7178 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:46.007709  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.008962  7178 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:46.010113  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:46.015475  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:46.017164  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.020823  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:46.025218  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:46.030162  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54075.5us
I20260709 13:15:46.031826  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:46.032426  7225 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:45.958443 12987 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:46.035562  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.034276  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.033751  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:46.037081  7261 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:46.036157  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:45.949154 13299 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:46.043568  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.047883  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2181) took 2514 ms. Trace:
I20260709 13:15:46.048285  7256 rpcz_store.cc:276] 0709 13:15:43.533128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.624396 (+ 91268us) service_pool.cc:224] Handling call
0709 13:15:43.624788 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.815111 (+190323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.047608 (+2232497us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b5400216bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:46.047823 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159959936}
I20260709 13:15:46.049556  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.050429  7178 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:46.019191 13247 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.916023  7078 catalog_manager.cc:5697] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 10 to 16, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 16 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:15:46.052831  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3215) took 2548 ms. Trace:
I20260709 13:15:46.054225  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.030861 13195 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.053287  7185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3225) took 2391 ms (client timeout 1771 ms). Trace:
W20260709 13:15:46.053501  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.033905 13206 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:15:46.055888  7185 rpcz_store.cc:269] 0709 13:15:43.658576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.731682 (+ 73106us) service_pool.cc:224] Handling call
0709 13:15:46.045050 (+2313368us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b5400248454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:46.045207 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174525824}
I20260709 13:15:46.054793  7179 rpcz_store.cc:276] 0709 13:15:43.497256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.497932 (+   676us) service_pool.cc:224] Handling call
0709 13:15:43.504265 (+  6333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.381587 (+877322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.045287 (+1663700us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b540039dfd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:46.045571 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009131264}
I20260709 13:15:46.058446  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.063091  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:46.068871  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:46.075630  7256 raft_consensus.cc:2410] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:15:46.029381 12912 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:15:46.019414 13409 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:15:46.038318 13218 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:46.042096 13321 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:46.075680  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.045840 12987 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:46.077781  7893 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:46.037694 13243 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
W20260709 13:15:46.078935  7894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 837) took 2607 ms (client timeout 2056 ms). Trace:
I20260709 13:15:46.054286 13312 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:46.091306  7894 rpcz_store.cc:269] 0709 13:15:43.471343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.474778 (+  3435us) service_pool.cc:224] Handling call
0709 13:15:46.078747 (+2603969us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54000bbb54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:46.078865 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619545856}
I20260709 13:15:46.088171  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:46.057415 13404 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.085690  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.037412 13401 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
W20260709 13:15:46.085628  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 60520us
I20260709 13:15:46.136484  7181 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:46.137821  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:46.062567 13247 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.094023  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.053083 13364 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:15:46.152379  7179 raft_consensus.cc:2410] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:15:46.083691  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 44190.7us
W20260709 13:15:46.095505 13414 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:15:46.097077 13243 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:46.088485 12912 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:46.064352 13195 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:46.099960  7078 catalog_manager.cc:5697] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 10 to 11, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 11 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.112922 13406 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.117627  7261 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:46.012550 13279 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.150374  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:46.217077  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:46.093179  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.094647 13284 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:46.183619  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:46.220856  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 70569.3us
I20260709 13:15:46.226475 13279 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:46.134665 13374 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:46.230654  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:46.233273  7178 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:46.238862  7180 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:46.174815 13321 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:15:46.242492  7328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2290) took 2433 ms (client timeout 1870 ms). Trace:
I20260709 13:15:46.242918  7180 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: []
W20260709 13:15:46.245386  7328 rpcz_store.cc:269] 0709 13:15:43.809109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.939524 (+130415us) service_pool.cc:224] Handling call
0709 13:15:46.242318 (+2302794us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b540013d654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:46.242423 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5759744}
W20260709 13:15:46.243455  7187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3222) took 2690 ms (client timeout 1692 ms). Trace:
W20260709 13:15:46.243773  7336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 943) took 3004 ms (client timeout 1827 ms). Trace:
W20260709 13:15:46.247388  7336 rpcz_store.cc:269] 0709 13:15:43.239819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.240713 (+   894us) service_pool.cc:224] Handling call
0709 13:15:46.243599 (+3002886us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54000212d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:46.243705 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791061888}
W20260709 13:15:46.248164  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 64655.2us
I20260709 13:15:46.249047  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:46.251212  7178 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
W20260709 13:15:46.247117  7187 rpcz_store.cc:269] 0709 13:15:43.553056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.553233 (+   177us) service_pool.cc:224] Handling call
0709 13:15:46.243177 (+2689944us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540036db54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:46.243362 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3049959296}
I20260709 13:15:46.255635  7180 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
I20260709 13:15:46.193593 13243 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:46.258179  7182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2536) took 2334 ms (client timeout 1925 ms). Trace:
W20260709 13:15:46.266796  7182 rpcz_store.cc:269] 0709 13:15:43.923427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.926394 (+  2967us) service_pool.cc:224] Handling call
0709 13:15:46.250317 (+2323923us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b5400117454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:46.258089 (+  7772us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14869760}
I20260709 13:15:46.193017 12912 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:46.223794 13257 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:46.228436 13218 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:46.221976 13409 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:46.259141 13287 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:15:46.135321 13404 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.178721 13310 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:46.287104  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:46.294981  7254 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:46.296589  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:46.295009  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3425) took 1404 ms. Trace:
I20260709 13:15:46.299861  7253 rpcz_store.cc:276] 0709 13:15:44.890955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.533708 (+642753us) service_pool.cc:224] Handling call
0709 13:15:45.533965 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.836385 (+302420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.294599 (+458214us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54002274d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:46.294918 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639510400}
I20260709 13:15:46.292006  7187 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:15:46.301393  7187 pending_rounds.cc:85] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 9
I20260709 13:15:46.301680  7187 pending_rounds.cc:107] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:15:46.301940  7187 raft_consensus.cc:2889] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:46.311874  7179 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:46.276671 12912 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:46.341178  7256 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:46.234047 13252 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:46.258008 13312 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:15:46.238837 13256 consensus_queue.cc:1175] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" responder_term: 17 status { last_received { term: 16 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:46.284250 13073 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.278488 13374 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:15:46.436687  7179 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:15:46.407652  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 169533us
I20260709 13:15:46.446935  7185 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:46.347797 13187 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:46.353962 13195 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:46.293932 13409 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:46.434080 13211 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:46.355139 13319 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.156s
I20260709 13:15:46.444661 13312 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:46.500451 13187 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:46.533864 13421 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 13:15:46.537753  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:46.539188  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:46.552234  7889 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:46.540956  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:46.543310 13395 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.923s	user 0.002s	sys 0.000s
I20260709 13:15:46.492574 13073 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.509866 13321 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:46.516687 13273 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:46.549978 13187 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:46.577155  7327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2288) took 2768 ms (client timeout 1867 ms). Trace:
W20260709 13:15:46.577744  7327 rpcz_store.cc:269] 0709 13:15:43.808393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.920702 (+112309us) service_pool.cc:224] Handling call
0709 13:15:46.576931 (+2656229us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400278154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:46.577073 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4409522560}
I20260709 13:15:46.435240 13243 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.562867 12987 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:46.612601  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:46.555914 12858 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:15:46.619546  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:46.621194  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3428) took 1708 ms. Trace:
I20260709 13:15:46.623642  7255 rpcz_store.cc:276] 0709 13:15:44.912562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.557143 (+644581us) service_pool.cc:224] Handling call
0709 13:15:45.557541 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.557984 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.558019 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.558612 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.628504 (+ 69892us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:45.628547 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.628627 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.542558 (+913931us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:46.620666 (+ 78108us) raft_consensus.cc:1685] finished
0709 13:15:46.620701 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.621100 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":621,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":6392192,"thread_start_us":56640,"threads_started":1,"wal-append.queue_time_us":45522}
I20260709 13:15:46.563117 13195 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:15:46.571009 13205 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
W20260709 13:15:46.640650  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 86413.8us
I20260709 13:15:46.605667 13218 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:46.649924  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:46.583127 13273 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:46.626156 13406 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:46.642120 13247 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:46.633637  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.639081 13410 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:46.625403 13431 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:15:46.651859 13416 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.409s	user 0.000s	sys 0.002s
I20260709 13:15:46.655910  7894 raft_consensus.cc:2955] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 5 to 11, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:15:46.717965  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:46.738895  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.558391  7078 catalog_manager.cc:5697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:46.740402  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 207773us
I20260709 13:15:46.635241 13312 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.663251 13404 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:46.749346  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:46.744308  7255 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:46.761246  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:46.777674  7259 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:46.771528  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:46.740427 13252 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:46.745594 13419 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.750866 13428 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:15:46.741891 13410 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:46.763629 13310 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:46.670248 12858 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
W20260709 13:15:46.782800  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 125504us
I20260709 13:15:46.742702 13406 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:15:46.807289 13434 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:15:46.869954  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 46145.4us
I20260709 13:15:46.879871  7259 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:46.803784 13439 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:46.881760  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 119659us
W20260709 13:15:46.892043  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:46.882351 13425 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.318s	user 0.000s	sys 0.002s
I20260709 13:15:46.763844 13321 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.879454 13073 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:46.811885 13419 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:46.903694 13430 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:15:46.916504  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:46.800163 13218 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.898713 13409 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:46.926692 13073 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.928467 13433 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.933169 13073 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.933495 13433 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.911175 13443 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:15:46.922818 13448 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:15:46.901678 13404 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:15:46.894199 13439 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:46.955623  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2224) took 3193 ms. Trace:
I20260709 13:15:46.958190  7330 rpcz_store.cc:276] 0709 13:15:43.762047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.036254 (+1274207us) service_pool.cc:224] Handling call
0709 13:15:45.036691 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.131728 (+ 95037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.131783 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.131850 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:45.131900 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.955285 (+1823385us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b540031c4d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:46.955342 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.955528 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217837312}
I20260709 13:15:46.945569 13273 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:46.942073 13406 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:46.975848  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.020s	sys 0.036s
W20260709 13:15:46.986922  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.020s	sys 0.037s
W20260709 13:15:46.987599  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 738570us
I20260709 13:15:46.988389  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:46.990672 13429 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.244s	user 0.002s	sys 0.000s
I20260709 13:15:46.954128 13452 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.021340 13452 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.023783 13452 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:46.999104 13447 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
W20260709 13:15:47.001693 13322 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.042s	user 0.014s	sys 0.000s
I20260709 13:15:47.025992 13322 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.027196  7260 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:47.028537 13322 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.029446  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3444) took 1192 ms. Trace:
I20260709 13:15:47.030342 13419 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.029877  7260 rpcz_store.cc:276] 0709 13:15:45.837087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.977732 (+140645us) service_pool.cc:224] Handling call
0709 13:15:45.978052 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.027594 (+1049542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.029168 (+  1574us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400125054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:47.029385 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412362624}
I20260709 13:15:46.922184 13410 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.033277 13284 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:47.034776  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 46482.1us
I20260709 13:15:47.035210 13364 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.035624  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:47.035742 13364 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:47.002161 12912 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.003s
W20260709 13:15:47.005239 13299 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.953s	user 0.013s	sys 0.000s
W20260709 13:15:47.006029 13279 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.779s	user 0.008s	sys 0.003s
I20260709 13:15:47.045063  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.046128  7150 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:47.047578  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.048482  7327 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:15:47.007510 13195 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:47.014613 13439 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.016460 13257 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:47.016209 13406 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:46.984982 13448 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:47.037379  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3419) took 3351 ms. Trace:
I20260709 13:15:47.037457  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:47.082641  7257 rpcz_store.cc:276] 0709 13:15:43.685967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.488474 (+1802507us) service_pool.cc:224] Handling call
0709 13:15:45.488787 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.879271 (+390484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.037134 (+1157863us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b540009a6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:47.037315 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896519552}
I20260709 13:15:47.052307  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2295) took 1473 ms. Trace:
I20260709 13:15:47.084286  7329 rpcz_store.cc:276] 0709 13:15:45.578569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.584683 (+  6114us) service_pool.cc:224] Handling call
0709 13:15:45.610417 (+ 25734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.687589 (+ 77172us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:45.687628 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.694821 (+  7193us) log.cc:844] Serialized 564 byte log entry
0709 13:15:45.894185 (+199364us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:45.894223 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.041012 (+1146789us) spinlock_profiling.cc:243] Waited 76.4 ms on lock 0x7b5400191ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:47.041072 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:47.041120 (+    48us) raft_consensus.cc:1685] finished
0709 13:15:47.041134 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.052229 (+ 11095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175802624,"thread_start_us":198952,"threads_started":1,"wal-append.queue_time_us":237152,"wal-append.run_cpu_time_us":1859,"wal-append.run_wall_time_us":1039281}
I20260709 13:15:47.069260  7330 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:47.075109  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.036496 13247 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:47.077692  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:47.089766  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 52483.4us
I20260709 13:15:47.090615  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:47.091934  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:47.094954  7327 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:15:47.053960 13195 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:47.097795  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:47.103753  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:47.076480 13257 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:47.107198  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.109426  7327 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:47.075676 13439 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:47.100376  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.119127  7333 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:47.103330  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.119786  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:47.120509  7335 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:15:47.082239 13448 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:47.125408  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:47.111789 13419 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:47.107569  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 844) took 3634 ms. Trace:
I20260709 13:15:47.128993  7892 rpcz_store.cc:276] 0709 13:15:43.473441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.709023 (+1235582us) service_pool.cc:224] Handling call
0709 13:15:44.715059 (+  6036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.308736 (+593677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.107228 (+1798492us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400684f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:47.107480 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362651520}
I20260709 13:15:47.105372 13322 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:47.065744 13299 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.099754 13435 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:47.051846 12912 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:47.135232  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.129796  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.109387 13362 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:47.127990 13217 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:47.131891  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:47.128201 13439 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.108630 13284 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:47.144784  7180 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:47.131228  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:47.147058  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:47.134526  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:47.128513 13187 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.004s
I20260709 13:15:47.144160 12912 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:47.130308 13419 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:47.150985  7183 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:47.139155 13362 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:47.151598  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:47.128047 13404 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:47.155140  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.129503 13432 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:47.162801  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:47.161427 13279 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:47.171484 13364 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:47.131934 13312 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:15:47.158977 13448 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.178437 13448 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:47.179682 13073 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.159547 12470 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:47.142781 13195 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.182569 13195 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:47.184360 13436 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.385s	user 0.003s	sys 0.000s
I20260709 13:15:47.141304 13321 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:15:47.186825 13433 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.187186 13321 consensus_queue.cc:1243] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:15:47.167654 13299 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.192656 13439 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.194221 13406 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:47.148010 13298 raft_consensus.cc:2764] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:15:47.194918  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:47.158411 13419 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:47.197872  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3233) took 1310 ms. Trace:
W20260709 13:15:47.199322  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 151400us
I20260709 13:15:47.159308 13362 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:47.157524 13217 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:15:47.152171 13437 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:47.161631 13456 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:15:47.154063 13322 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:15:47.152247 13187 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.189548 13438 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:47.199461  7178 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:47.201195  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:47.207489  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 60575.6us
I20260709 13:15:47.198362  7185 rpcz_store.cc:276] 0709 13:15:45.887810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.058194 (+170384us) service_pool.cc:224] Handling call
0709 13:15:47.197585 (+1139391us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54000ee2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:47.197774 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724322688}
I20260709 13:15:47.208822  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:47.208899  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:47.209708  7185 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:47.210736 13463 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:15:47.212095 13360 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:47.218139  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1149) took 1288 ms. Trace:
I20260709 13:15:47.220068 13187 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:47.221316 13322 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:47.221774 13322 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:47.223209 13342 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:47.223696 13342 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:47.224236  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:47.224550 13342 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.208366 13438 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:47.226384 13438 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.227813 13438 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:47.228571 12919 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.229151 12919 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.231026 13243 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:47.231551  7894 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:15:47.204020 13319 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:47.233773  7180 rpcz_store.cc:276] 0709 13:15:45.929676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.256513 (+326837us) service_pool.cc:224] Handling call
0709 13:15:46.256783 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.150841 (+894058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.217818 (+ 66977us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b5400256a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:47.218064 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2041756928}
I20260709 13:15:47.235350  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:47.235986  7180 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:47.222790 13322 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.172914 13431 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:47.240039 12919 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.246098  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:47.262380  7185 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:47.249845  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.251029  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:47.253189  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.264258  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:47.225698 13342 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:47.242555 13437 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:47.354360  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1152) took 1423 ms. Trace:
I20260709 13:15:47.287715  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.365366  7178 rpcz_store.cc:276] 0709 13:15:45.931353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.266832 (+335479us) service_pool.cc:224] Handling call
0709 13:15:47.199227 (+932395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.207673 (+  8446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.354055 (+146382us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54000ee2d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:47.354288 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143466880}
I20260709 13:15:47.277729  7180 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
W20260709 13:15:47.355018  7152 leader_election.cc:336] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.502s (SENT)
W20260709 13:15:47.296303  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50813.4us
I20260709 13:15:47.367280  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:47.367460  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:47.367811  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:47.263697  7333 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:47.338282  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.266119  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:47.335115  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.266563  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:47.274725  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:47.265894  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.283025  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.371703  7327 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:47.371815  7329 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:47.322285  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:47.374384  7258 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:15:47.294256  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48295.8us
I20260709 13:15:47.370957  7331 raft_consensus.cc:2376] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19. Re-sending same reply.
I20260709 13:15:47.381614  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:47.383404  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:47.384759  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:47.343138  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.386488  7261 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
W20260709 13:15:47.388440  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 113847us
W20260709 13:15:47.293111  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 305505us
I20260709 13:15:47.376786  7260 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 13:15:47.265576  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:47.390559  7185 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:47.369103  7178 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:47.391587  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.368322  7862 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:47.322788  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.392596  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:47.393375  7255 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:47.395480  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:47.396373  7253 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:47.352144 12987 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:47.406891  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:47.404244  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.258212 13354 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:15:47.348539 13460 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:15:47.404670  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.405390  7859 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:47.406585  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.411855  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:47.345916 13310 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.283111 13298 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:47.287786 13322 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:47.258342 13319 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.405997  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1160) took 1281 ms. Trace:
I20260709 13:15:47.414126  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:47.426371  7178 rpcz_store.cc:276] 0709 13:15:46.124688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.404687 (+1279999us) service_pool.cc:224] Handling call
0709 13:15:47.404970 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.405340 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.405372 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:47.405604 (+   232us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:15:47.405661 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.405754 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.405938 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:47.294548 12919 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:15:47.429311  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:47.408772  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:47.400388 13439 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:47.414826  7332 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:47.418388  7260 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
W20260709 13:15:47.423969  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.415053 13287 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:15:47.424975  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.346274 13403 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:15:47.439652 13403 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:47.407333 12987 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:47.440954 13403 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.387835 13288 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:15:47.443073 13341 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:47.432073 13426 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:47.447019  7335 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
W20260709 13:15:47.447301 13424 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:15:47.437094 12919 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:47.448045 12919 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:15:47.447929 13247 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:47.450731 13287 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:47.451180 13287 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:47.452037 13287 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.453600 13287 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:47.416116  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47835.9us
I20260709 13:15:47.442312 13403 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:47.442884 13411 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:47.452502 13458 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:47.431524  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.473670  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.476917  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.477411  7253 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:47.477960  7255 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:47.439038  7329 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:47.438972 13073 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:47.431366  7150 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:47.283720 13362 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:47.483413  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 52135.5us
I20260709 13:15:47.296644 13461 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.141s
I20260709 13:15:47.437561  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:47.293479 13252 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.124s
I20260709 13:15:47.282929 13360 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.145s
I20260709 13:15:47.414675 13459 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:47.478585  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:47.481740  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:47.556898  7255 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:47.482215  7331 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:47.484205  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:47.558214  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 74095.4us
I20260709 13:15:47.558548  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:47.559360  7150 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:47.560248  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.560405  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:47.457461  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:47.561249  7331 raft_consensus.cc:2368] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15.
W20260709 13:15:47.561606  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 104215us
I20260709 13:15:47.561726 13468 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:47.562390 13468 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.562551  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:47.562932 13468 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:47.563126  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:47.563803  7329 raft_consensus.cc:2376] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17. Re-sending same reply.
I20260709 13:15:47.564756  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.565382  7329 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:47.350956 13431 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.548074 13426 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:47.567199 13426 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.567577 13426 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:47.572300  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:47.481045 13321 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:47.579732  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.579741  7181 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:15:47.610950  7181 pending_rounds.cc:85] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 10
I20260709 13:15:47.611363  7181 pending_rounds.cc:107] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:15:47.611691  7181 raft_consensus.cc:2889] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:47.611720  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 109478us
I20260709 13:15:47.433188 13374 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:47.417590 13452 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 13:15:47.424165 12470 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:15:47.427942 13310 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.632529 13258 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:47.639693 13462 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:47.642189 13299 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.643710 13462 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:47.644275 13462 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:47.644184 13299 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.618513 13448 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:47.646553 13448 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.647011 13448 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:47.648563 13362 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:47.605970  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3250) took 1060 ms. Trace:
I20260709 13:15:47.492106 13458 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.651424  7179 rpcz_store.cc:276] 0709 13:15:46.545348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.630411 (+ 85063us) service_pool.cc:224] Handling call
0709 13:15:47.605629 (+975218us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b540036db54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:47.605870 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164385152}
I20260709 13:15:47.632171 13243 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:47.653697 13458 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.653963 13243 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:47.655208 13243 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.656800 13252 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:47.621158  7259 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 14. Current term is 15. Ops: []
W20260709 13:15:47.621620  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.456025 13437 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.179s
W20260709 13:15:47.637928 13472 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.195s	user 0.003s	sys 0.000s
I20260709 13:15:47.470232 13450 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:47.632264  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 984) took 1095 ms. Trace:
I20260709 13:15:47.596776  7329 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:47.483115 13073 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:47.456354 13319 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.653184  7330 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:47.654978 13452 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:47.455574 13470 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.225s
I20260709 13:15:47.696614  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3451) took 1581 ms. Trace:
I20260709 13:15:47.698097  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2557) took 2098 ms. Trace:
I20260709 13:15:47.714864  7186 rpcz_store.cc:276] 0709 13:15:45.599595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.215509 (+615914us) service_pool.cc:224] Handling call
0709 13:15:46.215962 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:46.550582 (+334620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.550620 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:46.550692 (+    72us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:15:46.550727 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.697745 (+1147018us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54002724d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:47.697821 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.698001 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769037696}
I20260709 13:15:47.562247  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.688334  7888 rpcz_store.cc:276] 0709 13:15:46.536746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.556526 (+ 19780us) service_pool.cc:224] Handling call
0709 13:15:46.573542 (+ 17016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.584112 (+ 10570us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:15:46.757984 (+173872us) log.cc:844] Serialized 14 byte log entry
0709 13:15:47.243413 (+485429us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.264392 (+ 20979us) log.cc:844] Serialized 26 byte log entry
0709 13:15:47.264582 (+   190us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:15:47.264627 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.264704 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:47.632016 (+367312us) raft_consensus.cc:1685] finished
0709 13:15:47.632038 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.632192 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":211823,"prepare.queue_time_us":338892,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":14679,"raft.queue_time_us":235892,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":70099,"thread_start_us":383520,"threads_started":2,"wal-append.queue_time_us":358295}
W20260709 13:15:47.705484  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.623291  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:47.613842  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.657518 13252 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:47.719272 13406 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.720708  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:47.706831 13299 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.713820  7256 rpcz_store.cc:276] 0709 13:15:46.115538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.115719 (+   181us) service_pool.cc:224] Handling call
0709 13:15:46.116076 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:46.353320 (+237244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.696214 (+1342894us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54002f7454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:47.696507 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517146368}
I20260709 13:15:47.750360  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.731094  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1142) took 3913 ms. Trace:
W20260709 13:15:47.722281  7152 leader_election.cc:336] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.705s (SENT)
W20260709 13:15:47.736861  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.737643  7331 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:47.759127  7258 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:47.760686  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.703604 13073 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:47.704035 13256 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.752206  7184 rpcz_store.cc:276] 0709 13:15:43.818158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.163539 (+345381us) service_pool.cc:224] Handling call
0709 13:15:45.962555 (+1799016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.214086 (+251531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.214135 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:46.214814 (+   679us) log.cc:844] Serialized 26 byte log entry
0709 13:15:46.554898 (+340084us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:46.602499 (+ 47601us) log.cc:844] Serialized 14 byte log entry
0709 13:15:46.602829 (+   330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.602935 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:47.183625 (+580690us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:47.188025 (+  4400us) raft_consensus.cc:1685] finished
0709 13:15:47.188138 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.730747 (+542609us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b540039cbd0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:47.730975 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48327,"prepare.queue_time_us":42515,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":1874,"raft.queue_time_us":78464,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":13719,"spinlock_wait_cycles":4089496576,"thread_start_us":447219,"threads_started":2,"wal-append.queue_time_us":475590}
I20260709 13:15:47.700569 13354 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:47.704349 13452 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:47.709677 13450 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:47.657102 13468 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.725373 13433 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:47.763993  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.765712 13406 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.771184  7255 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:15:47.772089 13354 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:15:47.772574  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.814796  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:47.792936  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:47.816999  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:47.800393  7152 leader_election.cc:336] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.867s (SENT)
I20260709 13:15:47.798825  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:47.764428  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:47.818596  7152 leader_election.cc:336] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.870s (SENT)
I20260709 13:15:47.762473  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.820618  7260 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:47.818933  7184 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:47.821534  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:47.823868  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.824743  7258 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:15:47.824838  7255 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:47.765125 13298 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:47.834864 13298 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:47.835413 13298 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:47.783528 13360 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.762987 13410 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:47.837733 13360 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.763059 12968 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:47.838454 13410 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.838932 12968 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.840158 13360 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:47.840775 13410 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.841027 12968 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:47.778162 13256 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.834898 13450 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.782737 12919 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.844883 12919 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:47.782328 13257 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.658s	user 0.012s	sys 0.000s
I20260709 13:15:47.846318 13257 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.846555  7302 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:47.795636 13433 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.854230  7257 raft_consensus.cc:2376] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17. Re-sending same reply.
I20260709 13:15:47.854682 13341 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:47.855015 13433 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:47.855541 13341 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:47.857180 13341 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.823182 12858 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.780289 13452 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:47.858982 12858 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.830485 13205 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.863075 13205 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.849413  7180 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
W20260709 13:15:47.830662 13473 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:15:47.816376 13252 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:47.885919  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.890507 13205 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:47.893380 13406 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:47.840806 13360 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:47.862353 12858 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:47.894232 13360 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.896597 13360 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:47.848815 13257 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:47.899871  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.883296  7329 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:47.904583  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.905833  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:47.906263  7302 leader_election.cc:336] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.692s (SENT)
I20260709 13:15:47.906955  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:47.904733  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.821514 13290 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.908664  7260 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:47.908929  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:47.830453 13438 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.002s
W20260709 13:15:47.902058  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 165018us
I20260709 13:15:47.910410  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:47.913751  7302 leader_election.cc:336] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.771s (SENT)
I20260709 13:15:47.913148  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:47.920658  7329 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:47.928589  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.929533  7260 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:47.929319  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.930280  7334 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:47.933763  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.933732  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.935307  7334 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:15:47.943434  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:47.936424  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.941463  7184 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:47.953172  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.936060  7255 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:15:47.956629  7260 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:15:47.961301  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:47.962697  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:47.963778  7152 leader_election.cc:336] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.920s (SENT)
I20260709 13:15:47.971839  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:47.964084  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:47.961236  7329 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:47.965979  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.928339 13360 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:47.910038 12852 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:47.974424 13322 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:47.975063 13322 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:47.975445  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:47.976182  7262 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:15:47.975988 13322 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.977224  7255 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:15:47.977578  7262 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:15:47.969319  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:47.978924  7894 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:47.955036 13448 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.989964  7184 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:47.990119 13448 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:47.932605 13290 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:47.999401  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.991832  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:47.993356  7182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3251) took 1447 ms (client timeout 1771 ms). Trace:
W20260709 13:15:48.016532  7182 rpcz_store.cc:269] 0709 13:15:46.545643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.194428 (+648785us) service_pool.cc:224] Handling call
0709 13:15:47.992963 (+798535us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b5400248454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:47.993273 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438051712}
I20260709 13:15:47.991315  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:48.021167  7184 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:15:48.015496  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51778.9us
I20260709 13:15:48.025043  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.030072  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:48.140561  7256 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:47.996695 13440 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.160s	user 0.007s	sys 0.011s
W20260709 13:15:48.033203  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 595665us
I20260709 13:15:48.147210  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:47.966574 13342 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.004s
I20260709 13:15:48.039283  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:48.149874  7182 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:48.045594  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:48.152038  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:48.050616  7894 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:15:48.019731 13279 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.147010  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:48.022516 13258 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:48.023844 13469 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.208588 13469 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:47.956595 13354 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.211122  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.212287  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:48.212626  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.213474  7259 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:48.213724  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:48.061254 13409 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:48.067760  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:48.079263 13073 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.080158  7336 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:15:48.221997  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.085927  7331 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:48.086902  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2569) took 1419 ms. Trace:
I20260709 13:15:48.214440  7182 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:15:48.223099  7180 rpcz_store.cc:276] 0709 13:15:46.667363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.398733 (+731370us) service_pool.cc:224] Handling call
0709 13:15:47.399141 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.866123 (+466982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.086567 (+220444us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b540017e154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:48.086824 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034936192}
I20260709 13:15:48.093775 13458 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:48.095463 13468 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:48.034253 13298 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:48.100736 13252 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:48.108151 13310 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:48.111896 13217 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:48.056360 13319 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:48.256405 13187 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.000s	sys 0.015s
I20260709 13:15:48.117167  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:48.291778  7262 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:48.117962 13290 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:48.221486 13354 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:48.122223  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:48.126513  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:48.136762  7185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.017s	sys 0.027s
W20260709 13:15:48.325086  7185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.017s	sys 0.027s
I20260709 13:15:48.148667  7253 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:48.148594  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:48.152937  7184 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:48.328118  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:48.329908  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:48.119269 13419 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.911s	user 0.009s	sys 0.000s
I20260709 13:15:48.330998 13419 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:48.334088 13419 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:48.207850  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:48.142844 13426 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.005s
I20260709 13:15:48.335353 13426 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:48.221107  7255 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:48.339749  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.341266  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:48.342001  7255 raft_consensus.cc:2376] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17. Re-sending same reply.
I20260709 13:15:48.083487  7327 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:48.259140  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.343053  7259 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:48.343868  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.344781  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.345036  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.345489  7253 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:48.346036  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:48.262050  7330 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:15:48.347116  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:48.347694  7330 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.347815  7184 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:15:48.348914  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:48.349607  7184 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:48.276598  7332 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:15:48.269217  7333 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:48.175474 13288 raft_consensus.cc:2764] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:15:48.115566  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.282238  7261 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
W20260709 13:15:48.282796  7862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.001s	sys 0.018s
W20260709 13:15:48.352569  7862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.001s	sys 0.018s
I20260709 13:15:48.254822 13458 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:48.352855  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:48.353060  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 896398us
I20260709 13:15:48.354009  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:48.354462  7183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3238) took 2447 ms (client timeout 1851 ms). Trace:
W20260709 13:15:48.354880  7183 rpcz_store.cc:269] 0709 13:15:45.907224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.964259 (+ 57035us) service_pool.cc:224] Handling call
0709 13:15:48.354239 (+2389980us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400118354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:48.354393 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2725919616}
I20260709 13:15:48.214591 13409 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.295794  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3254) took 1403 ms. Trace:
I20260709 13:15:48.297137  7256 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:48.365054  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.366108  7257 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:48.356443  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:48.360221  7178 rpcz_store.cc:276] 0709 13:15:46.892517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.428433 (+535916us) service_pool.cc:224] Handling call
0709 13:15:47.428717 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.456895 (+ 28178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.456927 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.482110 (+ 25183us) log.cc:844] Serialized 26 byte log entry
0709 13:15:47.929234 (+447124us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:48.272252 (+343018us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.294896 (+ 22644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.295267 (+   371us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:48.295405 (+   138us) raft_consensus.cc:1685] finished
0709 13:15:48.295456 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.295709 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5742,"raft.queue_time_us":50097,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":9560,"thread_start_us":679203,"threads_started":2,"wal-append.queue_time_us":531708}
W20260709 13:15:48.369738  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 162105us
I20260709 13:15:48.371831  7178 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:15:48.372089  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:48.310448  7186 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.019s	sys 0.032s
I20260709 13:15:48.119982  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2555) took 2575 ms. Trace:
I20260709 13:15:48.338284 13426 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:48.277774  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.373459  7181 rpcz_store.cc:276] 0709 13:15:45.545010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.137410 (+592400us) service_pool.cc:224] Handling call
0709 13:15:46.137738 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.612491 (+1474753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.119650 (+507159us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54001b44d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:48.119905 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3285600640}
I20260709 13:15:48.273586 13217 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:48.375948  7181 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:48.222357 13437 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:15:48.293247 13187 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.000s	sys 0.016s
I20260709 13:15:48.386807 13445 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:48.358737  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 236581us
W20260709 13:15:48.376214  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 249777us
I20260709 13:15:48.388706  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:48.377219  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 228688us
I20260709 13:15:48.391460  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:48.392115 13442 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:48.392621 13442 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.392706  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:48.393047 13442 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:48.393864  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.222708 13258 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.215684 13279 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:48.396656  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:48.395745  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:48.380388  7186 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.019s	sys 0.033s
W20260709 13:15:48.382162  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.385295  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:48.398223  7180 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
W20260709 13:15:48.395517  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 473106us
I20260709 13:15:48.381284 13248 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:48.404381  7183 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:15:48.395946  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:48.407618  7894 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:15:48.402878  7259 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:48.403232  7181 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:15:48.378660 13452 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.004s
I20260709 13:15:48.318077 12912 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:48.411379  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.381408 13433 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:15:48.395925 13484 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:15:48.420948  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:48.420153  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:48.422479  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:48.423585  7183 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:48.423843  7255 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:48.381659 13437 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:48.427107  7152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.838s (SENT) [suppressed 41 similar messages]
W20260709 13:15:48.469688  7328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.046s	sys 0.086s
W20260709 13:15:48.470283  7328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.046s	sys 0.087s
I20260709 13:15:48.422415  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2247) took 1033 ms. Trace:
I20260709 13:15:48.471516  7333 rpcz_store.cc:276] 0709 13:15:47.388843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.411617 (+ 22774us) service_pool.cc:224] Handling call
0709 13:15:48.422185 (+1010568us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b540025c454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:48.422339 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828148480}
I20260709 13:15:48.435766  7253 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:15:48.405927 13374 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:48.480655  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:48.396431 13288 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:48.473333  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:48.399092 13485 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:15:48.419672 13483 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:15:48.482672  7150 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.5.227.190:45419, user_credentials={real_user=slave}} blocked reactor thread for 43971.4us
I20260709 13:15:48.483315  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.481618  7890 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25. Ops: []
I20260709 13:15:48.483098  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1153) took 2546 ms. Trace:
I20260709 13:15:48.547226  7255 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:48.547130  7187 rpcz_store.cc:276] 0709 13:15:45.936956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.302961 (+366005us) service_pool.cc:224] Handling call
0709 13:15:46.356384 (+ 53423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:46.356586 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:15:46.499097 (+142511us) log.cc:844] Serialized 14 byte log entry
0709 13:15:46.892431 (+393334us) log.cc:844] Serialized 14 byte log entry
0709 13:15:46.900940 (+  8509us) log.cc:844] Serialized 14 byte log entry
0709 13:15:47.181371 (+280431us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18003388c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:47.995996 (+814625us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:48.052893 (+ 56897us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b18003388c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:15:48.482018 (+429125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.482082 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:48.482609 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.482904 (+   295us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.483039 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27505,"prepare.queue_time_us":167097,"prepare.run_cpu_time_us":186,"prepare.run_wall_time_us":2187,"raft.queue_time_us":61458,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":17431,"spinlock_wait_cycles":48851200,"thread_start_us":810997,"threads_started":3,"wal-append.queue_time_us":274939}
I20260709 13:15:48.411185 13470 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:48.549996  7259 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:15:48.411131 13411 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:48.488514  7183 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 16: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:48.489449  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.551201  7254 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:48.491564  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2189) took 1030 ms. Trace:
I20260709 13:15:48.482172  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.498926  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.499866  7181 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:48.501355  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:48.504509 13104 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.504819 13073 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:48.505501  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.511340 13488 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:48.487105 13410 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:48.488119 13288 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:48.421490 13452 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.565814  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:48.483445 13458 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.493713 13322 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:15:48.527463  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1164) took 1297 ms. Trace:
I20260709 13:15:48.591822  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.592868  7184 rpcz_store.cc:276] 0709 13:15:47.229668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.376933 (+1147265us) service_pool.cc:224] Handling call
0709 13:15:48.377202 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.398948 (+ 21746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.398979 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.399030 (+    51us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:15:48.399067 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.527061 (+127994us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b54000ed3d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:48.527147 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.527374 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49604992}
W20260709 13:15:48.397761 13450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.003s	sys 0.031s
I20260709 13:15:48.535220  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3256) took 1544 ms. Trace:
I20260709 13:15:48.515877 13256 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:48.540074  7888 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:48.494166 13362 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:48.542279 13217 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:48.544692  7182 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:15:48.424252 13248 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:48.439702 13433 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.421084 13469 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:48.558974  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.561343  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:48.623879  7254 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:48.625223  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.562321  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:48.568480  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:48.628289  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:48.629458  7333 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:48.629207  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.554505  7261 rpcz_store.cc:276] 0709 13:15:47.461217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.461405 (+   188us) service_pool.cc:224] Handling call
0709 13:15:47.461726 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.352385 (+890659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.485671 (+133286us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54002166d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:48.491374 (+  5703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886218624}
I20260709 13:15:48.414353 13321 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.130s
I20260709 13:15:48.482757 13437 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:48.564543  7150 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:15:48.644975  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 80580.7us
W20260709 13:15:48.645745  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.646320  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:48.595218  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:48.597347  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:48.599762  7332 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:15:48.545528 13483 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.594691  7186 rpcz_store.cc:276] 0709 13:15:46.991187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.716589 (+725402us) service_pool.cc:224] Handling call
0709 13:15:47.717140 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.717828 (+   688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.717874 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.733459 (+ 15585us) log.cc:844] Serialized 26 byte log entry
0709 13:15:48.398589 (+665130us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:48.398660 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.398741 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:48.534871 (+136130us) raft_consensus.cc:1685] finished
0709 13:15:48.534903 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.535128 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1268,"raft.queue_time_us":3942,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":36578,"thread_start_us":611688,"threads_started":1,"wal-append.queue_time_us":764267}
W20260709 13:15:48.562894 13471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.017s	sys 0.023s
I20260709 13:15:48.556514 13411 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:48.562888 13470 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.616669  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:48.617834  7892 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:48.588371 13288 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:15:48.598562 13450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.003s	sys 0.032s
W20260709 13:15:48.630750  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.631342  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.632472  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2564) took 2601 ms. Trace:
I20260709 13:15:48.622659 13433 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:48.604467 13462 consensus_meta.cc:287] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.960s	user 0.014s	sys 0.002s
I20260709 13:15:48.649375  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.651772  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:48.660230  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65101.1us
W20260709 13:15:48.681797  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 84599.9us
I20260709 13:15:48.681953  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:48.608644 13468 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:48.662961  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:48.603138 13362 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:48.486992 12987 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:48.666543  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:48.607774 13319 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:48.667778  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:48.582393 13104 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:48.672056  7185 rpcz_store.cc:276] 0709 13:15:46.031329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.404054 (+1372725us) service_pool.cc:224] Handling call
0709 13:15:47.404390 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.408372 (+  3982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.408402 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.408895 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:15:48.325572 (+916677us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:48.325636 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.325753 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:48.632170 (+306417us) raft_consensus.cc:1685] finished
0709 13:15:48.632199 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.632398 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3565,"raft.queue_time_us":6714,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3163,"thread_start_us":866359,"threads_started":1,"wal-append.queue_time_us":974837}
I20260709 13:15:48.634140  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:48.736016  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:48.633791 13374 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:15:48.588343 13410 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:48.660257 13471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.018s	sys 0.023s
I20260709 13:15:48.650950 13458 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:48.706256  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:48.664629 13469 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:48.653684 13217 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:48.665154 13483 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:48.737329  7333 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:15:48.736621 13298 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:48.739111  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 71552.2us
I20260709 13:15:48.747661 12987 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.733312 13319 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.668640 13431 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:48.678189 13342 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:48.701768 13468 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.704175 13404 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:48.667145 13470 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:48.758383  7336 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:48.733852 13443 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:48.719213 13073 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:48.741340 13486 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:48.724301 13409 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:48.677518  7330 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:48.764045  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:48.766968  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:48.741680  7260 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.025s	sys 0.046s
W20260709 13:15:48.789089  7260 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.025s	sys 0.046s
I20260709 13:15:48.789407  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2334) took 1129 ms. Trace:
I20260709 13:15:48.703644 13462 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:48.750037  7225 connection.cc:256] RPC call timeout handler was delayed by -2.3958129150000786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:15:48.789960  7330 rpcz_store.cc:276] 0709 13:15:47.660012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.347246 (+687234us) service_pool.cc:224] Handling call
0709 13:15:48.347569 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.786212 (+438643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.789338 (+  3126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:48.791491  7225 connection.cc:256] RPC call timeout handler was delayed by -1.1830164790001163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:15:48.791996  7225 connection.cc:256] RPC call timeout handler was delayed by -1.1713164790000974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:15:48.792378  7225 connection.cc:256] RPC call timeout handler was delayed by -1.1569164790000741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 13:15:48.792754  7225 connection.cc:256] RPC call timeout handler was delayed by -1.069616478999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 13:15:48.792769  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:48.793723  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:48.796553 13321 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:48.799685 13462 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:48.765657 13469 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:48.762784 13279 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:48.801555  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:48.769547  7262 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:15:48.807813  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:48.811847  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44980.1us
I20260709 13:15:48.718171 13248 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:48.778159 13495 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:15:48.823642  7333 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:48.778065  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3467) took 1139 ms. Trace:
I20260709 13:15:48.773765 13354 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:48.781898 13468 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:48.758002 13411 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.813187  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:48.820474 13452 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:48.821143 13258 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:48.782699 13443 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:48.781625 13342 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.832705  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:48.840334  7333 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:48.755314 13362 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:48.854024  7335 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
W20260709 13:15:48.855253  7179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.019s	sys 0.051s
W20260709 13:15:48.856132  7179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.019s	sys 0.051s
W20260709 13:15:48.826339 13502 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:15:48.858126  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.823984 13298 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:48.857550  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44480.9us
I20260709 13:15:48.834168 13462 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:48.801555 13073 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.871821  7892 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:48.855793  7258 rpcz_store.cc:276] 0709 13:15:47.638467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.906874 (+268407us) service_pool.cc:224] Handling call
0709 13:15:47.907177 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.907393 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:48.276211 (+368818us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.777626 (+501415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.777707 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:48.777760 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.777835 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.777992 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":626365,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":3848,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":18049,"thread_start_us":834992,"threads_started":2}
I20260709 13:15:48.866014 13312 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:48.856406 13411 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:48.875905  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:48.841439 13486 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:48.842123 13443 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:48.851264 13342 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:15:48.872920  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 466464us
I20260709 13:15:48.855651 13354 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.867612 13362 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:48.867828 13452 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.888406  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:48.888859  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 478447us
I20260709 13:15:48.809777 13431 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:48.889693  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 433128us
I20260709 13:15:48.897239  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:48.873952 13312 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:48.869717 13462 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:48.899442  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.871289 13439 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:15:48.916875  7892 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: [16.15-20.17]
I20260709 13:15:48.871938 13258 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:15:48.871734 13298 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.923488 13419 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:48.919824  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:48.925246  7892 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:48.889024 13354 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:15:48.926520  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 496214us
I20260709 13:15:48.903191 13104 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:48.909560 13312 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:48.905005 13321 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:15:48.937086 13298 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:48.887595 13469 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.962224 13319 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:48.962455  7892 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:48.962725  7334 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:15:48.963809 13073 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:48.925930 13426 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:15:48.900892 13452 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:48.911425 13462 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:15:48.968897  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 43595.4us
W20260709 13:15:48.984184  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.004163  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 298469us
I20260709 13:15:48.934545 13504 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:48.949483 13401 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
W20260709 13:15:49.047719  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 341552us
I20260709 13:15:49.041240  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3469) took 1322 ms. Trace:
I20260709 13:15:49.004920 13073 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.974871 13409 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:15:49.050521  7260 rpcz_store.cc:276] 0709 13:15:47.719180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.962193 (+243013us) service_pool.cc:224] Handling call
0709 13:15:47.967124 (+  4931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.967515 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:48.789682 (+822167us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.040649 (+250967us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.040743 (+    94us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:49.040815 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.040922 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.041139 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":566526,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"thread_start_us":1014116,"threads_started":2}
I20260709 13:15:49.011268 13504 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:49.077771  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2239) took 1786 ms. Trace:
I20260709 13:15:49.129120  7334 rpcz_store.cc:276] 0709 13:15:47.290917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.955856 (+664939us) service_pool.cc:224] Handling call
0709 13:15:49.077425 (+1121569us) spinlock_profiling.cc:243] Waited 1e+03 ms on lock 0x7b540013db54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:49.077678 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2299301632}
I20260709 13:15:49.088331 13104 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:49.089772  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2320) took 1835 ms. Trace:
I20260709 13:15:49.090152 13279 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:49.090271  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 82898.4us
I20260709 13:15:49.090577 13319 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.091442  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:49.091259  7327 raft_consensus.cc:2955] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 5 to 11, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:15:49.089816 13485 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:15:49.087314  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 190188us
W20260709 13:15:49.142567  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51213us
I20260709 13:15:49.143767  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:49.147933  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:48.966035 13486 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.070137 13290 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:49.113649  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:49.002347 13298 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 13:15:49.087311 13507 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:15:49.130463  7328 rpcz_store.cc:276] 0709 13:15:47.254526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.254716 (+   190us) service_pool.cc:224] Handling call
0709 13:15:47.255157 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.266434 (+ 11277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.266468 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.699319 (+432851us) spinlock_profiling.cc:243] Waited 972 us on lock 0x7b2c0013d8c8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:47.699908 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:15:48.470819 (+770911us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:48.968314 (+497495us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.089328 (+121014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.089412 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.089454 (+    42us) raft_consensus.cc:1685] finished
0709 13:15:49.089558 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.089711 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157347,"prepare.queue_time_us":70505,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":44,"raft.queue_time_us":148332,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":3458,"spinlock_wait_cycles":2235136,"thread_start_us":1267274,"threads_started":2,"wal-append.queue_time_us":1055681}
I20260709 13:15:49.141973 13485 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:49.065163 13252 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:49.104846  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2323) took 1848 ms. Trace:
I20260709 13:15:49.154808  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:49.141570  7336 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:15:49.158911  7186 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:15:49.138650 13442 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.745s	user 0.015s	sys 0.000s
I20260709 13:15:49.146924 13426 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:49.192493  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:49.199198  7328 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:49.200706  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 407102us
I20260709 13:15:49.207392  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:49.200016  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:49.193717  7329 rpcz_store.cc:276] 0709 13:15:47.256338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.979662 (+723324us) service_pool.cc:224] Handling call
0709 13:15:47.979983 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.980193 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:15:48.469257 (+489064us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.086269 (+617012us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.086498 (+   229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.086557 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:49.104330 (+ 17773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.104469 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.104675 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196373,"prepare.queue_time_us":562024,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":86,"raft.queue_time_us":199953,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":187,"thread_start_us":908374,"threads_started":2,"wal-append.queue_time_us":703380}
I20260709 13:15:49.155963 12852 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:15:48.985107 13431 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.228931  7328 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:49.237010  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2333) took 1577 ms. Trace:
I20260709 13:15:49.237728  7327 rpcz_store.cc:276] 0709 13:15:47.659415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.343344 (+683929us) service_pool.cc:224] Handling call
0709 13:15:48.343673 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.343919 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:48.763292 (+419373us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.091013 (+327721us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.236304 (+145291us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.236524 (+   220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.236581 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:49.236648 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.236742 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.236927 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60527,"prepare.queue_time_us":199214,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":66305,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":174,"thread_start_us":680655,"threads_started":2}
I20260709 13:15:49.150024 13187 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:49.061724 13073 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:49.315035  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.172288 13419 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:49.317373  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:49.328593  7335 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:49.141623 13319 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.152873 13404 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.199085 13104 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:49.333972  7336 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:15:49.192085 13491 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.351897  7255 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:15:49.170905 13290 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:49.240680 13439 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:15:49.360940  7335 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:49.364177  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:49.365022  7329 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 25: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:49.153131 13279 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.388833 13073 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:49.390826 13290 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.353996 13104 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:49.399415 13506 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
W20260709 13:15:49.400574 13515 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:15:49.408550 13319 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:49.223750 13426 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.350935 13187 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.082s
I20260709 13:15:49.223496 13442 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.419538 13485 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.427397  7336 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:15:49.226667 13322 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:49.205677 13252 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.435950  7328 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:15:49.442514 13104 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:49.416059 13524 raft_consensus.cc:2764] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:15:49.444607 13452 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:49.360105 13439 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:49.423581 13509 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:15:49.338610 13443 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.414965 13521 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.451746  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:49.485666  7893 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 25: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:15:49.443756 13217 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.003s
I20260709 13:15:49.356441 13404 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.465605  7328 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:49.313031 13445 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.117s
I20260709 13:15:49.467358  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:49.363741 13491 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.448231 13290 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:49.439550  7329 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:15:49.474989  7888 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
I20260709 13:15:49.495455  7329 pending_rounds.cc:85] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 12
I20260709 13:15:49.495767  7329 pending_rounds.cc:107] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:15:49.447899 13374 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.477655 13321 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:49.481786  7892 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260709 13:15:49.431887 13419 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:49.468094 13411 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.001s
I20260709 13:15:49.350466 13504 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.488023  7328 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25. Ops: []
W20260709 13:15:49.507616  7861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.017s	sys 0.057s
W20260709 13:15:49.508250  7861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.017s	sys 0.057s
I20260709 13:15:49.483485 13073 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:49.470847 13322 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:49.484472 13468 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.629s	user 0.014s	sys 0.000s
I20260709 13:15:49.489126 13252 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:49.511119 13514 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.485072 13521 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.511255 13321 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.720875 13321 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:49.627352  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 395713us
W20260709 13:15:49.642879  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 435439us
I20260709 13:15:49.649276  7253 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:15:49.652910  7258 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:49.652655  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:49.653923  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:49.489956  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 343080us
I20260709 13:15:49.510008  7332 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
W20260709 13:15:49.663007  7299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.010s
W20260709 13:15:49.488021  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 342131us
I20260709 13:15:49.734010 13536 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:15:49.496011  7329 raft_consensus.cc:2889] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:49.739120  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:49.740252  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2341) took 1166 ms. Trace:
W20260709 13:15:49.741567  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.741272 12852 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:49.741721 13217 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:49.743058 12852 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:49.664728  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2332) took 2273 ms. Trace:
W20260709 13:15:49.516783  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.745060  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:49.745937  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:49.675935 13322 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:49.677855 13279 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:49.750375 13404 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:49.679651 13419 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:49.575165 13426 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:49.573727 13442 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:49.575479 13443 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:49.576066 13458 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.817s	user 0.014s	sys 0.000s
I20260709 13:15:49.507916 13374 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.572150 13521 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:49.754532  7889 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
W20260709 13:15:49.494017 13437 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.820s	user 0.013s	sys 0.001s
I20260709 13:15:49.756366 13437 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.757813  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2234) took 1311 ms. Trace:
I20260709 13:15:49.758531  7255 rpcz_store.cc:276] 0709 13:15:48.445999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.113187 (+667188us) service_pool.cc:224] Handling call
0709 13:15:49.757225 (+644038us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400217ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:49.757531 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447586176}
I20260709 13:15:49.460209 13462 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.760305 13437 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:49.763852  7180 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 14.
I20260709 13:15:49.527150 13468 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.769479 13468 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:49.770030 13443 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.770900 13443 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.552902 13514 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.577343 13491 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:49.485523 13485 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:49.581739 13483 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.810s	user 0.012s	sys 0.000s
I20260709 13:15:49.791296  7330 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:49.792086 13483 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.794193 13410 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:49.795176  7894 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:49.794971  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:49.796254  7187 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:49.685449 13539 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:49.800338 13539 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:49.693867  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.701689  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:49.705969  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:49.716051 13342 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.812s	user 0.012s	sys 0.002s
I20260709 13:15:49.716638 13469 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.620565  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3255) took 2671 ms. Trace:
I20260709 13:15:49.804656 13469 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.804759  7179 rpcz_store.cc:276] 0709 13:15:46.949057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.654121 (+705064us) service_pool.cc:224] Handling call
0709 13:15:47.654514 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.654967 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:48.137519 (+482552us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.871468 (+733949us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:48.883594 (+ 12126us) log.cc:844] Serialized 26 byte log entry
0709 13:15:48.883769 (+   175us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:48.883814 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.883890 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.619521 (+735631us) raft_consensus.cc:1685] finished
0709 13:15:49.619631 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.620215 (+   584us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14514,"prepare.queue_time_us":620237,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":4545,"raft.queue_time_us":23177,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":47140,"thread_start_us":1064860,"threads_started":2,"wal-append.queue_time_us":783989}
W20260709 13:15:49.721944  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.735661  7299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.004s	sys 0.011s
I20260709 13:15:49.735101  7225 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:49.737346  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.737426  7257 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:49.743570 12852 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:49.522017 13073 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.747169 13535 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:49.743973  7331 rpcz_store.cc:276] 0709 13:15:47.390601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.274328 (+883727us) service_pool.cc:224] Handling call
0709 13:15:48.321677 (+ 47349us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:48.374675 (+ 52998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.374710 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:48.384871 (+ 10161us) log.cc:844] Serialized 78 byte log entry
0709 13:15:48.841468 (+456597us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:48.863699 (+ 22231us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.085028 (+221329us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b18003d2280. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:15:49.089273 (+  4245us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.089453 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.089524 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.663840 (+574316us) raft_consensus.cc:1685] finished
0709 13:15:49.663894 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.664354 (+   460us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40611,"prepare.queue_time_us":28156,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":7641,"raft.queue_time_us":268419,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":10276,"spinlock_wait_cycles":7624576,"thread_start_us":456138,"threads_started":1,"wal-append.queue_time_us":644134}
I20260709 13:15:49.743918 12919 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:15:49.740820  7329 rpcz_store.cc:276] 0709 13:15:48.573809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.425047 (+851238us) service_pool.cc:224] Handling call
0709 13:15:49.430199 (+  5152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.739639 (+309440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.740036 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:49.769510  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:49.776901  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:49.778155  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:49.758098 13374 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:49.782251  7181 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:49.814051  7178 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:49.572917 13470 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.796s	user 0.012s	sys 0.001s
I20260709 13:15:49.820216 13470 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.822228 13073 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:49.823756 13342 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.824260 12852 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.824760 13483 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:49.810859  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 654361us
I20260709 13:15:49.826226  7334 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:49.812047 13247 raft_consensus.cc:2764] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:15:49.828055 13514 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:49.815948  7186 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:49.830709  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2258) took 1231 ms. Trace:
I20260709 13:15:49.831336  7330 rpcz_store.cc:276] 0709 13:15:48.572369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.792383 (+220014us) service_pool.cc:224] Handling call
0709 13:15:49.794434 (+1002051us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b540031bad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:49.803728 (+  9294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2256864000}
I20260709 13:15:49.834228  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:49.834969 13535 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:49.835270  7888 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:49.836619 13535 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:49.838151 13541 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:15:49.822082  7180 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:49.840314 13533 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
W20260709 13:15:49.840512 13312 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.890s	user 0.000s	sys 0.023s
I20260709 13:15:49.840786 13247 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:49.837568  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:49.841615 13247 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.842222  7893 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
W20260709 13:15:49.817000  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 82361.4us
I20260709 13:15:49.845165 13247 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:49.847121  7225 leader_election.cc:400] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15.
I20260709 13:15:49.847571  7225 leader_election.cc:403] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:49.774425 13443 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:49.814028  7260 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:49.825125  7861 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:49.816048  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:49.838464  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:49.817502  7254 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:49.814832  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:49.829080 13462 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:49.861126 12852 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:49.872615 13461 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:49.875283  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:49.875924  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51238.7us
I20260709 13:15:49.876297 12919 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:49.876506 13298 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15.
I20260709 13:15:49.877532 13468 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:49.875953  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:49.880260  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:49.882380 13539 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:49.883373  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:49.889932  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:49.864707  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:49.814417 13536 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.896705 12919 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:49.841138 13312 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.893631 13504 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:49.916311  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:49.917918  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:49.917773 13104 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.912320 12919 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:49.939404  7180 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:49.932621  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 82993us
I20260709 13:15:49.935786  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:49.938977  7255 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:49.938422  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:49.946923  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.948033  7330 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:49.950181  7260 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:49.950893 13437 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:49.951025 13525 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.360s	user 0.005s	sys 0.001s
I20260709 13:15:49.951889 13312 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:49.952860  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:49.953130 13342 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:49.953799 13458 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:49.954290 13458 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:49.954725 13458 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:49.954986  7335 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:49.956614  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2254) took 1385 ms. Trace:
W20260709 13:15:49.959285  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 174807us
I20260709 13:15:49.962345 13518 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:49.963176 13518 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.963781 13518 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:49.931586 13468 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.962227 13517 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:49.967114 13517 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:49.968367 13468 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:49.968788 13539 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.969622 13539 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:49.951485 13437 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.957095  7333 rpcz_store.cc:276] 0709 13:15:48.571165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.855667 (+284502us) service_pool.cc:224] Handling call
0709 13:15:48.856038 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:48.864748 (+  8710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.864791 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:48.865409 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.340548 (+475139us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:49.340590 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.340664 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.836333 (+495669us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:49.956040 (+119707us) raft_consensus.cc:1685] finished
0709 13:15:49.956063 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.956408 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206716,"raft.queue_time_us":11782,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":14759,"spinlock_wait_cycles":6869376,"thread_start_us":431587,"threads_started":1,"wal-append.queue_time_us":613761}
I20260709 13:15:49.975494  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:49.981113 13439 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.982611 13104 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:49.982865 13439 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:15:49.984712  7185 raft_consensus.cc:2410] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:15:49.985235  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.968705 13517 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:49.998014 13354 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.061s	user 0.012s	sys 0.011s
I20260709 13:15:50.003826  7892 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25. Ops: []
I20260709 13:15:50.005237  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:49.963027 12987 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:50.006556 12987 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:49.971333 13469 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:50.003985  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.009413 13539 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:50.009805 12987 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:50.009723  7183 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:49.948086 13536 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.011384  7329 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:50.011663 13511 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:50.012171 13511 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:50.012715 13536 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:50.013418 13511 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.015476  7894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 870) took 1101 ms. Trace:
I20260709 13:15:50.015899  7894 rpcz_store.cc:276] 0709 13:15:48.915703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.915845 (+   142us) service_pool.cc:224] Handling call
0709 13:15:48.916180 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.795857 (+879677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.015112 (+219255us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400162bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:50.015381 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020270848}
I20260709 13:15:50.014452  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:50.019631  7329 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:15:50.021234  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:50.022583  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:50.023221  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:50.023456  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:50.024173  7329 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.007078  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:50.026391  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 151331us
I20260709 13:15:50.026834 13104 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:15:50.027168  7180 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.027801  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:50.027902 13104 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:50.029225 13104 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:15:50.029618 13104 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:50.030893  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 222539us
I20260709 13:15:50.031323 13268 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:15:50.036412  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.036600  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:50.037559  7327 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
W20260709 13:15:50.039539  7332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2251) took 1469 ms (client timeout 1935 ms). Trace:
W20260709 13:15:50.040014  7332 rpcz_store.cc:269] 0709 13:15:48.570090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.666229 (+ 96139us) service_pool.cc:224] Handling call
0709 13:15:50.039188 (+1372959us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54002896d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:50.039335 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797779200}
W20260709 13:15:49.968431 13516 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.618s	user 0.001s	sys 0.001s
I20260709 13:15:50.043483 13458 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:50.045051 13288 consensus_meta.cc:287] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.360s	user 0.017s	sys 0.009s
I20260709 13:15:50.047158  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:50.047381 13104 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:50.048643  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 98681.7us
I20260709 13:15:50.049044 13104 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:50.049787  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:50.052114  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.059672 13470 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:50.067453 13458 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:50.021631 13433 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.310s	user 0.012s	sys 0.009s
W20260709 13:15:50.070452  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 131296us
I20260709 13:15:50.076220  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:50.078838  7183 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
W20260709 13:15:50.082620  7334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2342) took 1214 ms (client timeout 1501 ms). Trace:
I20260709 13:15:50.085597  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.088819  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:50.089439  7302 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:50.081305 13511 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:50.097018  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:50.045732 13288 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:50.106302  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56707.3us
W20260709 13:15:50.088112  7334 rpcz_store.cc:269] 0709 13:15:48.867950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.140018 (+272068us) service_pool.cc:224] Handling call
0709 13:15:50.069883 (+929865us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54000e10d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:50.082539 (+ 12656us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556676480}
I20260709 13:15:50.109112  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.064747 13354 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.094833 13535 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:50.113004  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:50.095594 13470 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:50.083907 13433 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.099198 12987 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:50.122205  7329 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:50.108176 13298 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.123273  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.126849 13342 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:50.127115  7178 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:50.097275 13539 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:50.118158  7184 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
I20260709 13:15:50.124675  7183 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:50.132856 13536 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:50.133399  7328 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:15:50.133458 13536 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:50.133893  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.126737 13450 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:50.114725 13535 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.119606 13470 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.136585  7890 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:50.139271 13298 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:50.141672 13552 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:15:50.160182 13288 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:50.133339 13512 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:50.162559 13512 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.163004 13512 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:50.165263 13518 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.135255 13450 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.166951 13450 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:50.168119 13518 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:50.171747  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:50.172932 13299 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:50.173575 13299 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:50.174821 13299 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.178176  7150 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:50.158258 13104 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:15:50.179282 13470 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:50.130012 13342 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:50.184194  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 49499.8us
I20260709 13:15:50.180320 12919 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.189901  7180 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
W20260709 13:15:50.187649  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52952.5us
I20260709 13:15:50.135754 13536 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.135481 13535 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:50.189546 13504 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:50.197763 13504 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:50.198794  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2338) took 1625 ms. Trace:
I20260709 13:15:50.198987 13504 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.199291  7335 rpcz_store.cc:276] 0709 13:15:48.572931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.362134 (+789203us) service_pool.cc:224] Handling call
0709 13:15:49.426606 (+ 64472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.955575 (+528969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.198081 (+242506us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b54001b9254. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:50.198378 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1186753408}
I20260709 13:15:50.178249 13354 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:50.202023  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.189826 13342 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.209287 13512 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.212332 13512 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:50.214561  7184 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:15:50.217911 12919 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:50.215281  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1003) took 1631 ms. Trace:
I20260709 13:15:50.219224  7890 rpcz_store.cc:276] 0709 13:15:48.584434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.591633 (+  7199us) service_pool.cc:224] Handling call
0709 13:15:48.615944 (+ 24311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.161169 (+1545225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.214798 (+ 53629us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540043b2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:50.215164 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3469012864}
I20260709 13:15:50.217093  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:50.212334  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 77843.9us
I20260709 13:15:50.193344  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.229172  7183 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
W20260709 13:15:50.230441  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 122981us
I20260709 13:15:50.185420 12852 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.237948  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.239780 12987 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:50.240851  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.246356  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50267.8us
I20260709 13:15:50.250948 13354 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:50.253746 13341 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:50.254091  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:50.255205 12852 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.256491 13298 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:50.256628 13442 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:15:50.257212 13442 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.257666 13442 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:50.244925  7181 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:50.257961 12852 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:50.254292 13341 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:50.260270  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:50.191335 13518 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.259756 13341 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.255303  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:50.276382  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2347) took 1186 ms. Trace:
I20260709 13:15:50.260121 12987 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.278235  7328 rpcz_store.cc:276] 0709 13:15:49.090084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.514117 (+424033us) service_pool.cc:224] Handling call
0709 13:15:49.514494 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:50.144155 (+629661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.245562 (+101407us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540031b5d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:50.276264 (+ 30702us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414493568}
W20260709 13:15:50.282732  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.286243  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.283706  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.287740  7255 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.273301 13437 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:50.292721  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:50.293946  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.295334  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.296759  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.300623  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.302094  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.312765  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.312721 13540 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:15:50.313791  7179 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.319365  7258 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:50.321125  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.323037  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.323101  7179 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:50.283751 12852 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.324327  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.325135  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:50.326375 13517 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:50.326124 12852 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.326509  7260 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:50.327358 13187 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.327973 13187 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.328693 12852 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:50.326157  7302 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:50.333436  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 61782.9us
I20260709 13:15:50.336668 13433 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:50.337683 13433 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:50.281029 13518 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.347940 13518 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:50.349023  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:50.350986 13409 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:15:50.352125 13512 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:50.352362 13409 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:50.352698 13512 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.352967 13409 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:50.353231 13512 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:50.354674  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.352305  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 92126.8us
W20260709 13:15:50.352999  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 67507.2us
I20260709 13:15:50.353315 13458 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:50.277820 13322 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:15:50.360694  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.360803  7890 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:50.354144 13409 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.362859 13409 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:50.364406  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:50.367436 13341 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.363960  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:50.368623 12919 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:50.369226 12919 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:15:50.359119  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 60991.4us
I20260709 13:15:50.375643  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:50.382825  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.330438 13187 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:50.392177  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.395102  7182 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:50.400955  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.399010  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:50.402164  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 67647.3us
I20260709 13:15:50.402419  7299 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:50.403637  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:50.405786  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:50.406078  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:50.423812 13512 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.416566 13104 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:50.408021  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:50.411293  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.413879  7254 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:15:50.419909 13187 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:50.407372  7253 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:50.378922 13518 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:50.408951  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:50.454008  7260 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:15:50.411396  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:50.406854 13540 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:50.407788 13461 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:50.438910  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:50.370435 12919 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.381455 13458 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:50.388962 13354 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:50.438177  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:50.454169  7256 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:50.460309  7255 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:50.461985  7257 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:50.462178  7261 raft_consensus.cc:2410] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:15:50.463789  7261 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:50.465844  7258 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:50.470880  7896 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 15: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:50.475046  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.476106  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.477010  7184 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:15:50.483850  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.485132  7260 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:50.456444 13268 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.489670  7253 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260709 13:15:50.472517  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.438562 13450 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.503173  7184 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:50.512244  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.481396 13433 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:50.517027  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.513211  7180 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
W20260709 13:15:50.521088  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 115119us
W20260709 13:15:50.522178  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.525345  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:50.526548  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:50.528833  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.526113  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 134239us
I20260709 13:15:50.523187 13517 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:50.533846  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 131480us
I20260709 13:15:50.529309  7185 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:50.539079  7182 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:50.540100  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:50.546393  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:50.549638  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.548463  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:50.561095  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.561326  7328 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:50.550159  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:50.551072  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.562414  7185 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:50.550689  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:50.501240 13461 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.563642  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.527650 13299 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:15:50.524888 13268 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.585444  7256 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:50.586232  7181 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:50.582559  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:50.579497  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:50.559623 13483 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:50.590184  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:50.598340  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46838.2us
I20260709 13:15:50.599272 13268 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:50.602511 13322 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:50.603266 13322 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.603751 13322 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:50.607282 13511 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:50.608898 13437 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:50.609345 13437 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:50.580993 13504 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:50.592321 13518 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:50.577461 13104 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:50.658185 13104 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:50.638113  7253 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:50.647147  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:50.647903 13562 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.648000  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.613489 13354 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:50.564158 13535 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.635675 13504 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:50.657577 13512 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:50.648821  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.665818  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 118746us
I20260709 13:15:50.703893  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.704717  7262 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.675635 13409 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.590968 13442 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.578409 13458 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.575959 13517 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.685142 13504 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.602596 13540 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
W20260709 13:15:50.711648 13342 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.507s	user 0.013s	sys 0.001s
I20260709 13:15:50.711288 13437 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.712128 13342 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.712620 13354 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.713160 13437 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:50.677618 13469 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:15:50.715503  7896 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:15:50.716020  7896 pending_rounds.cc:85] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 12
I20260709 13:15:50.716298  7896 pending_rounds.cc:107] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:15:50.716589  7896 raft_consensus.cc:2889] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:50.717510 13470 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:50.715523 13558 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:15:50.719118 13518 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.725651 13461 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:50.726969 13450 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:50.732914  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:50.733567  7896 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.732491 13409 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.739104  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:50.739511 13187 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:50.740095 13535 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:50.740406 13409 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:50.740942  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:50.741772  7259 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:50.743351  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:50.744879 13565 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:50.745513 13442 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:50.744846  7896 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:50.748912  7335 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:50.714597 13342 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:50.739159  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 159764us
I20260709 13:15:50.755256  7185 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:15:50.755626  7328 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
W20260709 13:15:50.707753  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 141877us
I20260709 13:15:50.755024  7861 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:50.758734  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:50.759711  7260 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:15:50.759517  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 153487us
I20260709 13:15:50.762367  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:50.761830  7896 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:50.761622  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:50.763187  7328 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:50.770141  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:50.767733  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.772318  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:50.779742  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:50.756522 13536 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.001s
W20260709 13:15:50.807366  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.726498 13461 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:50.777511  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:50.778604  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:50.810290  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 200815us
I20260709 13:15:50.809100  7335 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
W20260709 13:15:50.816852  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 48849us
I20260709 13:15:50.821297  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:50.697701 13562 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.829089  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:50.777175 13442 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:50.814648 13536 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.835949 13470 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:50.826478 13187 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:15:50.836301 13439 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:15:50.838905  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:50.839921  7336 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:50.821003 13450 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:50.844616 13461 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.844990 13504 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.823314 13565 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:50.851114 13565 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.851543 13565 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:50.825001 13443 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
W20260709 13:15:50.838249  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 68237.2us
I20260709 13:15:50.831637 13342 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:50.864140  7256 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:15:50.868878  7262 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
W20260709 13:15:50.870685  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46791us
I20260709 13:15:50.821659 13574 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:50.871510  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:50.850538 12987 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.005s
W20260709 13:15:50.872285  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 238861us
I20260709 13:15:50.880054  7256 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:50.884430  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:50.869078 12852 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:50.865020 13442 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:50.901587  7181 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:15:50.905462  7181 pending_rounds.cc:85] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 11
I20260709 13:15:50.905802  7181 pending_rounds.cc:107] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:15:50.906098  7181 raft_consensus.cc:2889] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:50.903721  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.907747  7187 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:50.895117  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.910684  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.911476  7256 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:50.912273  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.874711  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.851536 13322 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:50.821466 13104 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.924659  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:50.879105 12987 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:50.941502  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57192.1us
I20260709 13:15:50.886085 13439 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:15:50.944918  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:50.950098 13567 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.927300 13187 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:50.950815 13567 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:50.953724 13567 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:50.919819 13564 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:15:50.954859 13564 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.955284 13564 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:15:50.955874  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:50.957352  7178 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:50.945039  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.947063  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.903446 12852 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.969349  7186 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:15:50.975205  7253 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:50.969723  7262 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:15:50.977864  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:50.909468 13574 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:15:50.980919  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.984433  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:50.932801 13458 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.986322  7335 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:50.992966  7256 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:50.995409  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:50.996881  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:50.997567  7179 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:51.000130  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.015594  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:50.976584 12852 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:51.001840  7890 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
W20260709 13:15:51.016849  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.016423  7330 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:50.950383 13572 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.121s
I20260709 13:15:51.052975  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.054169  7893 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:51.059211  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:51.061564  7896 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:50.996114 13504 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:51.000105 13470 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.051173 13342 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.031687 13461 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:51.080864  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:50.961426 13579 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 13:15:50.994565 13567 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.058617 13104 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:51.089466  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 144630us
I20260709 13:15:51.090428  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.072367 13187 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:51.068470 13512 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:15:51.007671 13458 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:51.097189  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 226148us
I20260709 13:15:51.105849  7330 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:15:51.110239  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:51.110754  7262 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:15:51.093492 13342 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.121145  7178 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:51.113205 13243 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:51.087224 13470 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.138916 13562 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:51.140172 13322 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:51.115686 13570 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:51.148209  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.115374 13536 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:51.120056 13409 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:51.103721 13568 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:15:51.075160 13442 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.135463 13575 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:51.114744 13567 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.152540 13409 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:51.206192 13342 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:51.208213 13470 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:51.208573  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 79740.8us
I20260709 13:15:51.211869 13579 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.184104 12987 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:51.201653 13587 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:15:51.215438  7894 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:15:51.231544  7894 pending_rounds.cc:85] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 12
I20260709 13:15:51.230839 13575 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.231830  7894 pending_rounds.cc:107] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:15:51.232156  7894 raft_consensus.cc:2889] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.233537 13567 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:51.234004 13575 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:51.148881 13574 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.235420  7327 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:15:51.236575  7331 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:15:51.237756  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.238550  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.239145  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.239727  7332 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:51.240694  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.241499  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:51.242118  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.239221  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.152199 13571 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.265s
W20260709 13:15:51.229837 13433 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.699s	user 0.005s	sys 0.007s
I20260709 13:15:51.229241 13579 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.221894 13594 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:51.157539  7179 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:15:51.202142 13582 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:51.219413  7186 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:51.251192  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:51.254267  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:51.264129  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.265815 13565 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.267403 13594 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:51.267948 13594 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:51.269307 13470 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.270217 13470 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.270861 13581 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:51.271443 13581 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:51.271863 13581 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:51.275125 13597 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:51.275795 13597 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.276217 13597 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:51.277782  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.277918  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.278949 13596 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:51.280284 13470 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:51.268985 13594 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.287209  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.291100  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.291970  7892 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:51.250696 13433 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:51.293279  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.312417 13594 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:15:51.312552  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 222208us
I20260709 13:15:51.313503 13564 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.328298  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.330165  7887 raft_consensus.cc:2368] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25.
I20260709 13:15:51.325996  7258 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:51.333891  7894 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:51.341605  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.343688  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.281713 13409 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.331877 13565 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:51.346004 13243 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:15:51.340535 13437 consensus_meta.cc:287] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.007s
I20260709 13:15:51.361619 13409 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:51.362919 13564 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:51.348806  7187 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:51.371362  7255 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:15:51.374989 13564 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:51.375454  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:51.376224  7335 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:15:51.376014 13564 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.376423 13579 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:51.377317  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.348378 13598 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:51.379190 13575 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.378437 13564 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:51.380100 13575 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.383517 13597 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.390928 13565 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:51.391438  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.391326  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:51.392205  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 68707.7us
I20260709 13:15:51.393236  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.393544  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.394177  7892 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:51.394737 13579 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:51.396169  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:51.393292 12852 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.385897  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:51.402462 13104 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:51.408448 13104 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.411497 13578 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:51.411994 13575 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:51.412030 13578 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:51.429590 13578 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.430330  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:51.431164 13578 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:51.426851 13342 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:51.431896 13342 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.424866  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:15:51.432531  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.433861 13593 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:51.427561 13536 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.435089 13536 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.437942 13536 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:51.434363 13593 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.431281  7260 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:51.438951 13104 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:51.440058 13342 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:51.441596 13581 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.442736  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:51.443606  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.423782 13594 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:15:51.444752  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:51.446095 13594 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:51.446501 13594 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:51.447124  7260 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:51.447281  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.447535 13594 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.448860 13594 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:51.449223  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:51.450912  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:51.453233 13458 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:51.455729 13540 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:51.456717 13589 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.364s	user 0.000s	sys 0.002s
I20260709 13:15:51.456552 13540 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.448000  7893 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:15:51.403807 13187 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:51.438942 13593 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:51.463436  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:51.464262 13540 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:51.466557  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:51.471446 13243 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:15:51.472091 13243 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.472563 13243 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:51.480436  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.483814 13581 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:51.484719 12852 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:51.490790  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.491088 13540 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:51.492193 13540 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:51.458009 13579 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:15:51.493781 13540 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.495746 13579 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:51.496805 13579 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:51.497586 13579 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:51.500640 13597 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:51.493531  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.501859  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:51.504490  7862 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:51.506402 13530 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:15:51.506675 13374 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:51.507206 13530 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:51.507805 13374 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:51.508888  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.508473 13530 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.508958 13374 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.510802 13581 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:51.511190  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:51.511934  7893 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:51.512169 13581 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:51.517292 13288 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:51.517843 13288 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:51.518836 13609 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:51.518986 13288 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.520184 13470 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:51.520619 13470 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:51.521690 13470 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.523552 13470 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:51.527077  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:51.527175 13579 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.529677  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:51.530606 13299 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:51.531044 13573 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:51.533259  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.531373 13299 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:15:51.460515 13439 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
W20260709 13:15:51.545109  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.547995  7893 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:51.549566  7260 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:51.540079  7335 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 25.
I20260709 13:15:51.549938  7255 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:15:51.510807  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.550961  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:51.553673  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:51.555004  7256 raft_consensus.cc:2410] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:15:51.545956 13579 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:51.560266  7262 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:51.560457  7260 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:15:51.561069  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:51.520637 13288 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:51.571569  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:51.583089  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:51.587383  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:51.588073  7261 raft_consensus.cc:2410] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:15:51.583420  7336 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:51.583874  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:51.588960  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:51.589130  7257 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:51.591832  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:51.592900  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 62318.7us
I20260709 13:15:51.593268  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:51.594355  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.595738  7331 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:51.595960  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.596020  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:51.598948  7259 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:51.599995  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.600432  7327 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:15:51.600688  7332 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:15:51.601630  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.601926  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.602548  7893 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:51.601634  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.602949  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:51.603494  7332 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:51.604857  7327 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:51.603590  7330 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:51.605614  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.605924  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:51.571094 13243 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.610811 13243 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:51.611577 13573 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:51.612834 13573 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.614861 13562 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:51.616406 13562 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:51.619482  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.620947 13443 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:51.621750 13443 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:51.625589 13535 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:51.627534 13535 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:51.561343 13299 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:15:51.643831  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 130848us
I20260709 13:15:51.592541 13596 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:51.653600  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:51.661206  7890 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:51.652505  7335 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:51.659555  7330 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:51.636722 13468 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.671432  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:51.675072  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:51.677088  7892 raft_consensus.cc:2368] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19.
I20260709 13:15:51.652505 13299 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:51.689643  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.691923  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:51.695964  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 185413us
I20260709 13:15:51.659137 13322 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:15:51.704960  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.706118  7335 raft_consensus.cc:2368] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25.
I20260709 13:15:51.709504  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.716053 13596 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:51.678084 13468 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:51.719353  7259 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:51.719707  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.721810  7896 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:51.720338  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:51.723505  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 116730us
I20260709 13:15:51.729887  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.731716  7889 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 16: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:51.733019  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.734063  7335 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
W20260709 13:15:51.744704  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.746922  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:51.751209  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:51.753937  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.757802  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:51.759160  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:51.760306  7333 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:51.761871  7181 raft_consensus.cc:2410] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:15:51.758517  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:51.762988  7889 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 21: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:51.763274  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.762977  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:51.781311  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.785526  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:51.801165  7335 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:15:51.803189  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:51.787293 13536 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:51.808487  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:51.811827  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:51.811827  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:51.817363 13442 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:51.819674  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:51.819967  7335 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:15:51.820633  7186 raft_consensus.cc:2410] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:15:51.821542  7179 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
W20260709 13:15:51.824536  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.827059  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:51.827749  7187 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:51.790755 13450 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:51.828971 13450 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.829363 13450 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:51.804548 12987 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:51.831482 13485 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:51.832515  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:51.833328  7182 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:15:51.751526 13517 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:15:51.838371  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:51.798882 13591 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:51.846428  7181 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:15:51.847067  7180 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:51.847349  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:51.853953  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:51.857170  7334 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: [12.12-14.13]
I20260709 13:15:51.846488 13609 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.859143 13609 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:51.860797  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:51.861663 13609 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:51.863103  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:51.864027  7332 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:51.866811  7328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:15:51.867733  7328 raft_consensus.cc:606] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:51.800302 12919 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:15:51.880179  7187 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:51.883065  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.884106  7331 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:51.881696  7333 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:51.756824 13299 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:51.891340  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 142314us
I20260709 13:15:51.892745  7179 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
W20260709 13:15:51.895881  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 86805.7us
I20260709 13:15:51.898454  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:51.899358  7333 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:51.902616  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.903988  7331 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:15:51.906908  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:51.911616  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:51.922128  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:51.925871 13591 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:51.936482  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44268.7us
I20260709 13:15:51.937984 13596 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:51.939242 13596 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:51.937984  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:51.941622  7334 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:51.949582  7261 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:15:51.950197  7261 pending_rounds.cc:85] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 12
I20260709 13:15:51.950493  7261 pending_rounds.cc:107] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:15:51.950865  7261 raft_consensus.cc:2889] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.952988  7259 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:51.954438  7259 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:51.944024 13609 raft_consensus.cc:2764] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:15:51.965463  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:51.969509  7225 leader_election.cc:400] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25.
I20260709 13:15:51.970001  7225 leader_election.cc:403] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:51.966677  7333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:15:51.972847  7333 raft_consensus.cc:606] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:51.973429  7333 raft_consensus.cc:614] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:51.990855  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:52.013521  7259 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:52.014762  7259 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:52.019863  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:52.024355 13622 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.025386 13616 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:52.025249 13622 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:52.026532 13619 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:15:52.024482 13625 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:52.027407 13625 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.027784 13625 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:52.031368 13618 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:15:52.034344 13616 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:15:52.035590  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 45352.1us
I20260709 13:15:51.954774 13596 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
W20260709 13:15:52.039542 13621 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:15:52.039958 13596 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:52.040524 13596 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:52.022073 13470 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:15:51.990598 13433 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:52.024608 13468 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:52.047947  7890 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:15:52.047832  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:52.038213  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.060034  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:52.070956 13518 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:15:52.071499 13518 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:52.072361 13518 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:52.073629 13518 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:52.075948  7259 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:15:52.076478  7259 pending_rounds.cc:85] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 10
I20260709 13:15:52.076764  7259 pending_rounds.cc:107] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:15:52.077086  7259 raft_consensus.cc:2889] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:52.099701 13433 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:52.105165 13579 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:52.105427 13540 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:52.115494 13433 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:52.123858  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 85744.6us
W20260709 13:15:52.136648 13633 log.cc:927] Time spent T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
I20260709 13:15:52.131111 13433 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:52.127439 13540 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:52.159689  7334 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:15:52.160811  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.162312  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:52.158521 13615 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.269s	user 0.004s	sys 0.000s
W20260709 13:15:52.171517 13627 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:15:52.177356 13625 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:52.180070 13625 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:52.181810 13593 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.706s	user 0.013s	sys 0.000s
I20260709 13:15:52.167735 13450 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.189273 13622 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:52.188684 13579 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:52.190127 13582 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:15:52.225564  7334 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:15:52.216507 13288 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.001s
I20260709 13:15:52.196305 13625 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:15:52.194728 13593 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.232306  7893 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:52.243562  7184 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:52.223649 13582 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:52.237262  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.238682  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.239880 13450 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:52.240005  7330 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:15:52.240974 13638 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:15:52.235138 13596 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:52.250195  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.246117  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 146125us
I20260709 13:15:52.251578  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:52.254046  7186 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:52.254971  7185 raft_consensus.cc:2368] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17.
I20260709 13:15:52.261353  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:52.241657 13470 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25.
W20260709 13:15:52.264019  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50920us
W20260709 13:15:52.264705  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.265210  7302 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.266184  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:52.268886  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:52.262171 13598 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.273444 13598 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.202795 13540 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:52.260715 13625 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:52.246557 13578 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:15:52.309325 13322 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:52.309882 13322 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.310250 13322 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:52.312826  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.287056 12852 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:52.318807  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.297080 13625 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:52.341380  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 80116us
I20260709 13:15:52.337387 13299 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:52.337453 13596 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:52.340129 13104 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:52.339993 13437 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:15:52.386595  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69848.4us
I20260709 13:15:52.389529  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:52.393002  7256 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 25.
W20260709 13:15:52.385422 12987 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.002s
I20260709 13:15:52.318677 13582 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.405309 13468 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:52.405197 13647 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:52.405915 13468 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:52.405813 13433 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:52.406452 13468 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:15:52.409142 13643 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:15:52.409497 13624 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.387s	user 0.003s	sys 0.000s
W20260709 13:15:52.411010  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 512583us
I20260709 13:15:52.411511 13625 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.412655 13625 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:52.413223 13626 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:15:52.413817 13626 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:52.414794 13626 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.416296 13437 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:52.417050 13437 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:52.422065  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.426541  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:52.431159  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.431535  7334 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:52.424213  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:52.425369  7332 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: [12.12-14.13]
W20260709 13:15:52.425837 13642 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:15:52.426481  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 121733us
I20260709 13:15:52.427120 13593 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:52.427860 13536 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:52.429682  7861 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.431080  7225 leader_election.cc:400] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25.
I20260709 13:15:52.425084  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:52.388459 13470 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:15:52.397119 12987 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:52.451567  7890 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:15:52.454005  7335 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:52.459411  7331 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:52.468433  7894 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:52.469015  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:52.472685  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.480360  7334 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
W20260709 13:15:52.487491 13648 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:15:52.439424 13536 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:52.436575 13598 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:52.467659 13567 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:52.496570  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.491809 13512 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:52.505748 13450 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.508946 13450 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.510593 13512 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:52.512645 13512 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.514868 13564 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:52.499375 13593 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:52.497421 12852 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:52.511091 13433 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:52.526998  7331 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:52.527038  7299 leader_election.cc:400] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19.
I20260709 13:15:52.541244  7299 leader_election.cc:403] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:15:52.541838  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:52.542699  7328 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:15:52.546015  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 73432.3us
I20260709 13:15:52.547204  7335 pending_rounds.cc:85] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 15
I20260709 13:15:52.547423  7336 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:15:52.547708  7335 pending_rounds.cc:107] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260709 13:15:52.548766  7335 raft_consensus.cc:2889] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:52.550374  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:52.551010  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:52.553200  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:52.553985  7334 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:52.555732  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:52.567255 12852 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:52.574736 13598 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:52.575886 13518 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:52.576490 13518 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.576946 13518 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:52.578974 13450 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:52.579898  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:52.581606  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.590873 13651 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19.
W20260709 13:15:52.594656  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44713.9us
I20260709 13:15:52.595813  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.602278  7328 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
W20260709 13:15:52.621834  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 232359us
I20260709 13:15:52.627667  7327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:15:52.628648  7327 raft_consensus.cc:606] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:52.629117  7327 raft_consensus.cc:614] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:52.633169  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:52.648785  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 53096us
W20260709 13:15:52.631924  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 72546.2us
I20260709 13:15:52.651765  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:52.655500  7260 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:52.663102  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:52.632578 13578 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:52.667464 13485 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:52.668206 13485 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:52.672974  7255 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:15:52.673457  7255 pending_rounds.cc:85] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 11
W20260709 13:15:52.673496  7228 leader_election.cc:336] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.708s (SENT)
I20260709 13:15:52.673847  7255 pending_rounds.cc:107] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:15:52.674803  7255 raft_consensus.cc:2889] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:52.675163  7255 pending_rounds.cc:107] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:15:52.675405  7255 raft_consensus.cc:2889] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:52.676559  7260 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:52.629323 13593 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:52.677028  7260 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:52.646961 13653 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.634829 13433 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:52.627940 13591 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.674192  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:52.681274  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:52.685624  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.657011 13567 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:52.678941  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45865.6us
W20260709 13:15:52.684780 13616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.004s	sys 0.016s
I20260709 13:15:52.646560 13536 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:52.701051  7260 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.699071  7334 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:15:52.705312 13483 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:52.733130  7254 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:15:52.704252 13616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.004s	sys 0.017s
I20260709 13:15:52.643828 13450 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:15:52.712926 13518 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.715052 13437 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.702363 13433 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:52.719954  7328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:15:52.803269  7328 raft_consensus.cc:606] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:52.720667 13536 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:52.684252 13442 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:15:52.705878 13582 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:52.724998  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 886) took 1085 ms. Trace:
W20260709 13:15:52.725870  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 68965.9us
W20260709 13:15:52.726436  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.706858 13540 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:52.730912  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:52.809926  7893 rpcz_store.cc:276] 0709 13:15:51.639223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.639359 (+   136us) service_pool.cc:224] Handling call
0709 13:15:51.648065 (+  8706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.242416 (+594351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.724576 (+482160us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540068e7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:52.724894 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1343040384}
I20260709 13:15:52.813220  7262 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:52.730913  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:52.814646  7259 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:52.731730  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:52.686968 13593 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:52.708513  7260 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:52.733319 13651 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:52.770905 13483 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:52.791405  7331 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:52.790349  7336 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:52.789258  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:52.761575 13468 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:52.735193  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61736.6us
I20260709 13:15:52.825323  7888 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:52.703594 13591 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:52.781474  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.755000 13578 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:52.808296  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:52.830910  7334 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:15:52.811465  7332 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:52.701315 13653 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.834239 13468 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:52.825759  7228 leader_election.cc:336] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.720s (SENT)
W20260709 13:15:52.770871 13652 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:15:52.828913  7327 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:15:52.809841 13598 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:52.824774  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.834856 13653 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:52.837742 13591 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:52.802688 13596 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:52.840991  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.842576  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.844084  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:52.849762 13485 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.872584 13485 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:52.822216 13593 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:15:52.877079  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47224.4us
I20260709 13:15:52.852766  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:52.845088  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:52.865562  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.866008 13659 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:52.870371 13609 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:52.885620  7888 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:52.898340  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:52.899565 13437 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:52.900104 13646 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:52.900276 13437 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:52.901221  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:52.900624 13646 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.902515 13646 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:52.892063 13596 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.905757 13518 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:52.902029 13470 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:52.907049 13470 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:52.908291  7257 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:52.908135 13470 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:52.902149  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:52.913550  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.916337  7333 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:15:52.918526  7333 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:52.919500  7893 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 21: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:52.921901 13433 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:52.921967 13540 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:52.922925 13540 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:52.855120 13598 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:52.925385 13620 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.895s	user 0.008s	sys 0.000s
I20260709 13:15:52.925902 13598 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:52.926988  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:52.927146 13243 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:52.928231 13243 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:52.929183 13243 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.930186 13243 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:52.931016  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 99982.4us
I20260709 13:15:52.931556 13483 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:52.932435  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.926199 13579 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:52.934089 13582 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:52.934847  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 83033.6us
I20260709 13:15:52.912184 13609 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:52.936219 13609 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:52.937515 13609 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:52.856225 13536 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:15:52.939939  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:52.941898  7336 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:52.923920 13540 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:52.943910  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:52.944777 13450 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:52.948730  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:52.953080  7260 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:15:52.953585  7260 pending_rounds.cc:85] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 12
I20260709 13:15:52.953867  7260 pending_rounds.cc:107] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:15:52.954156  7260 raft_consensus.cc:2889] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:52.920027  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 59942.2us
I20260709 13:15:52.939962  7335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d735c64b62484486814db631ca028bdb"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:15:52.955837  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:52.956362  7335 raft_consensus.cc:606] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:52.956827  7335 raft_consensus.cc:614] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:52.958424  7327 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:52.966457  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:52.969105  7334 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:52.947167  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:52.970600  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:52.980654  7332 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:52.966351  7262 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:15:52.984055  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:52.982965  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:52.906035 13596 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:53.018903  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:53.026364  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:52.989419  7258 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:52.946555 13450 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:15:52.973080 13660 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:15:53.060581  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:53.067961  7260 raft_consensus.cc:2368] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18.
I20260709 13:15:52.985441 13437 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:15:52.973493 13657 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:52.987305 12919 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:15:53.076713 13657 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:53.077348 13657 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:53.078979 12852 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:53.081113  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.082360  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.083070  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:52.984910 13567 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:15:52.984905 13591 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:15:53.043215 13322 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.727s	user 0.013s	sys 0.000s
I20260709 13:15:53.085155  7183 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:53.085960  7187 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:53.058368 13450 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.946453 13518 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.117s
I20260709 13:15:53.091063  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.091169  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.113242  7182 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:53.111431  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.113329  7184 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:53.114835  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.114956  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:52.985175 13530 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 13:15:53.118899  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.119138  7256 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:15:52.985435 13625 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:15:53.122390  7181 raft_consensus.cc:2410] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:15:53.124043  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:53.091974 13662 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:15:53.086864 13651 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:15:53.160550  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 266454us
I20260709 13:15:53.162173  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:53.160662  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.164578  7180 raft_consensus.cc:2410] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:15:53.116603 13450 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:53.090456 12987 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:53.116520 13591 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:53.181526  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:53.171125  7302 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:53.186059  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.087178 13659 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:15:53.163966 13104 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.116922 13322 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:53.119270 13536 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:15:53.220000  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:53.216877  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 136643us
I20260709 13:15:53.178009 13598 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:15:53.181720 13433 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:53.187077  7181 raft_consensus.cc:2376] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22. Re-sending same reply.
I20260709 13:15:53.227381  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:53.177611 13651 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:53.224905  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.217141 13517 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:53.224005 13625 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.229841  7186 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:53.230846  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:53.241539  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:53.243021  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:53.239715  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 202170us
I20260709 13:15:53.243969  7181 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:53.243111  7253 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:53.225514 13433 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:53.249395  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:53.252631  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:53.190062 12987 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:53.279891  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.253597  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:53.239832 13670 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:15:53.219874 13104 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:53.276137  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.284389  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.254455  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.258549  7253 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:15:53.285662  7180 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:53.263723  7255 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:15:53.260401  7256 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:53.263288  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:53.264308  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:53.258985  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.333314  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.285049  7183 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:53.340510 13104 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:53.370465  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:53.344617 12987 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:53.279750 13536 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:15:53.332482 13666 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:15:53.332858 13468 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:53.348049  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:53.348806 13664 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:15:53.348887 13243 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:53.351058  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.351794 13651 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:53.353890 13657 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:53.356418 13646 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:53.359019  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.332568 13437 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:15:53.296129  7182 raft_consensus.cc:2410] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:15:53.368086  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.475564  7183 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:53.373499  7187 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:15:53.476897  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.477721  7187 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:15:53.370138  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:53.248102 13517 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:53.389653 13616 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.441669  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 188407us
I20260709 13:15:53.256877 13582 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.456293  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 85902.4us
I20260709 13:15:53.248498 13625 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:53.498196  7262 raft_consensus.cc:2368] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19.
I20260709 13:15:53.451105 13468 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:53.272217 13579 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.176s
W20260709 13:15:53.446331 13669 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:15:53.489753  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:53.506281 13468 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:53.509485 13243 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.482436  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.491567  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.441184 13536 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:53.267645 13591 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:53.516162  7181 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:53.521692  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.496364  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.496696  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:53.289920 13540 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.185s
I20260709 13:15:53.501350  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.531627  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.510731 13646 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:53.497813 13616 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:53.443279 13653 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.514933  7186 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:53.273675 13433 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:53.539585  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.532747  7182 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:15:53.488909  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.510140 13243 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:53.568159  7181 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 12.
W20260709 13:15:53.565018  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 68402.3us
I20260709 13:15:53.510802 12987 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:15:53.520089 13655 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.811s	user 0.002s	sys 0.000s
I20260709 13:15:53.573060  7180 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:53.576314  7186 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:15:53.580403  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:53.527726 13536 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:53.589641  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:53.509507 13688 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:53.522099 13690 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:53.599035 13690 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:53.599188 13517 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:53.601585 13690 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:53.590660 13322 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:53.566418 13104 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:53.500222 13582 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:53.603681 13104 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:53.605029  7184 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:15:53.605419  7184 pending_rounds.cc:85] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 11
I20260709 13:15:53.605661  7184 pending_rounds.cc:107] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:15:53.605898  7184 raft_consensus.cc:2889] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:53.606129 13104 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:53.608120 13625 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:53.611346  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:53.615338  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:53.616158  7186 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:53.620819  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:53.620918  7183 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:15:53.627326  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:53.573760 13437 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:53.606244 13582 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:53.640247  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:53.528299 13530 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:15:53.635761  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:53.643520  7259 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:53.583015 12987 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:53.591678 13646 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:53.654546  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:53.655985  7327 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:15:53.633951 13688 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:53.574340 13653 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:53.679162  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:53.661079  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:53.661003  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:53.674507  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:53.759002  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 138292us
I20260709 13:15:53.759289  7332 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:53.677791  7336 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:15:53.759879  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:53.752154  7185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3316) took 1898 ms (client timeout 1643 ms). Trace:
I20260709 13:15:53.647850 13679 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:15:53.763350  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 302515us
I20260709 13:15:53.773748  7331 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:53.776006  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:53.760942  7185 rpcz_store.cc:269] 0709 13:15:51.790209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.790524 (+   315us) service_pool.cc:224] Handling call
0709 13:15:53.687969 (+1897445us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b54000ed8d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:53.688141 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016401792}
I20260709 13:15:53.647589 12987 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:53.762317 13690 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.666879 13582 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:53.691963 13622 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:53.812094 13582 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.658617 13512 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.135s
I20260709 13:15:53.781419 13679 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.656491 13701 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.166s
I20260709 13:15:53.848701 13517 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.782433 13675 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:53.867079  7225 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:53.868067  7152 leader_election.cc:400] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18.
W20260709 13:15:53.864112 13593 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.985s	user 0.014s	sys 0.004s
I20260709 13:15:53.864566 13712 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:53.819554 13582 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:53.791467 13646 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:53.863409 13243 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:53.873526  7152 leader_election.cc:403] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:53.810727 13690 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:53.824131 13485 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.865262 13705 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:53.887928  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 128122us
I20260709 13:15:53.904999  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:53.871138 13450 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.681s	user 0.005s	sys 0.006s
I20260709 13:15:53.860671 13679 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:54.010084  7258 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:15:54.037624  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 132715us
I20260709 13:15:53.989679 13437 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:53.989949 13625 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:15:54.068027  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.004381  7302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.007s
W20260709 13:15:54.071187  7302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.002s	sys 0.007s
W20260709 13:15:54.071800  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 701771us
I20260709 13:15:53.870453 13517 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:54.049695  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 387278us
I20260709 13:15:53.870110 13593 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:53.981433 13688 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:54.059530 13540 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:54.063359 13437 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.997855 13646 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.010283 13243 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 13:15:54.008018 13485 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:54.095860  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 272578us
I20260709 13:15:54.097154  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:53.889621 13675 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:53.981794 13712 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.035027 13450 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:54.099821  7302 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.643s (SENT) [suppressed 19 similar messages]
I20260709 13:15:54.114282  7178 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:54.124651 13517 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:54.125481 13708 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:54.127143 13641 raft_consensus.cc:3055] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:15:54.130059  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3546) took 1176 ms. Trace:
I20260709 13:15:54.130460 13675 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:54.131503 13699 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:15:54.133247 13593 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.133474 13724 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:54.136724 13536 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.001s
I20260709 13:15:54.139562 13712 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.089148 13437 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:54.080580 13616 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.194229  7894 raft_consensus.cc:2368] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18.
I20260709 13:15:54.062389 13705 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.163897  7261 rpcz_store.cc:276] 0709 13:15:52.953517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.953680 (+   163us) service_pool.cc:224] Handling call
0709 13:15:53.025614 (+ 71934us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.440701 (+415087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:53.440743 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.443941 (+  3198us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.633084 (+189143us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:53.634196 (+  1112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.634583 (+   387us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.129672 (+495089us) raft_consensus.cc:1685] finished
0709 13:15:54.129708 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.129933 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43421,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93,"thread_start_us":417989,"threads_started":2,"wal-append.queue_time_us":531530}
I20260709 13:15:54.142127 13706 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.212023  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 79609.8us
I20260709 13:15:54.193150 13622 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.193444 13653 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.195267 13625 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:54.198742 13675 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:54.199571 13641 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:54.208154 13690 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.094316 13688 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.251839  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:54.233822 13622 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.201048 13708 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.257160 13622 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.257330 13708 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.258463 13702 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18.
I20260709 13:15:54.234501 13723 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.022s
I20260709 13:15:54.249943  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:54.206229 13536 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.220499 13718 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.248813 13579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.014s	sys 0.040s
I20260709 13:15:54.288728  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:54.299638  7331 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.525s	user 0.013s	sys 0.000s
I20260709 13:15:54.308249  7331 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 13:15:54.275847 13579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.014s	sys 0.040s
W20260709 13:15:54.326511  7332 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.549s	user 0.013s	sys 0.001s
I20260709 13:15:54.327600  7332 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:54.327769  7334 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:54.338979 13625 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.290417 13718 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.215430 13724 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:54.349288  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 253814us
W20260709 13:15:54.349206  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 276433us
I20260709 13:15:54.242502 13706 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.345752 13574 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:54.383512 13715 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:54.385313 13646 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.386950  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3344) took 1029 ms. Trace:
I20260709 13:15:54.387389  7187 rpcz_store.cc:276] 0709 13:15:53.357311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.575905 (+218594us) service_pool.cc:224] Handling call
0709 13:15:53.576361 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.628357 (+ 51996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:53.628389 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.657486 (+ 29097us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.054112 (+396626us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:54.055389 (+  1277us) log.cc:844] Serialized 14 byte log entry
0709 13:15:54.095964 (+ 40575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.096060 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.386706 (+290646us) raft_consensus.cc:1685] finished
0709 13:15:54.386730 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.386885 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115930,"prepare.queue_time_us":693,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":156754,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":34245,"thread_start_us":261765,"threads_started":1,"wal-append.queue_time_us":483119}
W20260709 13:15:54.391770 13468 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.885s	user 0.014s	sys 0.004s
I20260709 13:15:54.392429 13468 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.328297 13641 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.395666  7329 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:54.396096  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:54.397620  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:54.398083  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 148222us
I20260709 13:15:54.398449  7255 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:54.399137  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:54.400810  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:54.401876 13591 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:15:54.402808 13591 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:54.402850 13450 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.403327 13591 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:54.354199 13714 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:54.404620 13596 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:54.404953 13714 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:54.406062 13579 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:15:54.406454 13579 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:54.407502 13574 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.407522 13579 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.409395 13579 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:54.410156 13574 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.412460 13705 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.413123 13485 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.416191 13470 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:54.416710 13724 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.403893 13591 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:54.418605 13573 raft_consensus.cc:993] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: : Instructing follower 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
I20260709 13:15:54.418891 13536 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:54.419241 13573 raft_consensus.cc:1081] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Signalling peer 2ecdd7dc4a144f5aa0f2f91c7b94434d to start an election
W20260709 13:15:54.390223 12987 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.001s
I20260709 13:15:54.420571 12987 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.423158 12987 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.424027 13718 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:54.438073 13658 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.719s	user 0.009s	sys 0.009s
I20260709 13:15:54.439412 13688 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.443077  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.443984  7253 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:15:54.444370 13437 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.446885 13591 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.448800 13720 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:54.449409 13720 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:54.450515 13720 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.452183 13720 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:54.449571 13722 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:15:54.416743 13470 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:15:54.456090 13721 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:15:54.455911 13470 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:54.457237  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54614.9us
I20260709 13:15:54.458267  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:54.459985  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:54.461566  7152 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:54.465621  7228 leader_election.cc:336] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.543s (SENT)
I20260709 13:15:54.466619 13729 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:54.466948 13732 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:15:54.472338  7228 leader_election.cc:336] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.837s (SENT)
I20260709 13:15:54.479936  7228 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:54.467476 13728 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:54.386163 13582 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.449045 13468 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:54.467840 13688 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.467949 13724 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:54.487856 13728 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.476575 13470 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:54.478389 13578 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:54.493124  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:54.466377 13714 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:15:54.456125 13591 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.496209  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:54.508769  7893 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:54.508540  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:54.509215  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:54.512913  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:54.514195  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:54.516495  7889 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:15:54.517962  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.521623  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:54.523367  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:54.512499 13573 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:54.506201 13670 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.508328 13579 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:54.538676  7888 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:15:54.527318  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:54.538932  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:54.499588 13646 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:54.529892  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:54.516098 13616 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:54.530748  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.533435  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:54.534691  7186 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:54.536895  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:54.526003 13707 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:54.541889  7179 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:15:54.552462  7179 pending_rounds.cc:85] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 9
I20260709 13:15:54.552798  7179 pending_rounds.cc:107] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:15:54.553151  7179 raft_consensus.cc:2889] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:54.544237  7182 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:15:54.529819  7890 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:15:54.522060 13571 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:54.520161 13536 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:54.494383 13688 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.545794  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:54.588944  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.551483  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:54.548122  7183 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:54.522225 13591 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:54.532662 13714 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.596019  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.596845  7179 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:15:54.597131  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:54.588079  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.588510  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:54.589514  7185 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:15:54.549332  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.538932 13579 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:54.542590 13646 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:54.527029 13578 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.556860 13536 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:54.601810  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.552175 13596 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:54.590773 12987 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:54.590583 13625 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:54.611198  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:54.595165 13568 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:54.612008  7182 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:54.617587  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:54.546531 13724 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:15:54.624606  7888 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:54.618245  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.545347 13573 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.603893 13706 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.621971  7261 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:54.621445 13625 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:54.610131 13739 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:15:54.613381  7179 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:15:54.605031 13700 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:15:54.625743  7183 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:54.609020  7187 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:54.540822 13670 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.617641 13616 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.541793 13732 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:15:54.603986 13591 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.614358 13578 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.620764 13707 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:54.628129 13536 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.621542 12987 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.629474 13691 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:54.687140  7894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1127) took 1747 ms (client timeout 2110 ms). Trace:
I20260709 13:15:54.631577 13573 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:54.687662  7894 rpcz_store.cc:269] 0709 13:15:52.939301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.946778 (+  7477us) service_pool.cc:224] Handling call
0709 13:15:54.686858 (+1740080us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540043a8d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:54.687042 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2791490944}
I20260709 13:15:54.690851 13688 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.600140 13437 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:54.693145  7262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2251) took 1570 ms (client timeout 1546 ms). Trace:
I20260709 13:15:54.697005  7185 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:54.648527  7261 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:54.652813  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.698971  7254 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:54.699357  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:54.699985  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.700973  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.663262  7335 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:15:54.665299  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.610800 13646 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:54.693459 13730 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.661337 13568 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:54.666570  7331 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:54.599835 13723 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.095s
W20260709 13:15:54.693758  7262 rpcz_store.cc:269] 0709 13:15:53.119998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.123645 (+  3647us) service_pool.cc:224] Handling call
0709 13:15:54.690434 (+1566789us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400349ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:54.690587 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857808768}
I20260709 13:15:54.615813 13726 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:54.668258  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:54.730789  7327 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:54.731168  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.704228  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.665652  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.733070  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.679105  7186 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:15:54.678910  7180 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:54.659359 13678 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.661465 12852 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:54.667943  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.738993  7330 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:54.633883  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.614831 13622 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.657512  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3337) took 1381 ms. Trace:
I20260709 13:15:54.682963 12987 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:54.673269  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.741396  7184 rpcz_store.cc:276] 0709 13:15:53.276233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.535458 (+259225us) service_pool.cc:224] Handling call
0709 13:15:53.535748 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:53.606589 (+ 70841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.657239 (+1050650us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b54002b52d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:54.657450 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158413184}
I20260709 13:15:54.743049  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.681305 13578 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.667619  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:54.759302  7329 raft_consensus.cc:2368] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21.
I20260709 13:15:54.658643  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:54.761317  7888 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 18: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:54.763317 13641 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:15:54.766660  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:15:54.771059 13692 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.944s	user 0.004s	sys 0.000s
I20260709 13:15:54.774834 13701 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:54.775368 13701 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:54.776260 13701 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.777070  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:54.779011  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:54.780000  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:54.780879  7896 raft_consensus.cc:2368] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18.
I20260709 13:15:54.781859  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:54.782521  7893 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
W20260709 13:15:54.785295  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.730408 13568 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.787809 13650 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.789192 13568 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.709940  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.675148 13616 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.790920  7299 leader_election.cc:400] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18.
I20260709 13:15:54.706512  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.793416  7185 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:54.703193  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.796185  7185 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:54.796454 13616 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.759305  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.600088 13702 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.103s
I20260709 13:15:54.604133 13708 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:15:54.719638  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:54.640492 13679 consensus_meta.cc:287] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.004s
I20260709 13:15:54.647015 13433 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:54.719058 13730 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.680505 13707 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.657068 13737 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:54.604223 13714 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.659649 13517 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.634582 13625 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:54.801975 13518 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.678083 13591 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.661267 13468 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:54.707734  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.745276  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.827080  7330 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:54.651127 13579 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.730046 13723 consensus_queue.cc:1243] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:15:54.832477  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:54.749042  7187 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:15:54.835227  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:54.749505 13622 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.750568  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:54.750308 13571 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:54.750964  7262 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 13:15:54.836632  7184 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 18: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:54.743032 12852 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.836905  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:54.837486  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.837566  7330 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:15:54.682013 13728 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.752521 13731 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.712757 13564 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.754231  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.857383  7334 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:15:54.755103 13678 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.674077 13670 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:54.757436 13582 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.788646 13650 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.879837 13650 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.791103  7335 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:54.881327  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.882074  7335 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:54.883266  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.884848  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.885802  7335 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 19: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:54.791704 13649 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:54.665299  7178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2607) took 1584 ms (client timeout 1531 ms). Trace:
W20260709 13:15:54.888137  7178 rpcz_store.cc:269] 0709 13:15:53.080648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.080811 (+   163us) service_pool.cc:224] Handling call
0709 13:15:54.665055 (+1584244us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002c4554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:54.665196 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2374136064}
I20260709 13:15:54.709515  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:54.804682  7327 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
W20260709 13:15:54.891086  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 181658us
I20260709 13:15:54.891611  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:54.892417  7327 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 18: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:54.892855  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.893659  7327 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:15:54.813220  7180 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:15:54.894737 13744 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:15:54.812282 13679 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.895895 13702 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:54.896483 13702 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.896993 13702 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:54.897742 13679 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.898561 13726 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.899081 13726 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:54.815517  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 222747us
I20260709 13:15:54.900413 12852 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.903664 13657 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.904690 13657 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:54.814441  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:54.906352  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 91992.5us
I20260709 13:15:54.906500 13582 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:54.907371 13582 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.909921 13582 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.910874 13647 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:54.911479 13647 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.911914 13647 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:54.647804  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.907398 13723 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:54.915001  7183 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:15:54.817962 13707 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:54.807513 13458 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:54.825717 13518 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.917431 13646 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.829738 13714 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:54.830144 13730 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.816084 13701 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:54.831143  7299 leader_election.cc:400] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18.
I20260709 13:15:54.935593  7299 leader_election.cc:403] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:15:54.935391  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.832805  7336 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
W20260709 13:15:54.845017  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.937739  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.851511  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:54.938867  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:54.855705  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.872722  7261 raft_consensus.cc:2410] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:15:54.825179 13517 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.873840  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:54.875849  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 43496us
I20260709 13:15:54.876672 13450 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:54.899355  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:54.915539 13723 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.945093  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:54.945966  7178 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:54.919416 13518 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:54.810395 13442 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:54.922003  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:54.926162 13678 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:54.968096  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.927155  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:54.927155  7329 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:54.956444  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.928053  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:54.970299  7180 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:15:54.931149  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.853309  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.940073  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:54.938572  7336 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:54.952510  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:54.932902 13650 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:54.959959  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:54.976022  7182 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:54.977893  7327 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:15:54.978672  7336 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:15:54.953329  7152 leader_election.cc:336] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.546s (SENT)
W20260709 13:15:54.962916  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 131959us
I20260709 13:15:54.840176 13468 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.980420  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:54.967716  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45835.2us
I20260709 13:15:54.967468  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:54.973949  7334 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:15:54.944939 13450 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.926842 13564 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.981956  7183 raft_consensus.cc:2368] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18.
I20260709 13:15:54.979588  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:54.957170 13708 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:54.983832  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:54.970474 13598 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18.
I20260709 13:15:54.990235  7330 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:54.934469 13714 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:15:54.988198  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:54.973086 13622 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.007572  7333 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:54.987294 13322 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:54.986835 13670 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.016517  7186 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:55.049619  7894 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:54.992029  7334 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:15:54.872710 13731 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.887095 13649 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:54.831604 13737 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:54.974890 13518 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.034008  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:55.068749  7896 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:15:55.036727  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 48616.7us
I20260709 13:15:55.032864  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:54.956864 13728 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:15:55.038101  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:55.083853  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45859.2us
I20260709 13:15:55.085835  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:54.977165  7187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:15:55.008333  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:55.086805  7187 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:55.087282  7187 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:54.987099 13437 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:15:54.994239 13450 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.042829  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:55.053272  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 122286us
I20260709 13:15:55.094892  7183 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:55.096122  7150 leader_election.cc:400] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21.
I20260709 13:15:55.096621  7150 leader_election.cc:403] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:15:55.056324 13468 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.101778  7184 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:55.033368 13591 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:54.967429 13483 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 13:15:55.041399 13609 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:15:55.041623 13616 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:55.041736 13708 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:55.061810  7178 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:54.999475 13678 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:55.076028  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:55.080474  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:55.080559  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:54.972359 13442 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.093294  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:55.100472  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 92531.4us
I20260709 13:15:55.157060  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:55.102917  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 149601us
I20260709 13:15:54.981909 13650 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:55.101227  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.133144  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47387.7us
I20260709 13:15:55.045459 13694 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:55.132073  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:55.130985 13659 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:55.138437  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:55.166606  7183 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:55.104642  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:55.035504 13686 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:15:55.132351  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:55.102005 13540 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:55.151520  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:55.170779 13540 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:55.162336  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:55.172024 13747 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:15:55.172374  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:55.173604 13675 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:55.175272  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:55.176656 13755 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:15:55.176446 13702 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.178339 13746 raft_consensus.cc:2764] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:15:55.149880 13616 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:55.179010 13616 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.179749 13731 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.180754 13731 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:55.181209 13731 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:55.181598 13731 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:55.133311 13726 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.183714 13723 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.135068 13578 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:55.184792 13578 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.185698 13726 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.187265 13578 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.093680 13707 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.189172 13737 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.189574 13707 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.190009 13737 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:15:55.167973  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63458us
I20260709 13:15:55.207719  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:55.168215  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:55.139603 13622 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:55.169965  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:55.213493  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:55.191179 13708 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:55.172216 13748 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:15:55.194620 13649 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:55.195287 13702 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.195672  7254 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:55.196643 13732 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:15:55.197681  7185 raft_consensus.cc:2368] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19.
I20260709 13:15:55.178506 12987 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.081018 13670 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.200584  7182 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:15:55.211018 13690 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.211203  7888 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:55.164676  7896 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:15:55.089344 13518 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.203027  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:55.190611  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:55.224550 13651 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:55.221083  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:55.171275 13540 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:55.101017 13625 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.161446 13678 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:55.165997 13437 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:55.222098  7302 leader_election.cc:400] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18.
I20260709 13:15:55.233454  7862 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:55.227201  7187 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:55.294710  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 78449.7us
I20260709 13:15:55.209383  7261 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:15:55.296521  7261 pending_rounds.cc:85] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 7
W20260709 13:15:55.296324  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 67808.2us
I20260709 13:15:55.296820  7261 pending_rounds.cc:107] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:15:55.297125  7261 raft_consensus.cc:2889] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:55.253265  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:55.254390 12987 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:55.254961  7335 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 16. Ops: []
I20260709 13:15:55.255455 13688 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:55.311627 13688 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:55.312590 13688 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.313952 13688 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:55.256033 13646 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.217968 13622 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:55.243393 12919 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:15:55.271962 13442 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.222648 13483 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:55.272416 13670 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:55.219224  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51094.2us
W20260709 13:15:55.280766  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 108475us
I20260709 13:15:55.282783  7258 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:15:55.331267  7258 pending_rounds.cc:85] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 11
I20260709 13:15:55.331529  7258 pending_rounds.cc:107] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:15:55.331772  7258 raft_consensus.cc:2889] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:55.280447  7256 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:15:55.333463  7256 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:55.329798  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:55.234856 13578 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:15:55.286978  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65998.4us
I20260709 13:15:55.293874 13678 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:15:55.289798  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 127849us
W20260709 13:15:55.344687  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.143666 13714 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21.
I20260709 13:15:55.299916 13374 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:55.301469 13650 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.301802  7261 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
W20260709 13:15:55.302304 13641 consensus_meta.cc:287] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.003s
I20260709 13:15:55.298084 13437 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:55.303318 13518 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:55.304111  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:55.304708 13694 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:15:55.378144  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 74112.8us
I20260709 13:15:55.250018 13726 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:15:55.311131  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1290) took 1430 ms. Trace:
I20260709 13:15:55.380077  7259 rpcz_store.cc:276] 0709 13:15:53.880414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.880801 (+   387us) service_pool.cc:224] Handling call
0709 13:15:53.881301 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.000467 (+119166us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:54.000503 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.671073 (+670570us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:54.671623 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.830768 (+159145us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:54.830804 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.830871 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.310745 (+479874us) raft_consensus.cc:1685] finished
0709 13:15:55.310772 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.311054 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118625,"raft.queue_time_us":119098,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":26705,"spinlock_wait_cycles":58282752,"thread_start_us":158736,"threads_started":1,"wal-append.queue_time_us":316118}
I20260709 13:15:55.298158  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:55.279400 13732 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:55.344074 13288 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:15:55.383051 13732 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.323859  7184 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:55.324421  7260 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 12. Current term is 13. Ops: []
I20260709 13:15:55.330618  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:55.337589  7187 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.324975 13703 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:15:55.324354 13675 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:55.390388 13675 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.328999 12852 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:55.339264  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:55.200207 13609 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
W20260709 13:15:55.345467  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 176313us
I20260709 13:15:55.345218  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:55.365147 13760 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:55.402601  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:55.403019 13760 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.403455  7330 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.403489 13760 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.405318  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:55.407286 13530 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:15:55.326009 13622 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:55.408352 13718 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:55.408794 13718 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:55.408836 13647 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.409847 13718 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.296927 13517 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.365051  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:55.284281 13690 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.366954  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:55.371124  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:55.340946 13735 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:55.343299 13578 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.433234 13723 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:55.438058 13578 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.438164 13723 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.438807 13723 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:55.394249 12852 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.341059 13725 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:55.440258 13725 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.441229 12852 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:55.379251  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:55.442816 13647 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:55.443323  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 64193.7us
I20260709 13:15:55.443475 13647 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:55.444032 13647 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:55.444136  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:55.444979 13647 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.445881 13670 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:55.446317 13670 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.446728 13670 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.435611 13450 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.451138 13728 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:55.454392 13322 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:55.455054 13322 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:55.457840 13578 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:55.387452  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 89386.9us
I20260709 13:15:55.459797 13670 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.465519  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:55.365415 13737 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
W20260709 13:15:55.389343 13752 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:15:55.411056  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:55.474071  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:55.311206 13433 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.411837 13625 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.376622 13437 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:55.412631 13530 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:55.430420 13714 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:55.416168 13731 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.385030 13650 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:55.426265  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:15:55.426863  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 81759.9us
I20260709 13:15:55.428061  7299 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:55.432446 13641 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.433107  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:55.433586  7183 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:55.431216  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:55.507463  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 76335.8us
I20260709 13:15:55.508260  7225 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:55.510090  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:55.511194  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:55.512727  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:55.513067  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:55.460425 13690 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.466965  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:55.387701  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57161.9us
I20260709 13:15:55.451593 13728 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:55.475036  7893 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.387094  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:55.412833  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2383) took 1761 ms. Trace:
W20260709 13:15:55.436725 13711 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.097s	user 0.002s	sys 0.002s
W20260709 13:15:55.460188 13753 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.308s	user 0.000s	sys 0.000s
I20260709 13:15:55.442437 13725 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.526839 13616 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.528658 13731 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.502466  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:55.530230  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:55.531126  7178 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:55.532075  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:55.531435  7079 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 9 to 11, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 11 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.533304  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:55.534039  7178 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:15:55.435386 13726 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:15:55.535107  7332 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:15:55.539760  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:55.540371  7178 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:55.504614 13650 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.506428 13651 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.506613 13746 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:55.518399 13625 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.437462 13622 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:55.505190  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 77221.6us
I20260709 13:15:55.554536  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:55.514228  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:55.515775  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:55.516286  7336 raft_consensus.cc:2368] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19.
I20260709 13:15:55.518060  7333 rpcz_store.cc:276] 0709 13:15:53.651573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.657037 (+  5464us) service_pool.cc:224] Handling call
0709 13:15:53.657376 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.039046 (+1381670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.412598 (+373552us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540031a1d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:55.412774 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3104588544}
I20260709 13:15:55.520426  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:55.561610  7183 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:55.524145 13573 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:55.517022 13766 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:15:55.499143 13433 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.518743 13718 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.502858  7330 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:55.538709 13705 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:55.516700 13641 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.545392 13650 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.545198 13690 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:55.547047 13609 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.586936  7178 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:55.577252 13573 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.591764 13573 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.594677 13728 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.602447  7255 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:15:55.572719 13578 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.582131 13731 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:55.550884 13651 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.580669 13766 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:55.579667  7893 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:55.626237  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:55.629361  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:55.629688  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:55.631362  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:55.600818 13616 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.632874  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:55.633579  7183 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:15:55.634688  7893 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:55.635082  7183 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:55.637609  7330 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:55.640501  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:55.638684  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 123014us
I20260709 13:15:55.642853  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:55.646919  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:55.639356  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:55.600864 13690 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.583407 13705 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.602586 13609 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.649159  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:55.650389  7859 leader_election.cc:400] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19.
I20260709 13:15:55.650878 13622 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.651522  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:55.651561 13703 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:55.653492 13641 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.677354  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:55.655469 13676 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:55.657158  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:55.657701 13437 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.680713  7327 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:55.681059  7327 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:55.659570  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.660228 13540 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.666353  7859 leader_election.cc:403] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:55.639917 13728 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.639235 13726 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:55.601449 13530 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.684870  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:55.681731  7327 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.691406  7327 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:55.687397 13675 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.005s
I20260709 13:15:55.697996 13433 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.694967 13288 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.703464 13678 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.706529 13679 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:55.714051  7330 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.714802 13726 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:55.716220 13540 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.715991 13726 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.717036  7257 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:55.718315  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:55.648736 13731 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:15:55.719074 13437 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.679991 13676 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:55.719660  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:55.720881  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:55.721355 13609 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.673622 13442 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:15:55.722666 13442 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:55.723060 13442 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:55.723672 13705 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.723912 13442 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.725330 13442 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:55.690997 13760 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.727483  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:55.727768  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:55.678285 13578 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:55.728895  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:55.729432 13760 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:55.731958  7182 raft_consensus.cc:2368] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19.
W20260709 13:15:55.733425 13772 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:15:55.690590 13777 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:55.735531 13651 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:55.737254 13769 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:15:55.737990 13766 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.739624  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:55.741763 13564 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:55.676069 13703 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:55.729583  7253 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21. Ops: []
I20260709 13:15:55.720641 13676 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:55.745679  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.749338  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1303) took 1091 ms. Trace:
W20260709 13:15:55.751287  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.738408 13625 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:55.753234  7327 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:55.748366  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1294) took 1733 ms. Trace:
I20260709 13:15:55.749763  7260 rpcz_store.cc:276] 0709 13:15:54.658159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.780755 (+122596us) service_pool.cc:224] Handling call
0709 13:15:54.781007 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.385448 (+604441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.749106 (+363658us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54002e7054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:55.749280 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249230720}
W20260709 13:15:55.775279  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.785322  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:55.791889  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 107109us
I20260709 13:15:55.792881  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:55.793376  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.784862  7258 rpcz_store.cc:276] 0709 13:15:54.015330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.059626 (+ 44296us) service_pool.cc:224] Handling call
0709 13:15:54.070437 (+ 10811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.332271 (+1261834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.748072 (+415801us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540034b2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:55.748295 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2786857344}
I20260709 13:15:55.796536  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:55.752153 13703 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:55.804114  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:55.782829 13705 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.810335  7327 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:55.816596  7330 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:55.738217 13322 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:55.801168 13760 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:55.841902  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2313) took 1171 ms. Trace:
I20260709 13:15:55.795354 13777 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:55.913434  7331 rpcz_store.cc:276] 0709 13:15:54.670086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.806287 (+136201us) service_pool.cc:224] Handling call
0709 13:15:54.809628 (+  3341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.136180 (+326552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.136215 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.136260 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:55.136289 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.841622 (+705333us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54002891d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:55.841675 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.841833 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679618432}
I20260709 13:15:55.809047 13676 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:55.808801 13730 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:55.815658 13578 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:55.953693  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:55.957240  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:55.959417  7331 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:15:55.959539  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.942440 13760 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:55.974478  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:55.975381  7327 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:55.953562 13609 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:55.981950  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:55.879474 13705 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:55.987035 13728 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:55.996902 13728 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.001895  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:56.003057  7327 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:56.005398  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.006379  7260 raft_consensus.cc:2410] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:15:56.014740  7258 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:15:55.985790 13609 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:56.019099 13780 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.322s	user 0.002s	sys 0.000s
I20260709 13:15:56.032759  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.035334  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:56.043232  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.045194  7258 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:56.045637  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.046751  7259 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:15:56.046577  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:56.049027  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 1044) took 1153 ms. Trace:
I20260709 13:15:56.049600  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:56.049537  7888 rpcz_store.cc:276] 0709 13:15:54.895522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.898917 (+  3395us) service_pool.cc:224] Handling call
0709 13:15:56.048828 (+1149911us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54006608d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:56.048960 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611784448}
I20260709 13:15:56.051863  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.034235 13690 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:56.056030 13322 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:56.060498 13450 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:56.063495  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.065629 13609 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:56.066164 13670 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:56.079443 13288 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19.
I20260709 13:15:56.082538  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.086658  7182 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:56.087648  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:56.052773 13771 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:15:56.085836  7862 leader_election.cc:400] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19.
I20260709 13:15:56.077701 13705 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:56.084924 13728 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:56.093189  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.097546  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:56.030368 13760 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:56.092250 13723 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.653s	user 0.013s	sys 0.000s
I20260709 13:15:56.107116 13723 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.109923  7180 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:56.112042  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:56.113292  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:56.113821  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.113862  7180 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:56.115538  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:56.115447  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:56.118546  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:15:56.119436  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.119905  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.117126  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:56.122851  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3358) took 1171 ms. Trace:
I20260709 13:15:56.123314  7185 rpcz_store.cc:276] 0709 13:15:54.951260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.951545 (+   285us) service_pool.cc:224] Handling call
0709 13:15:56.122567 (+1171022us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54001b49d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:56.122761 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523495168}
W20260709 13:15:56.125373  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.125492  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2315) took 1279 ms. Trace:
I20260709 13:15:56.126233  7335 rpcz_store.cc:276] 0709 13:15:54.845805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.993069 (+147264us) service_pool.cc:224] Handling call
0709 13:15:55.018504 (+ 25435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.298136 (+279632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.125176 (+827040us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540031c4d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:56.125416 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543232384}
I20260709 13:15:56.115351  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:56.055712 13650 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.128655  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.099566  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:56.133078  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:56.134152  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.131544  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:56.136771  7181 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:56.143371  7302 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:56.145551  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:56.152551  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1305) took 1272 ms. Trace:
I20260709 13:15:56.153906  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:56.155151  7334 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 13:15:56.162561  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.153059  7253 rpcz_store.cc:276] 0709 13:15:54.880406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.280948 (+400542us) service_pool.cc:224] Handling call
0709 13:15:55.281300 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.751943 (+470643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.152261 (+400318us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54002f7954. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:56.152476 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030463744}
I20260709 13:15:56.164703  7180 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:56.166038  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:56.167816  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.168634  7179 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:56.171022  7181 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:15:56.171137  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:56.173355  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:56.168406  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:56.181638 13782 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:56.181823  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:56.182521 13723 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:56.183316 13723 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:56.183735 13723 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:56.183794  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:56.184239 13723 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:56.142279 13705 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:56.185983 13705 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.173235 13735 consensus_queue.cc:1059] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:15:56.177836 13766 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:56.188378 13705 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:56.177445 13784 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:15:56.189010  7181 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:56.167289 13651 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:15:56.190042 13650 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:56.176832 13288 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:15:56.184772 13578 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:56.190685 13650 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:56.190869  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.153712 13616 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.179888  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.192526  7179 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:15:56.192238 13616 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:56.192982  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.194497 13616 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:56.197183  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:56.197528 13540 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:56.153965 13517 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:15:56.194926  7259 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
W20260709 13:15:56.218701  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.198458  7253 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:56.185235  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:56.199488  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:56.175906 13675 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:56.251158  7260 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:56.175227 13609 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:56.206322 13517 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:56.254602  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 55209.6us
I20260709 13:15:56.160560 13530 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:15:56.253949  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.261768  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.268738  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:56.208568 13437 raft_consensus.cc:2764] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 13:15:56.273379  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 88237.3us
I20260709 13:15:56.278263  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.280471  7260 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:56.270057  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:56.293751  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:56.294952 13616 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:56.300154 13726 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:56.303978 13729 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:56.304703 13729 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:56.259431 13705 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:56.272406 13517 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:56.279084 13728 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:56.290755  7180 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:56.326804  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:56.322711  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 189685us
I20260709 13:15:56.324402  7258 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:56.277878 13675 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:56.330044  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:56.340924  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:56.341926  7256 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:56.340467  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:56.347697  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:56.351755  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 195993us
I20260709 13:15:56.355010  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.355978 13726 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:15:56.364897  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:56.354911 13651 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:56.360693 13718 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:15:56.369097 13718 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:56.370319 13718 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:56.372185 13718 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:56.361413 13568 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:56.370693 13705 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:56.383258 13651 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.359965  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:56.384893 13670 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:56.389890 13670 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.390367 13670 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:56.340075 13536 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:15:56.391494 13729 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:56.393646 13729 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:56.395861 13723 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.401659 13670 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.367453  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:56.272156 13609 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:56.420148  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52807.6us
W20260709 13:15:56.423379  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63539.4us
I20260709 13:15:56.428520  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:56.429633 13536 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:15:56.434253 13609 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:56.435155  7259 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
W20260709 13:15:56.436240 13779 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.470s	user 0.004s	sys 0.000s
W20260709 13:15:56.412467 13703 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.008s
I20260709 13:15:56.438264 13703 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:56.439613  7888 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:56.444355  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1022) took 1017 ms. Trace:
I20260709 13:15:56.426614  7302 leader_election.cc:400] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19.
I20260709 13:15:56.445031  7333 rpcz_store.cc:276] 0709 13:15:55.427229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.559474 (+132245us) service_pool.cc:224] Handling call
0709 13:15:55.559970 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.560453 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.560498 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.561119 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.666833 (+105714us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:55.666881 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.666954 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.435362 (+768408us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:56.444005 (+  8643us) raft_consensus.cc:1685] finished
0709 13:15:56.444031 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.444250 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2626,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":11896,"spinlock_wait_cycles":4043648,"thread_start_us":77656,"threads_started":1,"wal-append.queue_time_us":228015}
I20260709 13:15:56.452360  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:56.471534  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.475708  7893 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:56.415628 13675 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:56.482020  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:56.482139 13723 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:56.426065 13728 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:56.493463  7888 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [16.15-21.18]
I20260709 13:15:56.494748  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:56.494899  7896 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:56.507638  7256 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:56.513461  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.449787 13450 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:56.522150  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 74502.7us
I20260709 13:15:56.518267 13705 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:15:56.519485 13726 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:15:56.520183  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.450392 13564 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.522521 13450 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:56.476068 13536 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:56.541786 13564 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:56.543169 13536 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.544094 13450 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:56.517119  7887 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:15:56.523658 13703 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:56.544793 13564 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:56.415983 13568 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:15:56.545670 13766 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:56.546218 13766 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.503971 13675 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:56.546980  7894 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:56.454231 13609 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:56.549921 13670 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:56.551800 13676 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.003s
I20260709 13:15:56.552093 13766 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:56.558215 13726 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.558858 13726 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:56.561355  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3570) took 1761 ms. Trace:
W20260709 13:15:56.562187  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.564417 13726 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:56.492651 13691 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:15:56.567621  7185 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:56.568302 13691 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:56.568687 13691 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:56.569793  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:56.570572  7887 raft_consensus.cc:2368] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19.
I20260709 13:15:56.571529  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.573262  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:56.573444  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:56.574116  7180 raft_consensus.cc:2368] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19.
I20260709 13:15:56.575256  7895 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:15:56.576830  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.578104  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:56.578243  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:56.578292  7335 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:56.564486 13678 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:56.580225  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:56.580873  7183 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:15:56.561899  7257 rpcz_store.cc:276] 0709 13:15:54.800377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.225915 (+425538us) service_pool.cc:224] Handling call
0709 13:15:55.226208 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.717487 (+491279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.561045 (+843558us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54001a2054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:56.561262 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128350592}
I20260709 13:15:56.569507 13691 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.584285  7333 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:56.583079 13676 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.586184  7896 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:15:56.590412  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:56.591486  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:56.697911  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:56.592556  7302 leader_election.cc:400] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19.
I20260709 13:15:56.699949  7302 leader_election.cc:403] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:15:56.700655  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 108237us
I20260709 13:15:56.593277  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:15:56.703953  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 110887us
I20260709 13:15:56.704799  7299 leader_election.cc:400] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19.
I20260709 13:15:56.594033  7180 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:56.594864  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.710603  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.609071  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:56.622197  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.730312  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:56.645160  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3572) took 1844 ms. Trace:
I20260709 13:15:56.731525  7262 rpcz_store.cc:276] 0709 13:15:54.800892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.279628 (+478736us) service_pool.cc:224] Handling call
0709 13:15:55.280069 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.441346 (+161277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.441379 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.441425 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:55.441455 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.644713 (+1203258us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54002e7f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:56.644771 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.644951 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370374912}
I20260709 13:15:56.733407  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:56.734234  7336 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:56.645742  7183 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:15:56.663424  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2321) took 1261 ms. Trace:
I20260709 13:15:56.737728  7334 rpcz_store.cc:276] 0709 13:15:55.401504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.401674 (+   170us) service_pool.cc:224] Handling call
0709 13:15:55.402100 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.158290 (+756190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.662992 (+504702us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b540013d654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:56.663317 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731147136}
I20260709 13:15:56.679044  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:56.679592  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:56.689378  7184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3353) took 1762 ms (client timeout 1735 ms). Trace:
W20260709 13:15:56.740985  7184 rpcz_store.cc:269] 0709 13:15:54.926471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.926869 (+   398us) service_pool.cc:224] Handling call
0709 13:15:56.689092 (+1762223us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540017d754. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:56.689280 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304871808}
I20260709 13:15:56.741386  7334 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:56.742146  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:56.742365  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:56.742779  7184 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:56.689823  7182 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 13:15:56.693763  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 245972us
I20260709 13:15:56.585892  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:56.752797  7332 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:56.596351  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:56.753181  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.755396  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.682211  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:56.752836  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 143908us
I20260709 13:15:56.757546  7887 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:56.736873  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.585189  7893 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:56.762795  7333 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:15:56.764449  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:56.765563  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 52351.4us
I20260709 13:15:56.767112  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:56.765579  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:56.778192  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:56.780010  7179 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:56.781168  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:56.752934  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:56.785241  7257 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:56.790169  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2274) took 1277 ms. Trace:
I20260709 13:15:56.790948 13718 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:56.791443  7255 rpcz_store.cc:276] 0709 13:15:55.512326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.512473 (+   147us) service_pool.cc:224] Handling call
0709 13:15:56.789840 (+1277367us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b5400219dd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:56.790043 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204553088}
I20260709 13:15:56.775102 13782 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:56.646751 13676 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:56.796205 13676 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:56.799597  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:56.589830 13691 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:56.614910 13761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.049s	sys 0.033s
I20260709 13:15:56.827781  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:56.815217  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 86237.4us
W20260709 13:15:56.590061 13776 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.868s	user 0.002s	sys 0.000s
I20260709 13:15:56.840931  7256 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:15:56.809913  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:56.810741  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:56.813956  7258 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:15:56.687909 13591 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.624774 12919 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:56.587051 13701 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:56.820302  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:56.777803 13675 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:56.822793 13795 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:56.829381  7335 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
W20260709 13:15:56.829792  7181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.028s	sys 0.035s
I20260709 13:15:56.610118 13568 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:56.605816 13703 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.761229 13540 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:56.761812 12852 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19.
I20260709 13:15:56.852210  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:56.853629  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:56.775895 13766 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:56.821336  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:56.761539 13726 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:56.786172 13564 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.097s
W20260709 13:15:56.857169 13798 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:15:56.590034 13582 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.237s
I20260709 13:15:56.782799 13730 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:56.860831  7181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.029s	sys 0.035s
W20260709 13:15:56.843814 13761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.049s	sys 0.033s
I20260709 13:15:56.605822 13702 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.243s
I20260709 13:15:56.988559 13764 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:56.989279 13764 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:56.951098 13799 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.077s
W20260709 13:15:56.993010 13775 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.262s	user 0.004s	sys 0.000s
I20260709 13:15:56.993373 13799 consensus_queue.cc:1243] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 13:15:56.993814  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.994784  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2655) took 1183 ms. Trace:
I20260709 13:15:56.995229  7181 rpcz_store.cc:276] 0709 13:15:55.811721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.189861 (+378140us) service_pool.cc:224] Handling call
0709 13:15:56.190221 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.200493 (+ 10272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.200524 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:56.212149 (+ 11625us) log.cc:844] Serialized 26 byte log entry
0709 13:15:56.953390 (+741241us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:56.953440 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.953520 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.994464 (+ 40944us) raft_consensus.cc:1685] finished
0709 13:15:56.994489 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.994712 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12629,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":5269,"thread_start_us":692123,"threads_started":1,"wal-append.queue_time_us":718024}
W20260709 13:15:56.997058 13729 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.001s
I20260709 13:15:56.922395 13766 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.916592 13540 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.001073 13540 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:56.833114 13678 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:56.908031  7334 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:56.920810  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:56.852299 12919 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:56.802315 13517 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:56.815907 13681 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:56.966614  7187 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:57.021862  7336 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:15:56.854880 13450 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:56.972383 13795 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.883589 13568 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:56.912804 13701 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:57.031565 13701 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:56.859539 13591 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:57.036504 13591 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:56.913200 13703 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.040337 13517 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:57.041286  7335 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:15:57.045579 13579 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:57.051271 13731 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:15:57.051879 13731 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:57.052588 13795 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.007121 13678 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:57.055279 13678 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:56.949453 13726 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.002818 13730 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:57.070294  7260 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:15:57.080355  7258 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:57.091347  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:57.094175  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:57.103139  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:57.105085  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:57.105129  7185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.009s	sys 0.017s
W20260709 13:15:57.107998  7185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.009s	sys 0.017s
W20260709 13:15:57.109215  7892 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.072s	sys 0.086s
W20260709 13:15:57.109688  7892 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.072s	sys 0.086s
I20260709 13:15:57.120905  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3374) took 1650 ms. Trace:
I20260709 13:15:57.121551  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2646) took 1315 ms. Trace:
I20260709 13:15:57.121899  7178 rpcz_store.cc:276] 0709 13:15:55.470858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.604325 (+133467us) service_pool.cc:224] Handling call
0709 13:15:55.604668 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.678571 (+ 73903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.678612 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.678682 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:55.678719 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.120496 (+1441777us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b5400247554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:57.120579 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.120804 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169394560}
I20260709 13:15:57.130774  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:57.016702  7184 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:15:57.019546  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:57.132689  7255 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:56.968379 13582 consensus_queue.cc:1243] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:15:57.029414 13764 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:57.029199 12919 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.016499  7257 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:15:57.122217  7182 rpcz_store.cc:276] 0709 13:15:55.806506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.146282 (+339776us) service_pool.cc:224] Handling call
0709 13:15:56.689508 (+543226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.745577 (+ 56069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.121278 (+375701us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b540017d750. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:57.121474 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248546688}
I20260709 13:15:57.079171 13517 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.140103  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:57.140977 12852 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:57.145905  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:57.148599 13517 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:57.151636 13517 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:15:57.147454  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 367320us
I20260709 13:15:57.164402  7185 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:57.166618  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:57.167552  7894 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:57.134688 13609 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:57.182566  7257 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:57.134054 13647 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:57.095690 13450 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:15:57.144093 13799 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:57.144929 13694 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:57.193861 13694 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:57.194361 13694 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:57.162070 13670 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:15:57.199150 13670 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:57.199636 13670 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:57.203547 13766 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:57.207098 13730 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:57.211540  7255 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:15:57.152884 13720 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:57.104228 13651 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:15:57.191630  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:57.227146  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:15:57.177510 13536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.005s
I20260709 13:15:57.146493 13729 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
W20260709 13:15:57.252791  7331 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.006s	sys 0.009s
W20260709 13:15:57.253327  7331 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.006s	sys 0.009s
W20260709 13:15:57.236819 13536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.008s	sys 0.005s
I20260709 13:15:57.235975  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:57.262359  7888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.006s	sys 0.023s
W20260709 13:15:57.269034  7888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.007s	sys 0.023s
W20260709 13:15:57.265246  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 73740us
I20260709 13:15:57.250211 13564 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:15:57.299777  7228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.007s	sys 0.012s
W20260709 13:15:57.300311  7228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.007s	sys 0.012s
W20260709 13:15:57.300657  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 553005us
W20260709 13:15:57.294122  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 58233us
I20260709 13:15:57.234601 13730 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:57.249554 13795 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:57.249778 13726 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:57.274529 13598 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:57.318881  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.256475 13450 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:15:57.295056 13625 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.295363 13766 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.319064 12852 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:15:57.327504  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.299117 13564 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:57.302343 13706 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:57.333770  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:57.340040  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.013s	sys 0.013s
W20260709 13:15:57.346959  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.013s	sys 0.013s
W20260709 13:15:57.347795  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 649958us
I20260709 13:15:57.349287  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:57.346997  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:57.308429 13651 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:15:57.318004 13799 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:15:57.357254 13564 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.319378 13730 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.359257 13795 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:57.350481 13591 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:57.293257 13782 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:57.351140  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:57.324446 13764 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.384503  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:57.305295 13536 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:15:57.350368 13766 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:57.384440 13706 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:57.402210 13730 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:57.360363 13723 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.132s
I20260709 13:15:57.345816 13625 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:57.407021 13795 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:57.419929  7179 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:15:57.422322  7260 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
W20260709 13:15:57.424800  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 74786.7us
W20260709 13:15:57.452216  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.515146  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:57.516458  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:56.358595  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:57.484879  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3363) took 2502 ms. Trace:
I20260709 13:15:57.491262  7859 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:57.491683  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:57.517666  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:57.445182  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1309) took 1280 ms. Trace:
W20260709 13:15:57.427836  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.518290  7253 rpcz_store.cc:276] 0709 13:15:56.164829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.179630 (+ 14801us) service_pool.cc:224] Handling call
0709 13:15:57.444894 (+1265264us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b540009abd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:57.445097 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12745472}
I20260709 13:15:57.423135  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:15:57.519884  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 96877.3us
I20260709 13:15:57.326867 13675 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:15:57.533033  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:57.529906  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:57.419535 13782 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:57.490147 13814 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:15:57.525879  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:57.547396  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:57.489466 13809 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:15:57.558568  7260 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:57.562561  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:57.563524  7894 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:57.466248 13720 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:15:57.464000 12919 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:57.467823 13609 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:57.528028 13437 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:57.421885 13536 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:15:57.468302 13650 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:15:57.567899  7255 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:15:57.410776 13724 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:57.424021 13706 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:57.422617 13579 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.148s
I20260709 13:15:57.588874 13706 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.423650 13766 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:57.416651 13647 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:57.547358 13730 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:57.594892  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1315) took 1388 ms. Trace:
W20260709 13:15:57.410596 13691 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.005s
W20260709 13:15:57.609000  7152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.027s	sys 0.032s
I20260709 13:15:57.547215 13728 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:57.527989 13616 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:57.420243 13764 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:57.608775 13322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.029s	sys 0.026s
I20260709 13:15:57.512943 13571 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.523170 13718 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:57.602248  7261 rpcz_store.cc:276] 0709 13:15:56.206896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.207022 (+   126us) service_pool.cc:224] Handling call
0709 13:15:56.207389 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.207759 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.207790 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:56.208296 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:15:56.637894 (+429598us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18000c5200. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:15:57.130971 (+493077us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:57.131027 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.131100 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.582798 (+451698us) raft_consensus.cc:1685] finished
0709 13:15:57.582830 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.594779 (+ 11949us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":633,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":39845,"spinlock_wait_cycles":2801920,"thread_start_us":492884,"threads_started":1,"wal-append.queue_time_us":1088240}
I20260709 13:15:57.549173 13737 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:57.619448 13728 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.418982 13591 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:57.609689  7152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.027s	sys 0.032s
I20260709 13:15:57.626431 13691 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:57.612792  7302 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.018s	sys 0.027s
I20260709 13:15:57.567401 13821 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:57.568445 13735 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:15:57.616429  7256 raft_consensus.cc:2410] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:15:57.597975 13609 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:57.595918 13536 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:57.596637 13650 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:57.617734 13678 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.004s
W20260709 13:15:57.618960 13540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.014s	sys 0.032s
W20260709 13:15:57.618165 13815 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:15:57.628976  7892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.023s	sys 0.024s
W20260709 13:15:57.600857  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44182.8us
I20260709 13:15:57.754405  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:57.607062 13730 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.434268 13731 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:57.768039  7258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.035s	sys 0.050s
I20260709 13:15:57.594451 13766 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:15:57.646209  7257 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:57.552703 13564 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:57.435308 13568 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:57.569773 13720 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:15:57.738229 13670 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.000s
I20260709 13:15:57.517400  7186 rpcz_store.cc:276] 0709 13:15:54.982309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.066777 (+ 84468us) service_pool.cc:224] Handling call
0709 13:15:55.067210 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.386160 (+2318950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.386211 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.386279 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:57.386328 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.484463 (+ 98135us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54001b3ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:57.484540 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.484737 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2001,"raft.queue_time_us":19460,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":5327252352}
W20260709 13:15:57.659212  7302 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.018s	sys 0.028s
W20260709 13:15:57.779848  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 949845us
W20260709 13:15:57.748478 13540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.016s	sys 0.032s
W20260709 13:15:57.648682  7181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.026s	sys 0.040s
W20260709 13:15:57.799862  7181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.026s	sys 0.040s
I20260709 13:15:57.646035 13437 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:57.612197 13647 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.803562 13647 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:57.804404 13647 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.805035 13647 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.653820 13728 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:57.745530  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:57.740015 13703 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:57.767531 13723 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.811311 13670 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.812269 13723 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.758693  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:57.760541  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:57.633549 13651 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:15:57.764972  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:57.768420  7258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.035s	sys 0.050s
I20260709 13:15:57.816581  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1052) took 1287 ms. Trace:
I20260709 13:15:57.645418 13571 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:57.632778 13322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.029s	sys 0.027s
I20260709 13:15:57.600420 13724 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:57.687163 13701 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:57.750434 13735 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:57.787025 13676 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:57.787704 13714 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:57.791306  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61111.9us
I20260709 13:15:57.854858 13650 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.793316 13579 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:57.794374 13694 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.599s	user 0.013s	sys 0.000s
I20260709 13:15:57.918649  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:57.798494 13675 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:15:57.810313  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 64928.3us
I20260709 13:15:57.648033 13718 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.832989  7178 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:57.815274  7335 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:57.834367  7253 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:15:57.730706 13517 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:57.930164  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:57.729247 13800 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:57.739723 13821 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:15:57.817399  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1054) took 1237 ms. Trace:
I20260709 13:15:57.767978 13730 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:57.653472 13795 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:57.814505 13670 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:57.748944 13678 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:57.775436 13691 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:15:57.833782 13824 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:57.832559 13723 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:57.871340  7893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.005s	sys 0.018s
W20260709 13:15:57.959328  7893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.005s	sys 0.018s
W20260709 13:15:57.876893  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 357734us
W20260709 13:15:57.961649  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:57.873229  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 350746us
W20260709 13:15:57.878759  7862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.025s	sys 0.025s
I20260709 13:15:57.835281  7184 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
W20260709 13:15:57.966965  7862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.025s	sys 0.025s
I20260709 13:15:57.836035  7888 rpcz_store.cc:276] 0709 13:15:56.529586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.538855 (+  9269us) service_pool.cc:224] Handling call
0709 13:15:56.539584 (+   729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.540136 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.540182 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:56.540808 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.269720 (+728912us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:57.269783 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.269893 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.816246 (+546353us) raft_consensus.cc:1685] finished
0709 13:15:57.816277 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.816498 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":609369,"threads_started":1,"wal-append.queue_time_us":1023958}
I20260709 13:15:57.867552 13625 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:57.938166 13820 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.918458  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:57.796216 13828 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:57.926872  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 379530us
I20260709 13:15:57.938481 13437 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:57.904682 13442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.011s	sys 0.024s
I20260709 13:15:57.957078 13824 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:57.864230 13536 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:57.930486 13450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.014s	sys 0.050s
I20260709 13:15:57.914846 13764 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:57.934283  7892 rpcz_store.cc:276] 0709 13:15:56.580293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.580590 (+   297us) service_pool.cc:224] Handling call
0709 13:15:56.586760 (+  6170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.587020 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:15:57.127646 (+540626us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.816941 (+689295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.817028 (+    87us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:15:57.817095 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.817185 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.817325 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67674,"prepare.queue_time_us":606104,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":84480,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":5757,"thread_start_us":1143777,"threads_started":2,"wal-append.queue_time_us":667242}
I20260709 13:15:57.905570  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3596) took 1022 ms. Trace:
I20260709 13:15:57.968313  7862 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:57.983573  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:57.949451  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:57.986331  7334 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:57.989647  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:57.931048  7333 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
W20260709 13:15:57.993438 13825 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:15:58.052057  7079 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:15:58.053341 13831 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:15:57.933405  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:15:57.999358 13442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.012s	sys 0.024s
W20260709 13:15:57.980366 13830 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:15:58.057371  7079 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 4 to 6, term changed from 6 to 8, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130), VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 8 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.938719 13675 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:58.059360 13833 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:15:58.022361 13647 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:57.919216 13676 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:58.062060 13834 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
I20260709 13:15:58.062299 13647 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.062994 13647 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:57.929566 13714 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.065241 13647 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:57.955068 13826 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:57.933447 13694 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:57.929780 13579 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.067327 13826 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.071568  7186 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:57.917331 13701 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.032548  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:57.941713 13517 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.031665  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:58.048856  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 65413.7us
I20260709 13:15:58.060571  7079 catalog_manager.cc:5697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.073060  7257 raft_consensus.cc:2376] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22. Re-sending same reply.
W20260709 13:15:58.015703  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 93089us
I20260709 13:15:57.986699 13650 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:58.006326  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:57.999716 13726 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:15:58.016042  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 231756us
W20260709 13:15:58.080650  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 131201us
I20260709 13:15:58.048619  7256 rpcz_store.cc:276] 0709 13:15:56.883285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.883757 (+   472us) service_pool.cc:224] Handling call
0709 13:15:57.888418 (+1004661us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b540034a3d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:57.905466 (+ 17048us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394657152}
W20260709 13:15:58.009950 13450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.015s	sys 0.050s
I20260709 13:15:58.083562  7259 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:57.942006 13800 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.010692 13824 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:58.112641  7300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.016s	sys 0.042s
W20260709 13:15:58.112861  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 179527us
I20260709 13:15:58.083134 13591 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:58.127171  7300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.017s	sys 0.042s
W20260709 13:15:58.135363  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 61506.8us
I20260709 13:15:58.138664  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:58.007342 13437 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.100279 13826 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:58.141220  7327 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:58.145988  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:58.154170  7328 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:58.120471 13540 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:58.162211 13540 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:58.163226 13571 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:58.168969 13839 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:15:58.172492 13701 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.175021  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.175313  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:58.175567 13718 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:58.176028  7256 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:58.176986 13819 raft_consensus.cc:476] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Not starting pre-election -- already a leader
I20260709 13:15:58.089583 13735 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.177799 13819 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:58.178190 13819 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.178558 13819 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:58.143878 13691 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:58.156104 13766 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.999055 13820 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.131451 13288 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:58.146292  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3597) took 1199 ms. Trace:
I20260709 13:15:58.159535 13437 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:58.159754 13836 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 13:15:58.160183  7078 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47542 (request call id 236) took 24740 ms (client timeout 15000 ms). Trace:
I20260709 13:15:58.201738  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:58.161504 12919 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.559s	user 0.004s	sys 0.008s
I20260709 13:15:58.151332 13591 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:58.125644 13536 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:58.177161 13837 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:58.166263  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2670) took 1415 ms. Trace:
I20260709 13:15:58.209607  7181 rpcz_store.cc:276] 0709 13:15:56.750438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.997029 (+246591us) service_pool.cc:224] Handling call
0709 13:15:56.997457 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.071036 (+ 73579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.071066 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.071559 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.800399 (+728840us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:57.800461 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.165769 (+365308us) spinlock_profiling.cc:243] Waited 73.1 ms on lock 0x7b540039d0d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:58.165822 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.165873 (+    51us) raft_consensus.cc:1685] finished
0709 13:15:58.165887 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.166178 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":586,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":168241408,"thread_start_us":674015,"threads_started":1,"wal-append.queue_time_us":721371}
I20260709 13:15:58.183648  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1057) took 1014 ms. Trace:
I20260709 13:15:58.212387  7893 rpcz_store.cc:276] 0709 13:15:57.169012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.169212 (+   200us) service_pool.cc:224] Handling call
0709 13:15:57.169667 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.175323 (+  5656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.175359 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.185777 (+ 10418us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.959915 (+774138us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:57.959978 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.960080 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.183428 (+223348us) raft_consensus.cc:1685] finished
0709 13:15:58.183450 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.183592 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20767,"raft.queue_time_us":253,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":13988,"thread_start_us":751567,"threads_started":1,"wal-append.queue_time_us":797867}
W20260709 13:15:58.140952  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 151417us
I20260709 13:15:58.215374  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:57.999512 13828 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:58.183997  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 81045.4us
I20260709 13:15:58.191601 13540 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:58.194658 12852 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:58.197005  7262 rpcz_store.cc:276] 0709 13:15:56.946925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.969510 (+ 22585us) service_pool.cc:224] Handling call
0709 13:15:56.970074 (+   564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.345479 (+375405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.345527 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.346017 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.887818 (+541801us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:57.927999 (+ 40181us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.939104 (+ 11105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.939213 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.145954 (+206741us) raft_consensus.cc:1685] finished
0709 13:15:58.145989 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.146199 (+   210us) inbound_call.cc:177] Queueing success response
0709 13:15:58.162088 (+ 15889us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b18003a7740. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
Metrics: {"mutex_wait_us":16430,"prepare.queue_time_us":40253,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":3829,"raft.queue_time_us":49640,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":20886,"spinlock_wait_cycles":16822144,"thread_start_us":851611,"threads_started":2,"wal-append.queue_time_us":603919}
I20260709 13:15:58.200286  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2671) took 1449 ms. Trace:
I20260709 13:15:58.135346 13647 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:15:58.208127  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:15:58.216912  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 248742us
I20260709 13:15:58.152860 13850 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:58.225142  7187 rpcz_store.cc:276] 0709 13:15:56.750772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.098517 (+347745us) service_pool.cc:224] Handling call
0709 13:15:57.099848 (+  1331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:57.114936 (+ 15088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.114994 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:57.130044 (+ 15050us) log.cc:844] Serialized 52 byte log entry
0709 13:15:57.635810 (+505766us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:57.635867 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.635951 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.061396 (+425445us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:15:58.182704 (+121308us) raft_consensus.cc:1685] finished
0709 13:15:58.182733 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.200170 (+ 17437us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":205,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":24343,"spinlock_wait_cycles":29384576,"thread_start_us":448241,"threads_started":1,"wal-append.queue_time_us":709639}
I20260709 13:15:58.194463  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:58.227734  7330 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:58.204650 13598 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:15:58.220896  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 142775us
I20260709 13:15:58.240381  7179 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:15:58.193744 13826 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:58.183892 13670 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:15:58.252812  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 141739us
I20260709 13:15:58.182099 13766 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.239331  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:58.221046  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:58.256707  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:15:58.259164  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:58.225320 13647 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.226649 13437 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:58.237069 13859 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:15:58.276571  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.218099 13591 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.230526 13855 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:58.114218 13821 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.286172  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:58.286684  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65696.9us
I20260709 13:15:58.318944  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:58.320762  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:58.251955 13598 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.321635 13828 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.221321 13837 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.322686 13437 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:58.323025 13676 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:58.323228 13437 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.323426 13598 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:58.298002 13766 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.279374 13851 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:15:58.202032  7078 rpcz_store.cc:269] 0709 13:15:33.355377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.355762 (+   385us) service_pool.cc:224] Handling call
0709 13:15:58.086750 (+24730988us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:47.292903 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:47.293715 (+   812us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:47.293774 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:15:47.293793 (+    19us) tablet.cc:662] Decoding operations
0709 13:15:47.832026 (+538233us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:47.832152 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:47.832187 (+    35us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:15:47.901492 (+ 69305us) tablet.cc:701] Row locks acquired
0709 13:15:47.935936 (+ 34444us) write_op.cc:260] PREPARE: finished
0709 13:15:47.999515 (+ 63579us) write_op.cc:270] Start()
0709 13:15:48.046935 (+ 47420us) write_op.cc:276] Timestamp: P: 1783602947959790 usec, L: 0
0709 13:15:48.058020 (+ 11085us) op_driver.cc:348] REPLICATION: starting
0709 13:15:48.059092 (+  1072us) log.cc:844] Serialized 10174 byte log entry
0709 13:15:49.395359 (+1336267us) op_driver.cc:464] REPLICATION: finished
0709 13:15:49.577017 (+181658us) write_op.cc:301] APPLY: starting
0709 13:15:49.577160 (+   143us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:49.909952 (+332792us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:49.941725 (+ 31773us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:50.048382 (+106657us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:50.048910 (+   528us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=0,mrs_lookups=0
0709 13:15:50.048994 (+    84us) write_op.cc:312] APPLY: finished
0709 13:15:50.049801 (+   807us) log.cc:844] Serialized 228 byte log entry
0709 13:15:50.050140 (+   339us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.077887 (+ 27747us) write_op.cc:454] Released schema lock
0709 13:15:50.091328 (+ 13441us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:50.160478 (+ 69150us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.160515 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21043,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":181256,"apply.run_cpu_time_us":45855,"apply.run_wall_time_us":538152,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112963,"num_ops":26,"prepare.queue_time_us":69621,"prepare.run_cpu_time_us":57461,"prepare.run_wall_time_us":1479680,"raft.queue_time_us":572517,"raft.run_cpu_time_us":20683,"raft.run_wall_time_us":169712,"replication_time_us":1337081,"thread_start_us":1245275,"threads_started":4,"wal-append.queue_time_us":759627,"wal-append.run_cpu_time_us":28728,"wal-append.run_wall_time_us":2249508}]]}
I20260709 13:15:58.353821  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:58.311136 13845 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:15:58.311803  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:58.312688 13579 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.314332 13681 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:58.316037  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:58.320935 13820 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.291615 13846 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:58.295034  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:58.279989 13647 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:58.315099 13288 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:15:58.387696 13616 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:58.366243 13851 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.388500 13681 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:15:58.413595  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 92903.5us
I20260709 13:15:58.364573 13625 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:15:58.267494 13729 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.295063 13842 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:15:58.266969 13848 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:58.353782  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:58.308138  7079 catalog_manager.cc:5697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 12 to 14, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 14 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.281185 13706 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:58.361879  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:58.363708  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:58.287787 13764 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:58.368260  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:58.315164 13442 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.258368 13826 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.287297 13859 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:58.323774 13437 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:15:58.369398 13812 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:15:58.246891  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 161536us
I20260709 13:15:58.418597  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:58.419775  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 135145us
I20260709 13:15:58.403206 13676 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:15:58.411486 13728 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.604s	user 0.015s	sys 0.000s
I20260709 13:15:58.325623 13855 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.406435 13694 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:58.408211 13616 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.408928 13800 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:58.429339  7183 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:58.437014  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:58.462576  7181 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:58.415644 13851 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:58.433563 13764 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.428664 13579 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:58.465726 13837 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.439831 13442 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.465581  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:58.474010  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:58.477933 13870 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:58.481355 13517 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:58.461462 13728 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.484208  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:58.494944  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:58.495867  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.499404  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:58.492381  7892 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:58.430815 13729 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.439340 13706 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.464792 13616 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:58.520108  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:58.543239  7179 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:15:58.545116  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:58.545437  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:58.548920  7179 raft_consensus.cc:2376] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17. Re-sending same reply.
I20260709 13:15:58.546109  7894 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:58.497762  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:58.554459  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56751.7us
I20260709 13:15:58.556134  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.557132  7256 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:15:58.471323 13764 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:15:58.554548  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 84751.8us
I20260709 13:15:58.567821  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:15:58.541440 13842 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:15:58.459194 13676 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:58.541946 13863 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:15:58.435111 13848 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:58.541778 13609 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.802s	user 0.015s	sys 0.000s
W20260709 13:15:58.578344  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83559.1us
I20260709 13:15:58.485013 13675 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.612012 13855 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.616417 13728 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.618580 13819 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:58.622563 13730 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.002s
I20260709 13:15:58.623102 13730 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.624588 13848 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.625341 13730 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:58.621182 13819 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.491531 13859 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.626703 13826 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.471843 13862 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.110s
W20260709 13:15:58.628536  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.579437  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:58.631127  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:58.581936  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:58.631811  7335 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:15:58.486116 13724 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:58.635699  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 53861.6us
I20260709 13:15:58.624668  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:58.491560 13591 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.492424 13865 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:15:58.542132 13873 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:58.579362  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:15:58.648013  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 68739.1us
I20260709 13:15:58.584860  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:58.650969  7333 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:58.552341 13718 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.588618  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:15:58.590090 13871 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:15:58.595294  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1023) took 3167 ms. Trace:
W20260709 13:15:58.657917  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69406.5us
I20260709 13:15:58.656863  7329 rpcz_store.cc:276] 0709 13:15:55.427455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.566176 (+138721us) service_pool.cc:224] Handling call
0709 13:15:55.566538 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.566922 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.566941 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.125672 (+1558731us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b1800300700. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a
0709 13:15:57.446083 (+320411us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b2c0013d8c8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:15:57.446873 (+   790us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.854751 (+407878us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:15:57.862935 (+  8184us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.057369 (+194434us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b1800300700. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:15:58.184495 (+127126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.184585 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.594991 (+410406us) raft_consensus.cc:1685] finished
0709 13:15:58.595019 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.595182 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8136,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":41883,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":5682,"spinlock_wait_cycles":68983808,"thread_start_us":527534,"threads_started":2,"wal-append.queue_time_us":502971}
I20260709 13:15:58.596182 13706 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.566967 13703 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:58.601119 13676 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.602219 13824 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:58.603089 13874 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:15:58.604719  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:58.608448 13856 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.580492 13844 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:58.579983 13442 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.492473 13579 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.459519 13681 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.657279 13694 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:58.643249  7181 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:15:58.650933  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 66183.1us
I20260709 13:15:58.659617  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:58.725212  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65671.5us
I20260709 13:15:58.656944 13867 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:15:58.643985 13737 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:15:58.661201 13827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.007s	sys 0.002s
W20260709 13:15:58.661109 13650 consensus_meta.cc:287] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.009s
I20260709 13:15:58.648204 13450 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:15:58.641595  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:58.725901  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:58.725065  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:58.738119  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:58.660751 13536 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:58.635468 13609 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.638528 13837 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.728209 12852 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:15:58.734885 13827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.007s	sys 0.003s
W20260709 13:15:58.726665 13834 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:15:58.661391 13718 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.727553 13694 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:58.733805 13844 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:58.728472  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:58.743462  7332 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:15:58.779912  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:58.745261 12852 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.616425  7079 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 9 to 10, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 10 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.782536  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:58.783104  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:58.783704  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:58.780663  7332 pending_rounds.cc:85] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 15
I20260709 13:15:58.751713 13609 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:58.752429  7253 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:58.788753  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:58.789801  7333 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:58.656226 13873 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.754824 13837 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.738867 12919 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:58.760124 13579 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.760944 13824 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:58.761162 13568 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:58.761936  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 343417us
I20260709 13:15:58.763551 13625 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:58.765259  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 299756us
I20260709 13:15:58.766129 13876 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:58.766607 13819 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.735580 13737 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.722823 13856 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.770262 13826 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.770361 13720 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.772342 13718 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:58.773979 13678 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:58.774137  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:58.778076  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2419) took 1989 ms. Trace:
I20260709 13:15:58.784941  7332 pending_rounds.cc:107] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 21.16
W20260709 13:15:58.784215  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55816.2us
I20260709 13:15:58.783293  7329 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
W20260709 13:15:58.787571  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 133857us
I20260709 13:15:58.795265 12852 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:58.810046  7333 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:15:58.816138  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:58.815356  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:58.782390 13867 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:58.817999  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:58.813705 13609 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:58.859469  7257 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:15:58.903119  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.782325 13691 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:15:58.843206  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:58.841280  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:58.780267 13694 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:58.845355  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.906993  7258 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:58.842500  7335 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:58.846987 13720 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:58.847491 13826 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.858523  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.910280  7334 rpcz_store.cc:276] 0709 13:15:56.788757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.008576 (+219819us) service_pool.cc:224] Handling call
0709 13:15:57.008862 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.079886 (+1071024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.777795 (+697909us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b540032aad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:58.778009 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2247475584}
I20260709 13:15:58.802794 13650 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:15:58.844981  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:58.904539  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 86622.3us
I20260709 13:15:58.931288  7181 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:58.904767  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:58.908130  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.814862 12919 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.908900  7332 raft_consensus.cc:2889] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:58.851676  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.787381 13536 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:58.817492 13876 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.848922  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:58.912146  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.766103 13437 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.911183  7257 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 13:15:58.804023 13844 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:58.938107  7259 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:15:58.906813 13540 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.003s
I20260709 13:15:58.910554 13691 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:15:58.963790  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.923626 13625 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:58.942806 13800 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:58.943868  7258 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:58.948110  7179 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:15:58.950661 12919 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.907418 13718 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.974478 13718 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.964501  7259 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:15:58.841500 13737 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:58.966338 13829 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:58.967283 13691 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.969731  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.984508  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:58.985415 13437 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:58.987818 13856 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.990422 13718 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:58.993808 13691 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:15:58.994769  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.985687  7255 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:58.995699 13873 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:58.977012 13625 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.996441  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.971802  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:59.000329  7331 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:58.976245  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:58.836755 13851 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.914209 13867 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.978555  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.016112  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.017409  7258 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:58.833316 13616 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:58.982936  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.975574 13800 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.020932  7259 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:15:58.996600 13625 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:15:58.998000 13647 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.005s
I20260709 13:15:59.047201 13647 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.026584 13800 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.050096 13647 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:58.960681 13876 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:58.922818 13609 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:58.971127  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.051406  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.051887  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:58.978552  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.010857  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.053380  7330 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:59.053409  7255 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:15:58.850261 13819 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.021495  7893 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:15:59.055011  7331 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:59.022297  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:59.023643  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:59.056154  7259 raft_consensus.cc:2376] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17. Re-sending same reply.
W20260709 13:15:59.028735  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.031994 13826 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.033064 13837 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.034194  7888 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:59.035483 13851 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.037779  7181 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:15:59.062559  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:59.038506  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.063917  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:59.039116  7895 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:59.030602 13844 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.000030 13829 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.052714  7257 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:59.067217  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.052673 13609 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.072736 13829 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.074115  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.074899  7257 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:15:59.075947  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.078323  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:59.081667  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:59.082185  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:59.083235  7179 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:59.084183 13568 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:59.059571  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.068333  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.086023  7336 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:59.086359  7258 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:15:58.962877 13540 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.071131 12919 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:59.086416  7260 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:15:59.092526  7178 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:15:59.093086  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.087929  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.078655 13860 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:15:59.097694  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.098939  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.099037  7258 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:15:59.100770  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:59.102155  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.103724  7261 raft_consensus.cc:2393] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 13: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:59.094660  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.095350  7254 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:59.104715  7257 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:15:59.104789  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.106609  7257 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:15:59.106738  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.108268  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.110113  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.113034  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.091638 12919 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.117836 13714 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.124799 13819 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.090907 13850 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.096832 13795 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:15:59.126474  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:59.110617 13851 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:59.135411  7179 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:15:59.098105 13860 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:15:59.137928  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.127063  7331 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:15:59.072778 13764 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.141968  7328 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:15:59.139927 13858 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.136251 13609 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.137323 13826 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.136364 12919 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.159804 13437 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:59.160571 13437 consensus_queue.cc:1243] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:15:59.134090 13829 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.144903  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.147023  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.155019  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:59.175711  7331 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:59.176852  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:59.177881 13437 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:59.178215 13766 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:59.176908  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.179335 13766 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:59.179778  7225 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:59.180922 13437 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:59.155645  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.181612  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.182200  7892 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:15:59.182590  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.185480  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:59.141613 13851 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.187166  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:59.192950  7260 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:59.186594  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:59.187166  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:59.197909 13873 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:59.199807 13865 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:15:59.188997 13829 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.189000 13517 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:59.205914  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 271779us
I20260709 13:15:59.207942 13540 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.208999 13862 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.209344  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:59.209569 13862 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.206553 13517 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.213150 13517 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.206830 13437 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:59.213613 13860 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.214278 13437 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.214829 13860 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:59.214936 13437 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:59.215301 13867 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:59.215360  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1036) took 1739 ms. Trace:
I20260709 13:15:59.216328  7332 rpcz_store.cc:276] 0709 13:15:57.476375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.495670 (+ 19295us) service_pool.cc:224] Handling call
0709 13:15:57.548504 (+ 52834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.934572 (+1386068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.215085 (+280513us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001928d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:59.215297 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2739221888}
I20260709 13:15:59.217734  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.219395  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:59.220459 13764 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.220837  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.141301 13850 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.189165 13647 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:59.222873 13647 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.222955  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:59.224342  7254 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:59.227138 13851 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:59.227427 13616 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.155226 13826 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.226668 13647 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.173076 13571 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.229349 13571 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.230228 13826 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.231662  7334 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.238101 13862 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.240473 13650 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:15:59.222424  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:15:59.241262  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55924.4us
I20260709 13:15:59.242187  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:59.242113  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:59.244083  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 56985.6us
I20260709 13:15:59.202553 12919 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.243544  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:15:59.255043  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.255941  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:59.257050  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:59.262097  7892 pending_rounds.cc:85] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 14
I20260709 13:15:59.262771  7892 pending_rounds.cc:107] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:15:59.263114  7892 raft_consensus.cc:2889] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:59.262965  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:59.265872  7894 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:15:59.257913 13650 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:59.269644 13650 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:59.165622 13609 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.271471 13893 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:59.272939 13609 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.274988  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.276793  7894 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:59.276674  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.174342 13731 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:59.278074  7225 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:59.282073  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:59.283515  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.284610  7332 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:15:59.283530  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:59.289354  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:59.286453  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:59.294214 12919 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:59.295862  7254 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:15:59.296136  7334 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:15:59.297034  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.300936  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:59.303347  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:59.258543 13867 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:59.307018  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:59.304517  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:59.307663  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:59.275974 13568 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:15:59.281282 13728 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:59.278378 13691 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:15:59.310425  7332 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:59.307037  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.314951  7331 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:15:59.315012  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.311923  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:59.313493 12919 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:59.315948  7254 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:59.316069 12919 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.312865  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:59.298537 13885 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:59.298493 13726 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:59.336614 13609 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:59.155154 13858 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.310494 13827 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:59.345147  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.317793 13616 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:15:59.363660  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:59.368170  7254 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.331571 13868 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:59.334489 13885 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.379606  7330 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:15:59.340179 13568 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:15:59.352514 13609 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.395545 13681 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:15:59.396869 13737 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.403025  7182 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 18. (term mismatch)
I20260709 13:15:59.409518  7182 pending_rounds.cc:85] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 17
I20260709 13:15:59.409505  7254 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:15:59.410068  7182 pending_rounds.cc:107] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 21.18
I20260709 13:15:59.410358  7182 raft_consensus.cc:2889] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:59.410857  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.411984  7254 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:15:59.428332 13896 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:15:59.428836 13737 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:59.431417 13894 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:15:59.433579  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1243) took 1171 ms. Trace:
I20260709 13:15:59.375021 13876 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.434144  7187 rpcz_store.cc:276] 0709 13:15:58.262293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.262851 (+   558us) service_pool.cc:224] Handling call
0709 13:15:58.263283 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.276354 (+ 13071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.276390 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:58.276956 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:15:58.847435 (+570479us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b18003055c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f557 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:59.076559 (+229124us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b18003055c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:15:59.153532 (+ 76973us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:15:59.153587 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.153688 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.433240 (+279552us) raft_consensus.cc:1685] finished
0709 13:15:59.433275 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.433486 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12662,"raft.queue_time_us":12921,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":11993,"spinlock_wait_cycles":43266048,"thread_start_us":76718,"threads_started":1,"wal-append.queue_time_us":979395}
I20260709 13:15:59.437705 13876 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.438925  7256 raft_consensus.cc:2368] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:15:59.444427  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.448266  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2688) took 1085 ms. Trace:
W20260709 13:15:59.449740  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.448748  7180 rpcz_store.cc:276] 0709 13:15:58.362925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.363140 (+   215us) service_pool.cc:224] Handling call
0709 13:15:58.363549 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.363781 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:15:58.639447 (+275666us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.644895 (+  5448us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.237001 (+592106us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b18003bce00. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:15:59.447652 (+210651us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b18003bce00. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:15:59.447895 (+   243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.447955 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:59.448001 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.448074 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.448202 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54717,"prepare.queue_time_us":208842,"prepare.run_cpu_time_us":158,"prepare.run_wall_time_us":31802,"raft.queue_time_us":812038,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":6252,"spinlock_wait_cycles":9687552,"thread_start_us":224427,"threads_started":1}
W20260709 13:15:59.450058  7152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.113s (SENT) [suppressed 6 similar messages]
I20260709 13:15:59.451037 13591 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:59.451586 13591 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.453658 13821 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:59.454073 13591 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.454272 13821 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.454917 13706 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:59.455504 13706 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.456700 13858 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.458287  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.458506  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:59.458185  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2690) took 1094 ms. Trace:
I20260709 13:15:59.459780  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.458772  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2683) took 1139 ms. Trace:
I20260709 13:15:59.459399  7185 rpcz_store.cc:276] 0709 13:15:58.363717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.367808 (+  4091us) service_pool.cc:224] Handling call
0709 13:15:58.368147 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.368368 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:58.736223 (+367855us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.457857 (+721634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.457914 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:59.457956 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.458034 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.458135 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":767876,"prepare.queue_time_us":212181,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"thread_start_us":310359,"threads_started":1}
I20260709 13:15:59.461215  7184 rpcz_store.cc:276] 0709 13:15:58.318938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.319075 (+   137us) service_pool.cc:224] Handling call
0709 13:15:58.319393 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.319595 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:58.424704 (+105109us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.458348 (+1033644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.458400 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:59.458444 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.458509 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.458612 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":721379,"prepare.queue_time_us":130016,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"thread_start_us":360691,"threads_started":2,"wal-append.queue_time_us":347483}
I20260709 13:15:59.385182 13885 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:59.463286  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:59.463413  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:59.463936  7185 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.464766  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:59.458135  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2682) took 1140 ms. Trace:
I20260709 13:15:59.466297  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:59.465555  7186 rpcz_store.cc:276] 0709 13:15:58.318541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.324975 (+  6434us) service_pool.cc:224] Handling call
0709 13:15:58.325356 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.352722 (+ 27366us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:58.440540 (+ 87818us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.457798 (+1017258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.457860 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:59.457909 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.457975 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.458077 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":751644,"prepare.queue_time_us":155105,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":9689,"thread_start_us":322273,"threads_started":2,"wal-append.queue_time_us":312781}
I20260709 13:15:59.466531  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.467212  7254 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:15:59.467238  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:59.413189 13609 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.387740 13571 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.482410  7186 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:59.467461  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:59.386322 13868 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.471669 13582 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:59.468349 13760 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.472088  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:59.472433 13888 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:59.472784 13851 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.473034 13706 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:59.472929  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 627971us
I20260709 13:15:59.373406 13827 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:59.474493 13694 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.001s
I20260709 13:15:59.508541  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:59.508985 13694 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.509447 13764 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:59.510100 13764 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.509327  7258 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.488509  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:59.456557 13821 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.501366 13888 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:59.525432  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1329) took 1337 ms. Trace:
I20260709 13:15:59.525915  7253 rpcz_store.cc:276] 0709 13:15:58.188175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.188335 (+   160us) service_pool.cc:224] Handling call
0709 13:15:58.207747 (+ 19412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.791495 (+583748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.525174 (+733679us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b540034b2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:15:59.525366 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252099456}
I20260709 13:15:59.502781 13868 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:59.506215  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1151) took 1228 ms. Trace:
I20260709 13:15:59.508718  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:59.534999  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46577.8us
I20260709 13:15:59.498976 13760 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.510166 13824 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:59.497514 13571 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:59.548861 13571 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:15:59.549372 13571 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:15:59.550868 13898 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.056s	user 0.002s	sys 0.002s
I20260709 13:15:59.552002 13579 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.552561 13579 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.554570  7329 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:15:59.555657 13764 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.556181 13851 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.531325 13723 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:15:59.557276 13579 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:15:59.558706  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.512171 13625 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:15:59.559576  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.560637  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:59.561319 13625 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.561489  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.515581 13800 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.562402 13723 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:59.562467  7890 raft_consensus.cc:2368] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22.
I20260709 13:15:59.564415  7262 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:15:59.511969 12919 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.464196 13850 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:59.512698  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.548866  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.564468  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.571391  7893 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
I20260709 13:15:59.569224  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:59.470554  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:59.523130  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.573735  7255 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:15:59.531154  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.482162  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:15:59.538054  7184 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:15:59.574915  7259 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:15:59.535045  7888 rpcz_store.cc:276] 0709 13:15:58.278316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.278593 (+   277us) service_pool.cc:224] Handling call
0709 13:15:59.506013 (+1227420us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400163854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:15:59.506147 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465375488}
I20260709 13:15:59.495672 13582 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.485769 13437 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.579542 13694 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.579542  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:59.581444 13760 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.463503 13568 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.568645 13723 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:59.582384 13723 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.582787 13723 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.585933 13650 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.592120 12919 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:59.596437  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.608637  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.609861  7329 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:15:59.539347  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:59.540792  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:59.576529  7258 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:15:59.578377  7895 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:15:59.575798  7257 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:15:59.614136  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.612792  7179 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:15:59.611814  7299 leader_election.cc:400] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22.
I20260709 13:15:59.621989  7299 leader_election.cc:403] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:59.595431  7302 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:59.565402  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:59.620164  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:15:59.620421  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 89772.8us
W20260709 13:15:59.625221  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.626252  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:59.626766  7257 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:15:59.627405  7255 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:59.629359  7253 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:59.629838  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:15:59.627389  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 62087.5us
I20260709 13:15:59.623340  7329 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:15:59.525851 13888 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.634045 13676 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:59.622538 13837 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 13:15:59.636534 13850 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:59.639925  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.640750  7261 raft_consensus.cc:2368] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
I20260709 13:15:59.641132  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:15:59.641884  7257 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:59.642822  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:59.644424  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:59.644665  7334 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 25. Current term is 26. Ops: []
W20260709 13:15:59.645123  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49822us
I20260709 13:15:59.631964  7150 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:15:59.654511 12852 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:59.657052  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:59.661319  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:59.572660  7185 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:15:59.665155  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:59.616523 13868 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:15:59.618094 13650 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:59.690052  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.717752  7255 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
W20260709 13:15:59.716320  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 50258.4us
I20260709 13:15:59.721889  7255 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:15:59.721778  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.726411  7257 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:15:59.731833  7255 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:15:59.744294  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:59.750811  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:59.753383  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:15:59.668746 13858 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:15:59.754421  7895 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:15:59.755875  7332 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:59.670083 13676 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:59.652252 13694 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:15:59.667321 13795 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:59.715592 13517 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:59.766283  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:15:59.670831 13865 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:59.774788  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 324732us
I20260709 13:15:59.667675 13800 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:15:59.786800  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.729086 13868 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:59.798744  7254 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 25. Current term is 26. Ops: []
I20260709 13:15:59.755455 13735 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:59.809454  7329 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:15:59.812289  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:15:59.813625  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51050.9us
I20260709 13:15:59.767505 13858 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:15:59.774375 13676 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:15:59.814337  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:59.823334  7332 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:59.783969 13591 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:59.789076 13517 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.828316  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:59.823021 13824 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:15:59.836386  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:59.825285 13729 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:15:59.829039 13676 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.888643  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:15:59.833076 13706 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:59.826411 13858 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:15:59.893160  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56888.9us
I20260709 13:15:59.894181  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:15:59.906226  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:15:59.908349  7255 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:15:59.833432 13517 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.815676 13579 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:15:59.901940 13703 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.916882 13703 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:15:59.891542  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 145165us
I20260709 13:15:59.833647 13591 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.903666 13782 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:15:59.904114 13582 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:15:59.838383 13828 raft_consensus.cc:2764] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:15:59.922973  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:15:59.933426  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:15:59.924583  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:15:59.934298  7335 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:15:59.934401  7895 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:15:59.927196  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:59.932405 13782 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:59.935771 13782 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:15:59.907531 13824 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:15:59.915263 13681 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 13:15:59.940534  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:59.951398  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:15:59.950873  7253 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:15:59.856297  7185 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:15:59.956148  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:15:59.960451  7894 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:15:59.957335 13718 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:15:59.961318  7254 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:59.961663 13718 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:59.957497 13582 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:15:59.957548 13735 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:15:59.963330 13582 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:59.963801 13582 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:15:59.964076 13851 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:59.964541 13851 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:15:59.965509 13851 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.954489 13288 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:59.967031 13288 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.967459 13288 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.966084 13723 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:15:59.931458 13706 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:15:59.962947 13865 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:59.929834 13827 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:00.097626 13906 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:15:59.909909 13868 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:15:59.954073 13437 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:00.094338 13865 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.095567 13706 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:15:59.954587 13885 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.113631 13827 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:00.182154 13723 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:15:59.973116 13726 raft_consensus.cc:2955] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Committing config change with OpId 17.11: config changed from index 5 to 11, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:00.168360 13865 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:59.948369 13828 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.273s
I20260709 13:16:00.197621 13827 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:00.264609  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:59.952131  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:00.274605  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3427) took 1024 ms. Trace:
I20260709 13:16:00.275120  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3426) took 1025 ms. Trace:
W20260709 13:16:00.292514 13701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.018s	sys 0.019s
I20260709 13:16:00.201526 13824 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:00.372668 13701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.019s	sys 0.019s
W20260709 13:16:00.337816  7892 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.026s	sys 0.048s
I20260709 13:16:00.375855 13579 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:16:00.375648  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 423450us
I20260709 13:16:00.376451 13579 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:00.377574  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:15:59.843070  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:00.170744 13706 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:00.355400  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.362058  7891 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.007s	sys 0.004s
I20260709 13:16:00.371430 13723 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:00.795100 13723 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.795403  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:00.796500  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:00.798087 13723 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.798954 13861 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:00.799772 13861 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:00.800443 13861 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:00.800911 13862 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.801741 13862 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:00.416868 13625 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:00.803090 13625 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:00.798993  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 43713.7us
I20260709 13:16:00.421555 13795 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:00.423333 13821 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:00.443737 13893 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:00.451431 13703 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.460700 13860 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:00.460968  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 924) took 1207 ms. Trace:
I20260709 13:16:00.522941  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3635) took 1357 ms. Trace:
I20260709 13:16:00.367139  7183 rpcz_store.cc:276] 0709 13:15:59.250248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.331404 (+ 81156us) service_pool.cc:224] Handling call
0709 13:15:59.331790 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.480396 (+148606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.480431 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.480896 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.839155 (+358259us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:15:59.839218 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.884181 (+ 44963us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.273620 (+389439us) raft_consensus.cc:1685] finished
0709 13:16:00.273710 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.274247 (+   537us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148200,"raft.queue_time_us":157144,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6768,"thread_start_us":357852,"threads_started":1,"wal-append.queue_time_us":688771}
I20260709 13:16:00.367518  7178 rpcz_store.cc:276] 0709 13:15:59.249950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.329805 (+ 79855us) service_pool.cc:224] Handling call
0709 13:15:59.332832 (+  3027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.481391 (+148559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.481422 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.495535 (+ 14113us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.840292 (+344757us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:59.840347 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.840440 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.274373 (+433933us) raft_consensus.cc:1685] finished
0709 13:16:00.274430 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.274879 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148103,"raft.queue_time_us":158647,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":14601,"thread_start_us":329035,"threads_started":1,"wal-append.queue_time_us":637757}
I20260709 13:16:00.529209 13885 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:00.529716  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3632) took 1366 ms. Trace:
I20260709 13:16:00.540833 13827 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:00.554314  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2312) took 1093 ms. Trace:
I20260709 13:16:00.557319 13851 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:00.558925  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 427382us
W20260709 13:16:00.560141 13571 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.010s	user 0.016s	sys 0.000s
I20260709 13:16:00.565467  7185 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:16:00.566686  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:00.570317 13900 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:00.571151 13670 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:00.378340 13579 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:00.592293 13437 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.593415  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.599284  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3640) took 1403 ms. Trace:
W20260709 13:16:00.610329 13694 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.011s
I20260709 13:16:00.635913 13846 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:00.623101  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1256) took 1054 ms. Trace:
I20260709 13:16:00.618271  7894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 927) took 1273 ms. Trace:
W20260709 13:16:00.652261 13858 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.010s
W20260709 13:16:00.636649 13288 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.669s	user 0.013s	sys 0.006s
W20260709 13:16:00.655990 13676 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.750s	user 0.006s	sys 0.013s
W20260709 13:16:00.661645 13782 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.725s	user 0.022s	sys 0.006s
I20260709 13:16:00.661423  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:00.662447 13582 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.698s	user 0.012s	sys 0.008s
I20260709 13:16:00.663967  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2677) took 2912 ms. Trace:
W20260709 13:16:00.643446 13609 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.150s	user 0.016s	sys 0.006s
I20260709 13:16:00.646198 13859 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:00.667173 13865 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:00.668264  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.614563 13829 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.621738  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3430) took 1370 ms. Trace:
I20260709 13:16:00.668944 13681 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:00.675721  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:00.679320 13868 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:00.688462 13517 consensus_meta.cc:287] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.738s	user 0.016s	sys 0.000s
I20260709 13:16:00.707578  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1053) took 1104 ms. Trace:
W20260709 13:16:00.716557  7262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2290) took 1858 ms (client timeout 1505 ms). Trace:
I20260709 13:16:00.732484 13731 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:00.806520 13625 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.829687 13609 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.831125  7258 rpcz_store.cc:276] 0709 13:15:59.163218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.622922 (+459704us) service_pool.cc:224] Handling call
0709 13:15:59.623195 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.623403 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:59.974718 (+351315us) log.cc:844] Serialized 14 byte log entry
0709 13:16:00.384671 (+409953us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:00.396648 (+ 11977us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:00.410381 (+ 13733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.416007 (+  5626us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.529528 (+113521us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15240,"prepare.queue_time_us":590366,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":1630,"raft.queue_time_us":28087,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":17122,"thread_start_us":706953,"threads_started":2,"wal-append.queue_time_us":356526}
I20260709 13:16:00.786680  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:00.833724  7180 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:16:00.833968 13571 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:00.834589 13937 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.079s	user 0.004s	sys 0.000s
I20260709 13:16:00.836349  7331 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
W20260709 13:16:00.789757  7256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2294) took 1884 ms (client timeout 1903 ms). Trace:
I20260709 13:16:00.839236 13694 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22.
I20260709 13:16:00.840260 13676 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.841238  7186 rpcz_store.cc:276] 0709 13:15:59.568904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.615810 (+ 46906us) service_pool.cc:224] Handling call
0709 13:15:59.616136 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.632576 (+ 16440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.632629 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.632699 (+    70us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:15:59.632745 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.622613 (+989868us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b54000ed3d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:00.622705 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.622932 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37134720}
I20260709 13:16:00.840626  7187 rpcz_store.cc:276] 0709 13:15:59.251060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.436811 (+185751us) service_pool.cc:224] Handling call
0709 13:15:59.437322 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.437641 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.437679 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.461584 (+ 23905us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.975399 (+513815us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:59.975738 (+   339us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.975990 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.976103 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.598381 (+622278us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18003bde20. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:16:00.621115 (+ 22734us) raft_consensus.cc:1685] finished
0709 13:16:00.621271 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.621512 (+   241us) inbound_call.cc:177] Queueing success response
0709 13:16:00.657081 (+ 35569us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b18003bde20. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:16:00.659773 (+  2692us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b18003bde20. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
Metrics: {"prepare.queue_time_us":123,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":81,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":116193,"spinlock_wait_cycles":274814208,"thread_start_us":470320,"threads_started":1,"wal-append.queue_time_us":640858}
I20260709 13:16:00.843068 13782 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.843614  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:00.844535  7186 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 13.
I20260709 13:16:00.845497 13782 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.845561  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:00.846714 13681 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:00.846822 13579 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:00.847314  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:00.847628 13706 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.848070 13681 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:00.848843  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:00.849622  7178 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:00.849833  7329 rpcz_store.cc:276] 0709 13:15:59.610689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.633280 (+ 22591us) service_pool.cc:224] Handling call
0709 13:16:00.707066 (+1073786us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54001d29d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:00.707327 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325249408}
I20260709 13:16:00.851645  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:00.852067 13858 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:00.853283  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:00.853605  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:00.841118 13862 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:00.777627 13718 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:16:00.794411  7891 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.008s	sys 0.004s
I20260709 13:16:00.839134  7255 rpcz_store.cc:276] 0709 13:15:59.195933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.758645 (+562712us) service_pool.cc:224] Handling call
0709 13:15:59.908100 (+149455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.908862 (+   762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.595733 (+686871us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54002279d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:00.598863 (+  3130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342589824}
W20260709 13:16:00.810011 13932 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:16:00.828217  7262 rpcz_store.cc:269] 0709 13:15:58.857978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.858199 (+   221us) service_pool.cc:224] Handling call
0709 13:16:00.715767 (+1857568us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b5400216bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:00.716263 (+   496us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461922176}
I20260709 13:16:00.738482  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:00.832640 13609 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.791639  7260 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:00.840801  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:00.854517  7887 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:00.843631  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:00.850351 13706 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.783013 13591 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:00.872460  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.872690  7186 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:00.873167 13718 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:00.873919  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:00.874481  7181 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:00.874938  7186 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:16:00.875573  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:00.856383  7182 rpcz_store.cc:276] 0709 13:15:57.751620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.756072 (+  4452us) service_pool.cc:224] Handling call
0709 13:15:57.756494 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.414595 (+1658101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.663346 (+1248751us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540017e154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:00.663720 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3785504000}
I20260709 13:16:00.857299  7261 rpcz_store.cc:276] 0709 13:15:59.460945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.470281 (+  9336us) service_pool.cc:224] Handling call
0709 13:16:00.553646 (+1083365us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x7b54002e7054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:00.553974 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154757888}
W20260709 13:16:00.838840  7256 rpcz_store.cc:269] 0709 13:15:58.905221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.907827 (+  2606us) service_pool.cc:224] Handling call
0709 13:16:00.789327 (+1881500us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54002161d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:00.789550 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160444160}
I20260709 13:16:00.809244  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:00.807817  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 964689us
I20260709 13:16:00.869004 13582 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.870098  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1055) took 1160 ms. Trace:
I20260709 13:16:00.880035  7331 rpcz_store.cc:276] 0709 13:15:59.709663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.709930 (+   267us) service_pool.cc:224] Handling call
0709 13:15:59.710442 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.836884 (+1126442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.857231 (+ 20347us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400289bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:00.869961 (+ 12730us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2588301056}
I20260709 13:16:00.829727 13795 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:00.883453 13795 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:00.883816  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:00.876726 13681 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:00.886333  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.871019  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:00.811967 13678 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.833765 13437 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.855386  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:00.875694  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:00.855527  7894 rpcz_store.cc:276] 0709 13:15:59.344561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.344800 (+   239us) service_pool.cc:224] Handling call
0709 13:16:00.617762 (+1272962us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b540068e7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:00.617989 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366644608}
W20260709 13:16:00.869055  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 103971us
I20260709 13:16:00.870682 13517 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.850720  7257 rpcz_store.cc:276] 0709 13:15:59.164073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.727646 (+563573us) service_pool.cc:224] Handling call
0709 13:15:59.728094 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.728696 (+   602us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:16:00.092921 (+364225us) log.cc:844] Serialized 14 byte log entry
0709 13:16:00.343146 (+250225us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:00.397560 (+ 54414us) log.cc:844] Serialized 26 byte log entry
0709 13:16:00.401132 (+  3572us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:00.401182 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.407695 (+  6513us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.470188 (+ 62493us) raft_consensus.cc:1685] finished
0709 13:16:00.470221 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.521694 (+ 51473us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":495998,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":665,"raft.queue_time_us":19657,"raft.run_cpu_time_us":671,"raft.run_wall_time_us":21742,"thread_start_us":310147,"threads_started":2,"wal-append.queue_time_us":62504}
W20260709 13:16:00.908764  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 184369us
I20260709 13:16:00.887596 13723 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:00.889683 13591 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:00.888844 13922 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:00.868273 13858 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:00.808360 13824 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:00.864605 13821 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:00.899053  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:00.917265  7890 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:00.868542 13676 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:00.914181  7893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1159) took 1316 ms (client timeout 1591 ms). Trace:
I20260709 13:16:00.922144  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:00.923240  7184 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:00.846503  7892 rpcz_store.cc:276] 0709 13:15:59.253090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.253760 (+   670us) service_pool.cc:224] Handling call
0709 13:15:59.254216 (+   456us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:15:59.332150 (+ 77934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.332207 (+    57us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:15:59.333066 (+   859us) log.cc:844] Serialized 104 byte log entry
0709 13:15:59.801860 (+468794us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:16:00.375518 (+573658us) log.cc:844] Serialized 14 byte log entry
0709 13:16:00.395645 (+ 20127us) log.cc:844] Serialized 14 byte log entry
0709 13:16:00.396309 (+   664us) log.cc:844] Serialized 14 byte log entry
0709 13:16:00.411828 (+ 15519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.460411 (+ 48583us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.460497 (+    86us) raft_consensus.cc:1685] finished
0709 13:16:00.460528 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.460815 (+   287us) inbound_call.cc:177] Queueing success response
0709 13:16:00.662765 (+201950us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b18002b0b40. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:16:00.711445 (+ 48680us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x7b18002b0b40. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
Metrics: {"mutex_wait_us":39865,"prepare.queue_time_us":213953,"prepare.run_cpu_time_us":173,"prepare.run_wall_time_us":2317,"raft.queue_time_us":41447,"raft.run_cpu_time_us":709,"raft.run_wall_time_us":15728,"spinlock_wait_cycles":22344448,"thread_start_us":967682,"threads_started":2,"wal-append.queue_time_us":481436}
I20260709 13:16:00.926889  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:00.922497  7893 rpcz_store.cc:269] 0709 13:15:59.583092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.660839 (+1077747us) service_pool.cc:224] Handling call
0709 13:16:00.899145 (+238306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.934616  7180 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:00.942898  7887 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:16:00.937235  7181 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:00.866827 13288 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:00.915032 13922 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:00.851516 13846 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.920918 13824 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:00.926230 13821 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:00.926419 13827 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:00.968833 13827 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:00.950806 13922 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:00.970918 13760 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:00.971397 13827 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.971704 13760 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.974291 13760 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.931348 13865 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:00.954499  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:00.955844  7179 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:00.956713 13582 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.956900 13718 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.957379 13571 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:00.959230 13437 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.959439  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:00.960682 13288 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:00.961233 13706 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:16:00.961817  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.947153 13681 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.962383  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 166119us
I20260709 13:16:00.962498  7186 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
W20260709 13:16:00.962849 13888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.004s	sys 0.016s
I20260709 13:16:00.963753  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:00.966745  7332 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:00.948405  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:00.981211 13935 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.982493  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:00.983445  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:00.987025 13924 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:01.025321  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:01.001392  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.026743  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 164657us
I20260709 13:16:01.008201  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.007841 13678 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:00.998059 13824 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:01.029266  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:01.013947 13888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.004s	sys 0.017s
I20260709 13:16:01.046110  7178 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
W20260709 13:16:01.051345  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.047372 13582 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:01.054994  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.056914  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.063057  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.030870 13681 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.065759  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:01.059569 13865 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:01.067508  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:01.077567 13846 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:01.079356  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:01.079465  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:01.081000  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:01.092402  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.053882 13795 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:16:01.101369  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:01.102324  7182 raft_consensus.cc:2376] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18. Re-sending same reply.
I20260709 13:16:01.102900 13678 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:01.103605  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:01.104321  7182 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:01.112114  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.115118  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:01.115273  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 74017.5us
I20260709 13:16:01.116966  7185 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:01.125440  7184 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:16:01.116413  7259 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
W20260709 13:16:01.127368  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 168182us
I20260709 13:16:01.131654  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.136097  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:01.145138  7178 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:01.145326 12919 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:01.146525  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.148046  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.148213 12919 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:01.151875  7253 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:16:01.152006 13718 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.144398  7184 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:01.156055  7187 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:01.157437  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:01.157876  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 194260us
I20260709 13:16:01.056612 13935 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.097848 13517 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:01.162041  7182 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
W20260709 13:16:01.162381  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 148343us
I20260709 13:16:01.166754  7258 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:01.166615  7887 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:01.163595  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:01.167275  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.152968 13718 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.117539 13865 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:01.169242 13568 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.169992  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:01.170213 13681 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:01.170878  7890 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:01.166900 13795 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:01.186770  7253 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:16:01.186685 13795 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.187371 13568 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.189441 13795 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:01.171499 13885 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:01.191012  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:01.191556  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.191812  7329 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:16:01.192482  7256 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:01.193051  7893 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:01.198532 13731 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:01.199342 13731 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:01.203681  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:01.204624  7329 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:01.205621  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:01.208669  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1060) took 1321 ms. Trace:
I20260709 13:16:01.209195  7332 rpcz_store.cc:276] 0709 13:15:59.887001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.888252 (+  1251us) service_pool.cc:224] Handling call
0709 13:16:01.208434 (+1320182us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b54001f4fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:01.208605 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2166776192}
I20260709 13:16:01.217563  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1071) took 1703 ms. Trace:
I20260709 13:16:01.217862  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:01.218765  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:01.220049  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:01.226661 13782 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:01.226902 13571 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.227365 13782 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:01.228569 13782 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.230079 13782 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:01.230234 13571 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.232561  7186 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:01.240546  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:01.241961  7887 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:01.172535 13850 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:01.173418 13856 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:01.174240  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:01.174986  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:01.178586  7260 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:16:01.154130 12919 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.131109 13288 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:01.252493  7893 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 27.
I20260709 13:16:01.259374  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.254889  7896 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
W20260709 13:16:01.270582  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 96486.7us
I20260709 13:16:01.271137  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:01.275074  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:01.275949  7333 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:01.276190 13568 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:01.276923  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:01.277868  7332 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 19: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:01.279569 13865 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.282729 13517 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:01.283450 13517 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.285828 13517 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:01.288570  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.289726  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:01.292718  7258 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:16:01.293581  7186 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: [16.10-17.11]
I20260709 13:16:01.293910  7333 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:01.298723  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:01.299870 13860 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:01.300338 13860 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:01.300719 13860 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:01.302024 13795 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:16:01.306607  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 249980us
I20260709 13:16:01.309743  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:01.311389  7256 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:01.261667  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:01.324888  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:01.325898  7333 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:01.325724 13651 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:01.327011 13651 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:01.327404 13651 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:01.328491 13651 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.330289 13651 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:01.331701  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:01.332126  7299 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:01.332329 13718 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:01.332937 13800 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:01.333627 13846 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:01.302569 13795 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:01.334209 13726 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:16:01.337707  7333 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:16:01.341652  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:01.334879 13893 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:01.349738  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:01.343431  7186 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:01.218231  7891 rpcz_store.cc:276] 0709 13:15:59.513982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.514161 (+   179us) service_pool.cc:224] Handling call
0709 13:15:59.514589 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.564927 (+ 50338us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:00.869133 (+1304206us) log.cc:844] Serialized 14 byte log entry
0709 13:16:00.950214 (+ 81081us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:00.962760 (+ 12546us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:00.962835 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.217194 (+254359us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b540002eed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:01.217251 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:01.217477 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":396074,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":3181,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":40104,"spinlock_wait_cycles":115130752,"thread_start_us":1342784,"threads_started":2,"wal-append.queue_time_us":187904}
I20260709 13:16:01.347462  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:01.353590  7890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1163) took 1759 ms (client timeout 1624 ms). Trace:
I20260709 13:16:01.355230  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:01.345019  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:01.356878  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.354287  7890 rpcz_store.cc:269] 0709 13:15:59.584257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.794837 (+1210580us) service_pool.cc:224] Handling call
0709 13:16:01.343064 (+548227us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54004fa1d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:01.343207 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278275840}
I20260709 13:16:01.359932  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.361052  7261 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:01.362164  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:01.358566  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:01.358692  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:01.339641 13861 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.007s
I20260709 13:16:01.355998  7330 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:01.368635  7262 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:01.357867 13795 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.369226  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.370158  7258 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:01.370225 13795 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:01.372802 13579 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:01.373601 13579 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:01.361984 13517 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:01.374876 13579 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.375885 13517 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:01.379065  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 124907us
W20260709 13:16:01.379367 13942 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:16:01.380312 13568 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:01.380494  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:01.381114 13568 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:01.381882  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:01.382970 13437 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:01.383533 13437 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.383970 13437 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:01.386930 13846 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:01.388371 13935 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:01.389247 13893 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:01.379390  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.391151  7888 raft_consensus.cc:2410] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:16:01.393182 13681 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.393534 13731 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.393805 13681 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.394819  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:01.397214 13681 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:01.397423 13922 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.399610 13517 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:01.401108 13851 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:01.382428  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:01.405586  7178 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:01.356420 13888 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:16:01.408704  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 62368.4us
W20260709 13:16:01.411306  7888 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1161) took 1827 ms (client timeout 1549 ms). Trace:
I20260709 13:16:01.412034  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:01.420406  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.422520  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55738.5us
W20260709 13:16:01.416400  7888 rpcz_store.cc:269] 0709 13:15:59.583698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.675087 (+1091389us) service_pool.cc:224] Handling call
0709 13:16:01.408363 (+733276us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400661554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:01.411206 (+  2843us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152873344}
I20260709 13:16:01.426878  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.407853 13856 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:01.432441  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:01.432441  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 100428us
I20260709 13:16:01.436975  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:01.438869  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.416440 13718 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:01.442391  7258 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:01.448913  7259 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:16:01.451900  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.454881  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:01.404191 13861 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.436128 13856 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:01.441471 13726 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:16:01.464922  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 82595.4us
I20260709 13:16:01.382447 13568 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.450527 13800 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:16:01.454023 13850 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:01.440788 13888 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:01.442224 13718 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:01.482757  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.441491 13935 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:01.447093 13571 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:01.438011 13858 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:01.487421 13924 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:01.477206  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:16:01.496134  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 114448us
I20260709 13:16:01.490172  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.441359 13859 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:16:01.504921  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.485975 13885 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:16:01.509927  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.487303  7259 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
I20260709 13:16:01.492102 13856 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:01.522145  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:01.529763  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.530357  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:01.531600  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 66791.4us
I20260709 13:16:01.534083  7258 raft_consensus.cc:2368] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:01.534458  7184 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:01.534683  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:01.499812 13850 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.540779  7260 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:01.544732  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:01.559453  7178 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:01.536741 13571 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:01.548316 13858 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.567078  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:01.563524 13888 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.564020  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:01.541023 13850 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:01.545836 13568 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:01.591403 13782 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:01.594156  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.561432 13846 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:01.539732 13731 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:01.573800  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:01.564034 13893 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:01.566751 13726 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.578042 13858 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:01.578747  7184 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:01.587677  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:01.602176  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:01.558962 13678 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:01.605268  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:01.606168 13706 raft_consensus.cc:2764] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:16:01.607026  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:01.608814  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:01.609275  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.617082  7186 raft_consensus.cc:2393] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:01.620761  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:01.571240 13922 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:01.625219  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.571939 13859 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:16:01.612008 13678 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:01.560792  7077 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 18 to 21, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 21 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.622450 13582 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:01.689579 13582 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:01.622475 13598 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.201s
I20260709 13:16:01.690493  7259 raft_consensus.cc:2368] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
W20260709 13:16:01.691066  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 86069.2us
I20260709 13:16:01.688746 13678 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:01.690104 13582 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:01.619072 13860 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.618297 13718 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.698865 13718 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:01.699479 13821 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.002s
I20260709 13:16:01.700476 13821 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.702028  7180 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:01.690977 13598 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:01.702924 13598 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:01.704373 13598 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.670328 13670 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:01.707079 13670 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.707536 13670 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:01.622465 13568 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:01.712198 13568 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:01.714990 13568 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.719482 13726 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:01.724633 13824 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.000s
W20260709 13:16:01.725394  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.726222  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 164204us
I20260709 13:16:01.729341 13856 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.706429 13598 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:01.735273 13860 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:01.741444  7888 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:01.725206 13824 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.744805 13885 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:01.745393  7185 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:01.745468 13885 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:01.722290 13726 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:01.747196 13885 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.761037  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:01.763134  7330 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:16:01.768301  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:01.768720 13795 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:01.769160  7332 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:01.769434 13795 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.771225  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:01.771920 13795 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:01.771960  7333 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:16:01.679592 13858 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 13:16:01.718302 13437 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.813746  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:01.815490  7332 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:01.792222 13517 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:01.836263  7888 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:16:01.837188  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:01.831743  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:01.847998 13795 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.848817 13795 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.849457 13821 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:01.821739 13846 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:01.826946 13517 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:01.840166 13885 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:01.870677  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:01.883515  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.883869  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3452) took 1127 ms. Trace:
I20260709 13:16:01.885707  7332 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:01.884295  7182 rpcz_store.cc:276] 0709 13:16:00.756203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.208247 (+452044us) service_pool.cc:224] Handling call
0709 13:16:01.208684 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.209022 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:01.441818 (+232796us) log.cc:844] Serialized 14 byte log entry
0709 13:16:01.883413 (+441595us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:01.883474 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:01.883526 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.883621 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:01.883784 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29231,"prepare.queue_time_us":355925,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":59801,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":49721,"thread_start_us":591590,"threads_started":3,"wal-append.queue_time_us":380974}
I20260709 13:16:01.854686 13582 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.877338 13571 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:01.902304  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.902609  7179 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
W20260709 13:16:01.907335  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 324176us
W20260709 13:16:01.908118  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 189263us
I20260709 13:16:01.910111  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:01.919595  7333 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:16:01.924826  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.926671 13963 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:01.926784 13678 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.921074  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:01.927951 13517 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.905297 13961 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:01.947319 13571 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.949959 13846 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.946349 13961 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:01.937755  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 371095us
I20260709 13:16:01.955567  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:01.957074  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:01.924204 13860 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:01.958063 13860 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:01.960007 13582 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:01.959481 13860 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.916337 13795 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:01.961817 13437 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:01.962862  7332 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:16:01.965343 13670 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.922859 13824 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:01.922466 13856 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:01.971779 13962 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:16:01.975345 13517 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:01.975548  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:01.976893 13957 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.112s	user 0.000s	sys 0.003s
I20260709 13:16:01.977660  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:01.944934 13967 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:01.978529  7331 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:01.978936 13967 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:01.980485  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:01.981560  7335 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:01.945662 13959 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.982895  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:01.983239 13678 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:01.983167 13959 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.984264  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:01.931953  7225 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:01.929741 13850 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:01.954322 13961 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:01.988999  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:01.991237  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:02.010380  7893 raft_consensus.cc:2410] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:16:02.000372  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:01.992432  7890 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:02.011631  7333 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:02.003576  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3451) took 1260 ms. Trace:
W20260709 13:16:02.008857  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 51871.5us
I20260709 13:16:02.012553  7180 rpcz_store.cc:276] 0709 13:16:00.744052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.204422 (+460370us) service_pool.cc:224] Handling call
0709 13:16:01.204794 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.702494 (+497700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.003301 (+300807us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54002b52d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:02.003506 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143039872}
I20260709 13:16:02.021489  7887 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27. Ops: []
W20260709 13:16:02.024221  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 136194us
I20260709 13:16:02.027818  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:02.028076  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 107080us
I20260709 13:16:02.028944  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:02.029114 13536 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:16:02.030566  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 105120us
W20260709 13:16:01.990180 13651 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.007s
W20260709 13:16:01.995146  7150 connection.cc:256] RPC call timeout handler was delayed by -2.0633134310000969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 13:16:01.982297 13967 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:01.986943  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:02.007911 13670 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:02.083830  7334 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:01.991925 13850 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:02.084288  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56583.5us
I20260709 13:16:02.031005 13960 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:02.111557  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:01.986588 13959 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:02.111487  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:02.030237 13703 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:02.124222 13963 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:02.032584 13288 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:02.137130  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:02.139173  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 105026us
I20260709 13:16:02.135854  7333 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:02.031059 13964 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:02.140195 12919 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:02.140273  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:16:02.143543  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.145260  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:02.119959 13961 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:02.147964  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:02.149621  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:02.121165 13960 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.151381 13960 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:02.151790  7261 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:02.153904 13850 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:02.149639 13961 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.157086 13961 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:02.162946  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:02.154381 13850 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.163795  7258 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:16:02.170547  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:02.171015  7328 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:02.172448  7254 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:16:02.174564  7259 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:02.174474  7327 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:16:02.178452  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:02.179474  7256 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:16:02.187023  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:02.185225  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:02.147152 13670 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:16:02.194140  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44646.3us
I20260709 13:16:02.195042  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:02.167567 13850 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:02.199832  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:02.176370 13681 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:16:02.213980  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 51234.5us
I20260709 13:16:02.212960 13795 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:02.196329 13536 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:02.216984  7261 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:02.221992  7861 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:02.220271  7333 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:16:02.219291  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:02.217902  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:02.221102  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:02.218051  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:02.227417  7258 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:16:02.228256  7253 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:02.205083 13681 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:02.211179 13971 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:16:02.229099  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 88926us
I20260709 13:16:02.166931 13963 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.234017  7334 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:02.222096 13935 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.233309  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:02.239112  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:02.239987  7333 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:02.221870 13694 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.237394 12919 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:16:02.248291 12919 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:02.248888 12919 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.249317 12919 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:02.240178  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:02.237879  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:02.253364  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:02.232261 13681 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:02.257999 13694 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.260147 13961 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.232084 13967 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:02.232431 13782 raft_consensus.cc:2764] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:16:02.232800 13971 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.263631 13971 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:02.265003  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 54097.3us
I20260709 13:16:02.265872 13963 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:02.267086  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:02.237493 13980 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:02.268362 13980 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.268754 13980 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:02.269426 13885 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:02.262348  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:02.260573 13694 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:02.262833 13967 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:02.269904 13885 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.273864 13981 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:02.275422 13865 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:02.275964 13782 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:02.277030 13969 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:02.266496 13963 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:02.278863 13935 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:02.280386 13970 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:02.230759 13718 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:16:02.281790 13965 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:02.284109  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:02.289075  7333 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:02.298298  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:02.279085  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:02.307543  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51430.8us
I20260709 13:16:02.300171  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:02.262518 13961 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:02.262377 13795 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:02.312335  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:02.317235  7890 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:02.318213  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:02.327734  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:02.290777 13981 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.290262 13885 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:02.329931  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.322263  7889 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:02.323841  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:02.325304  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:02.326412  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:02.303236 13959 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:16:02.327142  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 81117.5us
I20260709 13:16:02.329990  7259 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:02.333384 13782 raft_consensus.cc:2764] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:16:02.341382  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:02.343029  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:02.344676  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:02.345191  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:02.345620  7889 raft_consensus.cc:2410] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 20 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:16:02.345763  7333 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:02.347389  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:02.348146  7333 raft_consensus.cc:2376] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22. Re-sending same reply.
I20260709 13:16:02.348433  7890 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:16:02.349602  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:02.354135  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:02.354969  7889 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:02.356573  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:02.357542 13795 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:02.358738  7254 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:16:02.359944 13969 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:02.360723 13862 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:02.361210 13862 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:02.361084 13969 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.362367 13862 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:02.363211  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:02.360092  7335 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:16:02.366219  7889 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:02.363514 13862 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:02.349447  7891 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:02.369154  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:02.380822  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 53729.5us
I20260709 13:16:02.381001  7335 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 21. Ops: []
I20260709 13:16:02.377157 12919 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.382400  7335 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:16:02.387488  7895 raft_consensus.cc:2368] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18.
I20260709 13:16:02.388898 13288 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:02.389533 13288 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:02.329152 13924 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.408016  7335 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:02.425463 12919 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:02.411319  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:02.333498 13981 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:02.435223  7335 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:02.437057  7335 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:16:02.438709  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 43945.7us
W20260709 13:16:02.439095  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 221156us
I20260709 13:16:02.472431 12919 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:02.440256  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:02.430023  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:02.475677  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 45705.8us
W20260709 13:16:02.474417  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 109491us
I20260709 13:16:02.375058 13985 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:02.478142  7331 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:16:02.483826  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53921us
I20260709 13:16:02.432459 13865 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.432147 13694 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:02.486326  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:02.489280  7331 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:16:02.432665 13988 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:02.496505 13951 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.809s	user 0.003s	sys 0.001s
I20260709 13:16:02.501647 13989 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:02.380371 13964 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 13:16:02.407116 13579 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:16:02.503299 13985 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:02.402456 13681 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.380314 13960 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:02.482826 13965 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:02.472684 13858 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.073s
I20260709 13:16:02.492533 13893 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:16:02.542217 13988 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.555305  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:02.548175 13985 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:02.549642  7152 leader_election.cc:336] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.505s (SENT)
W20260709 13:16:02.552775 13975 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
I20260709 13:16:02.554154 13967 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:02.492174 13795 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:16:02.557371  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 173119us
I20260709 13:16:02.504289 13837 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:16:02.572084  7330 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:16:02.482980 13824 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:16:02.483573 13924 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.507477 13885 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.595870 13965 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:02.628774  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 79161.6us
I20260709 13:16:02.559564 13850 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:02.612768 13795 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:02.642197  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 86991.4us
I20260709 13:16:02.620208 13961 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:02.644701  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:02.559944 13865 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:02.647514  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61905.2us
I20260709 13:16:02.648995  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:02.657718  7331 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:02.659952  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:02.646956 13959 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:02.641621 13935 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:02.648454 13961 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:02.712124  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.713928  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:02.672935 13582 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:16:02.713869  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 112842us
W20260709 13:16:02.679598 13991 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:02.680354 13965 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:02.684098 13971 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:02.686282 13885 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:02.692999 13960 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:02.693671 13861 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:02.694451  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45549.6us
I20260709 13:16:02.712287 13579 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:02.731899  7302 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:02.654127 13969 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:02.738513  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:02.718402 13582 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:02.715651  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:02.745152  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:02.718014 13924 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:02.719389  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:02.694604 13978 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:02.724001  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:02.728636  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:02.714476 13961 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:02.713094  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:02.700634  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.742367  7333 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:02.721536 13888 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.735245 13969 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.746069  7178 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:02.735846 13579 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:02.753509  7180 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:16:02.754588  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:02.767431  7184 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:02.757550  7185 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:16:02.760218  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:02.739835  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 257550us
I20260709 13:16:02.750402  7260 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:16:02.769335  7183 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:16:02.771121  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:02.769737  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:02.776527  7152 leader_election.cc:336] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.113s (SENT)
I20260709 13:16:02.777107  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:02.765872 13990 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:02.780404  7178 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:02.759493 13885 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:16:02.781494 14001 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:02.782117 14001 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.753913 13651 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:02.789582  7336 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:02.727398 13980 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.757562 14000 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:02.763291 13978 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:16:02.847241  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 127327us
W20260709 13:16:02.845639  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 108733us
I20260709 13:16:02.858960 14000 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:02.861581 13288 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.874984  7260 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:16:02.765653 13969 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:02.879081 13971 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:02.880234 13582 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.881824 13582 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:02.842525 13991 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:16:02.873778  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:16:02.871526 13996 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:16:02.898849 13959 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:02.788380 13967 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:02.907956 14005 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:02.908838 14005 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:02.911098 13850 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:02.911489 13981 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.765964 13888 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.749065 13795 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.793063 13568 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:02.843173 13893 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.890383 13824 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:02.915431  7184 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:02.945011  7894 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:02.926198  7888 raft_consensus.cc:2368] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21.
W20260709 13:16:02.940397  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 66780.1us
I20260709 13:16:02.953104  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:02.987846  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 218177us
I20260709 13:16:02.989292  7150 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:02.991001  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:02.992076 14013 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:02.992985 14013 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:02.994197  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:02.995600  7184 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:16:02.996177  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 235089us
I20260709 13:16:02.998134  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:02.999795  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:03.000089  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:02.997815  7150 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:03.001999  7179 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:02.913664 14004 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:03.005702 14003 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:02.914297 13981 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:02.932737 13865 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:02.979115 13862 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.002s
I20260709 13:16:03.009990  7336 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:03.035543  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.034301  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:02.939697 13824 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:02.943245 13971 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:02.921389 13888 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:02.926903 13568 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:03.023159  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.997783 13963 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:02.986503 13980 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.032859  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:03.067744  7178 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:02.937456 13893 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:03.046018  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.007931 13967 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:03.049650  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:02.938280 13978 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.012251 13985 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:03.051184  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:02.910080 14005 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.002656  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:03.055414  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:03.061594  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 315597us
I20260709 13:16:03.084442  7256 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:03.085567  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 83011.8us
I20260709 13:16:03.087519  7255 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:03.016942 13965 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:03.092744  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:03.093751  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:03.094445  7331 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:03.096516  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:03.096782  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.099114  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:03.100040  7330 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:03.102432  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:03.103178  7260 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:16:03.108588  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:03.109431  7331 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:03.083186 14015 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:03.110821 14010 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:16:03.128031  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:03.114663 14018 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.114907  7336 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:03.115278  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:03.073890 13985 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:03.084383 13963 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:03.125378  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:03.131610  7335 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:03.151803  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:03.132441  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:03.090387 13846 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.065611 13971 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.101225 14000 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.148932  7328 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:03.149063  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:03.167938  7336 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:02.994401 14013 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.144953  7861 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:03.155261  7334 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:03.135175  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:03.165903  7330 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:03.169731  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:03.171571 13990 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:03.172319 13990 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.172816 13990 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:03.176256  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 71769.1us
I20260709 13:16:03.177000  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:03.177577  7184 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:03.135478 14003 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:03.130198 14015 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:03.153029 13985 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:03.174182 13971 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:03.190097  7336 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:03.190270  7331 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:03.190903  7178 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:03.198215  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:03.199294  7178 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:16:03.199795 14020 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:03.200680 14020 consensus_queue.cc:1243] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:16:03.204166 14010 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:03.205106 14010 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:16:03.209290  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 74270us
I20260709 13:16:03.209839  7150 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:03.206002  7184 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:03.202426 14020 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:03.204283 14028 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:03.189281 14015 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:03.172411 13846 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.198202 14004 raft_consensus.cc:2764] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:16:03.146894 14018 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.226135 14028 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:03.255227  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 45481.7us
I20260709 13:16:03.234898  7184 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:03.256733  7184 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:03.258453  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2455) took 1283 ms. Trace:
W20260709 13:16:03.260667  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49704.5us
I20260709 13:16:03.259095  7327 rpcz_store.cc:276] 0709 13:16:01.975493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.982425 (+  6932us) service_pool.cc:224] Handling call
0709 13:16:03.258152 (+1275727us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540013c754. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:03.258352 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231405952}
I20260709 13:16:03.256938  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:03.242252 13961 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.266958 14025 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:03.267731 14025 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:03.268153 14022 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:03.268652 14022 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:03.268854 14025 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.269572 14022 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.271317 13988 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.272831 13860 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:03.274026 14016 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:16:03.230683 13969 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.276186 13960 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.234411 14020 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.183588 13568 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.276917 14003 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.271755 13963 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.274412 14029 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:03.325361  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 62890.2us
I20260709 13:16:03.339555  7299 leader_election.cc:400] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18.
I20260709 13:16:03.421921  7299 leader_election.cc:403] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:03.304001 13995 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.342298  7187 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:03.349675  7256 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:03.358919 13965 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:03.360278  7183 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.000s
I20260709 13:16:03.424453  7183 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:16:03.425694  7261 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 24: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:03.361212 13582 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:16:03.433945  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 94691.2us
I20260709 13:16:03.435173  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:03.267740 13961 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.430884  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:03.432094  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:03.364720 14022 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:03.437770  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:03.441120  7336 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:03.442061  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:03.404765 14019 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:03.446022 14030 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.446362 13795 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18.
I20260709 13:16:03.446746 14030 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.447536 14012 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.448200 14012 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.450002 13782 raft_consensus.cc:2764] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:16:03.446745 13536 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:03.451124 14026 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:03.451403  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.451761 14026 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.453118  7301 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:03.454036 14023 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.079s	user 0.003s	sys 0.000s
I20260709 13:16:03.458674  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:03.459863  7254 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:03.460569 14028 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.461083  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:03.463380 13846 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.440104  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:03.413800  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:03.366417  7184 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.422019 13824 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:03.472808  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:03.484617  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:03.405804 14018 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.491906  7225 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:03.494110  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 237261us
I20260709 13:16:03.494549  7184 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:03.342918 13860 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.496157  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:03.429874 13893 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:03.496181  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:03.520087  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 98479.5us
I20260709 13:16:03.521867  7152 leader_election.cc:400] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
W20260709 13:16:03.522256  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 82239.5us
I20260709 13:16:03.523144  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:03.495648  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:03.524848  7178 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 13.
I20260709 13:16:03.498010  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:03.463217 13961 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:03.459890 13865 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:03.556427  7183 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
W20260709 13:16:03.557224  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.569409  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:03.570398  7327 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:16:03.450490 14012 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:03.569384  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:03.572170  7256 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:03.561240  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:03.573558  7336 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:03.575847  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 255694us
I20260709 13:16:03.549646 13568 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:03.433507 13960 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.430290 13995 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:03.584460  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 86517.9us
I20260709 13:16:03.558533 13850 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:03.586318  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:03.590818  7254 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:03.594044  7184 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:03.556804 14018 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:03.600798  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.601547  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 79803.5us
I20260709 13:16:03.570211 13893 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:03.612363  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:03.585716 13536 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.623894  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:03.624364 14020 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.619073  7896 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
W20260709 13:16:03.621132  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 98077.5us
I20260709 13:16:03.625334  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:03.622715  7180 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:16:03.624790  7889 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:16:03.626122  7180 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:03.627115  7180 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.627964  7891 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
W20260709 13:16:03.614001 13972 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:16:03.628410  7299 leader_election.cc:336] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Timed out: RequestConsensusVote RPC to 127.5.227.132:39125 timed out after 1.549s (SENT)
I20260709 13:16:03.628913  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:03.630049  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:03.628435  7180 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:03.632118 14030 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.630091 14020 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:16:03.631276  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3665) took 2191 ms. Trace:
I20260709 13:16:03.625861  7302 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:03.635901  7336 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:16:03.633209  7262 rpcz_store.cc:276] 0709 13:16:01.439811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.440029 (+   218us) service_pool.cc:224] Handling call
0709 13:16:01.452465 (+ 12436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:01.509081 (+ 56616us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:01.540921 (+ 31840us) log.cc:844] Serialized 14 byte log entry
0709 13:16:01.891339 (+350418us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b18003ecda0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a 00007fece9246a2a
0709 13:16:02.141714 (+250375us) log.cc:844] Serialized 14 byte log entry
0709 13:16:02.256837 (+115123us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:02.303830 (+ 46993us) log.cc:844] Serialized 52 byte log entry
0709 13:16:02.304017 (+   187us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:02.307605 (+  3588us) log.cc:844] Serialized 14 byte log entry
0709 13:16:02.314077 (+  6472us) log.cc:844] Serialized 14 byte log entry
0709 13:16:02.317626 (+  3549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.317738 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.452876 (+1135138us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b18003ecda0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:16:03.630959 (+178083us) raft_consensus.cc:1685] finished
0709 13:16:03.630992 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.631177 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129021,"prepare.queue_time_us":146009,"prepare.run_cpu_time_us":186,"prepare.run_wall_time_us":6928,"raft.queue_time_us":199862,"raft.run_cpu_time_us":640,"raft.run_wall_time_us":21718,"spinlock_wait_cycles":76306176,"thread_start_us":257266,"threads_started":3,"wal-append.queue_time_us":558836}
I20260709 13:16:03.497432 14019 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.626040  7327 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:16:03.639930  7892 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:03.604360 14026 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.645228 14033 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.077s
W20260709 13:16:03.645952 13856 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:16:03.656927  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:03.646347 14031 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:16:03.647059  7895 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:16:03.605641 13865 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:03.624831 14037 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:03.588353 13961 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.683499  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:03.624311 13536 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.652556 13850 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:03.648218 13800 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:03.688167  7262 raft_consensus.cc:2368] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:03.636121 13582 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:03.684796  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:03.672814  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:03.690507  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:03.693643  7896 raft_consensus.cc:2410] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:16:03.638075 13893 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.654582 13860 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:03.695477  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:03.660064  7150 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:03.694207  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:03.671797  7152 leader_election.cc:400] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 13 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 13. Current term is 14.
W20260709 13:16:03.712941  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53008.3us
I20260709 13:16:03.665551 14017 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:03.606678 13965 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.627135  7178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
W20260709 13:16:03.746981  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 118581us
I20260709 13:16:03.747141  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:03.751892  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 57819.7us
I20260709 13:16:03.760973  7256 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
W20260709 13:16:03.761459  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 112088us
I20260709 13:16:03.716439 13824 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:03.747658 14042 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:16:03.806411  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:03.764190 14019 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.764331 14037 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:03.767304 13536 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:03.817255  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:03.767457 13990 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.004s
I20260709 13:16:03.767844 13893 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:03.769053 14043 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:16:03.756784 13681 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:03.771402 13985 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.004s
I20260709 13:16:03.771826 13960 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:03.695977 13969 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.772207 13961 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.772619 13995 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.774143  7254 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:16:03.845877  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:03.846724  7254 raft_consensus.cc:2368] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17.
I20260709 13:16:03.684732 14038 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.778854  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:03.762512  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:03.850708  7260 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:03.804538  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.826172 13860 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:03.808696  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:03.813807  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:03.738950 14009 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:03.809037  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:03.859133  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:03.854657  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 361198us
I20260709 13:16:03.860095  7254 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:16:03.823089  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:03.735453 14040 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.805814 13824 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:03.833707  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:03.816993 14030 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:16:03.848580  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65775.9us
I20260709 13:16:03.668817 14015 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.740095 13865 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.866676  7256 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:03.875600  7183 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:16:03.876618  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:03.857149  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:03.879781  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:03.865183 14047 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.880945  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:03.880865 14047 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.881647  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:03.882193  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:03.883169  7254 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:03.831197 13985 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.885929 13985 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.860294  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:03.857738  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 78970.6us
I20260709 13:16:03.818650 13978 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:16:03.863652  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54692.4us
I20260709 13:16:03.781178 14017 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:03.865047  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:03.863734  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50086.1us
I20260709 13:16:03.869839  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:03.871855 14046 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:03.888446  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:03.872246 14037 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.876545  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:03.900457  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:03.901648 13935 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:03.890132  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:03.867832 13969 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:03.903357  7889 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:03.865299  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:03.886519  7254 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:03.822364 13990 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.895637  7260 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:16:03.888855  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:03.870131  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:03.906422  7859 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:03.869772 13860 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:03.911446  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2463) took 1914 ms. Trace:
I20260709 13:16:03.863613 13995 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:03.905293  7892 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 26.
I20260709 13:16:03.902094  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:03.935355  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:03.920078  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:03.943884 13800 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:03.944478 13800 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.944864 13800 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:03.855842 14038 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.925952  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:03.939849  7333 rpcz_store.cc:276] 0709 13:16:01.997165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.386593 (+389428us) service_pool.cc:224] Handling call
0709 13:16:02.386953 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.758311 (+371358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.911173 (+1152862us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b540031abd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:03.911389 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816745344}
W20260709 13:16:03.958773  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53291.3us
I20260709 13:16:03.961922 13681 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:03.949045 14046 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.962428 14047 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.963155 14047 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:03.963654 14047 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:03.964145 14046 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.869320 13961 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:16:03.964550 14047 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.911325 14017 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:03.967434 13969 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:03.968592 13969 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:03.969836 14015 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:03.868467 13536 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:03.979122  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:03.893316 14030 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:03.972854  7895 raft_consensus.cc:2368] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18.
I20260709 13:16:03.913257 13935 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:03.982157  7184 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:03.971446 13568 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:03.988503  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2718) took 1252 ms. Trace:
I20260709 13:16:03.986979  7889 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:16:03.868772 13824 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:04.007440  7179 rpcz_store.cc:276] 0709 13:16:02.736319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.738724 (+  2405us) service_pool.cc:224] Handling call
0709 13:16:02.753750 (+ 15026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.002972 (+249222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.988169 (+985197us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54002c4554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:03.988420 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570418432}
I20260709 13:16:03.962446 13681 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:04.019991  7894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1175) took 1722 ms. Trace:
I20260709 13:16:04.020581  7894 rpcz_store.cc:276] 0709 13:16:02.297099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.297235 (+   136us) service_pool.cc:224] Handling call
0709 13:16:04.019669 (+1722434us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b540043a154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:04.019891 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416545664}
W20260709 13:16:04.024636  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 186596us
I20260709 13:16:04.026618  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.032212  7862 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:16:04.030459  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.982761 14019 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:04.039062  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:04.035305  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.042078  7179 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:16:04.035683  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:04.043147  7184 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:16:04.043295  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:03.992300 13536 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:03.869078 14040 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.005012 13568 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.052388 13568 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:04.013027 14045 raft_consensus.cc:2764] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:16:04.049376  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.018201 13681 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:04.078773  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.989596 14009 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:16:04.027638 13985 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:04.041306 13995 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:04.038348 14015 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.115705  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 105637us
I20260709 13:16:04.031291 13893 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:16:04.115103  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.124200  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.121085  7890 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:04.113559  7184 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:04.127974  7184 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:16:04.135497  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 98612.3us
I20260709 13:16:04.138110  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.138844 14053 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.139125 13893 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:04.139729 13893 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:04.139428 14053 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.139925  7184 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:04.140688 13893 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.047300 14019 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.143604 13893 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:04.139092  7179 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:04.149214  7179 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:16:04.117395 13995 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:04.150919  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.166414 14061 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:04.167128 14061 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.171054  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:04.171882  7256 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:16:04.151360 13971 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:04.171238 14061 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:04.147774 13935 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:04.156418 14018 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.551s	user 0.013s	sys 0.000s
I20260709 13:16:04.185406  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.159184 13995 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:04.124073 14015 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.188019  7256 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:04.130347 13985 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.197575 14038 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:04.202375  7861 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:04.203356 12919 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:04.204087 12919 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:04.193763 14018 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:04.198794 14015 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:04.191248 14046 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:04.189337 14037 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.208467 14050 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.121032 13860 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.190116 13856 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:04.133229 14030 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.242357 12919 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.208730 13582 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:04.228889 14053 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:04.228718 13990 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:04.280144  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 114106us
I20260709 13:16:04.241474 14046 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:04.288211  7183 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:04.297592  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.302671  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.194561 13536 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.297716 13858 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.287861 14046 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:04.247920 14037 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.320195  7152 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:04.319823  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 293286us
I20260709 13:16:04.288131 14001 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:04.305955 13582 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.284890 13856 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:04.327978  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 402138us
I20260709 13:16:04.307260 13985 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:04.306854 14069 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.322580 13858 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.334560 13971 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:04.336720 13858 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:04.338840 13856 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:04.340699  7184 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:04.253368 14050 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.359400  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.371443  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:04.374531  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:04.379536  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.381539  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.395453  7889 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:16:04.358580 13856 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:16:04.404812  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.377259 13536 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
W20260709 13:16:04.407019 14078 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:16:04.407354 13995 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.397719 14022 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:04.386950 14040 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:04.398727 14015 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.411522 14070 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:16:04.414577 14050 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:04.333002 13582 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:04.420783  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 61676.6us
I20260709 13:16:04.435058  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.424165  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.348722 14069 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.442483  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.432155 14015 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.444104  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.449760  7184 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
W20260709 13:16:04.450157  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 220842us
I20260709 13:16:04.434206 13856 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.454664 14025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.105s	user 0.008s	sys 0.009s
W20260709 13:16:04.459733 14025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.008s	sys 0.009s
I20260709 13:16:04.460561  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.462749 14025 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:04.468881 14082 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.473276  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.484095  7330 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:16:04.441998 14022 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:04.485893  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.491901 14082 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.494933  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.495759  7327 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:04.497864  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3683) took 1855 ms. Trace:
I20260709 13:16:04.499320  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.500392 14029 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:04.437878 13800 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.500882 14029 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:04.502383  7262 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:04.502851 13800 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:04.498394  7261 rpcz_store.cc:276] 0709 13:16:02.642574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.642807 (+   233us) service_pool.cc:224] Handling call
0709 13:16:04.497629 (+1854822us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54002d3554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:04.497794 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1758795648}
W20260709 13:16:04.516824  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 72775.4us
I20260709 13:16:04.518198  7152 leader_election.cc:400] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17.
I20260709 13:16:04.519475  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:04.520396  7330 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:04.514935  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1370) took 1485 ms. Trace:
I20260709 13:16:04.524766  7258 rpcz_store.cc:276] 0709 13:16:03.019247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.019355 (+   108us) service_pool.cc:224] Handling call
0709 13:16:03.054838 (+ 35483us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:03.090134 (+ 35296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.090164 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:03.112912 (+ 22748us) log.cc:844] Serialized 52 byte log entry
0709 13:16:03.477380 (+364468us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:03.556716 (+ 79336us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.570521 (+ 13805us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.570721 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.570795 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.946732 (+375937us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b18003e11c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f
0709 13:16:04.409923 (+463191us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b18003e11c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:16:04.504184 (+ 94261us) raft_consensus.cc:1685] finished
0709 13:16:04.504209 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.504355 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13327,"prepare.queue_time_us":115826,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":3822,"raft.queue_time_us":70489,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":5446,"spinlock_wait_cycles":138420992,"thread_start_us":316330,"threads_started":2,"wal-append.queue_time_us":411345}
I20260709 13:16:04.495915 14069 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:04.528602  7152 leader_election.cc:403] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:04.529579  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:04.530295  7261 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:04.522346  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:04.501942 14029 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.487994 14020 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:04.536312  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.515818 14015 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:04.544492  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.483315 13856 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.555240  7330 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:04.539605 14069 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:04.545181 14029 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:04.560279 13856 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:04.551156 13858 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:04.546618 14025 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17.
I20260709 13:16:04.546901 14037 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:04.567118  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49137.3us
I20260709 13:16:04.546396 14082 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:04.574518 13568 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260709 13:16:04.564569  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.617698  7887 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:04.618417 13568 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.621734 13568 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:04.624136 13681 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 13:16:04.624333  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:04.625164  7184 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:04.624747 13681 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.627246 13582 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:04.628175 14046 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.631428 14046 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:04.631893 13960 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:04.632366 13960 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:04.633386 13960 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.636931 13681 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:04.615388  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.650135  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:04.652293  7888 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1173) took 2384 ms (client timeout 1549 ms). Trace:
W20260709 13:16:04.653053  7888 rpcz_store.cc:269] 0709 13:16:02.257059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.278770 (+ 21711us) service_pool.cc:224] Handling call
0709 13:16:04.617063 (+2338293us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400661554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:04.641025 (+ 23962us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385633024}
W20260709 13:16:04.650573  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 86106.5us
I20260709 13:16:04.655927  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.658034  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.667618  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:04.668135  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:04.662774 13681 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:16:04.656327 14024 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.081s	user 0.000s	sys 0.005s
I20260709 13:16:04.671378  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:04.655094 13568 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:04.673349 13681 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:04.673887 13681 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.666352 14019 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:04.664412 14082 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:04.674328 13681 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:04.658041 13960 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:04.682435  7261 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:16:04.685783  7888 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:16:04.691609 13824 consensus_meta.cc:287] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.660s	user 0.013s	sys 0.000s
I20260709 13:16:04.692147 13824 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.693300  7180 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:04.695308  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.695996  7180 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:16:04.696974  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.697878  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1086) took 1071 ms. Trace:
I20260709 13:16:04.698355  7334 rpcz_store.cc:276] 0709 13:16:03.626515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.629727 (+  3212us) service_pool.cc:224] Handling call
0709 13:16:04.697638 (+1067911us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540031a6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:04.697806 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150162176}
I20260709 13:16:04.699216 13681 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.702663 13681 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:04.704421 13824 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:04.683816 14046 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:04.717170  7184 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:04.720245  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:04.721303  7888 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:04.723711  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:04.728731  7890 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:16:04.729879  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.723151  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.714745 13846 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.732815 13924 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:04.737345 13846 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.722936 14046 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:04.745220  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:04.744179 14000 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:16:04.733897 13993 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:04.749014 13993 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.749768  7888 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:04.750828 14019 raft_consensus.cc:2764] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:16:04.751186 13993 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:04.751945 14046 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:04.752954  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.755239  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2719) took 2018 ms. Trace:
I20260709 13:16:04.755777  7181 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:16:04.756848  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:04.757122  7181 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:04.755661  7182 rpcz_store.cc:276] 0709 13:16:02.736634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.736785 (+   151us) service_pool.cc:224] Handling call
0709 13:16:04.700214 (+1963429us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:16:04.700464 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:04.700935 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:04.700971 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:04.701539 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:16:04.728963 (+ 27424us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:16:04.729047 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.729123 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.744684 (+ 15561us) raft_consensus.cc:1685] finished
0709 13:16:04.744707 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.755166 (+ 10459us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3212,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":8511872,"thread_start_us":26997,"threads_started":1,"wal-append.queue_time_us":35274}
I20260709 13:16:04.759020  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:04.760620  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.763031 13437 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:04.764106  7862 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.765839  7862 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:04.743882 13846 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:04.770982  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.773677 14038 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:04.776054  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:04.776757  7255 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:04.778800  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:04.780939  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.782150  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.783620  7254 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:16:04.785063  7256 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:16:04.785379  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:04.787436  7186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2721) took 2050 ms (client timeout 2072 ms). Trace:
W20260709 13:16:04.787868  7186 rpcz_store.cc:269] 0709 13:16:02.737250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.737353 (+   103us) service_pool.cc:224] Handling call
0709 13:16:04.760452 (+2023099us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b5800000c98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:16:04.787354 (+ 26902us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6848896}
I20260709 13:16:04.789435  7186 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:04.790447 14000 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:04.792004  7262 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:04.793164  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.793362 13536 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.793807  7262 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:04.793892 13536 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.794785 13935 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.795430 14082 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.795290 13935 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.795984 14082 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.797068  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:04.797736  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.798233 13568 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.798830 13858 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.798861 14061 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.800194 14061 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.800952  7255 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:16:04.801136  7334 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:16:04.801543  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.797658 13935 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:04.803201  7331 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:16:04.803757  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:04.799651 13858 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.831835  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.804941 14069 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.807020  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.795301 13694 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.808039 13865 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:04.808343  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.798337 14082 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:04.809824  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.837864  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:04.839483  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.840533  7330 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:04.814654  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:04.816179  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:04.773085  7184 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:04.822463  7182 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:16:04.826886  7256 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:04.827195  7333 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:16:04.828419 14061 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:04.829344 13437 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:04.832759  7335 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:16:04.841310  7328 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:04.843968  7152 leader_election.cc:336] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 2.049s (SENT)
I20260709 13:16:04.774539 14038 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:04.849377  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83649.7us
I20260709 13:16:04.868330  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.869220  7186 raft_consensus.cc:2410] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:16:04.852324  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:04.854887 14046 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.856438 13959 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:04.857574 13995 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:04.858374  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:04.848110 14000 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:16:04.858987 13992 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:04.860028  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.862951  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:04.843573 13865 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:04.880630  7890 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:04.865777  7336 raft_consensus.cc:2376] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17. Re-sending same reply.
I20260709 13:16:04.865696  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.867128  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:04.865479  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:04.871871  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:04.882956  7335 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:04.884393  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:04.880457  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:04.873905  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.878443  7332 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:04.847559  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.887380  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:04.888470  7888 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
W20260709 13:16:04.890221  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57724.5us
I20260709 13:16:04.890595  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.891373  7330 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:04.867808 14038 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.897361  7330 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:04.891120  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:04.835613 13993 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:16:04.893791  7887 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:04.831936 13568 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.898972  7331 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:04.908623  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.908812 13437 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.910008  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:04.875972 13998 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:04.911019 13998 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.911478 13998 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:04.889812 13782 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:04.843082 14069 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.914965  7077 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:04.898460  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.917281  7077 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 16, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 16 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:04.918407 14061 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.921486 14061 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.922119  7077 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 17 to 19, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 19 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.919773  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.924718  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.925439  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:04.925859  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:04.926280  7186 raft_consensus.cc:2393] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:04.926473  7180 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:16:04.927836  7895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 933) took 1073 ms. Trace:
I20260709 13:16:04.928213  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:04.927764  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:04.928380  7895 rpcz_store.cc:276] 0709 13:16:03.854651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.854982 (+   331us) service_pool.cc:224] Handling call
0709 13:16:04.927636 (+1072654us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b540056cf54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:04.927778 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150773504}
I20260709 13:16:04.929035  7893 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:04.847074 13694 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:04.931445  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 62762.2us
I20260709 13:16:04.928632  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:04.930203  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.932487  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:04.933341  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:04.911350  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:04.907770  7328 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:04.937427  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:04.938383  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 80116.4us
I20260709 13:16:04.936276  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:04.943408  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:04.900565 14038 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:04.939733  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:04.949096  7180 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:16:04.922327 14045 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.950389  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:04.951083  7257 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:04.949479  7334 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:04.947602  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:04.945843  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:04.942459 13960 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:04.960978 14019 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:04.950780  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:04.879369 13959 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.961939 14037 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:04.962807  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:04.963596  7180 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:04.964195 13959 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:04.930292  7077 catalog_manager.cc:5697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 6 to 15, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 15 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:04.969204  7331 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:16:04.936416 13978 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:04.973330  7180 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:04.967492  7330 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:16:04.960057 13846 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:04.968653  7179 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:04.971974  7261 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:04.982671  7332 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:04.982919  7261 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:04.936115 13582 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:16:04.967443  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.969657  7331 pending_rounds.cc:85] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 10
I20260709 13:16:04.976884  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:04.959309  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:04.981468  7328 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:04.984782  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.944928 14092 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:04.944736 14036 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.983777  7261 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:04.987540  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47887.5us
I20260709 13:16:04.998307  7893 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:16:04.966220 13859 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:04.969445 13961 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:04.972368 14045 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:04.943033 14010 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:16:04.942849 13782 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:16:04.943176 13824 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:16:04.988965  7331 pending_rounds.cc:107] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:16:05.030135  7331 raft_consensus.cc:2889] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:05.031512  7335 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:04.971182  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:05.006038  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:05.008064 13582 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:04.990321 13846 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:04.903358 13579 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:04.992906  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:04.996790 14092 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.993050 13993 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:05.024865  7261 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:05.027225  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:05.052029  7328 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:04.973089 13978 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:05.012018 13694 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:05.033097  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:05.032462  7330 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:05.024459 13961 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:05.043210 13579 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:05.044050  7253 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:16:05.044194 14003 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:05.085157  7257 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:05.044284 13582 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:05.040880 14021 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:16:05.044219  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:05.025333 14036 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:05.060123  7328 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:16:05.042215  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:05.130017  7335 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:05.001669 14029 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:05.074535  7330 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:16:05.077093 14020 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:05.078169 14025 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:16:05.081712  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:05.033154 13859 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:05.182554 14020 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:05.190040 14020 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:05.188580  7186 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:05.089144  7261 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:16:05.192226  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:05.084061 14003 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:04.991101 13865 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:05.128774 13824 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.082422 13961 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:16:05.133255  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.156945 13536 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:05.180357  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:05.181082  7262 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:05.183739  7332 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:16:05.189896 13859 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:05.083401  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1376) took 2062 ms. Trace:
I20260709 13:16:05.193511  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:05.052604 14092 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:05.194836  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 64337.7us
I20260709 13:16:05.217139  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.217235  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:05.118360 14037 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:05.147228  7260 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:05.220656  7260 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:05.203684  7328 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:16:05.205737  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:05.223109  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:05.192687 14021 consensus_queue.cc:1243] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:16:05.120975  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:05.197852  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:05.228116  7332 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:05.228230  7257 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:05.221635  7260 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:05.230259  7260 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:05.183153 14029 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:05.218921 14095 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:16:05.219410 13885 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:05.216145  7253 rpcz_store.cc:276] 0709 13:16:03.021318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.043216 (+2021898us) service_pool.cc:224] Handling call
0709 13:16:05.043678 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.080173 (+ 36495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.083303 (+  3130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.128134 14010 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:16:05.240388 13998 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:05.227481  7179 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:05.243047 14010 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:05.244266 14010 consensus_queue.cc:1243] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 22.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:16:05.232841  7185 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:05.211910 13824 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:05.208782 13846 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:05.250391  7328 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:05.245146  7185 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:05.261819  7258 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:05.281292  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:05.267863 14029 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:05.285319  7257 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
W20260709 13:16:05.286005  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 335981us
I20260709 13:16:05.288339  7329 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27. Ops: []
I20260709 13:16:05.296048  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.304363  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.310534  7260 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:16:05.289059  7185 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:05.309662  7225 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.516s (SENT) [suppressed 25 similar messages]
I20260709 13:16:05.353055  7185 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:05.357761  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 61812.8us
W20260709 13:16:05.367048  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 62776.2us
I20260709 13:16:05.368140  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.288399 13703 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:05.374431  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1192) took 1002 ms. Trace:
I20260709 13:16:05.249625 14037 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:05.212381 13978 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:05.380515  7889 rpcz_store.cc:276] 0709 13:16:04.372164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.372512 (+   348us) service_pool.cc:224] Handling call
0709 13:16:04.372870 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.396084 (+ 23214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.374117 (+978033us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b540002eed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:05.374360 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50918144}
I20260709 13:16:05.353821 13859 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:05.396817 13998 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:05.390307 13703 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:05.402415  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.347625 13960 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:16:05.363163 13571 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:05.425287  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 292762us
W20260709 13:16:05.432161  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.433557  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.374665 14045 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:05.458019 13856 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:05.460397 13703 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:05.425971 13885 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.433753 14044 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.646s	user 0.005s	sys 0.000s
I20260709 13:16:05.414400 13859 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:16:05.476907  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.474218 14100 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.243s	user 0.002s	sys 0.000s
I20260709 13:16:05.470726 13856 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.481856  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 172219us
I20260709 13:16:05.475533 13859 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:05.385830 14003 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:05.479660  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 111636us
W20260709 13:16:05.485730  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.514303  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.494553 14017 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:05.496436  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2452) took 3521 ms. Trace:
I20260709 13:16:05.560793  7329 rpcz_store.cc:276] 0709 13:16:01.974515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.979388 (+  4873us) service_pool.cc:224] Handling call
0709 13:16:01.979769 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.288865 (+3309096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.495921 (+207056us) spinlock_profiling.cc:243] Waited 3.3 s on lock 0x7b54003868d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:05.496282 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7589400448}
W20260709 13:16:05.499078 13983 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:16:05.513510  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:05.511966 13582 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:05.473670 13885 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:05.579761  7184 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:16:05.575521  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 62077.5us
W20260709 13:16:05.586658  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 153203us
I20260709 13:16:05.587519  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.516458 14036 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:05.593490 13288 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:05.575146 14108 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:16:05.594408 14036 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:05.578852 14105 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:05.590538 13582 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:05.511557 13856 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:05.595988 13824 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:05.634840 13582 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:05.636153 14036 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:05.636067 13582 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:05.636824 14036 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:05.638942 14105 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:05.643741  7185 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:16:05.646354  7185 pending_rounds.cc:85] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 7
I20260709 13:16:05.647671  7185 pending_rounds.cc:107] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:16:05.649426  7185 raft_consensus.cc:2889] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:05.647292 14037 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:05.656883 13885 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:05.658037 14104 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:16:05.660555 14101 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:16:05.664007 14099 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:16:05.665872 14038 consensus_meta.cc:287] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.701s	user 0.001s	sys 0.010s
I20260709 13:16:05.665694 14029 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:05.701344 14109 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:05.715683 14069 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:05.716146 13856 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:05.662966 14036 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:05.717144 13978 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:05.649277 13935 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:16:05.666383 14038 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:05.731305 14038 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:05.732652 14106 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:16:05.735080  7891 raft_consensus.cc:2393] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:05.742226  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.746170  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:05.753233  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:05.755470  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:05.756134  7257 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:16:05.757865  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:05.758534  7257 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:05.761235  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:05.763900  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.738574  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 112972us
I20260709 13:16:05.763618  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:05.768347  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:05.775868  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:05.771121 14012 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:05.784487 13288 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:05.771579  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:05.797343  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:05.815994  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:05.738237 14029 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:05.871423  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53916.8us
I20260709 13:16:05.819578  7254 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 13:16:05.820399  7152 leader_election.cc:336] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.951s (SENT)
W20260709 13:16:05.873642  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 53299.9us
W20260709 13:16:05.874425  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 106165us
W20260709 13:16:05.875514  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 288068us
W20260709 13:16:05.829574  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.877032  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.743108 13568 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:05.811890 13579 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.705s	user 0.008s	sys 0.005s
I20260709 13:16:05.887506  7260 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:16:05.888659 14030 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:05.889170 14030 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:16:05.889616  7079 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47554 (request call id 236) took 61753 ms (client timeout 15000 ms). Trace:
I20260709 13:16:05.889806 14102 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:05.890678  7178 raft_consensus.cc:606] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.891096  7178 raft_consensus.cc:614] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:05.891994  7180 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:16:05.891775  7862 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.893651  7862 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.795539 13995 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:16:05.912035  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.920433  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:05.922302  7258 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
W20260709 13:16:05.932235  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.874526 13571 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:05.874125 14103 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:05.877038 13983 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.898161 14020 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:05.889611 14030 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:05.922832 14029 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:05.930181 14001 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:05.904696 13980 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:05.957110  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:05.767314 14038 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.132s
W20260709 13:16:05.964121  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.982337  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.036936  7335 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:06.041791  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:05.988492 14103 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:05.821595 13846 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.112s
I20260709 13:16:05.996691  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2361) took 1208 ms. Trace:
W20260709 13:16:06.003546  7896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 934) took 2141 ms (client timeout 1766 ms). Trace:
I20260709 13:16:05.894804 14004 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.050890  7256 rpcz_store.cc:276] 0709 13:16:04.787841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.796350 (+  8509us) service_pool.cc:224] Handling call
0709 13:16:04.820179 (+ 23829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.841454 (+ 21275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.996324 (+1154870us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b540021a2d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:05.996572 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54047488}
I20260709 13:16:05.924893 13995 consensus_queue.cc:1243] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:16:05.904294 14037 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:16:05.939451 14045 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:05.944079 13568 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:16:06.045949  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.003599 13579 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:16:06.050973  7896 rpcz_store.cc:269] 0709 13:16:03.862259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.862491 (+   232us) service_pool.cc:224] Handling call
0709 13:16:05.994343 (+2131852us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b5400521f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:06.003441 (+  9098us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716691200}
I20260709 13:16:06.012246 13850 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.010583 13571 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:06.011911 14029 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:06.036144 13961 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.814s	user 0.004s	sys 0.009s
W20260709 13:16:05.987425  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 67138us
W20260709 13:16:06.088493  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 212718us
I20260709 13:16:06.095086  7256 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:06.149804  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:06.056358 14103 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:06.056990 14119 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:06.006295 13983 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.013753 14121 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.111s
I20260709 13:16:06.152897 14125 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.089851 13568 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.060197 14004 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.147493 13579 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:06.180294  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.161285  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.147218 13850 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:05.937881  7077 catalog_manager.cc:5697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 10 to 19, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 19 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.180296 13568 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:06.195310  7172 tablet_service.cc:1558] Processing DeleteTablet for tablet 242a63190870450082200759c7f513ab with delete_type TABLET_DATA_TOMBSTONED (TS 2ecdd7dc4a144f5aa0f2f91c7b94434d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47650
I20260709 13:16:06.207613 13579 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.161734 13961 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.196844 14133 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:06.191306 13859 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.004s
I20260709 13:16:06.196714  7890 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
W20260709 13:16:06.214958 14123 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:16:06.222059  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2482) took 1393 ms. Trace:
I20260709 13:16:06.222711  7334 rpcz_store.cc:276] 0709 13:16:04.828332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.831114 (+  2782us) service_pool.cc:224] Handling call
0709 13:16:04.831473 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.952241 (+120768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.221767 (+1269526us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001f4854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:06.221993 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261014400}
W20260709 13:16:06.227430  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.154089 14029 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:06.220470  7077 catalog_manager.cc:5697] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:06.230536  7077 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 12, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 12 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:16:05.890089  7079 rpcz_store.cc:269] 0709 13:15:04.136063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.144212 (+  8149us) service_pool.cc:224] Handling call
0709 13:16:05.889376 (+61745164us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:59.106363 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:59.115416 (+  9053us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:59.115504 (+    88us) write_op.cc:435] Acquired schema lock
0709 13:15:59.115535 (+    31us) tablet.cc:662] Decoding operations
0709 13:15:59.116797 (+  1262us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:59.116960 (+   163us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:59.117013 (+    53us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:15:59.145616 (+ 28603us) tablet.cc:701] Row locks acquired
0709 13:15:59.155935 (+ 10319us) write_op.cc:260] PREPARE: finished
0709 13:15:59.156156 (+   221us) write_op.cc:270] Start()
0709 13:15:59.156335 (+   179us) write_op.cc:276] Timestamp: P: 1783602959156075 usec, L: 0
0709 13:15:59.156358 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:59.159053 (+  2695us) log.cc:844] Serialized 2525 byte log entry
0709 13:15:59.962129 (+803076us) op_driver.cc:464] REPLICATION: finished
0709 13:16:00.230937 (+268808us) write_op.cc:301] APPLY: starting
0709 13:16:00.231057 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:00.235257 (+  4200us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:00.235376 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:00.424645 (+189269us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:00.425155 (+   510us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 13:16:00.425250 (+    95us) write_op.cc:312] APPLY: finished
0709 13:16:00.425896 (+   646us) log.cc:844] Serialized 65 byte log entry
0709 13:16:00.442240 (+ 16344us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:00.442566 (+   326us) write_op.cc:454] Released schema lock
0709 13:16:00.442666 (+   100us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:00.461676 (+ 19010us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:00.461711 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8058754,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":268496,"apply.run_cpu_time_us":14919,"apply.run_wall_time_us":230626,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":71714,"prepare.run_cpu_time_us":23784,"prepare.run_wall_time_us":210453,"raft.queue_time_us":531625,"raft.run_cpu_time_us":5899,"raft.run_wall_time_us":267452,"replication_time_us":805597,"thread_start_us":814467,"threads_started":4,"wal-append.queue_time_us":218019,"wal-append.run_cpu_time_us":51265,"wal-append.run_wall_time_us":2064450}]]}
W20260709 13:16:06.212862  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 165653us
W20260709 13:16:06.217226 14017 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.004s
I20260709 13:16:06.232369  7077 catalog_manager.cc:5697] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 13, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 13 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:06.256072 13850 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:06.215284 14133 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.261209 14133 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:06.261711  7259 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:06.262264 13437 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.263592 13858 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:06.265882 13437 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.267985 14103 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.269721 13437 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:06.270918  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.242650 14121 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.199599 14137 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:06.284808 14121 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.288939  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2476) took 1478 ms. Trace:
I20260709 13:16:06.289469  7333 rpcz_store.cc:276] 0709 13:16:04.810551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.810752 (+   201us) service_pool.cc:224] Handling call
0709 13:16:04.811206 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:04.841776 (+ 30570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.288489 (+1446713us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5400278654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:06.288835 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36092288}
I20260709 13:16:06.290036 14121 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:06.172241 14119 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.180699 14125 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.188627 13978 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:06.292860 14119 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:06.293329 13978 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:06.196105 14120 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:16:06.249799 14092 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.002s	user 0.009s	sys 0.005s
I20260709 13:16:06.293888 14030 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.279107 13858 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:06.295926 13858 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.296983  7255 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:16:06.297828  7259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2353) took 1521 ms (client timeout 1951 ms). Trace:
W20260709 13:16:06.298321  7336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2478) took 1484 ms (client timeout 1837 ms). Trace:
W20260709 13:16:06.298247  7259 rpcz_store.cc:269] 0709 13:16:04.776004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.778519 (+  2515us) service_pool.cc:224] Handling call
0709 13:16:06.296446 (+1517927us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400349ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:06.297755 (+  1309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3376073088}
W20260709 13:16:06.299145 13782 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:16:06.299865  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2749) took 1262 ms. Trace:
I20260709 13:16:06.300276 14028 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:06.300360  7183 rpcz_store.cc:276] 0709 13:16:05.037268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.512385 (+475117us) service_pool.cc:224] Handling call
0709 13:16:05.581687 (+ 69302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.582190 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.582238 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.595270 (+ 13032us) log.cc:844] Serialized 26 byte log entry
0709 13:16:05.766545 (+171275us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:05.766599 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.766707 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.299604 (+532897us) raft_consensus.cc:1685] finished
0709 13:16:06.299641 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.299795 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12082,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":118007,"threads_started":1,"wal-append.queue_time_us":269684}
I20260709 13:16:06.279315  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:06.302865 14121 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:06.279994  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2756) took 1160 ms. Trace:
I20260709 13:16:06.303471 14121 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.304230 14061 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:06.280040 13961 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:06.298728  7336 rpcz_store.cc:269] 0709 13:16:04.814157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.814299 (+   142us) service_pool.cc:224] Handling call
0709 13:16:06.298146 (+1483847us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b540013c754. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:06.298260 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56567168}
I20260709 13:16:06.304056  7184 rpcz_store.cc:276] 0709 13:16:05.119412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.783185 (+663773us) service_pool.cc:224] Handling call
0709 13:16:05.783609 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.784073 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.784113 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.784811 (+   698us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.068217 (+283406us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:06.068279 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.068376 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.279754 (+211378us) raft_consensus.cc:1685] finished
0709 13:16:06.279778 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.279927 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1680,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"thread_start_us":282875,"threads_started":1,"wal-append.queue_time_us":405759}
I20260709 13:16:06.216593 13859 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.295037 14092 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.305743  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:06.316504  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:06.198194 13571 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.313860  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:06.292716 14125 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:06.317145  7335 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:06.324376  7184 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:06.305290 13978 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:06.333328  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:06.333841  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 292124us
I20260709 13:16:06.335870  7225 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:06.337841  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 126141us
I20260709 13:16:06.345788  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:06.306279 13858 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:06.316201 14045 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.349638  7182 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:16:06.355708  7335 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:06.356104  7179 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:06.357906  7336 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:06.369704 14121 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:06.370348 14029 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.370518  7077 catalog_manager.cc:5697] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 15 to 17, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 17 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:06.372443  7329 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:16:06.299881 13568 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.374373 14029 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:06.375452 13568 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:06.355281 14103 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:06.359737 14045 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.380874 14045 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:06.403802  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:06.386649 14030 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:06.391237  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50580 (request call id 15) took 2772 ms. Trace:
I20260709 13:16:06.392170 13859 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:06.398772  7254 raft_consensus.cc:1217] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Deduplicated request from leader. Original: 15.12->[18.13-21.15]   Dedup: 18.13->[19.14-21.15]
W20260709 13:16:06.403908  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 68166.1us
W20260709 13:16:06.409202  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.410526  7254 pending_rounds.cc:85] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 13
I20260709 13:16:06.410864  7254 pending_rounds.cc:107] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:16:06.411023  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:06.411217  7254 raft_consensus.cc:2889] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:06.414997  7178 rpcz_store.cc:276] 0709 13:16:03.626733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.626948 (+   215us) service_pool.cc:224] Handling call
0709 13:16:06.391002 (+2764054us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54001b3fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9236853 00007fecee20460a 00007fece778a7d4 00007fece778a762 00007fece778a691 00007fece778a60c 00007fece77898c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:06.391137 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4862569728}
I20260709 13:16:06.418304  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:06.420009  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 181348us
W20260709 13:16:06.422492  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 179276us
I20260709 13:16:06.419567  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:06.432478  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:06.450302  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:06.450371  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:06.451942  7335 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:06.456842  7333 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:06.447779  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:06.453025  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:06.460600 14082 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:06.461088 14082 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.461488 14082 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:06.463594  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:06.466188 13837 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:06.466853 13837 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:06.372490  7077 catalog_manager.cc:5697] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 12 to 20, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 20 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:06.467841 13837 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:06.469830  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.418048 13969 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:06.470963 14009 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:06.471472 14009 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.471863 14009 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:06.475607  7225 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:06.477599 14092 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:06.477382 14082 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.478834 14137 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:06.479707 14137 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:06.474007  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:06.480369 14137 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:06.419833 14034 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:06.486945  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:06.487743  7336 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:06.487974 13865 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:06.468930  7077 catalog_manager.cc:5697] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:06.490675  7077 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 14 to 18, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 18 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:06.493274 14122 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.449s	user 0.000s	sys 0.001s
I20260709 13:16:06.492636  7077 catalog_manager.cc:5697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 17 to 18, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 18 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:06.494683 14040 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:06.497579 14046 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:06.512032  7187 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:06.482666  7225 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:06.514120 14034 raft_consensus.cc:2764] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:16:06.514748 13568 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:06.515960 14034 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:16:06.518703  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46726.7us
I20260709 13:16:06.434841 14030 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:06.418349 14067 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:16:06.525102  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2752) took 1486 ms. Trace:
I20260709 13:16:06.528949  7181 rpcz_store.cc:276] 0709 13:16:05.038280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.595414 (+557134us) service_pool.cc:224] Handling call
0709 13:16:05.605616 (+ 10202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.606003 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.606035 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.614529 (+  8494us) log.cc:844] Serialized 26 byte log entry
0709 13:16:05.737755 (+123226us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:05.737816 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.737913 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.492598 (+754685us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:06.519621 (+ 27023us) raft_consensus.cc:1685] finished
0709 13:16:06.519645 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.525025 (+  5380us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33789,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":21322624,"thread_start_us":81346,"threads_started":1,"wal-append.queue_time_us":297672}
I20260709 13:16:06.503762 14004 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:06.527241  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:06.533427  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 59501.8us
I20260709 13:16:06.518651 13965 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.518096 14034 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:16:06.546571 14138 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:06.556602  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:06.547777 14113 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:06.522912 13694 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.554169  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:06.557350  7893 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:16:06.525051 14141 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.566854 14012 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:06.568737 14012 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:06.568490 14147 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:06.569875 14147 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.570298 14147 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:06.568476 14141 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.574715  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:06.575971  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:06.575910  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:06.577416  7257 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:16:06.576350  7256 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 26. Current term is 27. Ops: []
I20260709 13:16:06.577601  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:06.580591  7887 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:06.552392 13703 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.529057 13961 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 13:16:06.584800  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 435084us
I20260709 13:16:06.599208  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:06.600047  7150 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:06.600221  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:06.601413  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:06.602941  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:06.603076  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:06.603695  7259 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:06.605216  7253 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:06.605749  7256 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:06.580471  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2754) took 1541 ms. Trace:
I20260709 13:16:06.606583  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:06.611837  7261 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:06.612802 14028 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:06.613416 14028 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.586302  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:06.616379  7257 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:16:06.529223 13969 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:16:06.584921  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2755) took 1543 ms. Trace:
I20260709 13:16:06.607144  7185 rpcz_store.cc:276] 0709 13:16:05.038838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.673223 (+634385us) service_pool.cc:224] Handling call
0709 13:16:05.673575 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:05.673940 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.673960 (+    20us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:05.687614 (+ 13654us) log.cc:844] Serialized 52 byte log entry
0709 13:16:06.232729 (+545115us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b1800306640. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:16:06.420786 (+188057us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:06.420829 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.420898 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.571335 (+150437us) raft_consensus.cc:1685] finished
0709 13:16:06.571362 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.580370 (+  9008us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":11720,"spinlock_wait_cycles":77487872,"thread_start_us":187854,"threads_started":1,"wal-append.queue_time_us":829450}
I20260709 13:16:06.588085  7859 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:06.560114 13795 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:16:06.586879 14046 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:06.584932 14045 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:16:06.593894 13703 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.594506 14082 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:06.571290 13694 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.596314 14009 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.597204 14148 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:06.561087 13965 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.494313  7077 catalog_manager.cc:5697] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 10 to 15, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 15 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:06.618719  7862 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:06.610903 14119 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.611155  7182 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:06.633740  7261 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
W20260709 13:16:06.641522  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 53497.4us
I20260709 13:16:06.606983 14141 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:06.649489  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:06.615727 14028 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:06.660027  7259 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:06.622308 13856 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:06.600220  7896 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:06.621995  7186 rpcz_store.cc:276] 0709 13:16:05.041741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.740945 (+699204us) service_pool.cc:224] Handling call
0709 13:16:05.741258 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.741466 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:16:06.006254 (+264788us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.584220 (+577966us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b18003a6f60. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:16:06.584459 (+   239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:06.584532 (+    73us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:16:06.584597 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.584694 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.584848 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33122,"prepare.queue_time_us":415812,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":5273,"raft.queue_time_us":410985,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"spinlock_wait_cycles":2341120,"thread_start_us":368712,"threads_started":2,"wal-append.queue_time_us":213743}
I20260709 13:16:06.699906  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1299) took 1830 ms. Trace:
W20260709 13:16:06.691231  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 72619.5us
I20260709 13:16:06.700480  7179 rpcz_store.cc:276] 0709 13:16:04.869370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.243919 (+374549us) service_pool.cc:224] Handling call
0709 13:16:05.244382 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.356477 (+1112095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.699647 (+343170us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400116f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:06.699843 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2542949248}
I20260709 13:16:06.701226  7862 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:06.607008 14041 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:16:06.607571 14029 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
W20260709 13:16:06.703037  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 145820us
I20260709 13:16:06.703477  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:06.711030  7185 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:16:06.646512 14133 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:16:06.703852  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 101211us
I20260709 13:16:06.607317 13782 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:16:06.706223  7862 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:06.706046  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:06.681978 14082 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.719230  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:06.720285  7182 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:06.711936  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:06.607885 14025 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:16:06.639657 14017 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:16:06.714957  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:06.725210  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:06.713634 13888 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:06.727397  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:06.700302 14046 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:06.733712  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:06.734292  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.734978  7150 connection.cc:256] RPC call timeout handler was delayed by -1.1486857520001195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
I20260709 13:16:06.726948 13837 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:06.737749  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:06.699581 13856 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:06.736276 13837 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.749095  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:06.749439  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:06.749684  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:06.713546 14133 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.693320 14119 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.750059 14053 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:16:06.762681 14107 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:06.766997  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:06.772917 14107 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:06.776115  7891 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 1093) took 1848 ms (client timeout 1718 ms). Trace:
I20260709 13:16:06.686067 14148 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.727769 13571 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:06.779520  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:06.806603  7892 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:06.804944  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:06.777113  7894 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:16:06.776548  7891 rpcz_store.cc:269] 0709 13:16:04.927682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.928376 (+   694us) service_pool.cc:224] Handling call
0709 13:16:06.775841 (+1847465us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b540049cd54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:06.776034 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1845952768}
I20260709 13:16:06.751816  7889 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:16:06.852316  7182 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:06.853955  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:06.766607 14118 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.771199  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:06.763823 13888 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:06.747877 13856 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:06.777725 13837 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:06.805477 14036 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.732494 14082 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.766973 13703 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:06.768276 13694 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:06.806835 14107 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:06.848515 13782 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.855721 14133 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:06.749115 13995 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.134s
I20260709 13:16:06.856918 14161 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:06.889567  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:06.888124  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 262130us
I20260709 13:16:06.857822 14037 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:06.878858 13888 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:06.880923 14136 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.810696 14147 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.888705 14020 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:06.909169  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 184152us
I20260709 13:16:06.892179 14160 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:06.879156 14118 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.904544 13969 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:16:06.926826  7180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3517) took 2092 ms (client timeout 2203 ms). Trace:
I20260709 13:16:06.928544  7072 catalog_manager.cc:5028] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): tablet 242a63190870450082200759c7f513ab (table test-workload [id=786759ba1b154200b9567dfd8516ad68]) successfully deleted
W20260709 13:16:06.930337  7180 rpcz_store.cc:269] 0709 13:16:04.834143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.976617 (+142474us) service_pool.cc:224] Handling call
0709 13:16:06.926518 (+1949901us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54001b3fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:06.926739 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075620096}
I20260709 13:16:06.891911 14036 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.932034  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:06.950781  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:06.913203 13888 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:06.951419  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:06.954216  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:06.957733  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:06.954464  7180 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:06.957269  7186 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:16:06.907781 13782 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.967150  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:06.919082 14171 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.929457 14119 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:06.972211  7334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:56808
W20260709 13:16:06.953495 14158 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
I20260709 13:16:06.976761  7334 raft_consensus.cc:606] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:06.977358  7334 raft_consensus.cc:614] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:06.954488 14009 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:06.991248  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:06.993852  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.997301  7892 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:07.002602  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:07.003736  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:07.004344  7333 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:06.916884 14037 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:06.916018 14136 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:06.911561 14161 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:07.020465  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53430.7us
I20260709 13:16:07.022166  7862 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:06.969535 14137 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:16:06.930040 14160 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.034613  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.036113  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:06.984104 14171 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.028241 13995 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:16:07.092263  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 138110us
I20260709 13:16:07.093392  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:07.098763  7182 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:07.078286 14173 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:07.079066 14148 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:07.010946 14167 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:16:07.066599 14139 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:07.082278  7187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 1284) took 3618 ms (client timeout 2013 ms). Trace:
I20260709 13:16:07.083961  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:07.150918  7892 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:16:07.147843  7187 rpcz_store.cc:269] 0709 13:16:03.464315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.472497 (+  8182us) service_pool.cc:224] Handling call
0709 13:16:07.082065 (+3609568us) spinlock_profiling.cc:243] Waited 3.01 s on lock 0x7b540036db54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:07.082180 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6912108288}
I20260709 13:16:07.154945  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:07.156196  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.157714  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.159231  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.159965  7187 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:07.162088  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:07.163003  7187 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:16:07.164065 14165 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:16:07.166054  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.077766 14037 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:07.122947  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.142330  7333 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
W20260709 13:16:07.142606  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 49333.7us
I20260709 13:16:07.148178 14139 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:07.170994  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:07.153735 14173 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:06.981073  7077 catalog_manager.cc:5697] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 10 to 19, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 19 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:07.160228 14082 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:07.192585  7187 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 13:16:07.193182  7187 pending_rounds.cc:85] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 10
I20260709 13:16:07.194941  7187 pending_rounds.cc:107] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:16:07.195339  7187 raft_consensus.cc:2889] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:07.195776  7187 pending_rounds.cc:107] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:16:07.196373  7187 raft_consensus.cc:2889] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:07.165206 14183 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:07.175486 14139 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:07.198915  7187 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:07.177096 14045 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:07.206489  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:07.184554 14147 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:07.210896  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:07.212486 14036 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:07.225396  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:07.229246 13983 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:07.232678 14136 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:07.194412 14021 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.028s
I20260709 13:16:07.215495 14045 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:07.222882 14164 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:16:07.220888 13782 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:07.220407 14017 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:07.243059  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.245836  7257 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:16:07.239996 14103 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:07.238688 14136 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.254774 14160 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:07.249570 14172 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:16:07.264626 14040 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:16:07.267771 14179 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:16:07.286092  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:07.282761 14156 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.397s	user 0.005s	sys 0.000s
W20260709 13:16:07.283658 14170 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:16:07.295725 14045 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.260617 13964 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:07.297080 13964 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.299448 13964 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:07.246654  7077 catalog_manager.cc:5697] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 18, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 18 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:07.261323 14136 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.305158 14147 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.305751 14147 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:07.307085 14138 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.738s	user 0.012s	sys 0.000s
I20260709 13:16:07.247925 14017 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.307606 14138 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:07.290589  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.309353  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.309427  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.310119 14017 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:07.310371  7257 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:16:07.294474 14155 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.433s	user 0.001s	sys 0.002s
I20260709 13:16:07.311354  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.248584 14173 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.311874  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:07.271405 14176 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:16:07.304800 13837 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.318812 13856 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.302013  7077 catalog_manager.cc:5697] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 15 to 17, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 17 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.313723  7253 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
W20260709 13:16:07.262171 14175 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:16:07.323724  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:07.330717  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.331820  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.332372  7261 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:07.333127  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.335902  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.316378 14040 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:07.346048  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:07.347575  7890 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:16:07.322969 14171 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:07.322831 14136 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:07.353793  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.354664  7253 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:07.355687  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:07.356784  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:07.357268  7253 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:07.361989  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:07.369879  7253 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:07.372900  7253 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:07.374599  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.375384  7253 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:07.339529 13888 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.376931  7253 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:16:07.391867  7253 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:16:07.392010  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:07.392942 13850 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:07.393227  7253 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:07.393605 13850 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.394148 13850 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:07.377919 14003 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:07.395843 14131 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:07.396296 14131 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:07.378824  7259 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:16:07.367050 14171 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:07.386435 13856 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:07.365475 14147 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:07.404451  7895 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:16:07.405675  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:07.407178  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:07.399904 14171 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.408910 14131 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:07.414139 14162 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.520s	user 0.000s	sys 0.002s
I20260709 13:16:07.414789 14131 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:07.416471 14153 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.603s	user 0.002s	sys 0.001s
I20260709 13:16:07.417778  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1414) took 1193 ms. Trace:
I20260709 13:16:07.418164  7260 rpcz_store.cc:276] 0709 13:16:06.224207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.224346 (+   139us) service_pool.cc:224] Handling call
0709 13:16:06.229756 (+  5410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.230122 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.230153 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.237435 (+  7282us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.387689 (+150254us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b180024dc00. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:16:06.622671 (+234982us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:06.622889 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.623276 (+   387us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.415673 (+792397us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:07.417510 (+  1837us) raft_consensus.cc:1685] finished
0709 13:16:07.417534 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.417709 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17049,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3306,"spinlock_wait_cycles":226129024,"thread_start_us":233580,"threads_started":1,"wal-append.queue_time_us":454063}
I20260709 13:16:07.420938 13888 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:07.421532  7260 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:16:07.422537 14154 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.693s	user 0.000s	sys 0.002s
I20260709 13:16:07.433897  7336 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:16:07.434418  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.427928  7077 catalog_manager.cc:5697] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 15, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 15 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:07.430346 14118 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:07.407302 13865 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:07.421087  7184 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:07.435220  7335 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:16:07.437752  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.439189  7331 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:07.403825 14136 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 13:16:07.448750  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.449782 13837 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:07.450526  7329 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [17.13-19.14]
I20260709 13:16:07.460848  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:07.461877  7336 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:07.452713  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:07.463604  7184 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:07.453769  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.453311  7330 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:07.466063  7335 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:16:07.467053  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.466945  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:07.467679  7335 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:07.467960  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:07.468276  7327 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:07.468552  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.468755  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:07.468853  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.429289 14171 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:07.482939  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.447178 14082 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:07.487249 14082 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.487744  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.489285  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.490784  7334 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:07.491068  7077 catalog_manager.cc:5697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 15 to 16, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 16 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:07.492076  7335 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:16:07.493002  7077 catalog_manager.cc:5697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.399093 14040 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.498246 13571 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:07.498785 13571 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:07.446687 14133 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
I20260709 13:16:07.473363  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:07.499719 14133 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.500280  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:07.502041  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:07.453640 13568 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.502722 13568 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.503144  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1417) took 1106 ms. Trace:
I20260709 13:16:07.503530  7254 rpcz_store.cc:276] 0709 13:16:06.396969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.398155 (+  1186us) service_pool.cc:224] Handling call
0709 13:16:06.398542 (+   387us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:06.412824 (+ 14282us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:07.281745 (+868921us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18004024c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fececc343c7 00007fece92469a7 00007fece92560bf 00007fece9256038
0709 13:16:07.347056 (+ 65311us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.404266 (+ 57210us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:07.405004 (+   738us) log.cc:844] Serialized 52 byte log entry
0709 13:16:07.405233 (+   229us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:07.405329 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.405396 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.502756 (+ 97360us) raft_consensus.cc:1685] finished
0709 13:16:07.502880 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.503074 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":545937,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":1859,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":5094,"spinlock_wait_cycles":27415296,"thread_start_us":122012,"threads_started":2,"wal-append.queue_time_us":104329}
I20260709 13:16:07.505035 13568 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:07.505718 13568 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:07.505914  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2758) took 1462 ms. Trace:
I20260709 13:16:07.506418 13694 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:07.472350  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.507516  7334 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:07.507659  7333 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:07.466763 14148 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:16:07.475831  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.482890 14130 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:07.483192  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.484001 14139 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.499230 13571 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:07.516516  7896 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:07.509240  7329 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:07.509137  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:07.506304  7178 rpcz_store.cc:276] 0709 13:16:06.043861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.421391 (+377530us) service_pool.cc:224] Handling call
0709 13:16:06.431348 (+  9957us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:06.611338 (+179990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.611377 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:06.612161 (+   784us) log.cc:844] Serialized 52 byte log entry
0709 13:16:06.715637 (+103476us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:06.861982 (+146345us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.884499 (+ 22517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.884625 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.412876 (+528251us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:07.505563 (+ 92687us) raft_consensus.cc:1685] finished
0709 13:16:07.505669 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.505835 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204951,"prepare.queue_time_us":113972,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":203844,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":5297,"spinlock_wait_cycles":65543808,"thread_start_us":102885,"threads_started":1,"wal-append.queue_time_us":193894}
I20260709 13:16:07.520280  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:07.520720 14139 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:07.521252  7893 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:07.526000 13579 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.502074 14133 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:07.515082 13981 consensus_queue.cc:1175] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" responder_term: 20 status { last_received { term: 20 index: 16 } last_committed_idx: 14 last_received_current_leader { term: 20 index: 16 } }
W20260709 13:16:07.530028  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 634587us
I20260709 13:16:07.531775  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:07.532395  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3717) took 2405 ms. Trace:
I20260709 13:16:07.532815  7262 rpcz_store.cc:276] 0709 13:16:05.126481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.225284 (+ 98803us) service_pool.cc:224] Handling call
0709 13:16:05.225601 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.219802 (+1994201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.219851 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.219912 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:07.219959 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.532161 (+312202us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5400059454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:07.532208 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.532332 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4585550592}
I20260709 13:16:07.534705  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:07.535537  7178 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:07.538293  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:07.490348 14082 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:07.561789  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:07.566126  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:07.571916  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:07.573163  7893 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:07.576417  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:07.578936  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 76947.7us
I20260709 13:16:07.580008  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:07.498806 14040 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:07.582846 14010 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:07.474480  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:07.514951  7184 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
W20260709 13:16:07.502192  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.585266  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.587045  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.605170  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:16:07.587594  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.483925  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.588671  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.589011  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.608664  7178 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:16:07.610231  7862 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:07.613540  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.614267  7184 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:16:07.607733  7254 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:07.614797  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:07.615196  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.616393  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:07.616672  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:07.613194  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.613220  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:07.617203  7182 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:16:07.593158  7150 leader_election.cc:336] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.837s (SENT)
W20260709 13:16:07.482079  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 80325.1us
I20260709 13:16:07.507055 13568 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:07.597260  7260 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:16:07.577877 14121 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:07.584391 14139 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:07.595597  7336 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:07.583932 14004 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.626988  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.588207 14069 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:07.658078 14069 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.658612 14069 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:07.665099  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2759) took 1074 ms. Trace:
I20260709 13:16:07.633368  7178 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:16:07.631532  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51663.8us
W20260709 13:16:07.631572  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 69955.9us
I20260709 13:16:07.585669 14131 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:16:07.578452 14029 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:16:07.645102 13568 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.628012 14121 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:07.614143 14166 consensus_queue.cc:1059] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:16:07.655038 14065 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.655697 14036 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:07.775125  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.628072 14197 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:07.654822 14004 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.657404  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.583549 14033 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:16:07.669663  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:07.630990  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:07.671738  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.803982  7186 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:07.672079  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.671787  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:07.622313 14133 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:07.667992  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:07.665759  7181 rpcz_store.cc:276] 0709 13:16:06.590785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.590938 (+   153us) service_pool.cc:224] Handling call
0709 13:16:06.593508 (+  2570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.616407 (+ 22899us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:06.616759 (+   352us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.545293 (+928534us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.579170 (+ 33877us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.579407 (+   237us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:07.579461 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.579560 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.664739 (+ 85179us) raft_consensus.cc:1685] finished
0709 13:16:07.664770 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.665009 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":663629,"prepare.queue_time_us":5166,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":30276,"raft.queue_time_us":697055,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7963,"spinlock_wait_cycles":30603136,"thread_start_us":286799,"threads_started":1,"wal-append.queue_time_us":400472}
I20260709 13:16:07.578867 14107 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:16:07.581024 13579 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.674186  7861 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:07.682029  7182 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
W20260709 13:16:07.754356  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.811846  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 180971us
I20260709 13:16:07.832926  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.811913 14166 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:07.680022 14147 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:07.812356 14004 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:07.818593  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 146877us
I20260709 13:16:07.846276  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:07.839094 13579 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:07.848553  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 180654us
I20260709 13:16:07.852478  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:07.774544 14036 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.675419 14025 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.169s
I20260709 13:16:07.871150  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.866561  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:07.874651  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 205032us
I20260709 13:16:07.876813  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:07.840493 14166 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.840838 14118 raft_consensus.cc:2764] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:16:07.848729 14147 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.862773 13536 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:07.597343  7077 catalog_manager.cc:5697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.864744 14036 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:07.817771 14065 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.897275  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:07.874738 14119 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:07.910004  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:07.896775 14003 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.001s
I20260709 13:16:07.883749 14130 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:07.887833 14053 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:07.892897 14166 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:07.895829 14147 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:07.909319 14107 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:07.917940  7257 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:07.910738 14025 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:07.888342 13782 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:16:07.924571  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:07.912024 13536 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:07.943780 13536 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.947185  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 1096) took 1210 ms. Trace:
I20260709 13:16:07.947798  7896 rpcz_store.cc:276] 0709 13:16:06.736624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.736995 (+   371us) service_pool.cc:224] Handling call
0709 13:16:07.946848 (+1209853us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400552b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:07.947095 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687678720}
I20260709 13:16:07.946604 14069 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.950798  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3739) took 1356 ms. Trace:
I20260709 13:16:07.951417  7256 rpcz_store.cc:276] 0709 13:16:06.594074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.599903 (+  5829us) service_pool.cc:224] Handling call
0709 13:16:07.950474 (+1350571us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b5400125a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:07.950709 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10736512}
I20260709 13:16:07.951465  7077 catalog_manager.cc:5697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 13 to 21. New cstate: current_term: 21 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.916913 14130 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.919425 14148 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:07.916442 14004 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:07.965605  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:07.961437  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 287318us
I20260709 13:16:07.961203  7862 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:07.959888  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:07.976198  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:07.977846  7228 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:07.900414  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:07.923887 14107 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:07.929914 14163 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.935s	user 0.004s	sys 0.016s
I20260709 13:16:07.930248 14178 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:07.930799 13969 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:07.931023 14045 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:07.897166 13865 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:16:07.924242 14019 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:07.919664 13850 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.002s
I20260709 13:16:07.977083  7333 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:07.987195  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:08.011392  7186 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
I20260709 13:16:07.990955  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:08.013065  7178 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:07.998723  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:07.928104 14025 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:08.019551 14025 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:07.952965 14069 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:08.023162 14069 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:08.023707 14069 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:08.024748 14069 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.956418 14130 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:08.028537 14139 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:07.957602 14148 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.030884 14019 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.033893 13981 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:07.957602 14121 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:07.980834 14053 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:16:07.981035 13824 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:16:08.005884  7181 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:08.010707  7183 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:08.016970  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.959007 14171 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.017910  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:07.954187  7077 catalog_manager.cc:5697] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 17, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 17 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:08.009513 14178 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:08.022879 14092 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:07.991875 14107 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:08.057427  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3538) took 1354 ms. Trace:
I20260709 13:16:08.057279  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:08.097512  7327 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:08.060949  7336 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:16:08.059473  7335 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:16:08.054141  7184 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:08.108768  7184 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:08.110368  7184 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:07.956990 14065 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:08.115020  7184 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:08.090590  7261 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:16:08.094138  7187 rpcz_store.cc:276] 0709 13:16:06.703013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.372387 (+669374us) service_pool.cc:224] Handling call
0709 13:16:07.372697 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.613078 (+240381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.613126 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.613648 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.863033 (+249385us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:07.863096 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.863192 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.057195 (+194003us) raft_consensus.cc:1685] finished
0709 13:16:08.057218 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.057361 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":251807,"raft.queue_time_us":248987,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":33704,"thread_start_us":249010,"threads_started":1,"wal-append.queue_time_us":417022}
I20260709 13:16:07.981391 14003 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:08.119256  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 218927us
I20260709 13:16:08.046272  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:08.043269  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:08.116839  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 123660us
I20260709 13:16:08.002753 13969 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:08.000769 13978 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:08.138648  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:08.140139  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:08.068395 13858 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:16:07.959065 13571 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.043982 14148 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:08.154961  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:08.155921 14037 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:08.044467 14119 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:08.034533 14019 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:07.992305 14004 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 13:16:08.044225 14020 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:08.182976 14020 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.185536 14020 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:08.186252 14020 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:08.071422 14010 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:08.153470  7256 raft_consensus.cc:2393] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:08.188462  7180 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:08.188947  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2768) took 1275 ms. Trace:
I20260709 13:16:08.190928 13694 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:08.152860 13782 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:08.063009 13965 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:08.137977 14065 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:08.163220 14025 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.152225 13703 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.057812 14166 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.117901 14177 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:16:08.156879 14033 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:16:08.034533 13981 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:08.051693 14161 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:08.141201 14160 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:08.177767  7327 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:16:08.137198 14133 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:08.137074 14197 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:08.072696 14139 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 13:16:08.062198 14147 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.018783 13850 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.189440  7179 rpcz_store.cc:276] 0709 13:16:06.913785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.431896 (+518111us) service_pool.cc:224] Handling call
0709 13:16:07.467499 (+ 35603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.628331 (+160832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.628366 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.628979 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.919382 (+290403us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:07.919427 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.919502 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.188686 (+269184us) raft_consensus.cc:1685] finished
0709 13:16:08.188712 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.188873 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195054,"raft.queue_time_us":160607,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":13208,"thread_start_us":275089,"threads_started":1,"wal-append.queue_time_us":524144}
I20260709 13:16:08.203202  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2365) took 3414 ms. Trace:
I20260709 13:16:08.204048  7253 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:08.158660 13858 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:08.239326 13960 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:08.169231 13978 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:08.239241  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:08.157382 13824 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 13:16:08.304702  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:08.308189  7896 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:08.248541  7184 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:16:08.309273  7184 pending_rounds.cc:85] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 13
I20260709 13:16:08.309612  7184 pending_rounds.cc:107] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:16:08.309937  7184 raft_consensus.cc:2889] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:08.270584  7258 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:16:08.204576 13782 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:08.274029  7255 rpcz_store.cc:276] 0709 13:16:04.789057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.942997 (+153940us) service_pool.cc:224] Handling call
0709 13:16:06.296594 (+1353597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.297401 (+   807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.202895 (+1905494us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400349ed0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:08.203099 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3052416768}
I20260709 13:16:08.312122  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1317) took 1125 ms. Trace:
W20260709 13:16:08.246883 14009 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.016s	sys 0.002s
I20260709 13:16:08.201265 13694 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.283624 13960 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:08.319420 13960 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:08.321945 14190 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.945s	user 0.004s	sys 0.000s
I20260709 13:16:08.244616 14019 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:08.323371 14019 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.324306 13983 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:08.324898 13983 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:08.314520 13782 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:08.328101 14025 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:08.271515 14160 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:08.329828 14160 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.331154 14160 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:08.293756 13571 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:08.295392 13858 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.295464 14171 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:08.299388 13981 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:08.303165  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 329844us
I20260709 13:16:08.349186  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:08.312620  7184 rpcz_store.cc:276] 0709 13:16:07.186833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.617944 (+431111us) service_pool.cc:224] Handling call
0709 13:16:07.618317 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.054014 (+435697us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400350d20. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece923e1c0 00007fece923f231 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c
0709 13:16:08.310469 (+256455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.312034 (+  1565us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500943104}
W20260709 13:16:08.235483  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 345407us
I20260709 13:16:08.179905 14119 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:08.318920 13856 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:16:08.338969  7328 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:08.217794 14065 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:08.318487 14009 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.016s	sys 0.004s
W20260709 13:16:08.355983  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 215899us
I20260709 13:16:08.384565  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:08.357285  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 202434us
I20260709 13:16:08.386056  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:08.199306 14178 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.364832  7896 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:16:08.273573 14173 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:16:08.247630 13703 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.392750  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:08.403558  7327 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:08.396045  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:08.404538  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.406396  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:08.326037 13983 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.361883 14082 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.425292  7150 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:08.392028 13858 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:08.437767  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:08.449787  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.414155 13824 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:08.460493  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:08.464711  7896 raft_consensus.cc:2393] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 15: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:08.458176  7184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:16:08.465826  7184 raft_consensus.cc:606] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:08.466239  7184 raft_consensus.cc:614] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:08.471163  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 491043us
I20260709 13:16:08.369976 13935 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:16:08.425596 14208 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:08.495013  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:08.494885  7329 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:16:08.422271 14171 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:08.420969 14148 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:08.426944 14004 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:08.427253 14141 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:08.433336 14133 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.423417 14197 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.316139  7077 catalog_manager.cc:5697] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 18, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 18 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:08.496276  7895 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:16:08.768656  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:08.831012  7327 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:08.497735  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:08.832738  7893 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:08.789988  7896 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:08.840924  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2418) took 1399 ms. Trace:
I20260709 13:16:08.456171 14025 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:08.795229  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:08.560468 14218 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 13:16:08.844241  7302 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.018s	sys 0.052s
I20260709 13:16:08.766692  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:08.743646  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 263369us
I20260709 13:16:08.538969  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:08.851089  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:08.841770  7331 rpcz_store.cc:276] 0709 13:16:07.441320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.594947 (+153627us) service_pool.cc:224] Handling call
0709 13:16:07.595913 (+   966us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:07.673533 (+ 77620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.673564 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:08.072228 (+398664us) spinlock_profiling.cc:243] Waited 83.9 ms on lock 0x7b18003d96c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a
0709 13:16:08.072662 (+   434us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b2c0013d8c8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:16:08.073524 (+   862us) log.cc:844] Serialized 52 byte log entry
0709 13:16:08.312176 (+238652us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:08.312214 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.312300 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.572999 (+260699us) raft_consensus.cc:1685] finished
0709 13:16:08.573030 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.840837 (+267807us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88470,"raft.queue_time_us":82878,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":24947,"spinlock_wait_cycles":225921024,"thread_start_us":238196,"threads_started":1,"wal-append.queue_time_us":497029}
W20260709 13:16:08.490381 14220 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.277s	user 0.001s	sys 0.001s
I20260709 13:16:08.463223 13579 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:08.618180 14166 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:08.583038 14130 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.000s
W20260709 13:16:08.559700 14215 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:16:08.871945  7302 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.018s	sys 0.052s
I20260709 13:16:08.873057  7891 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:08.872655  7894 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
W20260709 13:16:08.845162 14139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.012s	sys 0.027s
I20260709 13:16:08.563109 14029 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:08.827865 13983 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:08.495954 14173 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.882776  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.473686 13824 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:08.661741 14227 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:08.727837 14065 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:08.661441 14230 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:08.744457 14119 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:08.833858 14033 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:08.433246 14082 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.847092 14025 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.709501 14223 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:08.905678 14029 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:08.627396 13703 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:08.861486 14107 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.726s	user 0.013s	sys 0.000s
I20260709 13:16:08.827090 14131 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
W20260709 13:16:08.900033  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 681814us
I20260709 13:16:08.918354 13824 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:08.861215 13850 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:08.890504 14036 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.974s	user 0.013s	sys 0.001s
W20260709 13:16:08.890065 14069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.000s	sys 0.025s
I20260709 13:16:08.662029 13960 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.883721 13579 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:08.847198 14148 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.895561 14209 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.851619 14141 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:08.897454 14003 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.013s	sys 0.018s
I20260709 13:16:08.474525 13978 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:08.906749 14139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.013s	sys 0.027s
I20260709 13:16:08.902132 13837 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.923252 14186 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.624s	user 0.011s	sys 0.007s
I20260709 13:16:08.899762 14210 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:08.540681 14221 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:16:08.916245 13969 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.748s	user 0.014s	sys 0.000s
I20260709 13:16:08.852541 14208 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.913938 13995 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.938148  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:08.939347 14107 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.903478 14130 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.925732 14161 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:08.977842 14161 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.980424 14161 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:08.928781 14226 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.981853 13858 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
I20260709 13:16:08.982285 14226 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.931864 14025 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:08.965898 14029 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:08.946782 14069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.026s
I20260709 13:16:08.985703  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2422) took 1536 ms. Trace:
I20260709 13:16:08.986200  7334 rpcz_store.cc:276] 0709 13:16:07.452032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.075486 (+623454us) service_pool.cc:224] Handling call
0709 13:16:08.075984 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.076454 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:08.076858 (+   404us) log.cc:844] Serialized 14 byte log entry
0709 13:16:08.884218 (+807360us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.889604 (+  5386us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.889785 (+   181us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:08.889821 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.889897 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.985457 (+ 95560us) raft_consensus.cc:1685] finished
0709 13:16:08.985481 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.985639 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27898,"prepare.queue_time_us":15819,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":225149,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":22303,"thread_start_us":760977,"threads_started":2,"wal-append.queue_time_us":871165}
I20260709 13:16:08.987664 14082 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:08.988432  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:08.989123  7334 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:16:08.936233 14223 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.964143 14221 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.992623 14130 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:08.970999  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:08.939878 14033 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.937779 14119 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:08.959975 13837 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.971855 13579 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.969398 13969 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:08.983186 14160 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.652s	user 0.014s	sys 0.000s
I20260709 13:16:08.971506 13995 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.992903 14221 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:08.896253  7327 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
W20260709 13:16:08.957594 14003 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.013s	sys 0.018s
I20260709 13:16:08.917732 14173 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.927728 14227 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.931841 14230 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:08.990548  7334 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:16:09.005594  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.105005  7895 raft_consensus.cc:2410] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:16:08.950855 14036 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:08.970463 14210 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:09.086324 14236 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:16:09.094533  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 99951.8us
I20260709 13:16:08.996429 14213 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:16:09.103170  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.066916 14171 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:09.121302  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.992658 14223 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:09.008924 14224 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:16:09.128976  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2771) took 1144 ms. Trace:
I20260709 13:16:09.129426  7182 rpcz_store.cc:276] 0709 13:16:07.984543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.984699 (+   156us) service_pool.cc:224] Handling call
0709 13:16:07.985101 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.044791 (+ 59690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.044841 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.045509 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.414061 (+368552us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:08.414122 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.414204 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.128683 (+714479us) raft_consensus.cc:1685] finished
0709 13:16:09.128712 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.128903 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59156,"raft.queue_time_us":60791,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"thread_start_us":368045,"threads_started":1,"wal-append.queue_time_us":829225}
I20260709 13:16:09.107997  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2507) took 1498 ms. Trace:
I20260709 13:16:09.132529  7334 rpcz_store.cc:276] 0709 13:16:07.609344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.989906 (+1380562us) service_pool.cc:224] Handling call
0709 13:16:08.990288 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.107678 (+117390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.107938 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:09.094803 14065 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:09.121531 14245 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.137517 14245 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.144011 14036 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.146512 14230 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.148518 14245 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:09.095798 13782 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.768s	user 0.007s	sys 0.007s
I20260709 13:16:09.151995 13782 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.118438  7302 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:08.954655 14209 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.157043 14209 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.093354 14069 raft_consensus.cc:2764] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:16:09.087860 14107 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.088999 14141 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.095160 13579 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:09.089020 14033 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.163889 13837 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:09.164408  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2769) took 1181 ms. Trace:
I20260709 13:16:09.121057 14213 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.165012 14213 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:09.166340 13782 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.168964 13995 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:09.169193 14226 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.170272  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2393) took 1983 ms. Trace:
I20260709 13:16:09.172180 14173 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.172443  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.177016 13969 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.180344 14178 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:09.184754  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2498) took 1746 ms. Trace:
I20260709 13:16:09.185261  7328 rpcz_store.cc:276] 0709 13:16:07.437823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.437946 (+   123us) service_pool.cc:224] Handling call
0709 13:16:07.452769 (+ 14823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.369101 (+916332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.184402 (+815301us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b540013c754. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:09.184663 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037519232}
I20260709 13:16:09.093716 13960 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.112123 13858 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:09.170790  7253 rpcz_store.cc:276] 0709 13:16:07.186531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.394053 (+207522us) service_pool.cc:224] Handling call
0709 13:16:08.202116 (+808063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.274704 (+ 72588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.169980 (+895276us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b540009a6d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:09.170180 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849337216}
I20260709 13:16:09.149257 14227 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.149889 14148 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.152621 14210 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.122334  7330 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 13:16:09.084244  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 289134us
I20260709 13:16:08.947439  7077 catalog_manager.cc:5697] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 17, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 17 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:09.164881  7180 rpcz_store.cc:276] 0709 13:16:07.983072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.983289 (+   217us) service_pool.cc:224] Handling call
0709 13:16:07.983697 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.189011 (+205314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.164112 (+975101us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540039cbd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:09.164329 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470279040}
W20260709 13:16:09.196952  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 78615us
I20260709 13:16:09.203433  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2515) took 1587 ms. Trace:
I20260709 13:16:09.203462  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:09.200762  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:09.202296 14065 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.208015 14065 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:09.208331 14232 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.499s	user 0.007s	sys 0.003s
I20260709 13:16:09.197844 14136 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:09.210853 14130 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:09.196214 13858 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.211613 14130 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.192935 13850 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:09.213348 13850 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.113189  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.204017  7330 rpcz_store.cc:276] 0709 13:16:07.615717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.121655 (+1505938us) service_pool.cc:224] Handling call
0709 13:16:09.122031 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.203116 (+ 81085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.203361 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:09.233166  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:09.214332 14130 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:09.235325  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.133911 14171 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.235963 14210 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.258240 14241 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:16:09.272921 14208 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.274083 14171 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.274688 14210 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.277328 14210 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:09.238432 14226 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:09.278241 14226 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:09.279093  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.242214 14148 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:09.281491 14004 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:09.253608 14130 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:16:09.241456 13782 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:09.295264  7180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:16:09.294438 14004 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.284370 14226 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:09.296976 14160 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:16:09.298592 14119 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:16:09.300944 14119 consensus_queue.cc:1243] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:16:09.301493 14119 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:09.301841 14119 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:09.298817 14250 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:09.303736 14250 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.297914 14244 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:09.308852 14244 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:09.309438 14244 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:09.311878 14250 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.299846 14160 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:09.314158 14160 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:09.315310 14160 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.317680  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.318939 13846 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:09.319422 13846 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:09.317101 14160 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:09.321651  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.322532  7891 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 22: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:09.316219 14213 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.326992 14119 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.328022  7335 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:16:09.328891  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.329311 13850 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.264297 14036 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:09.329383  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2429) took 1117 ms. Trace:
I20260709 13:16:09.332026  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.340788  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.341483  7336 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 27.
I20260709 13:16:09.279860 14118 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:09.331171  7335 rpcz_store.cc:276] 0709 13:16:08.212275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.173628 (+961353us) service_pool.cc:224] Handling call
0709 13:16:09.174083 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.328518 (+154435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.329109 (+   591us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540013cc54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:09.329322 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353363712}
W20260709 13:16:09.343973  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.320343 13846 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.321208  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:09.346679  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.346352  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:09.347306  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.348634  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:09.349692 14250 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:09.350172 14250 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:09.350595 14250 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:09.351377  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.352341  7186 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:09.350382  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2432) took 1133 ms. Trace:
I20260709 13:16:09.354921 13579 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:09.283270 14107 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.322081 14226 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.358563  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:09.362993  7184 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:09.363770  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 111532us
I20260709 13:16:09.364120 13978 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:09.365660  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:09.367504  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:09.369472 14208 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:09.358742  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:09.370970  7335 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:09.371595  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:09.373183  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.373741  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:09.375154 13694 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:09.375622 13694 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.375988 13694 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:09.379876 14065 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:09.380151  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:09.380940  7181 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:09.380570 14065 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.370936 13850 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:16:09.382848 14227 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:09.383456 14227 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.384212 13850 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:09.385020 13960 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:09.385594 13960 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.388641  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:09.389546 14173 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.390086 14034 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:09.390498 14034 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:09.391381 14034 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.392412 14034 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:09.360630  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.361313  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:09.360348 14107 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.297096 13858 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:09.398716  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.399142  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:09.357487 13865 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:09.419425  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.420329  7261 raft_consensus.cc:2410] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:16:09.420336  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.419072  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.400000  7179 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:09.394418  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:09.398752  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.370352 14208 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:09.355547  7328 rpcz_store.cc:276] 0709 13:16:08.216536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.186240 (+969704us) service_pool.cc:224] Handling call
0709 13:16:09.197679 (+ 11439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.198295 (+   616us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:16:09.247480 (+ 49185us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.289903 (+ 42423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.290468 (+   565us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:09.293829 (+  3361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.350111 (+ 56282us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.350301 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53966,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":558,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":39940,"threads_started":1}
I20260709 13:16:09.328850 14119 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:09.344568 14147 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:09.418802  7180 raft_consensus.cc:606] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Received request to transfer leadership to TS c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:09.421160  7256 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:09.433115  7184 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:16:09.431859  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.435038  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.435374  7180 raft_consensus.cc:614] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:09.436378  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:09.436220  7261 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:09.437727  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:09.438391  7261 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:09.399587  7335 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:09.437880  7254 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 27: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:09.441042 14256 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.441673 14256 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.355964 13579 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.444593 13579 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.310612 14244 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.343247  7077 catalog_manager.cc:5697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 19, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 19 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:09.448855 14113 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:09.448710  7077 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 5 to 11, term changed from 11 to 18, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to <none>, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:09.330575 14036 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.450826 14131 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:09.451488 14131 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.453157 14036 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.453619 14131 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.330833 13824 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.436299  7256 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:09.454116  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:09.459154  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.459939  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:09.457604  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.399407 13846 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:09.446403 14244 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:09.470520  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:09.473392  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.477596  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.469424  7260 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:09.472436  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:09.456176 14226 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.393244 14242 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:09.491993  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2777) took 1477 ms. Trace:
I20260709 13:16:09.492589  7178 rpcz_store.cc:276] 0709 13:16:08.014573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.047477 (+ 32904us) service_pool.cc:224] Handling call
0709 13:16:08.047840 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.184298 (+136458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.184330 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:08.184376 (+    46us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:16:08.184408 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.491674 (+1307266us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540017e154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:09.491744 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.491916 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313237376}
I20260709 13:16:09.484081  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:09.484308  7187 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:09.484824  7186 raft_consensus.cc:2410] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:16:09.486886  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:09.488745  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.478904  7895 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:09.489763  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:09.509815  7891 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:09.345566 13782 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.490088  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.519110  7259 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:09.521468  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.514281  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.522344  7261 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:09.522771  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:09.523922  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.359484 14118 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.454173 14131 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.524721  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.525481  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.423017 14207 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:09.393342 14178 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 13:16:09.530017  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:09.530176  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:09.454746 14235 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:09.540915  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.565431  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.534521  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:09.534055  7260 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:09.574692  7254 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:09.541863  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.545935  7182 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:16:09.473001 13579 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:09.473663 14241 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:09.471864 14036 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:09.516876 14249 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:16:09.390098 14173 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.553431 14226 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.516120 14004 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:09.475286 13960 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.556262  7259 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:09.558939  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:09.560371  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.611554  7336 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:09.577082  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.612540  7182 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:09.613608  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.613706  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:09.580579  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.583437  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.540210 13856 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:09.543598 14065 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.594077  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.617498  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:09.623189  7186 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:09.597690  7896 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: [17.14-17.14]
W20260709 13:16:09.599975  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.581369 13858 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:09.625245  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:09.558045 14171 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.558255 14003 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.562450 14025 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.006s
W20260709 13:16:09.607160  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.607064  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:09.607932  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:09.608469  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.629525  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.483683 14139 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:09.616032  7179 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:09.616572  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.614491  7182 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 27.
I20260709 13:16:09.637084  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:09.637779  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2383) took 2453 ms. Trace:
I20260709 13:16:09.638195  7258 rpcz_store.cc:276] 0709 13:16:07.184082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.384619 (+200537us) service_pool.cc:224] Handling call
0709 13:16:07.953255 (+568636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.310882 (+357627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.636704 (+1325822us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b5400125a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:09.637607 (+   903us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b5400125a50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:09.637726 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035053824}
I20260709 13:16:09.533555 14253 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:09.639429  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:09.639967  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.631577  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:09.595075 14160 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:09.561617 14131 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.657034  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.629619  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:09.637920  7182 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:16:09.632376  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:09.654143  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.659286  7333 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:09.660526  7178 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:09.660369  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.649329  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:09.650317  7258 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:09.662418  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.653663  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.663159  7186 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:09.661147  7333 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:09.649585  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.615420 14004 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:09.667676  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.666783  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:09.673712  7333 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:09.671759  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:09.673926  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.563059 14207 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.675357  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:09.681742  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.676697  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.674929  7186 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:16:09.682453  7260 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:09.668237  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.624686 14036 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:09.634960 14266 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.648699 14227 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.677691  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.699012  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.699687  7261 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:09.700896  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:09.673329 14063 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:09.648394 14213 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:09.688212  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.706013  7179 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:09.706503  7259 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:09.676159 14004 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:09.610342 13579 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:16:09.657688 14178 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:09.653039 14065 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:09.653146 13858 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.653321 14160 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.603937 14241 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.730882 14160 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:09.732595 14241 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.574033 14235 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.735571 14235 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.737133 13782 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.741120  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.742132 13824 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.742512  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2504) took 2208 ms. Trace:
I20260709 13:16:09.743409 13824 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:09.744059 13824 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.743052  7329 rpcz_store.cc:276] 0709 13:16:07.534410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.192324 (+657914us) service_pool.cc:224] Handling call
0709 13:16:08.192809 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.830251 (+637442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.742215 (+911964us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54001f4ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:09.742440 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693621120}
I20260709 13:16:09.746925  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.682384  7333 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 14.
W20260709 13:16:09.748623 14255 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:16:09.750566  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.751336  7333 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:09.751744 14121 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:09.752202  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.760664  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:09.762106  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:09.763302  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.764199  7183 raft_consensus.cc:2410] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 22 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:16:09.694306  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.714679 14178 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.767402 14256 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.767802 14178 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:09.695528 14266 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.621374 14226 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:09.406986 13983 consensus_queue.cc:1175] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" responder_term: 18 status { last_received { term: 15 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:09.701491  7261 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:09.754295 14270 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:09.776502 14270 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:09.776964 14173 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.667346 13856 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.702991  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.778023  7260 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:16:09.777890 13856 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.779160  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.676959 14253 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:09.702507 14210 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:16:09.824576  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.646988 14025 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.684828 14133 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:09.680488  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:09.647473 14003 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.713212  7336 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:09.691202  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.868458  7182 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
W20260709 13:16:09.780635 14259 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:16:09.653434 14139 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.896104 14139 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.897518  7254 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:09.898770 14003 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.876003 14065 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:09.901012 14065 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.875765 14173 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.902333 14173 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.904738 14173 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.723290 14107 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:09.712287 14257 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:16:09.709769 14250 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:09.705863 14063 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:09.727078  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.924906  7259 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:09.741415 13437 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:09.765811  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:09.956318 13437 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:09.956540  7256 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:09.961457 13536 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.780507  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:09.963061  7260 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:09.693132  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.917464 14019 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.664932 14269 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:16:09.838155  7330 raft_consensus.cc:2368] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:09.774027  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:09.969789  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.970204  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.970757  7330 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 19: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:09.858981 14210 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:09.784512  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 98753.6us
I20260709 13:16:09.820592  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:09.845402 14271 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:16:09.849174  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:09.973483 14025 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.973805  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1116) took 1619 ms. Trace:
W20260709 13:16:09.973858  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 124818us
I20260709 13:16:09.975113 13856 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.972527  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:09.844924  7891 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
W20260709 13:16:09.851297 14261 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.229s	user 0.000s	sys 0.003s
I20260709 13:16:09.976579  7225 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:09.977555  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:09.978907 14034 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.005s
I20260709 13:16:09.978979  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.853283  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:09.980449  7180 raft_consensus.cc:2410] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 22 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:16:09.980754  7889 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
W20260709 13:16:09.981285 13850 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.597s	user 0.005s	sys 0.005s
I20260709 13:16:09.982203 13850 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:09.854938  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.982769 14063 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:09.855969  7261 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:09.983934  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:09.984675  7261 raft_consensus.cc:2368] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:09.972487  7329 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:09.986189  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:09.855893 14226 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:09.986765  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1117) took 1632 ms. Trace:
I20260709 13:16:09.987195  7329 rpcz_store.cc:276] 0709 13:16:08.354463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.985941 (+1631478us) service_pool.cc:224] Handling call
0709 13:16:09.986232 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.986422 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.986445 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.986484 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:09.986515 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.986568 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.986708 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:09.988116 13858 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:09.988387  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:09.711244 14036 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:09.856722  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.857949 13824 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:09.859467  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.567987  7077 catalog_manager.cc:5697] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 12 to 14, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 14 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:09.858981  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:09.855803  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 207937us
W20260709 13:16:09.920020 13694 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.010s
I20260709 13:16:09.652520 14171 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.864418 13960 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.136s
I20260709 13:16:09.892120  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.909862  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:09.911363  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:09.916927  7254 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:10.012573  7335 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:09.976639 14221 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.874s	user 0.015s	sys 0.007s
I20260709 13:16:09.922251  7185 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:10.013382  7255 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:09.928931 14266 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.950645 14118 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:09.867267 14133 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.971920 14210 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:09.747404  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:09.982658  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.855333 14265 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:09.974305  7330 rpcz_store.cc:276] 0709 13:16:08.354135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.971409 (+1617274us) service_pool.cc:224] Handling call
0709 13:16:09.971759 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.973406 (+  1647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.973448 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.973502 (+    54us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:09.973546 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.973634 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.973749 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3968}
W20260709 13:16:10.038266  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 290921us
I20260709 13:16:10.038836  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:10.002542 14107 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.991971  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.990206  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.971637  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.996290  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.985090  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:10.046115  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 61135.9us
I20260709 13:16:10.011799 14131 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:10.051368  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:09.998839  7178 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:10.052003  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:10.052702  7333 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:16:09.962078 13536 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:09.915256 14267 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.001003  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:10.005003  7262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.032s	sys 0.020s
W20260709 13:16:10.059842  7262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.032s	sys 0.020s
W20260709 13:16:10.005264  7301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.020s	sys 0.031s
W20260709 13:16:10.060520  7301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.020s	sys 0.031s
I20260709 13:16:10.004755  7256 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:10.064368  7256 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:16:10.008147  7260 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:10.008387  7329 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:16:09.874111  7181 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:09.971659 14207 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:10.020994  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:09.996330 14034 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:09.993358 13856 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:09.993459 14036 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:10.051203 14265 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.086234 13856 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:10.089089 14265 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:10.089334 13856 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:10.089867 14136 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:10.091110 14256 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:10.091733 14256 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:10.001055 14045 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:09.992038  7180 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:16:10.097705  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:10.098487  7180 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:16:10.047813 13935 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:10.047009  7150 leader_election.cc:400] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:10.102274  7150 leader_election.cc:403] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:16:10.102926  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56078us
W20260709 13:16:09.849268  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 65484.2us
I20260709 13:16:10.107487  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:10.021801 14221 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:10.067194  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1118) took 1712 ms. Trace:
I20260709 13:16:10.022861  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:10.111743  7329 rpcz_store.cc:276] 0709 13:16:08.354772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.988404 (+1633632us) service_pool.cc:224] Handling call
0709 13:16:09.989381 (+   977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.066933 (+ 77552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.067139 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.071776  7256 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: [22.13-22.13]
W20260709 13:16:10.112332  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 89574.7us
I20260709 13:16:10.113301  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:10.113976  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:10.075165 14141 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:10.109179 13856 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.119437 14069 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:10.119722  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:10.119925 13856 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.120816 14177 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:10.121621 14034 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:10.122097 14034 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:10.074651 14267 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:10.124325 14243 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.020s	user 0.004s	sys 0.000s
I20260709 13:16:10.124980 14267 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:10.127521 14171 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:10.129156  7254 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:10.129642  7254 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:10.132189  7260 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:16:10.127521  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2499) took 2689 ms. Trace:
I20260709 13:16:10.134106  7332 rpcz_store.cc:276] 0709 13:16:07.438221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.439904 (+  1683us) service_pool.cc:224] Handling call
0709 13:16:07.440557 (+   653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.467449 (+ 26892us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:08.288667 (+821218us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b18001e70c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fececc343c7 00007fece92469a7 00007fece92560bf 00007fece9256038
0709 13:16:08.757302 (+468635us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.107943 (+350641us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.108161 (+   218us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.108622 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.108735 (+   113us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:09.108770 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.108842 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.141999 (+ 33157us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b18001e70c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f522 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:16:09.210701 (+ 68702us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b18001e70c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db
0709 13:16:09.652862 (+442161us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b18001e70c0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:16:10.123707 (+470845us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:10.127268 (+  3561us) raft_consensus.cc:1685] finished
0709 13:16:10.127296 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.127448 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86183,"prepare.queue_time_us":446890,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":90,"raft.queue_time_us":27511,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":28721,"spinlock_wait_cycles":110002176,"thread_start_us":721128,"threads_started":2,"wal-append.queue_time_us":306272}
I20260709 13:16:10.137081  7332 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:16:10.136888 13437 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:10.137789  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1122) took 1212 ms. Trace:
I20260709 13:16:10.137993 13437 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:10.111728 14256 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.139281 14141 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.082480 14063 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.140954 14250 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:10.115258 13824 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.144016  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.144338  7179 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:16:10.138173  7332 rpcz_store.cc:276] 0709 13:16:08.925735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.136304 (+1210569us) service_pool.cc:224] Handling call
0709 13:16:10.136690 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.137515 (+   825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.137734 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.150949  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:10.115993  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:10.096825 14045 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:10.156347  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:10.073288  7255 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: []
W20260709 13:16:10.076807  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 75837.6us
I20260709 13:16:10.158393  7228 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:10.078521 14266 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:10.078935  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:10.159659  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:10.084065  7334 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:16:10.058874 14118 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:10.084683  7336 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:10.142278 13824 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:10.161428  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:09.999146 14235 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:10.039453  7330 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:10.011305 14019 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:16:10.075269  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:10.007840 13694 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:10.064440  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:09.777644 14270 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:10.006114 13850 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:16:10.036252 14133 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:10.110208 14265 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:10.175946  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:10.053314 14107 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.159915  7181 raft_consensus.cc:2410] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 21 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:16:10.191144  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:10.087102 14036 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:10.122498 14034 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:10.161068  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1120) took 1805 ms. Trace:
I20260709 13:16:10.162832  7331 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:16:10.163178  7180 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:16:10.196307  7180 pending_rounds.cc:85] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 11
I20260709 13:16:10.196013  7336 rpcz_store.cc:276] 0709 13:16:08.355344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.083929 (+1728585us) service_pool.cc:224] Handling call
0709 13:16:10.084424 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.160805 (+ 76381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.161010 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.196919  7180 pending_rounds.cc:107] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:16:10.197270  7180 raft_consensus.cc:2889] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.161026  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:10.198642  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 123445us
I20260709 13:16:10.198853  7332 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:10.172070 14235 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.200522  7330 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:10.130510  7254 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.175228  7178 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:10.159971 14045 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:10.174402 14118 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:10.179419 14177 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:10.072377  7258 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
W20260709 13:16:10.203555  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45244us
I20260709 13:16:10.200536  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1124) took 1271 ms. Trace:
I20260709 13:16:10.166350 14171 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:10.206118  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1125) took 1273 ms. Trace:
I20260709 13:16:10.200857  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:10.210101  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:10.180214 14139 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:10.215737  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:10.215848  7332 rpcz_store.cc:276] 0709 13:16:08.929486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.199658 (+1270172us) service_pool.cc:224] Handling call
0709 13:16:10.199991 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.200181 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.200217 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.200268 (+    51us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:10.200308 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.200372 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.200480 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:10.197980 14173 consensus_queue.cc:1175] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 20 status { last_received { term: 20 index: 11 } last_committed_idx: 9 last_received_current_leader { term: 20 index: 11 } }
I20260709 13:16:10.271409  7332 raft_consensus.cc:1275] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:10.272171  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2517) took 1069 ms. Trace:
I20260709 13:16:10.272531  7332 rpcz_store.cc:276] 0709 13:16:09.202667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.270581 (+1067914us) service_pool.cc:224] Handling call
0709 13:16:10.271040 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.271866 (+   826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.272109 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.216929  7262 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:16:10.273748 13960 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:10.205165 14267 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:10.274224 13960 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:10.193195 14063 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:10.208413 14019 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:10.220662  7330 rpcz_store.cc:276] 0709 13:16:08.932465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.204675 (+1272210us) service_pool.cc:224] Handling call
0709 13:16:10.205456 (+   781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.205676 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.205715 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.205774 (+    59us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:10.205821 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.205896 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.206043 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.274727 13960 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:10.252259 13856 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:10.208588 13568 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:10.266569 14213 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:10.209321 14270 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:10.267859 14118 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.270015 13694 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:10.270560 14266 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:10.077018  7077 catalog_manager.cc:5697] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 16 to 19, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 19 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.221516 14139 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:10.218111 13969 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:10.213073 14265 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.224321  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.221616 14273 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
W20260709 13:16:10.332723  7150 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.785s (SENT) [suppressed 5 similar messages]
I20260709 13:16:10.274592  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:10.276193  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1127) took 1325 ms. Trace:
I20260709 13:16:10.334417  7336 rpcz_store.cc:276] 0709 13:16:08.950902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.214699 (+1263797us) service_pool.cc:224] Handling call
0709 13:16:10.275561 (+ 60862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.275767 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.275797 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.275858 (+    61us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:10.275905 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.275979 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.276126 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:10.215583 14244 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.725s	user 0.007s	sys 0.004s
I20260709 13:16:10.254279  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:10.336377  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 82228.9us
I20260709 13:16:10.337389  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:10.284422  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:10.338490 13437 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:10.339059 13437 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:10.339498 13437 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:10.206736 14235 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:10.292932  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 92161.2us
I20260709 13:16:10.294973  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:10.344298  7332 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:10.344547  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:10.345770  7330 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:10.214386 14177 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:10.354719  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:10.355134 14177 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:10.356745  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:10.357796  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:10.298161  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 293051us
W20260709 13:16:10.290953 14004 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.000s
I20260709 13:16:10.301683  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:10.166497  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 59146.2us
W20260709 13:16:10.370033  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.189832 14253 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:10.327435 13568 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:10.326314  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:10.233321 14160 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:10.305464 14119 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.836s	user 0.012s	sys 0.000s
I20260709 13:16:10.347520  7184 raft_consensus.cc:2410] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:16:10.293691 13935 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:16:10.342792 14265 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.354228  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:10.358045 14242 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.818s	user 0.008s	sys 0.007s
I20260709 13:16:10.218966 14171 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:10.360585  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:10.392464  7182 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
W20260709 13:16:10.361784  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 77522us
I20260709 13:16:10.393639  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:10.366086  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:10.376121 13969 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.370740  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:10.372978 13437 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:10.374347  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.294056 14019 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:10.325301 14266 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:10.392477 14242 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:10.404982 14266 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:10.406014  7187 raft_consensus.cc:2410] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:16:10.406776  7185 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:16:10.331455 14139 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:10.377388  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:10.369191 14063 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:10.387226  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:10.389946  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:10.369498 14147 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:10.393031  7182 pending_rounds.cc:85] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 10
I20260709 13:16:10.424494  7182 pending_rounds.cc:107] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:16:10.424825  7182 raft_consensus.cc:2889] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.366044  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:10.370525  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.426108  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.426342  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 60432.6us
I20260709 13:16:10.332770 14141 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:10.419356  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:10.420143 14121 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:10.432972 13437 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:10.434607  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:10.404103  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:10.423532  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:10.443410  7330 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 27.
I20260709 13:16:10.444913  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:10.448311  7332 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:16:10.449314  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2522) took 1215 ms. Trace:
I20260709 13:16:10.450021  7330 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:10.451050  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2519) took 1247 ms. Trace:
I20260709 13:16:10.451540  7330 rpcz_store.cc:276] 0709 13:16:09.203258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.446237 (+1242979us) service_pool.cc:224] Handling call
0709 13:16:10.449760 (+  3523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.450711 (+   951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.450978 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.453452  7330 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:16:10.382911 14276 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:16:10.481698  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 148992us
I20260709 13:16:10.483283  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:10.485489  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.414480 14063 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:10.403726 14221 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:10.486415  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.486809  7336 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:10.395156 14171 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:10.500591  7332 rpcz_store.cc:276] 0709 13:16:09.233526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.447487 (+1213961us) service_pool.cc:224] Handling call
0709 13:16:10.447940 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.448986 (+  1046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.449244 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.502388  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:10.415388 13824 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:10.377616 14004 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.487774  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:10.394379 14277 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:10.508051  7330 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 13:16:10.508853  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 401189us
I20260709 13:16:10.509800  7332 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:10.467384 14276 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.488029 14130 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:10.433802 14213 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:10.430878 13571 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:10.482702 14029 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:10.466094 14003 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:10.467747 14148 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:10.511122 14107 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:10.517270  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:10.500159 14063 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:10.430595 14273 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:16:10.569628  7336 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:10.545085 14221 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:10.428918 13969 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.590070  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1123) took 1661 ms. Trace:
I20260709 13:16:10.588785 13571 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:10.596508 13536 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:10.601272  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 58924.5us
W20260709 13:16:10.611342  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 94184.1us
I20260709 13:16:10.636879  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:10.578285 14213 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:10.563349 14276 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:10.488919 14019 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:10.628409  7332 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:16:10.639204  7861 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:10.648917  7336 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25. Ops: [22.12-24.13]
I20260709 13:16:10.611259 13288 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:10.655246  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 295146us
I20260709 13:16:10.636296 14221 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.643647 14213 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:10.645744 13536 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:10.506803 14253 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:10.515013 13568 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:10.677342 14277 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:10.711431 14019 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:10.714052 14160 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:10.745023 14004 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:10.651885 14266 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.676983 14177 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:10.808748 14280 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:16:10.786062 14265 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:10.746201 14139 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.714255 13571 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.806913 14277 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:16:10.829203 14287 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:16:10.787088 13960 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:10.883383 14286 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:16:10.903777 14177 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:10.868841 13969 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:10.916471 14178 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.148s	user 0.012s	sys 0.006s
I20260709 13:16:10.707757 14221 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:10.977285 14210 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.924s	user 0.016s	sys 0.001s
I20260709 13:16:10.905687 14266 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:10.942677 14292 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:16:10.984843 14133 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.789s	user 0.008s	sys 0.015s
I20260709 13:16:10.986047 14133 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.037323 14133 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:10.932529 14034 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.723s	user 0.007s	sys 0.005s
I20260709 13:16:11.038393 14034 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.041946 14034 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:10.967314 14178 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.044951 14178 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:10.946022 14139 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:11.050482 14148 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:11.000984 14171 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.056334 14171 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:11.003191 14210 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.059942 14210 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:11.009522 14235 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.640s	user 0.013s	sys 0.000s
W20260709 13:16:10.950202 14036 consensus_meta.cc:287] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.006s
I20260709 13:16:11.070659 14036 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.073772 14036 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:11.002556 14270 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.688s	user 0.013s	sys 0.000s
W20260709 13:16:10.993276 14045 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.775s	user 0.002s	sys 0.011s
I20260709 13:16:11.075606 14045 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.078752 14045 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.084926 14213 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.087145 14235 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.090188 14235 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.029923 14276 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.136674  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:10.589148  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3567) took 1183 ms. Trace:
W20260709 13:16:11.172466  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.173710  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.172780  7179 rpcz_store.cc:276] 0709 13:16:09.405319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.154713 (+749394us) service_pool.cc:224] Handling call
0709 13:16:10.157043 (+  2330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.157277 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:16:10.393232 (+235955us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.587989 (+194757us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.588172 (+   183us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:16:10.588260 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.588398 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.589051 (+   653us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":419098,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":3132,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":7160,"thread_start_us":413157,"threads_started":2,"wal-append.queue_time_us":319611}
W20260709 13:16:11.172510  7178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.000s	sys 0.012s
W20260709 13:16:11.176309  7178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.000s	sys 0.012s
I20260709 13:16:11.177248  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:11.177996  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3569) took 1772 ms. Trace:
I20260709 13:16:11.178557  7178 rpcz_store.cc:276] 0709 13:16:09.405783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.210821 (+805038us) service_pool.cc:224] Handling call
0709 13:16:10.213789 (+  2968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.213976 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:10.508316 (+294340us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.177151 (+668835us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.177280 (+   129us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:11.177417 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.177578 (+   161us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.177895 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1255,"prepare.queue_time_us":392219,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"thread_start_us":922788,"threads_started":2,"wal-append.queue_time_us":283745}
I20260709 13:16:11.200453  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3564) took 1795 ms. Trace:
I20260709 13:16:11.201274  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3561) took 1797 ms. Trace:
W20260709 13:16:11.202241  7184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3555) took 1822 ms (client timeout 1630 ms). Trace:
I20260709 13:16:11.201081  7185 rpcz_store.cc:276] 0709 13:16:09.404438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.132676 (+728238us) service_pool.cc:224] Handling call
0709 13:16:10.133043 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.407212 (+274169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.199561 (+792349us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54002715d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:11.200204 (+   643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628834560}
W20260709 13:16:11.202906  7184 rpcz_store.cc:269] 0709 13:16:09.379713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.436126 (+ 56413us) service_pool.cc:224] Handling call
0709 13:16:11.201754 (+1765628us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54000eced4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:11.202038 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086269312}
I20260709 13:16:11.204793  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:11.205899  7184 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:16:11.207012  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1330) took 1799 ms. Trace:
I20260709 13:16:11.207454  7184 rpcz_store.cc:276] 0709 13:16:09.407764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.204700 (+1796936us) service_pool.cc:224] Handling call
0709 13:16:11.205305 (+   605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.206532 (+  1227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.206908 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.178566  7179 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:11.210307  7184 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:11.211233  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2792) took 1757 ms. Trace:
I20260709 13:16:11.214056  7184 rpcz_store.cc:276] 0709 13:16:09.453328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.209311 (+1755983us) service_pool.cc:224] Handling call
0709 13:16:11.209916 (+   605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.210919 (+  1003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.211141 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.577383  7186 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:11.235863  7336 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: []
W20260709 13:16:11.236999  7333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.013s	sys 0.029s
W20260709 13:16:11.237810  7333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.013s	sys 0.029s
I20260709 13:16:11.239770  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1119) took 2884 ms. Trace:
I20260709 13:16:11.240490  7333 rpcz_store.cc:276] 0709 13:16:08.355062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.053349 (+1698287us) service_pool.cc:224] Handling call
0709 13:16:10.053625 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.053819 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:10.314546 (+260727us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.238700 (+924154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.238855 (+   155us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:11.239039 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.239246 (+   207us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.239582 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":364338,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"thread_start_us":1144291,"threads_started":2,"wal-append.queue_time_us":486504}
W20260709 13:16:11.217000  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.218201  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.243417  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.201829  7180 rpcz_store.cc:276] 0709 13:16:09.403686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.099313 (+695627us) service_pool.cc:224] Handling call
0709 13:16:10.117900 (+ 18587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.198273 (+ 80373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.200728 (+1002455us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b54002c4554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:11.201089 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103072512}
I20260709 13:16:11.249068  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3769) took 1681 ms. Trace:
I20260709 13:16:11.249222  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1334) took 1765 ms. Trace:
I20260709 13:16:11.190434  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:11.223546  7259 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.023s	sys 0.040s
W20260709 13:16:11.250746  7259 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.024s	sys 0.041s
I20260709 13:16:11.252697  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2405) took 1584 ms. Trace:
I20260709 13:16:11.253943  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3765) took 1782 ms. Trace:
W20260709 13:16:11.221263  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.249785  7255 rpcz_store.cc:276] 0709 13:16:09.567038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.033147 (+466109us) service_pool.cc:224] Handling call
0709 13:16:10.073043 (+ 39896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.157990 (+ 84947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.248351 (+1090361us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b5400058050. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:11.248713 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74244992}
I20260709 13:16:11.228582  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 1329) took 1840 ms. Trace:
I20260709 13:16:11.255510  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1445) took 1835 ms. Trace:
I20260709 13:16:11.255743  7187 rpcz_store.cc:276] 0709 13:16:09.402934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.740792 (+337858us) service_pool.cc:224] Handling call
0709 13:16:11.228079 (+1487287us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b5400256a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:11.228379 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1526578048}
I20260709 13:16:11.256153  7257 rpcz_store.cc:276] 0709 13:16:09.419873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.458291 (+ 38418us) service_pool.cc:224] Handling call
0709 13:16:09.490003 (+ 31712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.894115 (+404112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.894151 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.894198 (+    47us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:09.894230 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.254819 (+1360589us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54001a3454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:11.254907 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.255240 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928691968}
I20260709 13:16:11.212936  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3556) took 1830 ms. Trace:
I20260709 13:16:10.620903  7329 rpcz_store.cc:276] 0709 13:16:08.929125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.152202 (+1223077us) service_pool.cc:224] Handling call
0709 13:16:10.152486 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.152703 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:16:10.379627 (+226924us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.579306 (+199679us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.589721 (+ 10415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.589779 (+    58us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:10.589822 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.589888 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.590014 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9654,"prepare.queue_time_us":333500,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":3960,"raft.queue_time_us":22971,"spinlock_wait_cycles":33189376,"thread_start_us":405339,"threads_started":2}
I20260709 13:16:10.638718  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:11.263762  7180 rpcz_store.cc:276] 0709 13:16:09.483422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.246563 (+1763141us) service_pool.cc:224] Handling call
0709 13:16:11.247753 (+  1190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.248601 (+   848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.248638 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.248737 (+    99us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:11.248804 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.248906 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.249112 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.230767  7183 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:10.705377 13288 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:10.913422 13960 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.091683 14063 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.261354  7178 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:11.253507  7256 rpcz_store.cc:276] 0709 13:16:09.668541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.065350 (+396809us) service_pool.cc:224] Handling call
0709 13:16:10.071537 (+  6187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.112865 (+ 41328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.252030 (+1139165us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b54001a2f50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:11.252422 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13433088}
I20260709 13:16:11.295862 14004 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.304575  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1333) took 1819 ms. Trace:
I20260709 13:16:11.259819  7182 rpcz_store.cc:276] 0709 13:16:09.382451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.891153 (+508702us) service_pool.cc:224] Handling call
0709 13:16:09.891613 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.425348 (+533735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.212424 (+787076us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b5400118354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:11.212752 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149436672}
I20260709 13:16:11.295935  7887 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 27.
W20260709 13:16:11.288381  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 649574us
W20260709 13:16:11.329296  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 87717us
W20260709 13:16:11.329946  7861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.013s	sys 0.002s
I20260709 13:16:11.330371 14130 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:11.330850 14270 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:11.330994 13824 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:11.390586  7861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.014s	sys 0.002s
I20260709 13:16:11.341238  7895 raft_consensus.cc:2368] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22.
I20260709 13:16:11.342970 14235 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.343878 14160 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:11.343448 14273 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:11.344666 14034 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.345789 14004 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.362998  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2447) took 1084 ms. Trace:
I20260709 13:16:11.353662  7182 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:11.355926 14107 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.359831  7887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 970) took 1009 ms. Trace:
I20260709 13:16:11.343469 14276 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:11.361016 14213 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:11.362484  7178 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:11.366541  7253 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:16:11.335813  7183 rpcz_store.cc:276] 0709 13:16:09.470271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.229671 (+1759400us) service_pool.cc:224] Handling call
0709 13:16:11.230257 (+   586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.282129 (+ 51872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.289598 (+  7469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.367712 14063 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.375016 14148 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.465036  7895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 971) took 1114 ms. Trace:
I20260709 13:16:11.378981 14299 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:11.380096  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1337) took 1729 ms. Trace:
I20260709 13:16:11.254563  7259 rpcz_store.cc:276] 0709 13:16:09.471588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.009535 (+537947us) service_pool.cc:224] Handling call
0709 13:16:10.033946 (+ 24411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:10.044669 (+ 10723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.044723 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:10.045535 (+   812us) log.cc:844] Serialized 52 byte log entry
0709 13:16:10.424423 (+378888us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:11.252312 (+827889us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.252941 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.253116 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.253221 (+   105us) raft_consensus.cc:1685] finished
0709 13:16:11.253233 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.253854 (+   621us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9185,"prepare.queue_time_us":173705,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":5727,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":5066,"thread_start_us":1082054,"threads_started":2,"wal-append.queue_time_us":437452}
I20260709 13:16:11.403797  7179 raft_consensus.cc:2410] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:16:11.389642 13288 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.408953 14004 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:11.411180  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 756745us
I20260709 13:16:11.470239  7895 rpcz_store.cc:276] 0709 13:16:10.352570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.356447 (+  3877us) service_pool.cc:224] Handling call
0709 13:16:11.464578 (+1108131us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54000bc7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:11.464887 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142943488}
I20260709 13:16:11.473259  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:11.473974  7861 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:11.410933 14107 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.446362  7254 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:11.476950 14107 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:11.415012  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2428) took 3202 ms. Trace:
I20260709 13:16:11.477710  7334 rpcz_store.cc:276] 0709 13:16:08.211959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.146895 (+934936us) service_pool.cc:224] Handling call
0709 13:16:09.147509 (+   614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.160297 (+1012788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.414358 (+1254061us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b5400253354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:11.414760 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152529792}
I20260709 13:16:11.416813  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2506) took 3872 ms. Trace:
I20260709 13:16:11.403322  7887 rpcz_store.cc:276] 0709 13:16:10.350342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.350890 (+   548us) service_pool.cc:224] Handling call
0709 13:16:11.359379 (+1008489us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54005a14d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:11.359643 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140548352}
W20260709 13:16:11.368547  7859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.016s	sys 0.004s
I20260709 13:16:11.419485  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2458) took 1127 ms. Trace:
I20260709 13:16:11.419160 14034 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.420246  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2796) took 1765 ms. Trace:
I20260709 13:16:11.410976 13824 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.421569 14270 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.596911 14034 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.592696  7336 rpcz_store.cc:276] 0709 13:16:10.292531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.650407 (+357876us) service_pool.cc:224] Handling call
0709 13:16:10.715158 (+ 64751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.236591 (+521433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.419199 (+182608us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54002896d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:11.419426 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195864320}
I20260709 13:16:11.598531  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:11.598789 14270 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:11.423950  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 1325) took 2036 ms. Trace:
I20260709 13:16:11.599697  7186 rpcz_store.cc:276] 0709 13:16:09.387067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.686935 (+299868us) service_pool.cc:224] Handling call
0709 13:16:11.423598 (+1736663us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b5400270bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:11.423757 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403530624}
I20260709 13:16:11.600411 14256 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:11.600596  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:11.601495  7336 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:11.427345  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2408) took 1748 ms. Trace:
I20260709 13:16:11.427393 13846 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:11.593961  7182 rpcz_store.cc:276] 0709 13:16:09.654587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.352793 (+1698206us) service_pool.cc:224] Handling call
0709 13:16:11.353304 (+   511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.404791 (+ 51487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.420177 (+ 15386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.607091 13846 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.607925  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:11.608714  7182 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:16:11.609803 13846 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:11.428609  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.428471  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:11.427455 14221 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.602133  7262 rpcz_store.cc:276] 0709 13:16:09.678402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.069354 (+390952us) service_pool.cc:224] Handling call
0709 13:16:10.216446 (+147092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.273856 (+ 57410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.426849 (+1152993us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54002f7450. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:11.427136 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337399168}
I20260709 13:16:11.611173  7890 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:16:11.612483  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:11.612706 14221 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:11.430127 14301 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.431329  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:11.402084  7332 rpcz_store.cc:276] 0709 13:16:10.255094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.543455 (+288361us) service_pool.cc:224] Handling call
0709 13:16:10.627998 (+ 84543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.645824 (+ 17826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.331361 (+685537us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b5400288cd0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:11.339178 (+  7817us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136506112}
I20260709 13:16:11.614183 14301 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.615279  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:11.616715  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:11.616882 14301 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.617529  7332 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:11.409719 14235 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.619632  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:11.620960 14235 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.432911  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:11.622287 13935 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:11.459233  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:11.461397  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2436) took 1932 ms. Trace:
I20260709 13:16:11.436661 13858 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:11.443385 13694 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:11.623971 13694 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:11.623143  7330 rpcz_store.cc:276] 0709 13:16:09.528964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.454835 (+925871us) service_pool.cc:224] Handling call
0709 13:16:10.455240 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.564878 (+109638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.460614 (+895736us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b54002891d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:11.461173 (+   559us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120640896}
I20260709 13:16:11.625727 13694 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.626843 14107 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.627579 13694 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:11.628062  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:11.449692  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:11.598584 13824 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.628971  7888 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:16:11.446765  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:11.629140  7262 raft_consensus.cc:2393] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:16:11.464036  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51968.6us
I20260709 13:16:11.629473  7258 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:11.631134  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:11.631383 14004 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.632201 14004 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.464972 14148 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:11.375361  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.635576 14004 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:11.635986  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.635581 14148 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:11.469791  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2787) took 2005 ms. Trace:
I20260709 13:16:11.623652 13858 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:11.457633  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1338) took 1758 ms. Trace:
I20260709 13:16:11.481154  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3578) took 1054 ms. Trace:
I20260709 13:16:11.481731  7180 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:11.479404  7331 rpcz_store.cc:276] 0709 13:16:07.544277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.888121 (+1343844us) service_pool.cc:224] Handling call
0709 13:16:08.888498 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.197900 (+1309402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.416166 (+1218266us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540038c7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:11.416571 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2924617472}
I20260709 13:16:11.471743 14299 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:11.500677  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 966) took 1918 ms. Trace:
W20260709 13:16:11.501400 14003 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.894s	user 0.003s	sys 0.017s
W20260709 13:16:11.501924  7327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2520) took 2298 ms (client timeout 1785 ms). Trace:
I20260709 13:16:11.502475  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:11.502799 13288 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:11.406296 14160 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.509424  7862 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:11.511267  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:11.512169 13571 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:11.512535 14300 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:11.514565  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:11.516503  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 153954us
W20260709 13:16:11.529469  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 205334us
I20260709 13:16:11.533941  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:11.535285 14063 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.537206  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:11.551278  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:11.555711  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:11.556679  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:11.556775  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:11.557632  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:11.569247  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:11.574316 14303 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:16:11.574904  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:11.632946  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:11.578050  7254 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:16:11.579088  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:11.585134 14121 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:16:11.591488  7253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1430) took 2217 ms (client timeout 1873 ms). Trace:
W20260709 13:16:11.592118  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.593376  7859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.021s	sys 0.004s
I20260709 13:16:11.601356  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:11.426880 14276 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.623404  7183 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:11.628257  7255 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:11.629210 13824 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:11.468952 14139 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:11.636569  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.470418  7184 rpcz_store.cc:276] 0709 13:16:09.650369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.260084 (+1609715us) service_pool.cc:224] Handling call
0709 13:16:11.309672 (+ 49588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.379531 (+ 69859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.379567 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.379660 (+    93us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:11.379715 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.379800 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.379979 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.637146  7185 rpcz_store.cc:276] 0709 13:16:09.451978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.206527 (+1754549us) service_pool.cc:224] Handling call
0709 13:16:11.211104 (+  4577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.211632 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:11.212448 (+   816us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.422314 (+209866us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b180027ef20. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:16:11.422541 (+   227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.422593 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:11.456651 (+ 34058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.456728 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.456855 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51219,"prepare.queue_time_us":69896,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":3565,"raft.queue_time_us":143477,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":185,"spinlock_wait_cycles":5050240,"thread_start_us":68026,"threads_started":1,"wal-append.queue_time_us":68569}
I20260709 13:16:11.796788  7336 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:11.734185  7258 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
W20260709 13:16:11.668296  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.729909  7179 rpcz_store.cc:276] 0709 13:16:10.417283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.176522 (+759239us) service_pool.cc:224] Handling call
0709 13:16:11.471314 (+294792us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:11.791561  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.821734  7178 rpcz_store.cc:276] 0709 13:16:09.699036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.361397 (+1662361us) service_pool.cc:224] Handling call
0709 13:16:11.361915 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.455818 (+ 93903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.457548 (+  1730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.737914  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:11.734325  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.833364  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 200535us
I20260709 13:16:11.834072 13782 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:11.835476 13782 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:11.835961 13782 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:11.836125 14256 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:11.836830 14256 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:11.837147 13782 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.839653  7182 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:11.834385  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:11.738654  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:11.733376  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:11.840047 13782 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:11.843073 14063 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.730357  7896 rpcz_store.cc:276] 0709 13:16:09.581984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.582199 (+   215us) service_pool.cc:224] Handling call
0709 13:16:09.582906 (+   707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.623863 (+ 40957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.499952 (+1876089us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b540068e7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:11.500437 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33003264}
I20260709 13:16:11.834084  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:11.845587  7257 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 27: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:11.846105  7260 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:11.846426  7334 raft_consensus.cc:2376] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21. Re-sending same reply.
I20260709 13:16:11.862481  7335 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:11.638273 14273 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.209s
I20260709 13:16:11.847849  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:11.730306 14004 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:11.837913 14256 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.743152 13579 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.853497  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2794) took 2199 ms. Trace:
I20260709 13:16:11.852324  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:11.856359  7183 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:11.852480  7186 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:11.638948 13935 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:11.871202  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:11.860462  7891 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 20: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:11.855046  7328 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:11.822440  7254 pending_rounds.cc:85] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 13
W20260709 13:16:11.730765  7253 rpcz_store.cc:269] 0709 13:16:09.374461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.388333 (+ 13872us) service_pool.cc:224] Handling call
0709 13:16:11.342198 (+1953865us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b5400317f20. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b3dc0 00007fece923fe18 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6
0709 13:16:11.591124 (+248926us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b5400058a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:11.591365 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889887872}
W20260709 13:16:11.854617  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 1.12998e+06us
W20260709 13:16:11.863224  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.731276 14121 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:11.642891 14301 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:11.859988  7329 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:11.866139  7331 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:11.866767  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:11.881013  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:11.881356  7179 raft_consensus.cc:2410] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260709 13:16:11.636499 14019 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.837s	user 0.015s	sys 0.006s
W20260709 13:16:11.730602  7327 rpcz_store.cc:269] 0709 13:16:09.203520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.501429 (+2297909us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:11.501599 (+   170us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:11.738562 14118 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.849851 14221 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.868955  7180 rpcz_store.cc:276] 0709 13:16:09.654011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.321920 (+1667909us) service_pool.cc:224] Handling call
0709 13:16:11.471476 (+149556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.731718 (+260242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.852933 (+121215us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54001b44d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:11.853350 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319676672}
I20260709 13:16:11.821604 14299 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:11.848901  7150 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:11.885665  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:11.886297  7183 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:11.875957  7259 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:11.670847 14279 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.197s
I20260709 13:16:11.878794  7330 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:11.878278  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:11.736768 14003 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:11.872586  7254 pending_rounds.cc:107] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:16:11.627604 14107 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.887588  7261 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:11.738288 14276 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:11.888677  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.891086  7254 raft_consensus.cc:2889] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.891552  7184 raft_consensus.cc:2410] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:16:11.892274 14118 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.892788  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:11.893622 14302 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:11.894335 14253 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:11.638360 13858 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.898952 14045 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:11.899765 14121 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.900460 14107 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.900701  7334 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:11.903738  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:11.869944 13579 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.904853 14082 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:11.904574 14004 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:11.904520  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:11.907789 13850 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.875972 13288 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:11.911863  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 63276.9us
W20260709 13:16:11.911055  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 402065us
I20260709 13:16:11.890307  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:11.918370  7179 raft_consensus.cc:2368] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22.
I20260709 13:16:11.919611  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:11.954718  7183 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:16:11.920977  7331 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:11.877823 14160 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.922528 14029 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:11.929840 14302 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:11.911100 14136 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:11.931200  7178 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:11.886957 13935 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:11.965852  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1448) took 2105 ms. Trace:
W20260709 13:16:11.936343  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 60635.7us
I20260709 13:16:11.945108 13579 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:11.946169 14121 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:11.947340 13858 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:11.959616  7260 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:11.966313  7254 rpcz_store.cc:276] 0709 13:16:09.860325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.128621 (+268296us) service_pool.cc:224] Handling call
0709 13:16:10.128987 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.445751 (+1316764us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b58007b71d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91980aa 00007fece921a447 00007fece9232fe7 00007fece92347de 00007fece923eb49 00007fece923f416 00007fece923bd8f 00007fece923b83e 00007fecee200419 00007fece7777bd4
0709 13:16:11.928295 (+482544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.965790 (+ 37495us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2693865216}
I20260709 13:16:11.871379 14139 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.925406 14253 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:11.930467 14235 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.890166 14221 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:11.962489 14302 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:11.983636 13850 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:11.985020  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 151248us
I20260709 13:16:11.984894  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:11.993854  7180 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:11.956954 13288 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:11.960575 14029 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:11.986392  7228 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:11.987884  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3575) took 1930 ms. Trace:
I20260709 13:16:12.003348  7185 rpcz_store.cc:276] 0709 13:16:10.057116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.975536 (+1918420us) service_pool.cc:224] Handling call
0709 13:16:11.987157 (+ 11621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.987434 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.987467 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.987523 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:11.987564 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.987631 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.987779 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.992643  7335 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:16:11.923810 13824 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.006057 14029 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:12.010681  7185 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:12.012135  7185 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:11.978770 14160 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.016310  7186 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 28.
I20260709 13:16:12.023566  7178 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:16:12.024137  7178 pending_rounds.cc:85] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 13
I20260709 13:16:12.024436  7178 pending_rounds.cc:107] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:16:12.024704  7178 raft_consensus.cc:2889] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.025599  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3576) took 1609 ms. Trace:
I20260709 13:16:12.025975  7178 rpcz_store.cc:276] 0709 13:16:10.416696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.990736 (+1574040us) service_pool.cc:224] Handling call
0709 13:16:12.023131 (+ 32395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.025265 (+  2134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.025524 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:12.028466 14306 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:16:12.029394 14221 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:12.029834  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1336) took 2494 ms. Trace:
I20260709 13:16:12.030474 14063 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:12.023568 13935 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.031332  7256 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:16:12.032043  7256 pending_rounds.cc:85] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 13
I20260709 13:16:12.030412  7187 rpcz_store.cc:276] 0709 13:16:09.535433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.257317 (+1721884us) service_pool.cc:224] Handling call
0709 13:16:11.258608 (+  1291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.336172 (+ 77564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.336225 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.435040 (+ 98815us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18004050a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:16:11.480964 (+ 45924us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.563145 (+ 82181us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:11.563200 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.563293 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.029486 (+466193us) raft_consensus.cc:1685] finished
0709 13:16:12.029515 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.029758 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70475,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":205,"spinlock_wait_cycles":5275520,"thread_start_us":130989,"threads_started":2,"wal-append.queue_time_us":371209}
I20260709 13:16:12.032320  7256 pending_rounds.cc:107] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:16:11.997330 14253 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:12.033372  7256 raft_consensus.cc:2889] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.034852  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:12.035451 14133 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:12.035900  7257 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:12.035918 14133 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:12.037897 14139 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:12.038944  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3568) took 2584 ms. Trace:
I20260709 13:16:12.038640 14133 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.040620 14133 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:12.008682 14235 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.043543 13824 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:12.029716 14003 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:16:11.961742 14301 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.046342 14003 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.047196  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:12.047616  7180 pending_rounds.cc:85] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 15
I20260709 13:16:12.053359  7180 pending_rounds.cc:107] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:16:12.030864  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:12.013676  7183 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:12.052441  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1339) took 2254 ms. Trace:
I20260709 13:16:12.055500  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3573) took 1999 ms. Trace:
I20260709 13:16:12.056103  7183 rpcz_store.cc:276] 0709 13:16:10.056416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.974495 (+1918079us) service_pool.cc:224] Handling call
0709 13:16:12.005938 (+ 31443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.055216 (+ 49278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.055441 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.978324 14136 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:12.039333  7181 rpcz_store.cc:276] 0709 13:16:09.405561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.209578 (+804017us) service_pool.cc:224] Handling call
0709 13:16:10.213321 (+  3743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.213697 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.213726 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.253170 (+ 39444us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.261431 (+1008261us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b18002d4720. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:16:11.547020 (+285589us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:11.547078 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.553763 (+  6685us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.983079 (+429316us) raft_consensus.cc:1685] finished
0709 13:16:11.983100 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.983357 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4915,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":10811,"spinlock_wait_cycles":53656960,"thread_start_us":222483,"threads_started":1,"wal-append.queue_time_us":1267403}
I20260709 13:16:11.968755 14082 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.053668  7180 raft_consensus.cc:2889] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:12.056951  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49106.8us
I20260709 13:16:12.055559  7184 rpcz_store.cc:276] 0709 13:16:09.797706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.931670 (+2133964us) service_pool.cc:224] Handling call
0709 13:16:12.007512 (+ 75842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.051995 (+ 44483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.052032 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:12.052094 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:12.052154 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.052227 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.052371 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:12.060350  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:12.062851  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 199309us
I20260709 13:16:12.040510 14004 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:12.009222 14045 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:16:12.068967  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:12.071741  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 85491.8us
I20260709 13:16:12.055343 14003 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:12.072734  7254 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:16:12.073848  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.067253 14107 raft_consensus.cc:2764] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:16:12.078347  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:12.078940  7255 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:16:12.066841 13824 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:12.063035 14139 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:12.075610 14004 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:12.098722  7261 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:12.086844  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:12.104315  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:12.105883  7260 raft_consensus.cc:2410] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:16:12.094532  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:12.113397  7253 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:12.115942 13536 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:12.095263 14004 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:12.144326  7257 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 13:16:12.146589  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 99554.5us
I20260709 13:16:12.081303 14160 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:12.159466  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 99259.3us
I20260709 13:16:12.165074  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:12.170653  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 88670.5us
W20260709 13:16:12.160465 13694 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.529s	user 0.013s	sys 0.000s
I20260709 13:16:12.173269  7255 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:12.147097 14139 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:12.174983  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 93637.5us
I20260709 13:16:12.157817 14004 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:12.186468  7150 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:12.188030  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:12.194052  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 107439us
I20260709 13:16:12.170282 14118 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:12.185389  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:12.203665  7260 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:12.159466 14034 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:16:12.187346 14019 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.209239  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:12.142238 14302 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.170233 14063 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:16:12.141835 14136 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:12.215960  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52745.6us
I20260709 13:16:12.228991  7259 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
W20260709 13:16:12.229664  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 69200us
W20260709 13:16:12.237568  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54443.3us
I20260709 13:16:12.236112  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:12.240686 14302 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:12.243044  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 55323.1us
I20260709 13:16:12.249205  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:12.233469 13850 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:12.253590  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.239863 13824 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:12.233098 14273 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:12.253921  7260 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:12.206923 14139 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:16:12.209542 14287 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.156s
I20260709 13:16:12.256716 14045 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:12.257627 14082 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:12.237308 14276 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:12.227453 13568 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
W20260709 13:16:12.276357  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 81959us
I20260709 13:16:12.252640 14301 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:12.239537 14300 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:16:12.262976 14118 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:12.262442 14273 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.242998 14019 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.279026 13824 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:12.297909  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.299646 14279 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:12.300195 14279 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:12.301452 14279 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:12.305073  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 128832us
I20260709 13:16:12.288506 14273 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:12.276027 14311 consensus_queue.cc:1048] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:16:12.273334 13579 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:16:12.315881 13579 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:16:12.316363  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.320609 14314 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:16:12.311955 13850 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:16:12.323040  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:12.323560  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3577) took 1906 ms. Trace:
I20260709 13:16:12.323761  7255 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:16:12.323964  7180 rpcz_store.cc:276] 0709 13:16:10.417039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.006919 (+1589880us) service_pool.cc:224] Handling call
0709 13:16:12.047361 (+ 40442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.077475 (+ 30114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.077512 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:12.082876 (+  5364us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.209591 (+126715us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:12.209634 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.209708 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.323268 (+113560us) raft_consensus.cc:1685] finished
0709 13:16:12.323290 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.323458 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":100116,"threads_started":1,"wal-append.queue_time_us":165485}
I20260709 13:16:12.325203  7253 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:12.316283 13579 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:12.326951  7261 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:16:12.327394  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:12.339995  7262 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:12.341753  7260 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:12.297214 14063 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:12.341881  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:12.343338  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:12.345036 14326 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:12.340742  7330 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:12.345533 14326 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:12.348657 14322 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:12.350554  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:12.290659 14316 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:16:12.347020 14160 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:12.362576  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50357.3us
I20260709 13:16:12.322902 14253 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.347359 14063 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:16:12.377746  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 130887us
I20260709 13:16:12.389590  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:12.391628 14121 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:12.368884 14118 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:12.398526  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 106898us
I20260709 13:16:12.398720  7260 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:12.408152  7182 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:16:12.399004  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.371632 14322 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:12.357739 13850 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:16:12.414178  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:12.392870 14279 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:12.360185 14320 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:16:12.397967 14315 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:12.426682 14235 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:12.427290 14317 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.108s	user 0.000s	sys 0.002s
W20260709 13:16:12.428872  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.430173 14312 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:16:12.406308 13536 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:12.431028 13536 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.433933 13536 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:12.435554  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 105195us
W20260709 13:16:12.436077  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 46626.1us
W20260709 13:16:12.446511  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.448164  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.404863 14121 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:12.410251 14118 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:12.383203 14299 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.361671 14321 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
W20260709 13:16:12.496488  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.412978 13782 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:12.529112  7179 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:12.407086 14160 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:16:12.532531  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:12.419004 13568 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:16:12.535908  7184 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 27. Current term is 28. Ops: []
I20260709 13:16:12.537358  7180 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:12.436420 14322 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:12.498685 14118 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:12.552829  7178 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:16:12.554800  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:12.504215  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 95539.9us
I20260709 13:16:12.501024 13536 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:12.538879 13858 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.001s
I20260709 13:16:12.497437 14121 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:12.558009  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 280177us
I20260709 13:16:12.505851 14235 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:16:12.563199  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.543907 14256 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.544219 14315 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:12.576067  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:12.576090 14315 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.579170 14322 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.547427 14019 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:12.568890 13288 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
I20260709 13:16:12.572108 14299 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:12.568864 13782 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:12.581476  7187 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:12.411547 14326 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.555218 13850 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:12.599009  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 182860us
I20260709 13:16:12.525879 14320 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:16:12.553828 13694 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:16:12.592352  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.576473 14082 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:12.603361  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:12.611482  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.567502 14235 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:12.593912 14301 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:12.607484  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:12.549638 13579 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:12.623395  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 90253.2us
I20260709 13:16:12.529317 13824 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.565752 13536 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.621189  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:12.628710  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.635486  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 369682us
I20260709 13:16:12.614224 14082 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:12.642060  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3572) took 2586 ms. Trace:
I20260709 13:16:12.645308  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:12.645931  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 54242.7us
I20260709 13:16:12.593287 14311 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:16:12.642655  7892 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:12.591265 14256 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.645637  7179 rpcz_store.cc:276] 0709 13:16:10.055939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.962729 (+1906790us) service_pool.cc:224] Handling call
0709 13:16:12.528802 (+566073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.530341 (+  1539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.641843 (+111502us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54001b3ad0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:12.641995 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204936576}
I20260709 13:16:12.653210  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:12.627218 14301 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:12.596537 13288 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.658787  7895 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:12.660218 13536 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:12.634117 13850 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:12.662225 14029 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.000s
I20260709 13:16:12.663277 14082 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.665438 13571 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:12.687599 14082 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:12.667472  7896 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:12.679808  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:12.681496  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:12.680632 14113 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:16:12.696141  7152 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:12.691828  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:12.691864  7331 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:12.697113  7329 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:12.667116 14253 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:12.684110  7861 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:12.700323  7327 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 14. Current term is 15. Ops: []
W20260709 13:16:12.700709  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 43677.7us
I20260709 13:16:12.675702 14301 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:12.700335  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 100197us
W20260709 13:16:12.705485  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.710753  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.690603 14133 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.009s
W20260709 13:16:12.707713 14004 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 13:16:12.705173 14327 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:12.705325 14311 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:16:12.726857  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 75478us
I20260709 13:16:12.708585 13694 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.695397 14029 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.706795 14325 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:16:12.735682  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:12.734754  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:12.739816  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 66461.6us
I20260709 13:16:12.695719 14235 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.745741  7184 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:16:12.719863 14321 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.750901  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:12.751036  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:12.737357 14139 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.763041  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:12.764585 14329 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.765278 14329 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.765343  7895 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
I20260709 13:16:12.767746 14329 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:12.768067 14003 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.000s
I20260709 13:16:12.768607 14329 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:12.768476 14003 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.769110 14329 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:12.769968 14313 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:12.773458  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:12.775017  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:12.775883  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:12.725148 14004 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.735237 13694 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.786567  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:12.801359  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.806924  7178 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
W20260709 13:16:12.808741  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.784220 13850 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:12.809427  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:12.770222 14329 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:12.814558 14319 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:16:12.814945 14331 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.088s	user 0.004s	sys 0.000s
W20260709 13:16:12.815083 14328 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:16:12.815215 14235 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:12.816298 14336 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:16:12.817566  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 65994.7us
I20260709 13:16:12.831359  7182 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:16:12.782243 14276 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:16:12.776470 14321 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:12.838973  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.838670  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:12.783037 14139 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:12.839691  7888 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
W20260709 13:16:12.846491  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 105795us
W20260709 13:16:12.847337  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 115108us
I20260709 13:16:12.827617 14319 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:12.821871 14148 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:12.875401  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:12.876083  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:12.879174  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:12.879500  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:12.881596  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:12.883927  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:12.890350  7333 raft_consensus.cc:2410] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 24 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:16:12.890713  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 111577us
W20260709 13:16:12.891947  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 43890.7us
I20260709 13:16:12.893010  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:12.842662 14327 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:16:12.897933  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 52254.3us
I20260709 13:16:12.911196  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:12.902338  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:12.899649  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:12.885306 14253 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:12.900928  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:12.879848 14256 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:12.887382 14273 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.005s
W20260709 13:16:12.957589  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 56756.6us
I20260709 13:16:12.903847 14300 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:12.967768  7334 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 27.
I20260709 13:16:12.968747  7152 leader_election.cc:400] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:12.969130  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:12.896327 14320 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.900447 14003 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:12.900090 14004 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:12.984766  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.899773 14019 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:12.996605  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:12.980902  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:12.987576  7335 raft_consensus.cc:2393] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:12.910580 13579 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:12.905501 14313 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:12.962041 14253 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.912585 14321 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:12.969648 14302 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:12.967309 14300 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:13.005936  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:12.998787  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:16:12.985496  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 83232.4us
W20260709 13:16:13.016036  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53020.8us
I20260709 13:16:13.016340  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:12.983433 14325 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:13.016912  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:13.030550  7184 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:12.968591 14287 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:16:12.987097 14113 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:12.986948 14029 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:13.026654  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:12.970312 14133 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:16:13.033357  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:13.005379 13782 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:13.001259 14019 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:13.003315 14253 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:13.027124 14004 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:13.009215 14302 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.052376 14343 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:16:13.053038 14302 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:13.053937 14343 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:12.971251 14273 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.056900 14273 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:13.058350 14327 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.059377 14019 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.061094 14019 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:13.040436  7335 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:13.035657  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:13.046732  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:13.047254  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51361.1us
I20260709 13:16:13.048625  7331 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:13.050112  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:13.072674  7336 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:13.051383 14353 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:16:13.052495 14347 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:13.003054 14320 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:13.074807  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 196951us
I20260709 13:16:13.076339  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:13.054392 14343 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:13.038604 14113 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:13.107633  7335 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:13.042270 13850 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:13.070183  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:13.015237 14121 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.046522 13782 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:13.112310  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 69349.2us
I20260709 13:16:13.104135 14029 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:13.113240 13694 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.114492 14139 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:13.131618 14139 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:13.132241 14139 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:13.133249 14139 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:13.136293 14118 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.003s
I20260709 13:16:13.119103  7331 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:13.067090 14004 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:13.122918  7181 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:13.123472  7332 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [21.13-21.13]
W20260709 13:16:13.124414  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.143034  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:13.142565  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.116765 13288 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:13.146670  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.046602 14319 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.111730 13850 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:13.128743  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.122398 13782 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:13.031052 14107 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:16:13.137969  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:13.111416 14113 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:13.141462  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 71445.1us
W20260709 13:16:13.106803 14345 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:16:13.147724  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:13.148077 14004 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:13.118216 14353 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:13.175695  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:13.148767  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:13.075074 14301 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:13.178681  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 285710us
I20260709 13:16:13.148914 14221 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:13.175238 13850 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:13.185902  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:13.201221  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 55587us
I20260709 13:16:13.210922  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:13.183189  7301 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:13.143635 14273 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.047s
I20260709 13:16:13.201367  7180 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:13.149101 13694 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:16:13.202514  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.142549 14118 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.213375  7181 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:16:13.205233 14082 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.000s
I20260709 13:16:13.150205 14302 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:13.218869  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 81005.3us
I20260709 13:16:13.224017  7256 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23. Ops: []
W20260709 13:16:13.200798 14279 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.765s	user 0.013s	sys 0.000s
W20260709 13:16:13.225142  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.225895  7178 raft_consensus.cc:2410] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:16:13.139782 14300 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:13.227403  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.182365 14319 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:13.189380 14133 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:13.183765 14029 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:13.233458 14339 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:13.234375  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 110914us
W20260709 13:16:13.260421 14358 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:16:13.260715  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:13.234048 14353 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.235455  7892 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:13.254853 14029 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:13.263166  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3795) took 1019 ms. Trace:
I20260709 13:16:13.263294 14029 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:13.263573  7259 rpcz_store.cc:276] 0709 13:16:12.243659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.243795 (+   136us) service_pool.cc:224] Handling call
0709 13:16:12.254255 (+ 10460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.282702 (+ 28447us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:12.707926 (+425224us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.122879 (+414953us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:13.146320 (+ 23441us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.146543 (+   223us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:13.146596 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.147789 (+  1193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.262914 (+115125us) raft_consensus.cc:1685] finished
0709 13:16:13.262943 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.263103 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18617,"prepare.queue_time_us":330465,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":256839,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":29436,"thread_start_us":797756,"threads_started":4,"wal-append.queue_time_us":315631}
I20260709 13:16:13.266147 14107 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:13.235123 14318 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:13.267992  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:13.236634 14357 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:16:13.191200 14343 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.216383 14034 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:13.288142 14034 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:13.288705 14343 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:13.289012  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:13.290187 14344 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:16:13.262603 14356 log.cc:927] Time spent T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:13.291036 14344 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:13.240234 14302 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.241078  7260 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:13.242744  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:13.182370 14330 consensus_queue.cc:1175] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 23 status { last_received { term: 22 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:13.247485 14348 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:13.248835  7178 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:16:13.250761  7262 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:13.250612  7183 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:13.223676 13858 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:13.254132  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 71028.4us
I20260709 13:16:13.256866 14121 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.259208 14256 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:13.315419  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:13.268337  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:13.133157 14325 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.270383 14107 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:13.297113 14311 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.296607 14348 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.304232 14302 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.307514  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.216874 14063 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.266444 14133 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:13.298841  7178 pending_rounds.cc:85] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 12
W20260709 13:16:13.327757  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.309324 14301 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.343478  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:13.349767  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:13.352314  7178 pending_rounds.cc:107] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:16:13.352839  7178 raft_consensus.cc:2889] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.355005  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:13.355995  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.356006  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:13.360136  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:13.343402 14302 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.371145 14365 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.371819 13850 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.372773 14329 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.373518  7225 connection.cc:256] RPC call timeout handler was delayed by -1.2455064529999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
I20260709 13:16:13.374953 14364 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:13.375074  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:13.375308 14320 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:13.375501 14321 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.376818 14136 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:13.377190  7334 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:13.380669 14300 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:13.366681 14107 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.415519 13571 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:16:13.392659  7180 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:13.385705  7894 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:16:13.407866  7183 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:13.397254 14326 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:13.353536 14121 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:13.293511 14273 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 13:16:13.418054 14136 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:13.425323 14321 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.421808  7328 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:13.423642  7225 leader_election.cc:400] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22.
I20260709 13:16:13.475577  7225 leader_election.cc:403] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:16:13.424008 14364 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.422433 14329 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.420910 13850 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:13.428232 14235 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.001s
W20260709 13:16:13.387094  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.384526 14118 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:13.425980 14302 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:13.397610 14332 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.018s	sys 0.014s
I20260709 13:16:13.424114  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:13.501724  7329 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:13.453732  7228 leader_election.cc:336] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.577s (SENT)
I20260709 13:16:13.339133 14311 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.456238  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.470432  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:13.503773  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 88404us
I20260709 13:16:13.504257  7180 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:13.505537  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.507403  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:13.508994  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.509806  7180 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:13.511027  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.511861  7180 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:13.431771 14256 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:16:13.426394 14253 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.462123  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:13.527369  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:13.528071  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 83433us
I20260709 13:16:13.528106  7260 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:13.527390  7257 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:13.472173  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:13.416131 14365 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:13.496405  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.529711  7183 raft_consensus.cc:2376] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23. Re-sending same reply.
I20260709 13:16:13.473089 13694 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.453480 14082 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.531064  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.527396  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:13.532088  7259 raft_consensus.cc:2410] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:16:13.533250  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.531090  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:13.501488 14332 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.018s	sys 0.015s
I20260709 13:16:13.513054  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:13.555513  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.528697  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.557448  7262 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:16:13.534374 14363 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:16:13.557564  7253 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:13.554831  7187 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:13.528177 14235 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22.
I20260709 13:16:13.566212  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:13.578976  7178 raft_consensus.cc:2393] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:13.571285  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.568178  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.580644  7180 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:13.475893 14133 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.584758  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.584896  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:13.585263  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:13.568342  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 98651.5us
I20260709 13:16:13.586377  7187 raft_consensus.cc:2410] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:16:13.586990  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:13.560393 14121 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:13.535416 13858 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:16:13.590001  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.588934  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:13.593777  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.590351  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:13.593931  7254 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:13.563519 14136 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.598820 14315 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:13.599849 14315 consensus_queue.cc:1243] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:16:13.600428 14315 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:13.600800 14315 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:13.601550  7179 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:16:13.589937 14369 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:16:13.603077 14118 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.563169 13694 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.603681 14118 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.606031 13694 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:13.606931  7183 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:13.607275  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 153581us
I20260709 13:16:13.608345 14004 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.567783 14352 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.595459  7253 raft_consensus.cc:2410] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:16:13.559792 14348 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.612973  7329 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
W20260709 13:16:13.614078  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 59247.7us
I20260709 13:16:13.567579 14353 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:13.616325 14365 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:13.616719 14364 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.560439 14082 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:13.619197 14370 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:13.620455  7181 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:16:13.624303 14329 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.626169 14029 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.633507 14301 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.602527 14315 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.636449  7254 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:13.675282  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:13.618026 13579 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.606s	user 0.005s	sys 0.005s
I20260709 13:16:13.678798  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:13.683524  7185 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:13.685238  7183 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:16:13.686457  7260 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:13.688933 14082 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:13.691435 14321 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:13.635737 14113 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.691937 14311 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:13.693382 14315 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:13.684903 13571 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.713511  7888 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 27. Current term is 28. Ops: []
W20260709 13:16:13.694831 14372 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:16:13.638267 14121 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:13.695240 14019 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.007s
I20260709 13:16:13.636317 14352 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.697865  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:13.722421  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 107642us
I20260709 13:16:13.707201  7257 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:16:13.684532  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.709698  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.724712  7183 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
W20260709 13:16:13.710381  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 101684us
I20260709 13:16:13.726468  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:13.711479  7182 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
W20260709 13:16:13.717651 13782 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.003s
I20260709 13:16:13.714195  7891 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:13.718106  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.728632 14004 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:13.706867  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.715047  7186 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:16:13.734201  7186 pending_rounds.cc:85] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 12
I20260709 13:16:13.734486  7186 pending_rounds.cc:107] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:16:13.734767  7186 raft_consensus.cc:2889] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.734824 14339 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:13.734941  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:13.736162 14121 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.736897 14253 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.728803  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:13.712237 14301 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.739488 14029 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:13.739804  7183 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:13.717461 13571 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.741107 14301 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.742082 13571 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:13.743835 14352 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.742061  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.742758 13782 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.745590  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:13.746528  7184 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:13.729352  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.730852  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:13.746533  7183 raft_consensus.cc:2368] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22.
I20260709 13:16:13.748690  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.748867 14321 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:13.748934  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.749545 14321 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.750000 14321 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:13.742964 14381 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.751062 14381 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.752682 14287 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:13.753733 14381 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.755247 14287 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:16:13.755714  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:13.758103  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:13.758814  7894 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:13.758991  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:13.760375 14063 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:13.760448  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:13.761224  7889 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:13.755971 14113 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:13.735344 14339 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.750113  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.758311 14313 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:16:13.768023 14319 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.001s
I20260709 13:16:13.776202  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.772756  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:13.777294  7180 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:13.779273  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:13.791299  7180 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:13.791038  7181 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 13:16:13.769402 14339 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:13.794237  7887 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:13.769470 14313 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:13.796764  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65979.1us
I20260709 13:16:13.797549  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:13.795872 14375 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:16:13.775830 14353 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:16:13.803439  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 99251.2us
I20260709 13:16:13.804342  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:13.801981  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:13.790985 14019 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:13.811254  7894 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:13.812048  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:13.806516  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:13.802726 14329 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.820422 14329 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.821377 14384 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.827965  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:13.835603 14299 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:16:13.836987 14221 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:13.814872 14365 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:13.841190 14329 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.841449  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:13.869207  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 49660.6us
I20260709 13:16:13.847062  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:13.869616  7895 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:13.870486  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:13.849723  7889 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:16:13.808127 14364 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:13.855033  7894 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:16:13.875391 13571 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:13.877202  7892 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:13.877542 13571 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.840662 14326 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:13.877985 13571 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:13.878098 14326 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:13.879096  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:13.879884  7330 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:13.864624  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:13.840684 14321 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.864897 13782 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.899098  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3596) took 1003 ms. Trace:
I20260709 13:16:13.899600  7186 rpcz_store.cc:276] 0709 13:16:12.895707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.895856 (+   149us) service_pool.cc:224] Handling call
0709 13:16:12.896207 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.735277 (+839070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.898809 (+163532us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54002b52d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:13.899028 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1868424576}
I20260709 13:16:13.900347  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:13.863466 14353 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:16:13.881857  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 75399.9us
I20260709 13:16:13.905485  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:13.861608 14299 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:13.906533  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:13.907003  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.906774 14299 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.907542  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:13.907994 14299 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:13.908571 14003 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:13.909011 14003 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:13.909395 14003 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:13.909585  7254 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:13.910192  7256 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:16:13.910830 14329 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:13.910934  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:13.911357  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.882975 14301 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:13.912129  7257 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:13.912617 14301 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:13.913013 14301 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:13.913673  7260 raft_consensus.cc:1240] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:16:13.885398  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:13.915022  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.911381 14329 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.912139  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.916221 14329 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:13.888036 14136 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:13.864413 14221 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:13.918553 14221 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.919091  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.919713 14221 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:13.919874  7262 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:16:13.888666  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:13.923069  7331 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:13.888090  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:13.889180  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.923920  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:13.893250 14339 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.923333  7861 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:13.897631 14118 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.873440 14364 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.933362 14364 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:13.933216 14326 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.934271  7333 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25. Ops: [22.12-24.13]
I20260709 13:16:13.934618 14326 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:13.935407  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:13.936077  7330 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:13.936236 14339 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:13.914741 14353 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:13.881421 14313 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:13.937238  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:13.937733  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:13.922811 14392 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:16:13.937920  7332 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:16:13.938436  7257 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:13.939320  7331 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:16:13.864552 14384 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.924276  7261 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:13.942781 13858 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:13.905643  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1237) took 1030 ms. Trace:
W20260709 13:16:13.912004 14362 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.684s	user 0.004s	sys 0.000s
I20260709 13:16:13.943626  7888 rpcz_store.cc:276] 0709 13:16:12.875576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.875989 (+   413us) service_pool.cc:224] Handling call
0709 13:16:12.891192 (+ 15203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.717363 (+826171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.905362 (+187999us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b5400551ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:13.905549 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890621184}
I20260709 13:16:13.923435  7186 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:16:13.924134  7328 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:13.867661 14365 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.924702  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:13.925539  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1238) took 1026 ms. Trace:
W20260709 13:16:13.926849  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.949149  7891 rpcz_store.cc:276] 0709 13:16:12.899172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.899334 (+   162us) service_pool.cc:224] Handling call
0709 13:16:13.925369 (+1026035us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b540043b2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:13.925482 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1746272128}
W20260709 13:16:13.927014  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 53695.3us
I20260709 13:16:13.863281 13824 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.978917 13824 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.895078 14034 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.930804  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:13.931128  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:13.990782  7329 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
W20260709 13:16:13.990856  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 59795us
I20260709 13:16:13.927646  7862 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:13.932387  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:13.924614 14107 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:16:13.993934  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 66369.2us
I20260709 13:16:13.997538  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:13.932847 14348 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:13.913981 14301 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.937132  7179 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:16:13.933467  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:14.015034  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:14.015805  7186 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:16:14.016175  7186 pending_rounds.cc:85] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 8
I20260709 13:16:14.016666  7186 pending_rounds.cc:107] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:16:14.016920  7186 raft_consensus.cc:2889] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.881557 14121 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:13.886482 14321 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:13.956496  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.026808 14136 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:16:14.027592  7261 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:16:14.027681 14136 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:14.028198 14136 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:14.028717  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.028862 14325 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:14.029469  7261 raft_consensus.cc:2368] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19.
I20260709 13:16:14.030102 14325 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:13.957275  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1141) took 1236 ms. Trace:
I20260709 13:16:13.957631  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.031255  7254 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:14.032218  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.033313  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.033973  7254 raft_consensus.cc:2368] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21.
I20260709 13:16:13.958385  7253 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:16:14.016111  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.958909  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.958902  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:13.959800 14365 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:13.960299 14118 consensus_queue.cc:1059] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:13.948848 14273 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:16:13.960988  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:13.962782  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:13.952219  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:13.964000  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.964603 14353 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:13.967016  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:13.967444 14384 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:13.975399 14313 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:13.971635 14003 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.047045  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:14.050949  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:13.977835 14329 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:13.988088  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:14.056353  7894 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:13.988564  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2557) took 1140 ms. Trace:
I20260709 13:16:14.007354  7262 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:14.015205  7335 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:13.946269  7299 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:14.022640  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.057368  7334 rpcz_store.cc:276] 0709 13:16:12.848399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.014440 (+166041us) service_pool.cc:224] Handling call
0709 13:16:13.988359 (+973919us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54000e10d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:13.988492 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767902592}
I20260709 13:16:14.022862 14034 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:14.011161 14221 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:14.023734 14364 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:14.013669 14045 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:14.026556 14300 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:14.028146  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:13.956775 14276 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:14.030392  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.036507  7259 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:16:14.073307  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:14.037109  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.041076  7328 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:14.041723  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:14.043568  7861 leader_election.cc:400] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19.
I20260709 13:16:14.040622 14019 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.045696  7260 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:14.074496  7254 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:14.053382 14148 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:14.010902 14107 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.055164  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:14.082077  7186 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:14.058466  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:14.030792  7327 rpcz_store.cc:276] 0709 13:16:12.721145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.726790 (+  5645us) service_pool.cc:224] Handling call
0709 13:16:12.737180 (+ 10390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.749075 (+ 11895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.749113 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:12.777075 (+ 27962us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.042255 (+265180us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:13.042309 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.042393 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.864046 (+821653us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:13.944631 (+ 80585us) raft_consensus.cc:1685] finished
0709 13:16:13.944656 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.957203 (+ 12547us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4260,"raft.queue_time_us":7259,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":23719,"spinlock_wait_cycles":2442496,"thread_start_us":229947,"threads_started":1,"wal-append.queue_time_us":376832}
I20260709 13:16:14.061509  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:14.062239  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:14.063005  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:14.082820  7183 raft_consensus.cc:2410] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
W20260709 13:16:14.064327  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 112203us
I20260709 13:16:14.083050  7187 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:14.087788  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:14.087960  7333 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:14.059568 14301 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:14.035909 14348 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:14.071947  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 125779us
I20260709 13:16:14.036705  7257 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:16:13.987737 13824 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:14.074751  7861 leader_election.cc:403] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:16:14.035377 14330 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:16:14.068195  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.103566  7178 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:14.128193  7262 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:14.080981  7894 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:14.030511 14325 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:14.068775  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 107875us
I20260709 13:16:14.134074  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:14.092851  7330 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:14.054774 14121 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:14.139406  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.139693  7183 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:16:14.140183  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.058780 14321 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:14.085877 14107 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:14.103155  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:14.145121  7186 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:14.127089  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:14.107421  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:14.131317  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 92112.7us
I20260709 13:16:14.029349 14136 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.076704 14045 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.136811  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.071450 14344 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:14.089447  7261 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:16:14.061367 14287 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.067s
I20260709 13:16:14.147264  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:14.157204  7329 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:14.095476 13694 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:14.148766  7328 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:16:14.061196 14324 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 13:16:14.154526  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:14.160480  7181 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 27. Current term is 28. Ops: []
I20260709 13:16:14.132499 14352 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:14.162719  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.167447  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.170259  7259 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:14.162920  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:14.172910  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:14.174472  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.175205  7254 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 13.
I20260709 13:16:14.076056 14082 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:16:14.088873 13850 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:16:14.169529  7262 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:14.179785  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.167001 14339 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:14.184433  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50427.2us
I20260709 13:16:14.195923  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:14.196611  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:14.153592 14381 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:16:14.185179 14398 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:16:14.162984 13694 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.183970  7335 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 28.
I20260709 13:16:14.084707 14019 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:14.147100 14113 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:14.141176 14318 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19.
I20260709 13:16:14.144976 14330 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.146401 14063 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:14.195466 14299 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.199298  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.199991  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.164338 14045 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:14.208010  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:14.188277 14148 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:14.211226  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.211601  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:14.193583 14343 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:14.187623 14344 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:14.147421 14353 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:16:14.217422  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:14.202813 14381 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.305759  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.306531  7254 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
W20260709 13:16:14.306540  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 110096us
W20260709 13:16:14.197582  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.308449  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:14.235168  7262 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:14.236536  7261 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:14.238037  7186 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:14.239933  7259 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:14.192281 14384 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:16:14.207569 13694 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:14.216125 14136 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:14.255151  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.209681 14113 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:14.279385  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.320859  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.279685  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.309901  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:14.311137  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:14.285585 14398 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:16:14.242030 14321 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:14.316454  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.317315  7253 raft_consensus.cc:2368] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21.
I20260709 13:16:14.328925  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.316526  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.261868 14029 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:14.319892  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.332427  7254 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 22: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:14.311450 14381 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:14.323249  7328 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:14.333134  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.325217  7329 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:16:14.329771  7259 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:14.305455 14004 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.332916  7260 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
W20260709 13:16:14.324617 14400 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:16:14.234113 14330 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.260583 14343 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.333906  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.350673  7262 raft_consensus.cc:2393] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:14.341120 14004 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.243304 14299 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.324116 14148 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.355429  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.355857  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:14.348469  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.357234  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:14.221647 14325 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.327374 14380 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:14.352605  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:14.234336 14121 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.364177  7187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:16:14.365248  7187 raft_consensus.cc:606] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:14.365731  7187 raft_consensus.cc:614] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:14.317888 14318 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.030s
W20260709 13:16:14.360369  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52009.6us
I20260709 13:16:14.369043  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:14.369089  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:14.356964  7254 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:14.370910  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.371290  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:14.372366  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.373193  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:14.374010  7259 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:14.372174  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.375248  7254 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:16:14.375609  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.377301  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.378091 14321 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:14.378767  7259 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:14.379958  7228 leader_election.cc:400] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22.
I20260709 13:16:14.377182  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.356153  7253 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:14.382416  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.380813  7259 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:16:14.386142  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:14.387564  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:14.388394  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:14.389755  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.384025  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:14.390825  7259 raft_consensus.cc:2393] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 16: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:14.390146  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:14.383236  7260 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:14.393409  7262 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:16:14.344681 14353 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:14.345373 14329 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:14.399842  7262 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:14.400326  7259 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:16:14.403053  7259 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:14.403384  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:14.404323  7894 raft_consensus.cc:2393] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 16: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:14.406001  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:14.406231  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:14.407943  7259 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:16:14.358222 14343 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:14.410084  7334 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:14.408107  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.412652  7254 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:16:14.412732  7333 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:14.415541  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:14.416419  7261 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:14.361852 14364 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:14.415477  7262 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 13:16:14.418792  7253 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:14.419162  7262 pending_rounds.cc:85] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 12
I20260709 13:16:14.413877  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:14.419483  7262 pending_rounds.cc:107] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 13:16:14.417971  7894 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:16:14.419816  7262 raft_consensus.cc:2889] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:14.363502 14352 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:14.418133  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:14.416395  7327 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:14.419883  7887 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:14.393659 13850 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:14.397436 13858 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:16:14.428017  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 48242us
I20260709 13:16:14.426222  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:14.427282 13850 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.443210 13850 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:14.443871 13571 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.005s
I20260709 13:16:14.444005 14299 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:14.444355 13571 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:14.445556 14399 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:16:14.412352 13288 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.033s
W20260709 13:16:14.448768 14397 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 13:16:14.449971  7261 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:14.451249 14384 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:14.452620 14339 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:14.453043 14339 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:14.382020 14148 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.455982  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:14.456768 14148 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:14.430150 14118 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:14.457593 13782 raft_consensus.cc:3055] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:14.457695 14004 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:14.458137 13782 raft_consensus.cc:740] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:14.444880  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.459079 13782 consensus_queue.cc:260] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:14.460136 13782 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:14.450433  7261 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:14.464171  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:14.454653  7335 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:14.445583  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:14.442920 14318 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:14.465793  7334 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:14.466882  7328 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:14.464071  7261 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:14.427452 14029 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:14.470383  7261 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:14.466439 13858 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:14.470765 14029 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.471905 13858 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:14.478116 14396 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.337s	user 0.000s	sys 0.005s
I20260709 13:16:14.415733 14113 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.480042 14113 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:14.480151 14395 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:16:14.457628 14118 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.484375 14118 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:14.485802  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.453929 14339 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:14.490360 14004 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:14.490298 14352 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:14.492444  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:14.500168  7259 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 27. Current term is 28. Ops: []
I20260709 13:16:14.503837  7334 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:14.438433 14348 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:14.506534  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:14.478284 14221 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:14.510030  7892 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 15.
W20260709 13:16:14.511456  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.490459 14343 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:14.513415  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.514899  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:14.515504 13571 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:14.509238 14403 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:14.515990 14413 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:14.516427  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:14.553450  7334 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:16:14.553697  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:14.519038 14004 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:14.533018 14339 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:14.416760 14380 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:16:14.438234 14324 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.077s
W20260709 13:16:14.606070  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 179870us
I20260709 13:16:14.539855 14276 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:14.416635 14344 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.511602  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.567296 14401 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:16:14.572116 14343 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:14.504400 13694 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.646087  7261 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 16. (term mismatch)
W20260709 13:16:14.579982  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.646716  7261 pending_rounds.cc:85] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 15
I20260709 13:16:14.579298 14299 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:14.581219  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:14.647055  7261 pending_rounds.cc:107] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 13:16:14.581386 14019 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:14.587021 14330 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:14.588657  7259 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 18. Current term is 19. Ops: []
W20260709 13:16:14.603452  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 49875.8us
I20260709 13:16:14.491979 13850 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:14.528702 14327 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:14.558189 14301 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:16:14.579268  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 150554us
I20260709 13:16:14.673655  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:14.677704  7888 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:14.679085  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.680004  7256 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:14.682240  7228 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:14.647737  7334 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:16:14.520923 14411 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:14.650760  7261 raft_consensus.cc:2889] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:14.653611  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:14.635434 13571 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:14.668695  7336 raft_consensus.cc:2393] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:14.674322 14300 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:16:14.685045  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:14.723304  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.724597  7186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:16:14.749822  7186 raft_consensus.cc:606] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Received request to transfer leadership to TS c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:14.669227 14301 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.618127 14403 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:14.794178  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44239.9us
W20260709 13:16:14.730528  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.733661  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 51556.4us
I20260709 13:16:14.796509  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:14.648619 14299 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:14.738880  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 85359.2us
I20260709 13:16:14.684187  7329 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:14.727883 14019 raft_consensus.cc:2764] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:16:14.801491  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:14.801752 14403 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:14.802211  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.803032 14424 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.003s
W20260709 13:16:14.804464 14414 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.075s	user 0.000s	sys 0.002s
I20260709 13:16:14.752868 14411 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:14.758993 13571 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:14.806532 13850 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:14.806351 14411 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:14.806437 13571 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:14.747228 14063 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 25 current term: 25 is higher.
I20260709 13:16:14.763773 14415 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.754801 14409 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.104s
W20260709 13:16:14.810907 14045 consensus_meta.cc:287] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.000s
I20260709 13:16:14.811395 14045 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.811770 14118 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:14.814106 14045 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:14.818025 14276 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.826697 14273 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:14.810916 14415 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:14.830092 14107 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.000s
I20260709 13:16:14.846486  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:14.847012  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:14.847205  7329 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:14.847769  7327 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:14.848208  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:14.848850  7329 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:14.849562  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:14.796988 14330 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:16:14.850775 14330 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:14.851810 14330 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.853180 14330 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:14.833250  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:14.853816  7181 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:14.795404 14301 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:14.836334  7256 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:14.814235 14118 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:14.751952 14343 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:14.841300 14133 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:14.880143  7179 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:14.816495 14003 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:14.844116 14403 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:16:14.844939 14325 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:14.845062  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.900732  7259 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:14.846902 14107 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:14.852785  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:14.813786 14381 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:14.857391  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:14.905731  7184 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:14.861375  7330 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
W20260709 13:16:14.858516  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.863719  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:14.865350  7328 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 27. Current term is 28. Ops: []
W20260709 13:16:14.867071  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 72067.6us
I20260709 13:16:14.907092  7335 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 28.
W20260709 13:16:14.867328  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.908165  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.906129  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48903.5us
I20260709 13:16:14.830989  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:14.909049  7334 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:14.879333  7332 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
W20260709 13:16:14.844105 14313 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.789s	user 0.013s	sys 0.000s
I20260709 13:16:14.884068  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:14.913259  7894 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
W20260709 13:16:14.885535  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 89101.1us
I20260709 13:16:14.916538  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:14.917405 14365 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.864s	user 0.008s	sys 0.005s
I20260709 13:16:14.927547 13694 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:14.796802 14256 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:14.830261 14415 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:14.929319  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 45388.4us
I20260709 13:16:14.930649  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:14.932142 14364 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:14.932878  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:14.862725  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:14.865926 14343 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.863457 14407 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:16:14.946877 14343 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:14.950124  7329 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:14.952507  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:14.954042  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:14.930433 14420 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
W20260709 13:16:14.932951  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 74066.3us
I20260709 13:16:14.940188 14416 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:14.967857 14416 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.968297 14416 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:14.940809 14063 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:14.941004 14422 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.138s	user 0.001s	sys 0.002s
I20260709 13:16:14.966248  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:14.932540 14364 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.928329 14256 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:14.942793 14034 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.880357 14133 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:14.954545  7184 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:16:14.933919 14118 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:14.954958  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:14.957371  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:14.993340  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:14.963687  7181 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:14.960165  7259 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:14.918053 14365 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:14.967222  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 106625us
W20260709 13:16:14.955293  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52361us
I20260709 13:16:14.970144 14415 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:14.996217  7225 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:14.907809 14348 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:14.987493  7179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:16:14.838243 14299 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:14.969861 14003 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:14.965139  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:14.949965 14004 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:16:14.988119 14364 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:14.997371  7179 raft_consensus.cc:606] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Received request to transfer leadership to TS c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:15.001688  7862 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:14.989014 13782 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:16:15.004526  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:15.007367  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:14.992221 14118 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.014187  7258 raft_consensus.cc:2368] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22.
I20260709 13:16:14.998534 14003 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.998464 14063 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:15.027434  7331 raft_consensus.cc:2410] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:16:15.002820 14423 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:14.991673 14034 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.006140 13782 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:15.012173 14321 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:15.012676 14319 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:15.006568 14253 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:15.015156 14118 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:15.015859 13824 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:15.069482  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 69488.4us
I20260709 13:16:15.014355 14300 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:15.015355 14327 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:15.070366  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:15.057785 14319 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:15.071520 14319 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:15.071623  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:15.072616 14423 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:15.073009 14423 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.073047  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:15.073510 14423 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:15.074695 14374 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:15.070361 14300 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:15.076216 14300 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.030009 14063 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.029600 14003 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:15.066123 14321 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:15.069054 14045 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.055743 13782 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:15.065856 14381 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:15.082455 14063 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:15.096674 14029 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:15.082372 13824 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:15.103610  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:15.137961  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:15.101722  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 94432.9us
W20260709 13:16:15.232789  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.140188  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:15.255621  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 115563us
I20260709 13:16:15.256677  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:15.258159  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:15.036684 14256 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:15.263203  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 125336us
I20260709 13:16:15.268992  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:15.270555 14019 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:15.260973 14004 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:15.271932 14004 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:15.272343 14004 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:15.275321 14256 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:15.279448 14365 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:15.262588 14348 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:16:15.282940 14321 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.283690 14348 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 28 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:15.284721 14348 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.286689 14327 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:15.287222 14327 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.266649  7225 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:15.287627 14327 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:15.095304 14133 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.309696 14003 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.279706 14034 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:15.262521 14410 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:15.100605 14045 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:15.323338 14418 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.516s	user 0.003s	sys 0.000s
W20260709 13:16:15.328461  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 61935.7us
W20260709 13:16:15.336019  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46282.6us
I20260709 13:16:15.112665 14301 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.339643 14004 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.350675  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:15.131801 14029 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:15.359663  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:15.264425 14423 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.342555 14019 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:15.374483 14004 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:15.375377  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.367364 14029 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:15.362804 14343 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:15.348701 14344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.063s	sys 0.087s
I20260709 13:16:15.409781  7185 raft_consensus.cc:2368] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21.
W20260709 13:16:15.410019  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 57843.1us
I20260709 13:16:15.414053  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:15.411309 14279 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:15.417407 14279 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.418114 14423 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:15.419860 14279 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:15.420154  7180 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:15.423604 14003 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:15.425388 14325 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.002s
I20260709 13:16:15.357913 14034 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:16:15.358052 14365 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 13:16:15.432493 14374 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:15.432909 14364 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.436208 14045 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:15.413092 14019 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:15.437012 14364 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:15.437753 14118 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.437870 14019 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.440349 14118 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:15.435884 14416 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.364861 14353 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:15.377110 14409 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:16:15.443410 14344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.065s	sys 0.093s
I20260709 13:16:15.455089  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1474) took 1436 ms. Trace:
I20260709 13:16:15.451452 14330 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.455546  7260 rpcz_store.cc:276] 0709 13:16:14.018981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.396296 (+377315us) service_pool.cc:224] Handling call
0709 13:16:14.420659 (+ 24363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.421024 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.421061 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.421518 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.649897 (+228379us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:14.649944 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.650021 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.322532 (+672511us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:15.452190 (+129658us) raft_consensus.cc:1685] finished
0709 13:16:15.452225 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.454990 (+  2765us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2335,"raft.queue_time_us":3593,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4326,"spinlock_wait_cycles":165208832,"thread_start_us":185446,"threads_started":1,"wal-append.queue_time_us":278095}
I20260709 13:16:15.461719  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:15.462137 14425 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.647s	user 0.002s	sys 0.002s
I20260709 13:16:15.463099  7180 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:15.463694  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3622) took 1408 ms. Trace:
I20260709 13:16:15.464282  7178 rpcz_store.cc:276] 0709 13:16:14.055774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.128614 (+ 72840us) service_pool.cc:224] Handling call
0709 13:16:14.145539 (+ 16925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.149140 (+  3601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.149172 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.184713 (+ 35541us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.594311 (+409598us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b1800407020. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:16:14.639687 (+ 45376us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:14.639730 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.639804 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.357901 (+718097us) spinlock_profiling.cc:243] Waited 64.2 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:15.463405 (+105504us) raft_consensus.cc:1685] finished
0709 13:16:15.463433 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.463621 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3212,"raft.queue_time_us":8146,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":12139,"spinlock_wait_cycles":151298176,"thread_start_us":45150,"threads_started":1,"wal-append.queue_time_us":608683}
I20260709 13:16:15.466425  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:15.466889  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 198021us
I20260709 13:16:15.467293  7894 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:15.468519  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:15.447738 14321 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:15.474261  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:15.474987  7889 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:15.454838 14440 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:15.472517  7152 leader_election.cc:400] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21.
I20260709 13:16:15.481025  7152 leader_election.cc:403] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:16:15.452198 14409 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:15.472038 14330 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.496670  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2489) took 1072 ms. Trace:
I20260709 13:16:15.497267 14330 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:15.498116 14440 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.497920 14299 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.474543 14253 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:15.498677 14440 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:15.462287 14343 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:15.510739 14319 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.497144  7331 rpcz_store.cc:276] 0709 13:16:14.423902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.455683 (+ 31781us) service_pool.cc:224] Handling call
0709 13:16:15.496414 (+1040731us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b540031bad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:15.496603 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310575360}
I20260709 13:16:15.535887  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:15.511997 14416 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:15.512400  7889 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
W20260709 13:16:15.513119 14419 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.698s	user 0.006s	sys 0.005s
W20260709 13:16:15.514403 14426 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.694s	user 0.012s	sys 0.000s
I20260709 13:16:15.514075 14327 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:15.515311  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 45201us
I20260709 13:16:15.554039  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:15.555788  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:15.556885 14004 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:15.557341  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:15.515847 14409 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:15.515805 14344 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21.
I20260709 13:16:15.563964 14299 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:15.534704 14447 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
W20260709 13:16:15.516739 14443 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:15.516652  7894 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:15.527644 14301 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:15.529363  7262 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:16:15.529825  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 629999us
W20260709 13:16:15.531709  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 631538us
I20260709 13:16:15.536626  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:15.539537  7862 leader_election.cc:400] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21.
I20260709 13:16:15.588313  7301 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:15.588613  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49633.8us
I20260709 13:16:15.557597 14004 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:15.548225 14253 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:15.566587  7299 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:15.594139  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:15.567456  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:15.589701  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:15.574252  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:15.567073  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:15.595352  7327 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:16:15.595925  7334 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:15.610437  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:15.611065  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 44557us
I20260709 13:16:15.597180  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:15.611975  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:15.595758  7889 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:15.610452  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:15.592126 14446 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:15.626844  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:15.627704  7179 raft_consensus.cc:2368] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21.
I20260709 13:16:15.563970 14319 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:15.624274  7299 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:15.569660 14327 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:15.593397 14004 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:15.636633  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 277027us
I20260709 13:16:15.637320 14004 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:15.638211 14253 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.633500 14381 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:15.683887  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:15.642891  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1483) took 1144 ms. Trace:
I20260709 13:16:15.685237  7257 rpcz_store.cc:276] 0709 13:16:14.498962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.499160 (+   198us) service_pool.cc:224] Handling call
0709 13:16:14.527497 (+ 28337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.542551 (+ 15054us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:16:14.542605 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.617885 (+ 75280us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.737936 (+120051us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:14.737982 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.738066 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.513686 (+775620us) spinlock_profiling.cc:243] Waited 59.2 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:15.642498 (+128812us) raft_consensus.cc:1685] finished
0709 13:16:15.642525 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.642817 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4270,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":19608,"spinlock_wait_cycles":136267008,"thread_start_us":78962,"threads_started":1,"wal-append.queue_time_us":173938}
I20260709 13:16:15.644615  7185 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:15.631001 14136 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:15.613336 14082 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:15.653251  7888 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:15.653573  7892 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:16:15.653972  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:15.655937  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:15.692807  7887 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:15.631340 14148 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:15.656760  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:15.614727 14301 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:15.655937  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:15.629017 13782 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:15.660523 14427 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.649s	user 0.000s	sys 0.002s
I20260709 13:16:15.660233 14063 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.668041  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:15.669085  7891 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:15.670795  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:15.671119  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 77059.9us
I20260709 13:16:15.666488  7150 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:15.672132  7258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2442) took 1637 ms (client timeout 1502 ms). Trace:
W20260709 13:16:15.673744  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.711526  7889 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 16.
I20260709 13:16:15.633414 14299 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:15.674714  7261 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:16:15.675009  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1361) took 1183 ms. Trace:
I20260709 13:16:15.714159 14413 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.715554 14446 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:15.714125  7182 rpcz_store.cc:276] 0709 13:16:14.492019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.492223 (+   204us) service_pool.cc:224] Handling call
0709 13:16:14.504302 (+ 12079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.518613 (+ 14311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.518669 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.519167 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.620377 (+101210us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:16:14.620435 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.620539 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.512355 (+891816us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:15.670491 (+158136us) raft_consensus.cc:1685] finished
0709 13:16:15.670527 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.674942 (+  4415us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13907,"raft.queue_time_us":75714,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":37070592,"thread_start_us":100785,"threads_started":1,"wal-append.queue_time_us":175176}
I20260709 13:16:15.627424 14339 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.716172 14446 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:15.716809  7185 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:16:15.716691 14339 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.717278 14446 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.715560 14413 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:15.635839 14415 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.002s
I20260709 13:16:15.719872 14415 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:15.719324  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 52935.9us
I20260709 13:16:15.681612  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:15.696336  7327 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:15.723450  7179 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:16:15.723932 14344 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:15.725539 13824 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:15.725651  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:15.697504  7332 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:15.726408 14118 raft_consensus.cc:993] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: : Instructing follower c85cf49c63cc4e66b4747d8c4fa14022 to start an election
I20260709 13:16:15.677677  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:15.719430 14339 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:15.727384  7260 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:15.730814 14327 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.703745  7331 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:16:15.726011 13824 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:15.731454 14327 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.732398 13824 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.733678 14327 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:15.733625 13824 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:15.731846  7179 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:15.721935  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:15.634351 14330 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:16:15.739863  7178 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:15.726912 14415 raft_consensus.cc:1081] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Signalling peer c85cf49c63cc4e66b4747d8c4fa14022 to start an election
I20260709 13:16:15.741838  7327 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:15.741844  7260 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:15.743257  7178 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:16:15.738211  7332 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
W20260709 13:16:15.710114  7152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.502s (SENT) [suppressed 25 similar messages]
W20260709 13:16:15.710902  7258 rpcz_store.cc:269] 0709 13:16:14.024921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.027878 (+  2957us) service_pool.cc:224] Handling call
0709 13:16:15.662296 (+1634418us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b5400216bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:15.662490 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2159785344}
I20260709 13:16:15.764441 14118 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:15.764568 14415 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:15.694789 14381 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:15.695943 14148 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.779942  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:15.782218  7255 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:15.782974  7178 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
W20260709 13:16:15.784596  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 103072us
I20260709 13:16:15.697217 14301 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:15.706925 14136 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:16:15.794713 14411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.013s	sys 0.030s
I20260709 13:16:15.792677 14299 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:15.706841 14082 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:15.796865 14451 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:15.809201  7179 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:16:15.801360  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:15.818004  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:15.779147 14319 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.785884 14148 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:15.799870 14411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.013s	sys 0.030s
I20260709 13:16:15.799947 14301 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:15.773753 14339 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:16:15.831943 14019 raft_consensus.cc:2764] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:16:15.845535  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:15.832621 14416 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:15.840570  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:15.850283  7259 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 22: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:15.836089  7260 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:15.822940 14348 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:15.843355  7254 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:16:15.851668  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:15.856703  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:15.836087  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:15.858009  7261 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:15.855605  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:15.800819 14406 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:16:15.860860  7253 raft_consensus.cc:2393] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 19: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:15.856050  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:15.863067  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:15.867679  7257 raft_consensus.cc:2376] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19. Re-sending same reply.
I20260709 13:16:15.863832  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:15.863365  7259 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 22: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:15.873809  7894 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:15.885847  7261 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
W20260709 13:16:15.886466  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 262325us
I20260709 13:16:15.888398  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:15.888619  7894 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:15.890539  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:15.892905  7895 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:15.891216 14327 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:15.894757  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:15.895787  7333 raft_consensus.cc:2368] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21.
I20260709 13:16:15.894356 14327 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.898772 14327 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:15.900102  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:15.902412  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:15.906349  7261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf"
dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
mode: GRACEFUL
new_leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
 from {username='slave'} at 127.0.0.1:46710
I20260709 13:16:15.830157 14319 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.887488  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1362) took 1386 ms. Trace:
I20260709 13:16:15.909437  7859 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:15.912427  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:15.913125  7894 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:15.834545 14462 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:16:15.913069  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:15.915503  7895 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:16:15.912132  7187 rpcz_store.cc:276] 0709 13:16:14.500905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.501111 (+   206us) service_pool.cc:224] Handling call
0709 13:16:14.504605 (+  3494us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:14.531514 (+ 26909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.531571 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:14.637013 (+105442us) log.cc:844] Serialized 52 byte log entry
0709 13:16:14.837127 (+200114us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:14.837166 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.837230 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.659848 (+822618us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:15.875151 (+215303us) raft_consensus.cc:1685] finished
0709 13:16:15.875180 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.887407 (+ 12227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14764,"raft.queue_time_us":75636,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":48,"spinlock_wait_cycles":5258112,"thread_start_us":151557,"threads_started":1,"wal-append.queue_time_us":311990}
I20260709 13:16:15.907588  7261 raft_consensus.cc:606] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Received request to transfer leadership to TS 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:15.922152  7261 raft_consensus.cc:614] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:15.922552  7887 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:15.849422 14440 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.874177 14113 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.926203  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:15.932487  7254 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:16:15.933773  7894 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:15.935366  7859 leader_election.cc:400] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21.
I20260709 13:16:15.935765  7859 leader_election.cc:403] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:16:15.935794  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:15.919967 14459 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:15.942044  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:15.861685 14463 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:16:15.915217 14465 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:15.916908 14063 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:15.948844  7888 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:15.951894  7256 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:15.934547 14406 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:15.939519 14327 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:16:15.957307  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 100315us
I20260709 13:16:15.938856 14462 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:15.943719 14019 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:15.877038 14381 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.939513 14459 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.911154 14299 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.945257 14407 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.951035 14465 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.888164 14082 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:15.963589  7332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
 from {username='slave'} at 127.0.0.1:33688
I20260709 13:16:15.974531  7332 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:15.975083  7332 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:15.961567 14327 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.942515 14113 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.973413  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:15.939325 14451 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:16:15.965543 14019 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:15.967638  7150 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:15.939599 14348 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:16:15.968357 14462 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:15.968875 14459 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:16.013896  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2581) took 1194 ms. Trace:
I20260709 13:16:15.966516 13782 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:15.972627 14465 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:15.993820 14469 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:15.997831 14402 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21.
I20260709 13:16:16.002357 14413 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:16.002908 14468 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:16.003702 14348 consensus_queue.cc:1243] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:16:16.004643 14462 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.005275  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:16.006799  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:15.985529 14406 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:16.008303 14440 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:16.008994  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:16.018523  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:16.014426  7336 rpcz_store.cc:276] 0709 13:16:14.819327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.893780 (+ 74453us) service_pool.cc:224] Handling call
0709 13:16:14.894361 (+   581us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:15.525229 (+630868us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:15.525561 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.695430 (+169869us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:15.705440 (+ 10010us) log.cc:844] Serialized 52 byte log entry
0709 13:16:15.705633 (+   193us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:15.792160 (+ 86527us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.013295 (+221135us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b5400184820. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece91b7733 00007fece923cdbf 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c
0709 13:16:16.013360 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.013458 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.013602 (+   144us) raft_consensus.cc:1685] finished
0709 13:16:16.013630 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.013814 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":692858,"prepare.queue_time_us":86545,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":84,"raft.queue_time_us":686528,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":10341,"spinlock_wait_cycles":9154944,"thread_start_us":255552,"threads_started":2,"wal-append.queue_time_us":245794}
W20260709 13:16:16.016849  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49312.5us
I20260709 13:16:15.986009 14327 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:15.968600 14411 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:16:16.017385 14019 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:16.036916  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:16.045753  7332 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:15.947929 14136 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:16.065552 14133 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:16.072062 14460 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.078161  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:16.084506 14113 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:16.086059 14029 consensus_meta.cc:287] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.676s	user 0.005s	sys 0.006s
I20260709 13:16:15.972430 14407 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:16.090101  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 379993us
I20260709 13:16:16.091435 14107 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:16.027118 14415 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:16.032264 14273 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:16:16.152797 14329 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:16.153841 14329 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:16.154213 14329 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:16.155730  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:16.156456  7180 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:16.099097  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:16.159044  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:16.159158  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 60220us
I20260709 13:16:16.159780  7253 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:16.109762  7331 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:16.160712 14339 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:16.161165 14339 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.108719  7333 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:16.161509 14339 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:16.161952 14472 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:16.110852  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:16.164304  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:16.164989  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 54229.8us
I20260709 13:16:16.165345  7186 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:16.162207  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:16.113090  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 188196us
W20260709 13:16:16.120302  7330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2571) took 1922 ms (client timeout 2090 ms). Trace:
I20260709 13:16:16.104867 14321 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.107460 14256 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.105124 14348 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.189147  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:16.136890  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:16.139269  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:16.191536  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:16.116466 14325 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.141739  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:16.086395 14301 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.151134  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:16.195477  7261 raft_consensus.cc:2368] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22.
I20260709 13:16:16.195652  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:16.109920  7334 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:16.196941  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:16.197767  7334 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:16.178233  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:16.181071  7330 rpcz_store.cc:269] 0709 13:16:14.193305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.193466 (+   161us) service_pool.cc:224] Handling call
0709 13:16:16.115207 (+1921741us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b540013e054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:16.115335 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335001984}
I20260709 13:16:16.179149  7332 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.192989  7184 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:16.199930  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:16.096212 14468 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.200387  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:16.201201  7186 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:16:16.196836  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:16.171833  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:16.208699  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:16.205221  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:16.141395 14413 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.206316  7187 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:16:16.206609  7180 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:16.149341 13782 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.219118  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:16.224493  7333 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:16.211139  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:16.150996 14319 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:16.226138  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:16.227149  7887 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:16.221186  7187 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:16.190115 14450 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:16.229864  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:16.221635  7180 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:16.231014  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:16.235550  7894 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:16.231592  7331 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:16.238027  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:16.238909  7330 raft_consensus.cc:2376] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22. Re-sending same reply.
I20260709 13:16:16.239538  7179 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:16.245074  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:16.246011  7183 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:16.244002  7187 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:16.140841 14460 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:16.219588 14409 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.661s	user 0.004s	sys 0.008s
I20260709 13:16:16.246284  7862 leader_election.cc:400] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21.
I20260709 13:16:16.142863 14029 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.201757 14415 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:16.223627 14063 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:16.293835  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:16.292902  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 131408us
I20260709 13:16:16.300912  7186 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:16.290795  7334 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:16.303645  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:16.304778  7334 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:16.327075  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:16.193783 14321 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:16.333667  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:16.201932 14256 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:16.334403  7327 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 22: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:16.234601 14353 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:16.334992 14450 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:16.205693 14348 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.336840  7887 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 17. (term mismatch)
I20260709 13:16:16.347023  7334 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:16.250072 14411 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:16.353762 14256 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:16.354310  7327 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:16:16.229064 14416 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.110s
I20260709 13:16:16.206017 14325 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.308542 14063 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:16.228928 14413 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:16.382274  7887 pending_rounds.cc:85] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 16
W20260709 13:16:16.382418  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 342420us
I20260709 13:16:16.249034 13782 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.342192 14353 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.412947  7887 pending_rounds.cc:107] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 27.17
I20260709 13:16:16.413591  7887 raft_consensus.cc:2889] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.397966  7179 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:16.342855 13571 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.294560 14409 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.416245  7327 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:16.308781 14459 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.432724  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:16.247390 14406 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.410990 14063 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:16.436123  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.417230 14344 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.332181 14136 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.307817 14329 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.418480 14353 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:16.379120 14480 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:16:16.455662 14381 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:16.428268 14273 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.398665 14411 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.423895 14256 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:16:16.461992 14107 raft_consensus.cc:993] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: : Instructing follower c85cf49c63cc4e66b4747d8c4fa14022 to start an election
I20260709 13:16:16.448132 14343 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:16.489297 14477 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:16:16.490221 14459 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:16.491745 14413 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:16.492491 14148 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.003s
I20260709 13:16:16.493552 14325 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:16.494330 14468 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.494930 14450 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.425518 13571 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.473863 14381 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:16.458395 14344 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:16.500893 14381 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:16.502291 14471 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:16:16.503895 13782 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.504667 14301 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.504417 14343 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:16.474864 14004 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.785s	user 0.014s	sys 0.000s
W20260709 13:16:16.507262 14485 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:16.507171 14004 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:16.508461 14407 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:16.509730  7182 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:16:16.492962 14148 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.511059 14107 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.512100  7328 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:16:16.510286 14004 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:16.420271 14415 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:16.528801  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:16.532502 13858 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:16.533107 13858 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:16.534106 13858 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:16.535457 13858 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:16.541689 14019 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.542392 14343 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.474296 14273 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.545759 14063 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:16.554937  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.548771 13824 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.002s
I20260709 13:16:16.519548 14446 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.513193 14329 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:16.579524  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50825.2us
I20260709 13:16:16.576573  7185 raft_consensus.cc:2410] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:16:16.546386 14273 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.524919 14413 raft_consensus.cc:1081] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Signalling peer c85cf49c63cc4e66b4747d8c4fa14022 to start an election
I20260709 13:16:16.526618 14082 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:16.547737 14451 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:16.601593  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:16.601784  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:16.603113  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:16.603876  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:16.599931  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:16.573833 14004 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:16:16.605958 14118 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:16:16.625061 14321 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:16.599490 14082 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:16.627041 14348 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.594599 13571 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.627189 14082 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:16.628419 14082 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:16.628839 14465 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.594s	user 0.012s	sys 0.000s
I20260709 13:16:16.629356 14465 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.630707  7895 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
W20260709 13:16:16.629827 14469 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.002s
I20260709 13:16:16.631970 14339 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:16.631973 14469 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:16.608439  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:16.638615  7887 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:16.564527 14301 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 13:16:16.648808 14488 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:16:16.652473 14411 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.653875 14409 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.622424 14460 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:16.664130 14063 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:16.672894 14004 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:16:16.673393  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 71915.6us
I20260709 13:16:16.674340  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:16.673453 14494 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:16.594746 14446 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.685321 14446 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.675168 14497 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:16.600122 14148 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.680552  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:16.686578 14497 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:16.687615 14497 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.688144  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:16.689086 14497 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:16.621868 14496 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:16.689988  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:16.687949 14301 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:16:16.679769 14495 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:16.602049 14451 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:16.606088 14029 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.635464 14045 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.634824 14465 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:16.696354  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:16.634454 14339 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:16.680400 14452 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:16:16.673446 14004 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:16.674566 14019 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:16.674552 14344 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:16.689086 14413 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:16.699218 14446 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:16.674942 14353 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:16.743275  7334 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:16.714165 14301 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:16.757830  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.773051  7187 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:16.704195 14045 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:16.751299 14446 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.785475  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:16.841075  7182 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:16.841437  7182 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:16.753486 14019 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.842818  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3846) took 1177 ms. Trace:
I20260709 13:16:16.843245  7255 rpcz_store.cc:276] 0709 13:16:15.665423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.667781 (+  2358us) service_pool.cc:224] Handling call
0709 13:16:16.842580 (+1174799us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b54002260d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:16.842756 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173130496}
W20260709 13:16:16.854174  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.807830  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:16.812404  7180 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:16.857178  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:16.857846  7180 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:16.759366 14413 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:16.759163 14504 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:16.759486 14344 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.839262 14327 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.003s
I20260709 13:16:16.868796  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:16.808561 14063 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.836241  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.792996  7178 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:16.867046 14499 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:16:16.860890  7892 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:16.875144  7180 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
W20260709 13:16:16.792547  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 100235us
I20260709 13:16:16.879863  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:17.043990  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 164220us
I20260709 13:16:17.045823  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:16.883083  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:16.933746  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:16.780397 14496 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:16.863001  7182 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.049157  7182 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:17.056025  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 173091us
I20260709 13:16:17.056828  7152 leader_election.cc:400] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22.
I20260709 13:16:17.057206  7152 leader_election.cc:403] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:16.861168 14348 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.863593 14416 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:16.787688 14451 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.088579  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:17.102070  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:16.877954 14446 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:17.171413  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:17.172260  7891 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:17.054425 14321 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.861529 14019 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:17.250047  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 193253us
I20260709 13:16:16.874323 14344 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.254207  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:17.082037 14502 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:17.251353  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:16.873986 14327 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.151104 14494 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:16:17.248395 14499 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:16:17.284266  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 228155us
I20260709 13:16:16.871939 14504 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.185324 14451 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:17.281548 14494 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.291260  7182 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:17.294174  7183 raft_consensus.cc:2410] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:16:17.097540 14496 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.255892 14411 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22.
I20260709 13:16:17.295131 14514 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:16:17.296712 14507 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
I20260709 13:16:17.311348 14411 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.311971 14411 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.313467  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:17.314467 14411 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.315021 14353 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.316032 14327 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.315956  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.316960  7178 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 28. Current term is 29. Ops: []
I20260709 13:16:17.318202 14029 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:17.318480  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:17.319365  7182 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:16:17.319983 14500 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.506s	user 0.000s	sys 0.001s
W20260709 13:16:17.320247 14497 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.002s
I20260709 13:16:17.063990 14063 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.263296 14118 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:17.325599 14118 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.327535 14063 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.327896 14118 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.330071  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:17.107791 14348 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.323788 14446 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.152531 14416 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.309203  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 1001) took 1064 ms. Trace:
I20260709 13:16:17.308861 14496 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.335966 14514 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:17.336207 14353 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.336455 14451 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:16:17.336724  7185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3630) took 1616 ms (client timeout 1937 ms). Trace:
W20260709 13:16:17.308418 14506 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.456s	user 0.001s	sys 0.000s
I20260709 13:16:17.337401 14063 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:17.337697  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2505) took 1262 ms. Trace:
W20260709 13:16:17.376108  7185 rpcz_store.cc:269] 0709 13:16:15.720045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.721661 (+  1616us) service_pool.cc:224] Handling call
0709 13:16:17.336466 (+1614805us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b540039d5d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:17.336662 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1924006656}
W20260709 13:16:17.341156 14478 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.917s	user 0.002s	sys 0.000s
I20260709 13:16:17.344769 14019 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.335602  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2497) took 1314 ms. Trace:
W20260709 13:16:17.309468 14509 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.457s	user 0.000s	sys 0.001s
I20260709 13:16:17.252372 14321 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.368471  7888 rpcz_store.cc:276] 0709 13:16:16.245138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.283901 (+ 38763us) service_pool.cc:224] Handling call
0709 13:16:16.327485 (+ 43584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.343668 (+ 16183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.343721 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.344388 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 13:16:16.713912 (+369524us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:16.713973 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.714077 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.308933 (+594856us) raft_consensus.cc:1685] finished
0709 13:16:17.308973 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.309141 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15703,"raft.queue_time_us":27081,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":15181,"thread_start_us":303282,"threads_started":1,"wal-append.queue_time_us":659250}
I20260709 13:16:17.336894 14327 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:17.376773  7334 rpcz_store.cc:276] 0709 13:16:16.074889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.382488 (+307599us) service_pool.cc:224] Handling call
0709 13:16:16.382902 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.743803 (+360901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.337453 (+593650us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54001ffed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:17.337636 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828243328}
I20260709 13:16:17.363415 14494 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:17.380085  7328 rpcz_store.cc:276] 0709 13:16:16.021046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.021177 (+   131us) service_pool.cc:224] Handling call
0709 13:16:16.031475 (+ 10298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.512548 (+481073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.335314 (+822766us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400289bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:17.335539 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104693632}
I20260709 13:16:17.375154 14411 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.378464 14118 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:17.403294  7332 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:16:17.411375  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2499) took 1379 ms. Trace:
I20260709 13:16:17.411895  7332 rpcz_store.cc:276] 0709 13:16:16.032343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.399038 (+1366695us) service_pool.cc:224] Handling call
0709 13:16:17.402870 (+  3832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.411019 (+  8149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.411294 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:17.404824 14321 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:17.379835 14082 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.751s	user 0.012s	sys 0.002s
W20260709 13:16:17.406409  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 405154us
I20260709 13:16:17.396663 14327 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.427632 14321 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.429251  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:17.453756  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:17.453845  7894 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:17.454655  7180 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:17.430007  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:17.455397  7891 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:17.432134 14004 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.433888  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2857) took 1295 ms. Trace:
I20260709 13:16:17.457298  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:17.439229  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2496) took 1418 ms. Trace:
I20260709 13:16:17.458096  7888 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:17.440093 14416 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.284188 14413 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.442582 14348 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.445583  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:17.382012 14353 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.457304  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:17.424037 14118 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.457834  7184 rpcz_store.cc:276] 0709 13:16:16.138181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.208426 (+ 70245us) service_pool.cc:224] Handling call
0709 13:16:17.433632 (+1225206us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b5400259254. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:17.433812 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984146816}
I20260709 13:16:17.458003  7335 rpcz_store.cc:276] 0709 13:16:16.020754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.020899 (+   145us) service_pool.cc:224] Handling call
0709 13:16:16.031582 (+ 10683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.037171 (+  5589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.037223 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.095127 (+ 57904us) log.cc:844] Serialized 26 byte log entry
0709 13:16:16.483516 (+388389us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b18004788a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:16:16.692613 (+209097us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:16.692656 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.692725 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.438879 (+746154us) raft_consensus.cc:1685] finished
0709 13:16:17.438902 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.439158 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28608,"raft.queue_time_us":8719,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":11793,"spinlock_wait_cycles":6129408,"thread_start_us":208845,"threads_started":1,"wal-append.queue_time_us":676860}
I20260709 13:16:17.426168 14315 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.463753  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:17.467516  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.461355 14321 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.464753  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.469518 14118 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.465040  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.470238 14279 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.426659 14498 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:17.473945  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.470831 14279 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.475818  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.476814  7184 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 25: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:17.477546 14279 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.478336  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:17.478935  7228 leader_election.cc:336] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.686s (SENT)
I20260709 13:16:17.479372  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:17.480513 14451 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:17.473763 14498 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.483119 14498 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:17.487779  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.492467  7228 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:17.425590 14411 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.501216  7888 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:17.499006 14348 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.505990  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:17.492676 14004 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:17.500008 14451 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.510098 14416 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:16:17.523213  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 236824us
I20260709 13:16:17.474829 14315 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.527016 14522 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:16:17.530356 14315 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.525796  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:17.526405  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:17.534487  7896 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 28.
W20260709 13:16:17.525653 14329 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.928s	user 0.014s	sys 0.000s
I20260709 13:16:17.171269  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:17.520998 14523 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:17.527571 14344 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.518287 14348 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.523716 14019 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:16:17.551326  7262 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:16:17.551757 14329 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:17.549034 14416 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:17.541414 14522 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:17.553650  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.556378 14315 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.557688  7257 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:17.558980  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.500870 14514 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.564049  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.558570  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.528683 14451 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.553803 14348 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.566145 14329 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.568545 14279 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.572415  7184 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:17.577966  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.548173 14446 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.546732 14497 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.549914 14504 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.569636  7261 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:17.578790  7257 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:17.578466  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.581347  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.594942  7259 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:17.595511  7184 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:17.593436  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.596863  7262 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:17.571165 14502 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:17.599491  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:17.600440 14502 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.603500 14344 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.604326 14344 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.593199 14279 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.608655 14279 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.609171 14344 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.591573  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:17.611833 14344 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.569197 14523 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.623471  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.623688 14344 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.596057 14522 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.640362 14494 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.641628 14045 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:17.642411 14446 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.642757 14329 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.598359 14528 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.050s
I20260709 13:16:17.598173 14497 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.643953 14348 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:16:17.644767  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53285.8us
I20260709 13:16:17.645128 14353 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.593509 14416 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.648396 14411 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.573837 14315 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.660135 14451 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.661450  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.662811  7256 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:16:17.744460  7256 pending_rounds.cc:85] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 10
I20260709 13:16:17.744827  7256 pending_rounds.cc:107] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:16:17.745157  7256 raft_consensus.cc:2889] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:17.671115  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:17.749294  7259 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:17.701110  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:17.672832 14498 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.735097  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:17.754117  7181 raft_consensus.cc:2376] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22. Re-sending same reply.
I20260709 13:16:17.754266  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.738477  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:17.757088  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:17.739408  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:17.758703  7182 raft_consensus.cc:2376] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19. Re-sending same reply.
I20260709 13:16:17.759800  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:17.762380  7257 raft_consensus.cc:2410] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:16:17.747684  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.737524  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.763880  7187 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:17.767236  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:17.681147 14527 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:17.772398  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.773190  7183 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:17.773403  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.773993  7186 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:17.771651  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.775198  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.780057  7178 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:17.744012 14348 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:17.784052 14530 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:17.785629  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:17.786702  7259 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:17.787730  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:17.789440  7260 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:17.754595 14327 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.681700 14522 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:17.796579  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.723728 14446 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.798768  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:17.795439  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:17.771183 14416 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.805898  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:17.801328  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.672467 14523 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.790850 14348 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:17.823894  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.808874  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:17.809387 14327 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:17.809060 14502 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:17.815398  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:17.827872  7253 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:17.819036  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:17.821023  7895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 999) took 1599 ms. Trace:
I20260709 13:16:17.828663  7895 rpcz_store.cc:276] 0709 13:16:16.221412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.221575 (+   163us) service_pool.cc:224] Handling call
0709 13:16:16.221991 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.631186 (+409195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.820752 (+1189566us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400162bd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:17.820962 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939198336}
I20260709 13:16:17.792490 14451 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:17.804790 14530 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.831529  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:17.829602  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:17.835618  7262 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:17.839387  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:17.841531  7259 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:17.782845 14527 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.845432  7260 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:17.844939 14327 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:17.849334 14416 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.850449 14494 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.851100 14498 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.851532  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:17.852166  7895 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:17.853024  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:17.853731  7887 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:17.855903 14522 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.848992 14327 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.831338 14528 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:17.833335 14502 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.865530  7887 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:17.867836  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.868243  7895 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:17.872596  7257 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:17.874733  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.876334  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.872941  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:17.876747  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.877767  7186 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:17.878912  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:17.877192  7181 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:17.860041 14497 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.883942  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:17.867030 14502 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:17.863036 14315 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.885264  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:17.885671  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.889070  7260 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:17.890398  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.891732  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:17.869805 14534 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:17.841904 14530 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.894104  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:17.892746  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:17.880442 14494 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:17.890170 14113 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:17.899820 14113 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:17.900812 14113 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.896314  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:17.898618 14498 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:17.905500  7257 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 14.
I20260709 13:16:17.902941 14497 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:17.897670  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.881891 14416 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
W20260709 13:16:17.893682 14536 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 13:16:17.926158 14082 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:17.926838 14082 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.927450  7328 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:17.927556  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.928874  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.928999 14082 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.930094  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:17.931907  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:17.932765  7335 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:17.915218 13824 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:17.907013 14497 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.921053 14486 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:17.921307  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.940551  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.942440  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:17.942664  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.943220  7330 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:17.895725 14534 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:17.945150 14534 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:17.939416 14497 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:17.947110  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:17.947921  7332 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:16:17.949618  7255 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:16:17.951264  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.951462  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.951930  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.953212  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.953857  7259 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 15.
I20260709 13:16:17.955166 14527 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:17.955278  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:17.956164  7334 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:17.956287 14523 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:17.921844 14460 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.962538  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.937978  7253 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:17.890151 14413 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.969709  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:17.871744 14533 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:16:17.957692  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:17.972245 14468 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:17.958087  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:17.973839  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:17.974591  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.975132  7253 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:17.975447  7181 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:17.975035  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:17.958092  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.896328 14004 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:17.908571 14514 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:17.919147 14348 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:17.968673  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:17.985930  7182 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:16:17.986186  7334 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:17.988782 14352 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:17.972504  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.973910  7184 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:17.959630  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:17.991739  7336 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:17.993067  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:17.969319 14460 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.001173  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:17.977824  7254 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:17.962487  7335 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:17.977833  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:17.950794  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:17.981228  7259 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:16:17.981453  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.976567  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.908447 14344 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:18.005676  7255 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:17.983553  7180 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:16:17.986359  7182 pending_rounds.cc:85] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 12
I20260709 13:16:17.987215  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.988073  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:18.009730  7327 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:17.987990  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:17.964084 13850 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.977074 14486 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.022761  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.024241  7256 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:18.024511  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.025259  7331 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 28.
I20260709 13:16:17.943410  7262 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:18.028777  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:18.030248  7185 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:18.000396  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:18.000705  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:17.993203  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:17.947223 14416 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:18.009238  7182 pending_rounds.cc:107] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:16:18.046108  7182 raft_consensus.cc:2889] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:17.970273 14413 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:17.986999 14468 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:17.940528 14498 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:18.017053  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:18.054924  7892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 992) took 2174 ms (client timeout 2067 ms). Trace:
I20260709 13:16:18.017409  7255 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:16:18.020835  7259 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:16:17.935848  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:18.059294  7258 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:18.026413  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:17.998128  7330 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:17.984553 14514 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:18.043226  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.063252  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.064137  7335 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:18.043424  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.007361 14451 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:18.044231 14256 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.055613  7892 rpcz_store.cc:269] 0709 13:16:15.863402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.863566 (+   164us) service_pool.cc:224] Handling call
0709 13:16:18.037044 (+2173478us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b540068e7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:18.037222 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187065088}
I20260709 13:16:18.021548 14528 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.071048  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.071632  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:18.070323  7334 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
W20260709 13:16:18.072289  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55273.3us
I20260709 13:16:18.008445 14004 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:18.078105  7260 raft_consensus.cc:2410] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:16:18.079263  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.079761  7255 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:16:18.088764  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.093396  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:18.097699  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.079986  7862 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:18.033243 14273 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:18.107884  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.114315  7183 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:18.120525  7334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b"
dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
 from {username='slave'} at 127.0.0.1:33688
I20260709 13:16:18.105149  7301 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:18.134375  7327 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:18.135413  7334 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:18.136790  7334 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:18.075872 14468 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.052580 13694 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.052295 13571 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.044001 14416 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:18.153968  7262 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:16:18.070654 14514 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:18.164372  7182 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:16:18.208230  7892 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:16:18.091723 14063 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.090447 14279 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.028283 13850 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.103467 14522 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.224498  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.254136  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3645) took 1486 ms. Trace:
W20260709 13:16:18.256049  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 184505us
I20260709 13:16:18.254871  7179 rpcz_store.cc:276] 0709 13:16:16.767384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.767507 (+   123us) service_pool.cc:224] Handling call
0709 13:16:16.767861 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.782882 (+ 15021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.782932 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.783541 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.872955 (+1089414us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b1800351d60. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:16:18.091697 (+218742us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:18.091741 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.091824 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.253493 (+161669us) raft_consensus.cc:1685] finished
0709 13:16:18.253536 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.254014 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13036,"raft.queue_time_us":13544,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":21483,"spinlock_wait_cycles":12627328,"thread_start_us":218529,"threads_started":1,"wal-append.queue_time_us":1467794}
W20260709 13:16:18.257462  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 177538us
W20260709 13:16:18.258087  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 164806us
I20260709 13:16:18.258769  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:18.259109  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:18.260402  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 155352us
I20260709 13:16:18.264972  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:18.266058  7892 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:18.268270  7892 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:16:18.272073  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:18.273883  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:18.274585  7895 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:18.279716  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:18.281977  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:18.286258  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:18.288168  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:18.290156  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.291293  7331 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:16:18.291596  7327 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:18.291316  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.292820 14563 raft_consensus.cc:2764] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:16:18.294978 14563 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.298457  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 402209us
I20260709 13:16:18.118459 14273 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.111573 14473 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:18.314494  7328 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:18.316496  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:18.307013  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:18.175788 14543 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:16:18.161927 14468 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:18.180745 14302 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:18.334084  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.201334 14413 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:18.339157  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:18.350239 14302 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:18.339568  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:18.339862  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:18.121672 13858 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.213s
I20260709 13:16:18.359963  7889 raft_consensus.cc:2376] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19. Re-sending same reply.
I20260709 13:16:18.360321  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:18.340592  7185 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:18.101925 14533 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.203s
I20260709 13:16:18.082360 14019 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.150s
I20260709 13:16:18.211395 14352 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:18.341161  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:18.095769 14256 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.207569 14315 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:18.183538 14148 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:18.330040 14273 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:18.196619 14348 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:18.340618  7334 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.096764 14451 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.124353 14462 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.215s
I20260709 13:16:18.338747  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.230552 14513 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.209726 14460 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:18.354791  7895 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:18.104019 14528 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.310026 14279 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.401108  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:18.368539 14315 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.401865  7183 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:18.365229  7332 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:18.327278 14327 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.349295  7327 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:18.370826  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:18.405263  7255 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:18.368319 14550 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:18.328598 14508 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.202051 14045 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.149s
I20260709 13:16:18.385305 14019 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:18.379391  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:18.411684  7328 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:18.379994  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.380805  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:18.412694  7185 raft_consensus.cc:2393] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 14: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:18.122352 14503 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.275s
I20260709 13:16:18.381742  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:18.384466  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:18.416180  7179 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
W20260709 13:16:18.385304  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 127723us
I20260709 13:16:18.260493 14553 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 13:16:18.384550  7336 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:18.437769  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.439405  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.440002  7255 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:16:18.232292 13694 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.335978 14301 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:16:18.448174 14082 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:18.208258 14004 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.399574 14513 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.451838 14321 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:18.453008 14553 raft_consensus.cc:3055] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:18.453464 14553 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:18.454362 14553 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.455756 14553 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:18.435348 14253 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:18.458046 14486 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:18.458493 14446 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:18.459380 14503 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:18.459806 14503 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:18.405606 14315 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:18.460690 14503 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.372615 14416 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.400130  7262 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:18.364168 14352 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.435423 14550 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.463501 14352 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:18.303282 14063 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.420815 14528 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:18.469521  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1258) took 1054 ms. Trace:
I20260709 13:16:18.470001  7896 rpcz_store.cc:276] 0709 13:16:17.415579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.416132 (+   553us) service_pool.cc:224] Handling call
0709 13:16:18.469319 (+1053187us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b54005a14d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:18.469443 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171025792}
I20260709 13:16:18.351784 14563 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.195255 14498 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:18.412552 14502 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.004s
I20260709 13:16:18.371703  7225 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:18.475680 14502 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.476851 14321 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:18.478085 14502 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:18.479040  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:18.479877  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:18.480551  7333 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 25. Current term is 26. Ops: []
I20260709 13:16:18.480729 14556 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:18.484509 14451 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:18.486274 14513 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:18.487074 13694 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:18.419486  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:18.419507 14045 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:18.410602 14136 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:18.417176 14019 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:18.488005 13850 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:18.411155 14327 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.416963 14508 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.427294 14530 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:18.428264 14279 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:18.410826 14551 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:16:18.404742 14148 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:18.570775  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.415480  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:18.571622  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 156218us
I20260709 13:16:18.572685  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:18.574023  7152 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:18.436321  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 177314us
I20260709 13:16:18.575291  7299 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:18.304050 13571 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.440850  7255 pending_rounds.cc:85] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 11
I20260709 13:16:18.578969  7255 pending_rounds.cc:107] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:16:18.561834  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:18.310770 14522 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.462167 14503 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:18.404178  7334 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:18.490052  7261 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:18.482322  7333 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:16:18.497517  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 125916us
I20260709 13:16:18.538173 14019 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:18.596194  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:18.514430 13858 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:18.530382  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:18.530781 14571 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:18.531618  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:18.602782  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:18.532737  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:18.604543  7186 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:18.605856  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:18.533779  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: true dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:18.606953  7182 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:18.607352  7182 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:18.608282  7182 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.609459  7182 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:18.537135  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:18.538753  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 196858us
I20260709 13:16:18.541785  7253 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:18.542250  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:18.557694  7183 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
W20260709 13:16:18.560381  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 204340us
I20260709 13:16:18.566546  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: true dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:18.432227 14256 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:18.579732  7255 raft_consensus.cc:2889] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:18.448705 14082 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:18.583810  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:18.588778  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:18.502566 14045 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:18.421489  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.538568 14473 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:18.599646  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:18.636881  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:18.562507 14451 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.616561  7178 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 29: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:18.566426 14136 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:18.603750  7180 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:16:18.643596  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:18.617455  7861 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:18.582782 14148 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:18.595916 14409 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:18.641422  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:18.595500 14494 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:18.651515  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.656070  7328 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:18.601622 14523 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:18.652814  7182 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
I20260709 13:16:18.651448  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.665112  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:18.629801 14082 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:18.757921  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 111058us
I20260709 13:16:18.617966 14450 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:18.676983  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 101789us
I20260709 13:16:18.815832  7257 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:16:18.644279 14004 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.642727 14107 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.813777  7299 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:18.647231 14348 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:18.648360 14353 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:18.767010 14559 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:16:18.650036 14279 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:18.846728  7186 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:18.653687 14494 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:18.851148  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 267437us
I20260709 13:16:18.851454  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1509) took 1187 ms. Trace:
I20260709 13:16:18.869789  7253 rpcz_store.cc:276] 0709 13:16:17.664430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.976919 (+312489us) service_pool.cc:224] Handling call
0709 13:16:18.541543 (+564624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.611447 (+ 69904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.851213 (+239766us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b5400125550. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:18.851388 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297863936}
I20260709 13:16:18.871326  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:18.838348  7327 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:18.857131  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:18.830262 14563 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:18.860952  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 219615us
I20260709 13:16:18.864728  7333 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:16:18.763356 13850 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:18.873294  7257 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:16:18.654179 14409 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.874835  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:18.654901 14451 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.872419 14494 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:18.653440 14446 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.206s
I20260709 13:16:18.877962  7327 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:16:18.881260  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 67617.7us
I20260709 13:16:18.912000  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:18.881852  7333 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:16:18.883639  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 320185us
I20260709 13:16:18.832186 14253 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:16:18.886642  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 221586us
I20260709 13:16:18.865185 14279 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.901316  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:18.905077 14136 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.847702 14004 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.906114 14550 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:18.843675 14107 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:18.918957  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.925271  7253 raft_consensus.cc:2410] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:16:18.885706  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:18.951978  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 44405.1us
I20260709 13:16:18.900089 14409 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:18.956506  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:18.926877  7257 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:18.916997  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:18.966174  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49337us
I20260709 13:16:18.967481  7225 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:18.952997 14497 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.005s	user 0.013s	sys 0.000s
I20260709 13:16:18.965557  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:18.869601 14474 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:16:18.979034  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.980217  7333 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:16:18.981889  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:18.925993 14549 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.465s	user 0.002s	sys 0.000s
I20260709 13:16:18.970191  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:18.952812 14344 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:16:18.953156 14534 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.007s	user 0.015s	sys 0.000s
I20260709 13:16:18.984490  7893 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
W20260709 13:16:18.955308 14468 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.006s
W20260709 13:16:18.931329 14568 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:16:18.985993  7333 raft_consensus.cc:2376] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24. Re-sending same reply.
I20260709 13:16:18.976826 14523 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:19.056552  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.987138  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:19.057634  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:19.058063  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:18.906308 14566 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.069s
I20260709 13:16:18.935094 13571 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:19.058729  7330 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
W20260709 13:16:18.923285 14574 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:16:18.915959 14348 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:18.924782 14451 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:18.858498 14045 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:18.884371 14581 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 14, Time since last communication: 0.096s
I20260709 13:16:18.942453 14279 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:19.038412  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.957234 14578 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:18.990468  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:18.917395 14253 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:18.968297 14550 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:19.089700  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 147152us
I20260709 13:16:19.118458  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:18.973460 14530 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:18.956117 14583 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:19.101536  7184 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
W20260709 13:16:19.129448  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 139078us
W20260709 13:16:19.003715  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 118371us
I20260709 13:16:19.103602  7333 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:18.881096 14473 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:18.995707 14508 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:18.989526 13858 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:16:18.996992 14344 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.059227 14327 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:18.988994 14497 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.128441  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:19.131524  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:19.139396  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:19.136907 14556 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.007s
I20260709 13:16:19.062741 14586 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
W20260709 13:16:19.152324  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 186877us
I20260709 13:16:19.157004  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:19.103986 14348 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:19.061630 14468 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.059634 14534 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.122740 14498 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:18.988083 14582 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.165s
I20260709 13:16:18.984724 13850 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.192294  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 60869.7us
I20260709 13:16:19.192714  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:19.198925  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:19.190971  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:19.158092 14344 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:19.203755  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:19.151422 14550 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:19.194600  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:19.269995  7330 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
W20260709 13:16:19.145970  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 495393us
I20260709 13:16:19.204918  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:19.205374  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:19.271499  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 66675.6us
I20260709 13:16:19.272761  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:19.158481 13858 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:19.266706  7329 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:19.130831 14446 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:16:19.191222 14556 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:19.276628  7259 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:19.277422  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:16:19.277787  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 72508.5us
I20260709 13:16:19.278185 14550 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.282328  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2492) took 1470 ms. Trace:
I20260709 13:16:19.198412 14498 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.124436 14578 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.193343 14597 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:19.195472 14598 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:19.281596  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.174975 14523 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:16:19.299435  7258 rpcz_store.cc:276] 0709 13:16:17.812388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.085762 (+273374us) service_pool.cc:224] Handling call
0709 13:16:18.086250 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.086553 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.086590 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.134121 (+ 47531us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.539775 (+405654us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:18.827764 (+287989us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.878579 (+ 50815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.878805 (+   226us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.282026 (+403221us) raft_consensus.cc:1685] finished
0709 13:16:19.282053 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.282252 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40923,"prepare.queue_time_us":513383,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":58584,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10183,"thread_start_us":435965,"threads_started":2,"wal-append.queue_time_us":426219}
I20260709 13:16:19.166083 14508 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 13:16:19.195654 14595 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:19.268529 14327 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:19.312937  7258 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:16:19.313217 14523 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:19.316949 14327 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.314481 14508 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:19.317734 14327 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:19.317916 14508 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:19.319140 14576 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 13:16:19.320348  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3661) took 1220 ms. Trace:
I20260709 13:16:19.320485 14508 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:19.304698 14550 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:19.320837  7184 rpcz_store.cc:276] 0709 13:16:18.099963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.100189 (+   226us) service_pool.cc:224] Handling call
0709 13:16:18.100662 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.132008 (+1031346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.320085 (+188077us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400385c54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:19.320281 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300712832}
W20260709 13:16:19.323419 14579 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:16:19.323800 14148 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.000s
I20260709 13:16:19.324251 14148 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.328706 14497 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:19.330114  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.330294 14602 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:19.331173  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2482) took 1524 ms. Trace:
I20260709 13:16:19.332448 14468 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:19.331558  7254 rpcz_store.cc:276] 0709 13:16:17.806376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.014030 (+207654us) service_pool.cc:224] Handling call
0709 13:16:18.014547 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.015113 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.015157 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.464035 (+448878us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b2c00010988. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:16:18.464529 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.809431 (+344902us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:18.951111 (+141680us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.958516 (+  7405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.958761 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.330860 (+372099us) raft_consensus.cc:1685] finished
0709 13:16:19.330966 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.331109 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62447,"prepare.queue_time_us":281873,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":7055,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":21870,"spinlock_wait_cycles":28228352,"thread_start_us":357121,"threads_started":2,"wal-append.queue_time_us":414501}
W20260709 13:16:19.333423 14352 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.869s	user 0.006s	sys 0.010s
I20260709 13:16:19.316280 14585 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:19.336556 14534 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:19.337308 14503 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.740s	user 0.007s	sys 0.003s
I20260709 13:16:19.337832 14588 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:16:19.338232  7335 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:19.338956 14004 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:19.339661 14588 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:16:19.317168 14523 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:19.339057 14550 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.314874 14603 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:19.352295 14523 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:19.342612  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 64217.6us
I20260709 13:16:19.269217 14565 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:19.344643  7332 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:19.288183 14451 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:19.286751 13858 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:19.286931 14530 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:19.346293  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 69181.2us
I20260709 13:16:19.261829 13850 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.305357 14498 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:19.333889 14352 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:19.372452  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.340201 14588 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:19.376315  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.380923  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:19.385865  7330 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:19.381389 14451 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:19.388029  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:19.367985 14273 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.982s	user 0.009s	sys 0.005s
W20260709 13:16:19.395951  7328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.011s	sys 0.008s
W20260709 13:16:19.398685  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 280332us
I20260709 13:16:19.390386  7335 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:19.431603  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:19.430438  7328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.011s	sys 0.013s
I20260709 13:16:19.337393 14494 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.385739 14528 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:16:19.438601  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 246039us
I20260709 13:16:19.440929  7331 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:19.438087  7861 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:19.447602  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2529) took 1012 ms. Trace:
I20260709 13:16:19.451297  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:19.447608  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:19.392750 14514 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.082s	user 0.004s	sys 0.009s
I20260709 13:16:19.451176  7328 rpcz_store.cc:276] 0709 13:16:18.435207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.656930 (+221723us) service_pool.cc:224] Handling call
0709 13:16:18.811237 (+154307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.811549 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:16:18.843456 (+ 31907us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.447251 (+603795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:19.447319 (+    68us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:19.447364 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.447432 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.447542 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32121,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":5130,"thread_start_us":591509,"threads_started":1}
I20260709 13:16:19.447988  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:19.406981 14315 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.933s	user 0.007s	sys 0.006s
I20260709 13:16:19.455672  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:19.388902 14588 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:19.286672 14253 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.338855 14348 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.491086 14613 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.491684 14613 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.398846 14550 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:19.463405 14004 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:16:19.462675 14514 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.457989 14603 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:19.477813 14588 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.460629 14595 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
W20260709 13:16:19.485173 14553 consensus_meta.cc:287] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.029s	user 0.010s	sys 0.003s
I20260709 13:16:19.486371 14586 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.489064 14321 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.012s	user 0.005s	sys 0.005s
I20260709 13:16:19.494745  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:19.495647 14585 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:19.427742 14581 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:19.498190  7180 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:19.399242 14590 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:19.447892 14566 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:19.460922 14598 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:16:19.546206  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 256720us
I20260709 13:16:19.549270  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:19.389249 14107 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:19.435840 14273 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.556430 14279 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.564363  7260 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 25. Current term is 26. Ops: []
I20260709 13:16:19.543475 14550 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:19.463420 14315 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.587203  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:19.587102  7178 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:19.591554  7887 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:19.457357 14451 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.565979 14594 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:19.609028  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:19.563033 14321 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:19.573340 14566 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.618029  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:19.572433 14553 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:19.618335  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:19.569973 14603 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.590214 14107 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:19.693965  7258 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:19.563634 14586 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.675892  7889 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:19.589596 14598 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.571794 14585 raft_consensus.cc:697] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:19.690244  7894 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:16:19.614439 14594 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.723589  7888 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:16:19.676891 14566 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:19.599689 14497 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:19.603076 14550 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.569554 14581 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.671965  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:19.768955  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 330921us
I20260709 13:16:19.769634  7336 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:19.770828 14585 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.573709 14590 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.743587 14578 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:19.824414  7330 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:19.735944 14004 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 13:16:19.777544 14019 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.147s	user 0.009s	sys 0.005s
I20260709 13:16:19.767805 14598 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:19.839152  7184 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:19.777762 14594 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:19.777570 14613 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:19.846282  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:19.852739  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 401513us
I20260709 13:16:19.854020  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:19.824339 13850 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:19.845165 14348 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.848536 14446 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.029s
I20260709 13:16:19.700908 14603 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.738903 14107 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.870961  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:19.823954 14497 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.853960 14494 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:19.880015  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:19.866914 14446 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.000s	sys 0.029s
I20260709 13:16:19.908232  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:19.845505 14019 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.917560  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:19.921240  7330 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:19.917676  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:19.925047  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:19.910288 14611 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:16:19.880422 14553 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:19.876878 14279 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:19.948868  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:16:19.947773  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.924242 14315 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:19.956858 14619 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:16:19.957122 14315 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:19.958048 14315 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.958765 14601 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:19.959386 14601 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:19.960362 14601 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:19.960736 14603 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:19.965169  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2619) took 1606 ms. Trace:
I20260709 13:16:19.965656  7335 rpcz_store.cc:276] 0709 13:16:18.359258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.419248 (+ 59990us) service_pool.cc:224] Handling call
0709 13:16:19.964947 (+1545699us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54001d29d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:19.965099 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952100096}
I20260709 13:16:19.967043  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:19.967743  7335 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:19.973362  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3881) took 1477 ms. Trace:
I20260709 13:16:19.973929  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3873) took 2087 ms. Trace:
I20260709 13:16:19.974336  7259 rpcz_store.cc:276] 0709 13:16:17.886911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.061344 (+174433us) service_pool.cc:224] Handling call
0709 13:16:18.061740 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.283623 (+1221883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.973683 (+690060us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002274d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:19.973870 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2793136000}
I20260709 13:16:19.974956  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3878) took 1537 ms. Trace:
I20260709 13:16:19.975183  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:19.976037  7183 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:19.977030  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2610) took 1683 ms. Trace:
I20260709 13:16:19.977581  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:19.978988  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:19.979305  7187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3654) took 1998 ms (client timeout 1637 ms). Trace:
I20260709 13:16:19.979660  7330 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
W20260709 13:16:19.979809  7187 rpcz_store.cc:269] 0709 13:16:17.980835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.981194 (+   359us) service_pool.cc:224] Handling call
0709 13:16:19.979103 (+1997909us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54000ee2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:19.979235 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372235008}
I20260709 13:16:19.980628  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:19.980705  7335 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:19.981447  7187 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:19.981778  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:19.977033  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:19.914889 14514 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:19.984516  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3886) took 1347 ms. Trace:
I20260709 13:16:19.988497  7254 rpcz_store.cc:276] 0709 13:16:18.636990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.333443 (+696453us) service_pool.cc:224] Handling call
0709 13:16:19.333846 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:19.334090 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.334118 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.340623 (+  6505us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.589193 (+248570us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:19.589233 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.589312 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.984288 (+394976us) raft_consensus.cc:1685] finished
0709 13:16:19.984312 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.984455 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":201887,"threads_started":1,"wal-append.queue_time_us":374624}
I20260709 13:16:19.975461  7262 rpcz_store.cc:276] 0709 13:16:18.437886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.463434 (+ 25548us) service_pool.cc:224] Handling call
0709 13:16:18.463815 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.464206 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:18.866126 (+401920us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.383245 (+517119us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.384019 (+   774us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.384208 (+   189us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:19.384244 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.384317 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.974723 (+590406us) raft_consensus.cc:1685] finished
0709 13:16:19.974745 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.974892 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29270,"prepare.queue_time_us":506989,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":8827,"raft.queue_time_us":5845,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":203,"thread_start_us":840048,"threads_started":2,"wal-append.queue_time_us":692543}
I20260709 13:16:19.990592  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:19.991041  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:19.991915  7262 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:19.993264  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:19.995273 14612 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:16:19.947806 14446 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.049s
I20260709 13:16:19.951179 14565 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:19.999466 14019 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:19.999282 14565 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.001740  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2509) took 2049 ms. Trace:
I20260709 13:16:20.001871  7228 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:19.966398 14082 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.128s	user 0.006s	sys 0.005s
I20260709 13:16:19.869720 14348 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:19.977490  7331 rpcz_store.cc:276] 0709 13:16:18.294093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.294302 (+   209us) service_pool.cc:224] Handling call
0709 13:16:18.294569 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.455178 (+1160609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.976761 (+521583us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002896d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:19.976955 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2635722496}
I20260709 13:16:19.973845  7257 rpcz_store.cc:276] 0709 13:16:18.495771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.052040 (+556269us) service_pool.cc:224] Handling call
0709 13:16:19.052500 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.145890 (+ 93390us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:16:19.178294 (+ 32404us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.436627 (+258333us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.436893 (+   266us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:19.436943 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:19.436988 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.973055 (+536067us) spinlock_profiling.cc:243] Waited 93 ms on lock 0x7b5400349ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:19.973114 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.973275 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2337,"prepare.queue_time_us":45707,"prepare.run_cpu_time_us":15457,"prepare.run_wall_time_us":62796,"raft.queue_time_us":600,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":20896,"spinlock_wait_cycles":320931840,"thread_start_us":256795,"threads_started":1,"wal-append.queue_time_us":438588}
I20260709 13:16:19.988154  7335 raft_consensus.cc:2410] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:16:19.958477 14315 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:19.991293  7254 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:19.975848  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:20.004120  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2625) took 1578 ms. Trace:
I20260709 13:16:20.004922  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1519) took 1235 ms. Trace:
I20260709 13:16:20.014669  7336 rpcz_store.cc:276] 0709 13:16:18.425532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.438814 (+ 13282us) service_pool.cc:224] Handling call
0709 13:16:20.003833 (+1565019us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540031bad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:20.004023 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2712927104}
I20260709 13:16:20.015008  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:20.016073  7254 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:20.002563  7329 rpcz_store.cc:276] 0709 13:16:17.952659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.957284 (+  4625us) service_pool.cc:224] Handling call
0709 13:16:20.001535 (+2044251us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540025c454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:20.001674 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2908382976}
I20260709 13:16:20.005446 14590 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:20.004168 14610 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:16:20.009500 14019 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:20.015185  7253 rpcz_store.cc:276] 0709 13:16:18.769362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.871026 (+101664us) service_pool.cc:224] Handling call
0709 13:16:20.004675 (+1133649us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b54002f7954. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:20.004853 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121646976}
I20260709 13:16:20.018287  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:20.028231  7254 raft_consensus.cc:2410] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:16:20.019411  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:19.947547 14614 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.004074 14581 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.020406 14514 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:20.004245 14565 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:20.025779  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:20.020061 14617 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:16:20.013546  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:20.016409 14273 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:20.008828  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:20.040508  7259 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:20.043280  7254 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:16:20.037292 13850 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:20.037771 14614 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.053198 14497 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:20.054829 14063 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.055436  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1263) took 1092 ms. Trace:
I20260709 13:16:20.060853  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.080313  7178 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:20.061441 14348 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.017110 14082 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.067123  7262 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:20.038923  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:20.067279 14344 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.799s	user 0.008s	sys 0.005s
I20260709 13:16:20.062165 14523 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:20.076872  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1521) took 1307 ms. Trace:
I20260709 13:16:20.100044  7254 rpcz_store.cc:276] 0709 13:16:18.769846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.037819 (+1267973us) service_pool.cc:224] Handling call
0709 13:16:20.042843 (+  5024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.076537 (+ 33694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.076806 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:20.100872  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 62048.8us
I20260709 13:16:20.079027  7889 rpcz_store.cc:276] 0709 13:16:18.962901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.963039 (+   138us) service_pool.cc:224] Handling call
0709 13:16:18.963350 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.762847 (+799497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.055160 (+292313us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b5400521f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:20.055366 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507170560}
W20260709 13:16:20.067703 14498 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.678s	user 0.006s	sys 0.005s
W20260709 13:16:20.068964 14409 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.091s	user 0.005s	sys 0.009s
I20260709 13:16:20.106997 14614 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:20.074654 14586 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:20.113129 14594 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.094952 14107 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.036844 14019 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.099781 14523 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:20.097309 13858 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.003s
I20260709 13:16:20.115579 14348 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:16:20.116988 14327 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.798s	user 0.014s	sys 0.001s
I20260709 13:16:20.117304 14082 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:20.117758  7327 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:20.118214 14598 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:20.119045  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 251416us
I20260709 13:16:20.171196  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:20.184154  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 235347us
W20260709 13:16:20.157742  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.159026  7893 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:20.094856 13850 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.102041  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:20.211467  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 109567us
I20260709 13:16:20.114857 14344 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.194063 14301 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:20.186560  7889 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:20.187423  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:20.190865  7894 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:20.220098  7894 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:20.193234  7153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.000s	sys 0.016s
I20260709 13:16:20.153578 14523 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:20.119340 14566 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.120822 14498 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.201087  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:20.134742 14409 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.203830  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:20.204880  7329 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:16:20.185635 14348 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:20.216192  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:20.231348  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:20.156587  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 174243us
W20260709 13:16:20.223183  7153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.000s	sys 0.016s
I20260709 13:16:20.158826 13858 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.221246  7894 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.188261 14327 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.232923  7335 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:16:20.234583  7187 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:20.244684  7894 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:20.246644  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:20.248423  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:20.250782  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:20.251261  7895 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:20.222054 14497 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:20.251859  7329 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 28.
I20260709 13:16:20.252118  7262 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:16:20.252300  7255 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:16:20.252933  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:20.253660  7329 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:20.254434  7889 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:16:20.256207  7302 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:20.256888  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:20.254431  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:20.257302  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:20.262599  7328 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 28. Current term is 29. Ops: []
I20260709 13:16:20.238449 14486 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:20.270699  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:20.278434  7894 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:16:20.278999  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:20.279795  7335 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:20.271651  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:20.219195 14063 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:16:20.284772  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:20.226521 14301 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.293459  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:20.298458  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:20.302031  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:20.333091  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 76976.7us
I20260709 13:16:20.323273  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.320256  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:20.261750 14604 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.310972 14554 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:20.334038  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:20.334390  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:20.388734  7890 raft_consensus.cc:2368] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21.
W20260709 13:16:20.389638  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 55362.4us
I20260709 13:16:20.390758  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:20.259172 14497 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.256371 14553 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.386363  7178 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:20.395533  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:20.396088  7859 leader_election.cc:336] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Timed out: RequestConsensusVote RPC to 127.5.227.131:35093 timed out after 1.792s (SENT)
I20260709 13:16:20.396849  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:20.334064  7330 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:20.259910 14634 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.403069 14634 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.404456  7891 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:20.331180 14348 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.292140 14633 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:16:20.388984  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55047.5us
I20260709 13:16:20.321200 14302 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.385541 14594 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.411926 14302 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:20.268057 14327 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.400872 14598 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:20.417757  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 151362us
I20260709 13:16:20.411156 14633 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.411267  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1393) took 1820 ms. Trace:
I20260709 13:16:20.319588 13850 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:20.399969 14642 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:16:20.398370  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:20.357159 14646 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.053s	user 0.001s	sys 0.001s
I20260709 13:16:20.315673 14508 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:20.318454 14045 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:20.416589  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:20.440119  7183 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:20.311208 14486 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.112s
I20260709 13:16:20.301270 14352 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:20.321787 14566 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:20.391618 14577 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.867s	user 0.005s	sys 0.012s
W20260709 13:16:20.394665 14636 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:16:20.450769  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1392) took 1860 ms. Trace:
I20260709 13:16:20.423588 14633 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:20.435432 14406 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:20.395062 14586 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:20.436071  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.399477 14497 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:20.419312 14513 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:20.443116  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.424614 14650 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.260605 14315 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.421440  7179 rpcz_store.cc:276] 0709 13:16:18.590417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.632462 (+ 42045us) service_pool.cc:224] Handling call
0709 13:16:18.632817 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.641492 (+  8675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.641538 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.056374 (+1414836us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b2c0001afe8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:16:20.056898 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.193821 (+136923us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:20.193882 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.195968 (+  2086us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.410920 (+214952us) raft_consensus.cc:1685] finished
0709 13:16:20.410947 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.411197 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8242,"raft.queue_time_us":19865,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":106907,"spinlock_wait_cycles":5572352,"thread_start_us":136455,"threads_started":1,"wal-append.queue_time_us":210097}
I20260709 13:16:20.476174  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.421671 14019 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.389473 14446 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:20.454249  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:20.456436  7186 rpcz_store.cc:276] 0709 13:16:18.590103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.632061 (+ 41958us) service_pool.cc:224] Handling call
0709 13:16:18.649765 (+ 17704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.869198 (+219433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.450460 (+1581262us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400116f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:20.450701 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452234112}
I20260709 13:16:20.456663 14634 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.385578 14604 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.395241 14082 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:20.411290 14553 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.395607 14523 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.437729 14508 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:20.460603  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:20.457963 14572 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.474442  7178 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:20.502429  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.503692  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:20.504441  7178 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 26: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:20.505386  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.506139  7178 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:20.477128  7179 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:20.512341 14315 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.487875 14446 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.513275 13850 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.513489 14446 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:20.513907 13850 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.517338 13850 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:20.477607 14650 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.521070 14650 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:20.474607 14513 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.523057 14352 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.524533 14344 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:20.475864 14643 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:16:20.525554 14572 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.487787  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:20.527015  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:20.527509  7182 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:20.528648  7182 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:16:20.529683  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2509) took 1047 ms. Trace:
I20260709 13:16:20.488325 13858 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:20.530187  7257 rpcz_store.cc:276] 0709 13:16:19.483050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.063380 (+580330us) service_pool.cc:224] Handling call
0709 13:16:20.063796 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.064211 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.064250 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.074418 (+ 10168us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.236263 (+161845us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:20.285565 (+ 49302us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.287735 (+  2170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.287850 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.529479 (+241629us) raft_consensus.cc:1685] finished
0709 13:16:20.529501 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.529625 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1613,"prepare.queue_time_us":175185,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":922,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":3531,"spinlock_wait_cycles":25344,"thread_start_us":154089,"threads_started":2,"wal-append.queue_time_us":160925}
I20260709 13:16:20.522360  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:20.461869 14586 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.468422 14498 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.498811  7889 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:20.500365  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.539559  7179 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:20.530196 14572 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:20.534392 14523 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.534837  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3666) took 2009 ms. Trace:
I20260709 13:16:20.529767  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.544875  7179 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:16:20.545195  7186 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:16:20.491714  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 73203.2us
I20260709 13:16:20.476378 14409 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.546778  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:20.480315 14460 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.545096  7182 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:20.546779  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:20.550854  7299 leader_election.cc:400] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21.
I20260709 13:16:20.551295  7299 leader_election.cc:403] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:16:20.463461 14406 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.543685  7185 rpcz_store.cc:276] 0709 13:16:18.525211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.525799 (+   588us) service_pool.cc:224] Handling call
0709 13:16:18.526195 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.526426 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:16:18.526818 (+   392us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.534307 (+2007489us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b18002bd320. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287
0709 13:16:20.534428 (+   121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:20.534487 (+    59us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:20.534535 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.534614 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.534765 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37295,"prepare.queue_time_us":2058,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":265660,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":17457,"spinlock_wait_cycles":3682560,"thread_start_us":322225,"threads_started":2,"wal-append.queue_time_us":303655,"wal-append.run_cpu_time_us":1443,"wal-append.run_wall_time_us":1080412}
I20260709 13:16:20.539240 14586 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:20.565220  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.565644  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:20.561412  7894 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:16:20.567286  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:20.523774 14352 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.564182  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:20.570364  7888 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 29: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:20.563230  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:20.551972 14572 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:20.478796 14652 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:16:20.568707  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:20.571759  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.571014  7890 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:20.556535 14460 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.611472  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2624) took 2186 ms. Trace:
I20260709 13:16:20.616148  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 1015) took 1033 ms. Trace:
W20260709 13:16:20.619067  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.604349  7887 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:20.572393  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:20.639987  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1517) took 1871 ms. Trace:
W20260709 13:16:20.645002  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 76364.8us
I20260709 13:16:20.592191  7331 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:16:20.619777  7888 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:20.647202  7331 pending_rounds.cc:85] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 13
I20260709 13:16:20.647663  7331 pending_rounds.cc:107] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:16:20.646504  7258 rpcz_store.cc:276] 0709 13:16:18.768839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.349348 (+580509us) service_pool.cc:224] Handling call
0709 13:16:19.350027 (+   679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.694473 (+344446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.639585 (+945112us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54002d4454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:20.639893 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790438272}
I20260709 13:16:20.645031  7186 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:20.649857  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:20.580608  7861 leader_election.cc:336] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.808s (SENT)
I20260709 13:16:20.650784  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:20.651538  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 71010.1us
I20260709 13:16:20.652856  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:20.654065  7334 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:20.648169  7331 raft_consensus.cc:2889] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:20.648604  7332 rpcz_store.cc:276] 0709 13:16:18.425242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.757596 (+332354us) service_pool.cc:224] Handling call
0709 13:16:18.757996 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.363219 (+605223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.611144 (+1247925us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400278654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:20.611392 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298860288}
I20260709 13:16:20.656150  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:20.574607  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:20.657495  7336 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:20.634351 14608 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:16:20.659894  7894 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:20.659787  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:20.647939  7893 rpcz_store.cc:276] 0709 13:16:19.582669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.587933 (+  5264us) service_pool.cc:224] Handling call
0709 13:16:20.615852 (+1027919us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54005537d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:20.616069 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178536320}
I20260709 13:16:20.664186  7182 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
W20260709 13:16:20.635289 14533 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:16:20.567977 13858 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:20.705972  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:20.574254  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:20.707182  7890 raft_consensus.cc:2368] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22.
I20260709 13:16:20.662514  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:20.697660 14608 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:20.592608 14118 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.712809  7332 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 26: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:20.659409 14620 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.632201 14588 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:20.600637 14548 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 2.140s	user 0.003s	sys 0.000s
I20260709 13:16:20.621592 14148 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:20.709607  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:20.710070  7335 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:20.677701 14634 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:20.608907 14406 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:20.677968 14523 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:20.710366  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 61819.5us
I20260709 13:16:20.710652  7330 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:20.608614 14416 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:20.599072 14604 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.714910 14655 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:20.715672  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:20.717854  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 152306us
I20260709 13:16:20.718665 14648 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:20.712821 14019 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:20.719799 14460 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:20.720243 14118 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.713047 14348 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.721441 14522 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.678301 14344 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:20.572966 14508 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.679656 14329 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.568253 14315 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.146s
I20260709 13:16:20.723232 14497 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.736742 14654 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:16:20.714135 14446 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.583688 14136 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:16:20.727758 14656 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
I20260709 13:16:20.727913  7336 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:20.728039 13858 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21.
I20260709 13:16:20.729105  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:20.730461  7182 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:20.730965 14486 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:20.708329  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1160) took 2091 ms. Trace:
I20260709 13:16:20.800017  7182 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:20.800179 14486 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:20.801620  7182 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:20.592410 14657 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.152s
I20260709 13:16:20.803383 14657 consensus_queue.cc:1243] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 24.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:16:20.736713 14572 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:16:20.698864 14560 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 2.251s	user 0.003s	sys 0.005s
I20260709 13:16:20.626670 14045 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.707798  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.602888 14513 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:20.708034  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 45669us
I20260709 13:16:20.811761  7186 raft_consensus.cc:2376] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25. Re-sending same reply.
I20260709 13:16:20.812958  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:20.745661  7257 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:20.745748  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:20.747241  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:20.751313  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.744405  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:20.816722  7258 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:16:20.817986  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:20.761796  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:20.819911  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 58199.2us
I20260709 13:16:20.821676  7299 leader_election.cc:400] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22.
I20260709 13:16:20.822100  7299 leader_election.cc:403] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:16:20.771699  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:20.823064  7259 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:20.772855  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:20.707065 14633 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.722051 14608 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.742854 14634 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:20.750402 14451 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.776232  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:20.726873 14620 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.758955 14655 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:20.724030  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:20.845217  7893 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:16:20.772495 14019 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.796957  7894 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:20.758808 14148 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:16:20.759131 14652 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:16:20.762868 14523 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.797348  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.800041  7896 rpcz_store.cc:276] 0709 13:16:18.617445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.617643 (+   198us) service_pool.cc:224] Handling call
0709 13:16:18.646486 (+ 28843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.764448 (+117962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.764480 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.854995 (+ 90515us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.636604 (+1781609us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b180025ae00. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:16:20.703290 (+ 66686us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:20.703342 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.703416 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.705447 (+  2031us) raft_consensus.cc:1685] finished
0709 13:16:20.705483 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.708264 (+  2781us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117531,"raft.queue_time_us":235823,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":17530,"spinlock_wait_cycles":64513792,"thread_start_us":66452,"threads_started":1,"wal-append.queue_time_us":1822394}
I20260709 13:16:20.801559 14486 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.788206 14344 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:20.792826 14508 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:20.773067 14406 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:16:20.829463  7258 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:20.839459 13858 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22.
I20260709 13:16:20.788427 14329 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.776046 14348 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.837716  7861 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:20.839998  7254 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:20.806704 14588 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:16:20.840852  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:20.900862  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.798754 14136 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.851823  7178 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:20.843883 14604 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:16:20.838063 14572 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:20.908110 14113 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:20.908324 14572 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:20.908664 14113 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:20.908910 14572 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:20.911885  7257 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:16:20.912096 14633 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.913375  7257 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:20.833671  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:20.866696  7894 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:20.813757 14045 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.914108 14655 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:20.915122  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 81586.9us
I20260709 13:16:20.915570 14655 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:20.916589 14045 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:20.917230 14045 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:20.844907 14451 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.921154 14451 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:20.921788 14451 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:20.922724 14302 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:16:20.925163 14662 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:16:20.925422  7258 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:16:20.839385 14634 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:20.838480 14630 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:16:20.899603  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 61967.4us
I20260709 13:16:20.928442  7178 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 26.
I20260709 13:16:20.927119  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1396) took 2290 ms. Trace:
I20260709 13:16:20.929100  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:20.931406  7180 rpcz_store.cc:276] 0709 13:16:18.637128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.647326 (+ 10198us) service_pool.cc:224] Handling call
0709 13:16:18.647737 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.565927 (+918190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.926852 (+1360925us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54000ed3d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:20.927023 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955397888}
I20260709 13:16:20.904430  7259 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
W20260709 13:16:20.933085  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 118762us
I20260709 13:16:20.909830 14113 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.881651 14019 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:20.939073  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:20.905891 14533 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:20.921196 14136 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:20.927060 14523 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:20.949177 14533 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:20.953284 14533 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:20.953758 14596 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:20.954509 14596 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:20.956024 14596 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.957681 14596 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:20.939883 14570 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:16:20.959926 14570 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:20.960433 14570 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:20.946384  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:20.961519 14570 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:20.974771 14113 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:20.987687  7302 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 2.029s (SENT) [suppressed 22 similar messages]
I20260709 13:16:20.988027  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:20.988808  7180 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:20.927060 14344 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:20.937495 14530 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 13:16:20.990330  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.000120 14497 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.000368 14668 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:21.000692 14446 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.020049 14570 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:21.023641 14329 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.025610 14460 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:21.026731 14460 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.027952 14586 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.030242 14586 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.031071  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:21.031649 14460 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:21.032811 14624 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.080s	user 0.002s	sys 0.000s
I20260709 13:16:21.035038  7179 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: [18.11-20.12]
I20260709 13:16:21.036048  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:21.037279 14550 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.006912 14118 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.044756  7180 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:16:21.043428  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:21.004706 14596 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:16:21.059535  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:21.057412  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69764us
I20260709 13:16:21.069999  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:21.006675 14634 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.083375  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:21.055544 14045 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:21.059607 14460 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:21.063109 14353 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:21.070668 14555 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.085112 14329 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:16:21.099572  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.090447 14523 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:21.099393 14348 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.103178 14329 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.111284 14329 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:21.115813 14630 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:21.116415 14630 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:21.098073  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 169069us
I20260709 13:16:21.085727 14497 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:16:21.095808 14353 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.139031  7861 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:21.057098 14572 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.139375 14353 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:21.143569  7262 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:21.146270  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:21.146965 14634 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:21.158457  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 220693us
I20260709 13:16:21.158075  7861 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:21.111066 14045 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.157754 14327 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.167251 14327 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.134876 14569 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:21.138715 14523 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:21.173287  7225 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:21.175201  7329 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:21.176721  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1398) took 1778 ms. Trace:
I20260709 13:16:21.178037  7184 rpcz_store.cc:276] 0709 13:16:19.398477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.398719 (+   242us) service_pool.cc:224] Handling call
0709 13:16:19.399068 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.843390 (+444322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.176327 (+1332937us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002b43d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:21.176639 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011594112}
I20260709 13:16:21.171321 14113 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:21.184523 14554 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.187395  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:21.188207  7259 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 14.
W20260709 13:16:21.192045 14615 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.450s	user 0.001s	sys 0.002s
I20260709 13:16:21.192822  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:21.193149 14572 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:21.193794  7887 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 24: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:21.195564  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:21.197674 14352 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:21.199816  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:21.200726  7894 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
W20260709 13:16:21.205770  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 116526us
I20260709 13:16:21.206347  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:21.207386  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:21.105449 14555 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.217824  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:21.182914 14569 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:21.213660 14113 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:21.215863 14674 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:16:21.187386 14554 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.230682 14554 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:21.172559 14533 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:21.220475  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.232043  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:21.233165 14533 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:21.233940 14533 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:21.217545 14680 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:21.234840 14523 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.234416 14533 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.236342 14533 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:21.208365 14416 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:21.226524 14113 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.237375  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:21.238691  7257 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:21.228190 14019 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:21.260525  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.263216  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.274962  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 67680.7us
I20260709 13:16:21.274083  7257 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
W20260709 13:16:21.285744  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 68036.4us
I20260709 13:16:21.236944 14680 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:21.237318 14555 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:21.242327 14416 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:21.275933  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:21.290138  7225 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:21.288340  7258 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:21.277946 14527 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:21.296355 14680 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.292096 14416 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:21.305266  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:21.307081  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:21.293592 14674 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:21.294469 14497 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:21.309813  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:21.308116  7336 raft_consensus.cc:2410] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:16:21.318275 14674 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:21.321659  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:21.322168  7861 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:21.324656  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:21.301975 14682 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:21.309108  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:21.329365  7330 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:21.343726 14045 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.296382 14527 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:16:21.345413 14684 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:21.360666  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:21.362264  7181 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:21.341507 14566 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:21.347270 14677 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:21.345635 14497 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:21.331512 14682 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:21.374820  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:21.379669 14673 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:16:21.328958 14630 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.391551 14673 consensus_queue.cc:1243] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 23.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:16:21.373217 14677 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:21.347929 14329 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.328560 14569 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.388247 14685 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:21.347273 14045 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.385175 14566 raft_consensus.cc:697] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:21.384761 14550 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:21.428059  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.430944  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 124653us
I20260709 13:16:21.460800  7334 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:16:21.391397 14682 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.418107 14677 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:21.476112  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.429330 14685 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:21.457914 14523 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:21.373464 14674 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:21.498114 14618 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.582s	user 0.006s	sys 0.005s
I20260709 13:16:21.465672 14550 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.483857 14353 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.484131 14019 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:21.512534  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2538) took 2130 ms. Trace:
I20260709 13:16:21.513000 14630 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.515699 14329 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.512964  7333 rpcz_store.cc:276] 0709 13:16:19.381947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.382150 (+   203us) service_pool.cc:224] Handling call
0709 13:16:19.382485 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:19.382924 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.382962 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.383428 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.553684 (+170256us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:20.020507 (+466823us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.020731 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.020805 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.497391 (+1476586us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:21.512227 (+ 14836us) raft_consensus.cc:1685] finished
0709 13:16:21.512337 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.512471 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":600156,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":17107,"raft.queue_time_us":4826,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":5145,"spinlock_wait_cycles":9676160,"thread_start_us":590224,"threads_started":2,"wal-append.queue_time_us":458077}
I20260709 13:16:21.516619 14566 consensus_queue.cc:237] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.517963  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 1011) took 3185 ms. Trace:
I20260709 13:16:21.518980 14553 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.520107 14353 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.520977 14685 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.518422  7892 rpcz_store.cc:276] 0709 13:16:18.332700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.333015 (+   315us) service_pool.cc:224] Handling call
0709 13:16:18.488691 (+155676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.755019 (+266328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.755073 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.755820 (+   747us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.889310 (+133490us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:18.889363 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.889634 (+   271us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.328796 (+439162us) raft_consensus.cc:1685] finished
0709 13:16:19.328820 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.517583 (+2188763us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54005a14d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:21.517856 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44167,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":356932352,"thread_start_us":301534,"threads_started":2,"wal-append.queue_time_us":404527,"wal-append.run_cpu_time_us":2880,"wal-append.run_wall_time_us":1140639}
I20260709 13:16:21.468006 14684 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:21.524518 14684 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.525913 14301 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:21.514369 14045 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:21.535151 14689 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:16:21.537467  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:21.539171  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:21.482594 14682 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:21.522209 14685 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:21.562840  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.563659  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.568976 14608 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:21.572211  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:21.572664  7889 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:16:21.572995  7892 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:21.492362 14523 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.587006 14634 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:21.587571 14634 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:21.587838 14657 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:21.588543 14657 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:21.588595 14634 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.590286 14634 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:21.591835 14550 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:21.590165 14657 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:21.667136  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.682015  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:21.683876  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:21.682884  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1518) took 2913 ms. Trace:
I20260709 13:16:21.684137  7256 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:21.684954  7253 rpcz_store.cc:276] 0709 13:16:18.769122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.034254 (+1265132us) service_pool.cc:224] Handling call
0709 13:16:20.034770 (+   516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.035265 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.035313 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.035911 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.521129 (+1485218us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b1800130900. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:16:21.681587 (+160458us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:21.681745 (+   158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.681947 (+   202us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.682077 (+   130us) raft_consensus.cc:1685] finished
0709 13:16:21.682096 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.682564 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":22232,"spinlock_wait_cycles":4471680,"thread_start_us":159744,"threads_started":1,"wal-append.queue_time_us":1589336}
W20260709 13:16:21.696659  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.701190  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:21.701498  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:21.701541  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:21.691558  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:21.709021  7256 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:21.623986 14657 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:21.721367 14522 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:21.735087 14569 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:21.736637 14569 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.744128  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:21.752198 14572 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.753373 14572 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.754472  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:21.754644  7301 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:21.756803 14554 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:21.757902 14554 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:21.761822 14554 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:21.762733 14523 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:21.771008  7333 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:21.771567 14572 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:21.778035  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.780522 14569 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:21.784449  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2895) took 2295 ms. Trace:
I20260709 13:16:21.784749  7336 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: [22.12-22.12]
W20260709 13:16:21.785247  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.785997  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.786592  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:21.787933  7336 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:21.787082 14569 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.789093 14569 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.789292  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1526) took 1042 ms. Trace:
I20260709 13:16:21.790179  7262 rpcz_store.cc:276] 0709 13:16:20.746856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.746988 (+   132us) service_pool.cc:224] Handling call
0709 13:16:21.788688 (+1041700us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54001e05d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:21.789053 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753204608}
I20260709 13:16:21.797325  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3876) took 3378 ms. Trace:
I20260709 13:16:21.785136  7187 rpcz_store.cc:276] 0709 13:16:19.488560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.982719 (+494159us) service_pool.cc:224] Handling call
0709 13:16:19.983011 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.241723 (+258712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.783704 (+1541981us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400117454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:21.784170 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578022784}
I20260709 13:16:21.786587  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:21.799891  7261 rpcz_store.cc:276] 0709 13:16:18.418614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.418789 (+   175us) service_pool.cc:224] Handling call
0709 13:16:18.420634 (+  1845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.594066 (+173432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.796722 (+3202656us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b5400226ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:21.797105 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159073152}
W20260709 13:16:21.810949  7327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1175) took 2834 ms (client timeout 1792 ms). Trace:
W20260709 13:16:21.811681  7327 rpcz_store.cc:269] 0709 13:16:18.976358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.977554 (+  1196us) service_pool.cc:224] Handling call
0709 13:16:21.810233 (+2832679us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400253854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:21.810553 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436212992}
I20260709 13:16:21.812155  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2541) took 2428 ms. Trace:
I20260709 13:16:21.806571 14413 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:21.817302 14550 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:21.819001  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2543) took 1855 ms. Trace:
I20260709 13:16:21.818650 14550 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.819208  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:21.819527  7331 rpcz_store.cc:276] 0709 13:16:19.963231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.012025 (+ 48794us) service_pool.cc:224] Handling call
0709 13:16:20.024660 (+ 12635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.655288 (+630628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.818249 (+1162961us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540031a6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:21.818723 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304050944}
I20260709 13:16:21.820345  7185 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:21.821998 14550 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:21.817390  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 86282us
I20260709 13:16:21.817816 14413 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.823166  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2550) took 1170 ms. Trace:
I20260709 13:16:21.823829  7332 rpcz_store.cc:276] 0709 13:16:20.652657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.655748 (+  3091us) service_pool.cc:224] Handling call
0709 13:16:21.822573 (+1166825us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b54001919d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:21.822884 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121321216}
I20260709 13:16:21.827230 14413 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:21.828066  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:21.829180  7261 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:21.810179  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56034.3us
I20260709 13:16:21.820083 14650 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:21.836227  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:21.837321  7895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 1016) took 2253 ms. Trace:
I20260709 13:16:21.836246  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1267) took 1567 ms. Trace:
I20260709 13:16:21.838065  7891 rpcz_store.cc:276] 0709 13:16:20.268662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.269774 (+  1112us) service_pool.cc:224] Handling call
0709 13:16:21.835758 (+1565984us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54006608d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:21.836007 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283263744}
I20260709 13:16:21.839016  7890 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:16:21.840866  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.843397  7181 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:16:21.846396  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:21.829185  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1274) took 1260 ms. Trace:
I20260709 13:16:21.840797  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1277) took 1086 ms. Trace:
I20260709 13:16:21.851927 14569 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:21.852171  7336 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:21.816032  7328 rpcz_store.cc:276] 0709 13:16:19.383235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.453255 (+ 70020us) service_pool.cc:224] Handling call
0709 13:16:19.490024 (+ 36769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.263295 (+773271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.811314 (+1548019us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b540013d154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:21.811954 (+   640us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776050560}
I20260709 13:16:21.849095  7890 rpcz_store.cc:276] 0709 13:16:20.754923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.774599 (+ 19676us) service_pool.cc:224] Handling call
0709 13:16:21.838254 (+1063655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.839434 (+  1180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.840543 (+  1109us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54006608d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:21.840726 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413926784}
I20260709 13:16:21.847730  7888 rpcz_store.cc:276] 0709 13:16:20.568123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.572879 (+  4756us) service_pool.cc:224] Handling call
0709 13:16:20.619551 (+ 46672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.647502 (+ 27951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.828596 (+1181094us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b54005537d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:21.828892 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82816256}
I20260709 13:16:21.859041  7185 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:21.813257  7225 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:21.837797  7895 rpcz_store.cc:276] 0709 13:16:19.583883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.584737 (+   854us) service_pool.cc:224] Handling call
0709 13:16:19.585057 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.251924 (+666867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.836733 (+1584809us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b540068e7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:21.837103 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531675904}
I20260709 13:16:21.863492  7861 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:21.866590 14045 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:21.867209 14045 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:21.867408  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:21.867786 14045 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:21.873633  7182 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 28. Current term is 29. Ops: []
I20260709 13:16:21.874962 14348 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.859843  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:21.875998 14348 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.877696  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:21.883823  7333 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:21.847918 14684 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:21.887621 14684 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:21.902233  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.903635  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:21.906404  7187 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:21.911021 14348 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:21.916719  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:21.919108  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:21.919512  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:21.921499 14582 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:21.921885  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:21.923300  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:21.925601  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:21.927059  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:21.928225  7186 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:21.927312 14651 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:21.931376  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:21.933275  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:21.907105 14569 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:21.942057  7261 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:21.940683  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:21.947278  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:21.947570  7256 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:21.950191  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:21.950309  7259 raft_consensus.cc:2410] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:16:21.952833  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:21.956857  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:21.934537 14651 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:21.967064  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:21.971719  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.972064  7262 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:21.975039  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:21.982498  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.982826  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:21.985517  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:21.982869 14651 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:21.986640 14651 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:21.991348 14650 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:21.992419 14650 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:21.995282 14572 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:21.995987 14572 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:21.996435 14572 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:21.997257  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2507) took 2517 ms. Trace:
I20260709 13:16:21.997442  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:21.980456 14416 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.661s	user 0.016s	sys 0.010s
I20260709 13:16:22.000010  7262 raft_consensus.cc:2368] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23.
I20260709 13:16:22.000703 14620 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:22.001250  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 287469us
I20260709 13:16:21.997736  7255 rpcz_store.cc:276] 0709 13:16:19.479585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.059015 (+579430us) service_pool.cc:224] Handling call
0709 13:16:20.059462 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.252811 (+193349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.996656 (+1743845us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400125054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:21.997066 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425099520}
I20260709 13:16:22.002756 14677 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.004320  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3875) took 3594 ms. Trace:
I20260709 13:16:22.004716  7261 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:16:22.007706  7260 rpcz_store.cc:276] 0709 13:16:18.409998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.410914 (+   916us) service_pool.cc:224] Handling call
0709 13:16:18.413256 (+  2342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.586194 (+1172938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.001268 (+2415074us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002e7554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:22.004112 (+  2844us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2646806400}
I20260709 13:16:22.003611 14684 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:22.015128  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:22.015592 14677 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:22.016083  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:22.005229 14416 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:22.019205 14690 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.502s	user 0.003s	sys 0.003s
I20260709 13:16:21.994055 14650 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.030320  7260 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:22.025345  7178 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:22.031961  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:22.032931  7178 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:22.041545  7253 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:22.042470  7255 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 25
W20260709 13:16:22.045878 14533 consensus_meta.cc:287] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.766s	user 0.018s	sys 0.002s
I20260709 13:16:22.048321 14416 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:22.048447  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3677) took 1808 ms. Trace:
I20260709 13:16:22.044808  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:22.057344  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.063194  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.063668  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.064487  7888 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:22.065091  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.065320  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.064642  7336 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:22.063675  7890 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:16:22.067983 14486 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.068064 14045 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.068888 14486 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.040622  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:22.066888 14591 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:22.038264 14497 consensus_meta.cc:287] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.585s	user 0.017s	sys 0.005s
I20260709 13:16:22.058916  7179 rpcz_store.cc:276] 0709 13:16:20.239963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.545860 (+305897us) service_pool.cc:224] Handling call
0709 13:16:20.546190 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:21.054538 (+508348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.047908 (+993370us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54002715d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:22.048270 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123495808}
I20260709 13:16:22.067028  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.077610  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:22.078027 14486 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:22.078385  7890 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:22.079463 14591 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.080827 14148 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:22.081295 14148 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:22.082422 14148 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.086846 14148 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:22.090521  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.082517 14591 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:22.102233 14691 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.587s	user 0.000s	sys 0.002s
I20260709 13:16:22.102881 14497 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:22.103225  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:22.105664 14637 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.106263 14637 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:22.108263 14608 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.008s
I20260709 13:16:22.109045 14637 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:22.111860 14620 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.112545 14620 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.121232  7187 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
W20260709 13:16:22.123042  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 111099us
I20260709 13:16:22.124240  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:22.126959 14528 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:22.127552 14528 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:22.128726 14528 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.130971  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:22.132066  7256 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:22.133047  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.133714  7256 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:22.135421  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.136276  7184 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:22.139086 14045 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:22.139189  7890 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:16:22.138850  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.140141  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.140982  7330 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:16:22.142686  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.046514 14533 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.143646  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.144579  7335 raft_consensus.cc:2393] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:22.145797  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.146696  7334 raft_consensus.cc:2376] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22. Re-sending same reply.
I20260709 13:16:22.147491 14533 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:22.147934  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.142861  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:22.103166 14711 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:16:22.151247  7329 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:22.151129  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.155021  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:22.155187  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:22.155241  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 143252us
I20260709 13:16:22.157074  7256 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:22.162777  7255 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:22.159636  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:22.165705  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.167912  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.171197  7185 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:22.098165 14684 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:22.172132  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:22.172295  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:22.167721  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.154508 14582 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:22.172715  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:22.173718  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 47267us
I20260709 13:16:22.178170  7890 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:22.179939 14302 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:16:22.180106  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:22.180765  7187 raft_consensus.cc:2376] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21. Re-sending same reply.
I20260709 13:16:22.180908  7887 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:22.181844  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.182899  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:22.183275  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.183595  7184 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:22.184473  7301 leader_election.cc:400] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23.
I20260709 13:16:22.184834  7301 leader_election.cc:403] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:22.186115  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:22.186591  7186 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:16:22.187023  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:22.180117  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.187042  7181 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:22.196257  7260 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:22.197511  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.198678  7862 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:22.197376  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.199625  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.199965  7891 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:16:22.177174  7178 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.202560  7330 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:22.207834  7179 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:22.207566  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:22.209792  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:22.210426  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:22.210947  7182 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 19: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:22.212575  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.213263  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:22.213732  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.214248 14684 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:22.214602  7187 raft_consensus.cc:2368] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23.
I20260709 13:16:22.216687  7890 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:16:22.215019  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:22.219661  7256 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:22.218892  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.219740  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:22.228183  7329 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:22.219379  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.229063  7181 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 25.
I20260709 13:16:22.215314  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.230814  7255 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 25: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:22.213263  7182 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:22.214789 14684 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.233971 14684 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:22.235771  7258 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:16:22.236251 14671 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:22.236735 14671 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.237109 14671 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:22.237149  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.237812  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.237946  7258 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 25.
I20260709 13:16:22.239202  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.240142  7259 raft_consensus.cc:2410] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:16:22.240677  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.241130  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.241802  7261 raft_consensus.cc:2410] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:16:22.241919  7259 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:22.242702  7257 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:22.219143  7331 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:22.246644  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:22.247463  7261 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:22.224891 14299 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23.
I20260709 13:16:22.214802 14652 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:22.199741 14302 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 13:16:22.255389 14416 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:22.255276  7225 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:22.256021  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.260186  7184 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:22.262017  7178 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:22.256737 14652 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:22.262923  7186 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
W20260709 13:16:22.265007  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.265910  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:22.266863  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.269182  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:22.271965 14674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.004s	sys 0.017s
W20260709 13:16:22.272486 14674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.005s	sys 0.018s
I20260709 13:16:22.272773  7891 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:16:22.273548 14327 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:22.274039 14677 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:22.274946 14523 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:22.260100 14591 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:16:22.279870 14591 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:22.280341 14591 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:22.281778 14591 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.288154  7262 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
W20260709 13:16:22.288341  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 89837.8us
W20260709 13:16:22.290323  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.292802  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:22.295488  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.295791  7890 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260709 13:16:22.296305 14591 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:22.298725 14657 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.012s
I20260709 13:16:22.298558  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.299649  7330 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:22.299955  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.300213  7182 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:22.300786  7328 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:22.295377  7334 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 13:16:22.302791  7334 pending_rounds.cc:85] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 16
I20260709 13:16:22.302443 14572 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.303049  7334 pending_rounds.cc:107] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:16:22.303369  7334 raft_consensus.cc:2889] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.305377 14572 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:22.306453  7333 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:22.307585  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:22.309141 14523 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:22.309767 14523 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:22.310026  7862 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:22.310998 14416 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:22.310881 14523 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.312587 14416 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:22.313216 14674 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:22.313649 14674 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:22.314421 14590 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.315060  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:22.315517 14596 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:22.316119 14596 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:22.317445 14608 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:22.317255 14596 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.314687 14674 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.268268 14652 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:22.310340  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:22.328994  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.345247  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:22.345984 14634 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.005s
I20260709 13:16:22.347150  7889 raft_consensus.cc:2410] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
I20260709 13:16:22.350553  7262 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:22.351154 14674 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:22.351892  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:22.352552  7262 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:22.354984  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.355827  7182 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:22.356961  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.358193  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:22.363049  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53081.9us
I20260709 13:16:22.363947  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:22.347177  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 92068.7us
I20260709 13:16:22.365468  7862 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:22.366372  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:22.368212  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:22.369208 14327 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:22.369901  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:22.364068 14528 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:22.370815 14528 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.371029  7184 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:22.371222 14528 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:22.372061  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.372970  7184 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 25: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:22.373842  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:22.294930  7261 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:22.381400  7185 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:22.384548  7331 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 24. Current term is 25. Ops: []
W20260709 13:16:22.391719  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47204.8us
I20260709 13:16:22.394714  7178 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 13:16:22.395331  7178 pending_rounds.cc:85] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 16
I20260709 13:16:22.400521  7187 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:16:22.402309  7178 pending_rounds.cc:107] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 13:16:22.401547  7184 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:16:22.408073  7178 raft_consensus.cc:2889] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.402546  7259 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:22.404273  7182 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:22.391499 14634 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:22.315079 14590 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.414829  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:22.402277 14533 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:22.427754  7185 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
W20260709 13:16:22.395917  7150 connection.cc:256] RPC call timeout handler was delayed by -1.635719963000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 13:16:22.432070  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 66663.8us
I20260709 13:16:22.438534  7261 raft_consensus.cc:1240] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: [18.11-20.12]
W20260709 13:16:22.436718  7150 connection.cc:256] RPC call timeout handler was delayed by -1.5412199630000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
I20260709 13:16:22.428994  7328 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:22.425621 14677 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:22.449354  7259 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
W20260709 13:16:22.450446  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.451390  7256 raft_consensus.cc:2468] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 15.
I20260709 13:16:22.433784 14348 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:22.439905 14299 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:22.464409  7150 connection.cc:256] RPC call timeout handler was delayed by -1.1077877480001916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260709 13:16:22.464529  7331 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:16:22.469169 14450 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:22.467017  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 97230.2us
I20260709 13:16:22.471643 14450 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:22.473048  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63836.6us
I20260709 13:16:22.474124 14450 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:22.475543  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:22.425377 14554 consensus_queue.cc:1059] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:16:22.471417  7150 connection.cc:256] RPC call timeout handler was delayed by -1.0689783940001689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3085s for a response
I20260709 13:16:22.482509  7262 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:22.487841  7256 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:16:22.490221  7336 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:22.490803  7336 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:22.495975 14651 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.478489 14657 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:22.471114 14684 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.510224 14651 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.510465  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.515704  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.516383  7187 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:22.521760  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:22.501852 14590 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:22.531047  7261 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 20. Current term is 21. Ops: []
W20260709 13:16:22.536106  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.523810  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:22.540290  7331 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 20: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:22.540831 14638 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:22.540580  7336 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.541319 14638 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:22.541913  7336 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:22.543376 14554 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:22.544080 14554 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.546859  7254 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:22.548048  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3910) took 1073 ms. Trace:
I20260709 13:16:22.548506  7254 rpcz_store.cc:276] 0709 13:16:21.474845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.414387 (+939542us) service_pool.cc:224] Handling call
0709 13:16:22.454913 (+ 40526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.547604 (+ 92691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.547915 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.553454  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:22.554883 14327 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:22.556936 14327 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:22.570928  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.579624 14718 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:16:22.588528 14651 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:22.512998 14348 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:16:22.593199  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3891) took 1219 ms. Trace:
I20260709 13:16:22.542450 14638 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:22.593931  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.594575  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.594744 14638 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:22.595018  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.593670  7257 rpcz_store.cc:276] 0709 13:16:21.373941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.374473 (+   532us) service_pool.cc:224] Handling call
0709 13:16:22.592946 (+1218473us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b540009a6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:22.593104 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662159616}
I20260709 13:16:22.597962  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.598346  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:22.598869  7257 raft_consensus.cc:2410] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:16:22.599159 14344 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.599339 14450 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:22.599771 14344 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.600754  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:22.601599 14695 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.087s	user 0.007s	sys 0.000s
I20260709 13:16:22.602298 14344 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:22.602721  7183 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:16:22.604538  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51238.2us
I20260709 13:16:22.605407  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:22.606382  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:22.608418 14620 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:22.612066  7255 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:16:22.620054  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3892) took 1245 ms. Trace:
I20260709 13:16:22.620617  7255 rpcz_store.cc:276] 0709 13:16:21.374314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.611191 (+1236877us) service_pool.cc:224] Handling call
0709 13:16:22.611704 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.619572 (+  7868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.619955 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.623116 14620 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.623907 14620 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.622372  7255 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:22.613700  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.630868  7182 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 29.
I20260709 13:16:22.632412  7256 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:16:22.633366  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:22.635133 14552 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.635492 14634 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:22.635929 14634 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.635792 14552 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.636320 14634 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:22.636071 14621 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:22.638120 14552 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:22.640606  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:22.643035  7256 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:16:22.646785  7256 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:16:22.649442  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44130.1us
I20260709 13:16:22.649806 14692 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:22.650492  7861 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:22.650970 14692 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:22.651413 14692 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:22.651358 14685 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:16:22.653084 14685 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:16:22.653587 14685 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 28 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:22.654906 14685 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.656400 14685 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:22.656473  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:22.659421  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:22.659847  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.660648 14677 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:22.660863  7261 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 16.
I20260709 13:16:22.661321 14677 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:22.662323 14677 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.668478 14692 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.667889  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:22.670125 14655 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:22.675036 14655 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:22.675621 14655 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.676061 14655 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:22.620411 14687 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.108s	user 0.010s	sys 0.000s
I20260709 13:16:22.678880 14409 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:22.681010 14409 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:22.681531 14409 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:22.681988 14409 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:22.683379 14572 raft_consensus.cc:3055] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:22.683956 14572 raft_consensus.cc:740] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:22.647944 14552 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:22.648706 14591 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:22.649085  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:22.550117  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:22.618175 14720 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.098s	user 0.001s	sys 0.001s
I20260709 13:16:22.647477  7302 leader_election.cc:400] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171) with higher term. Message: Invalid argument: T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23.
W20260709 13:16:22.684913  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 171182us
W20260709 13:16:22.685204  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44712.8us
W20260709 13:16:22.700874  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50607.5us
W20260709 13:16:22.704202  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 55212.6us
I20260709 13:16:22.705494 14674 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:22.705768 14299 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:22.706094 14674 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:22.708292  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:22.709311  7187 raft_consensus.cc:3055] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:22.709740  7258 raft_consensus.cc:2410] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:16:22.709717  7187 raft_consensus.cc:740] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:22.710346  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49030.8us
I20260709 13:16:22.713533 14348 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:16:22.731467  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:22.732859  7336 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:16:22.690840 14620 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:22.710081 14590 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:22.771380 14590 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:22.761225  7187 consensus_queue.cc:260] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.772620  7187 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:22.737998  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.772904 14590 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.775398  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2922) took 1423 ms. Trace:
I20260709 13:16:22.775827  7180 rpcz_store.cc:276] 0709 13:16:21.351914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.352155 (+   241us) service_pool.cc:224] Handling call
0709 13:16:21.352574 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.359454 (+  6880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.359491 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.379820 (+ 20329us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.468669 (+ 88849us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:21.468728 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.468803 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.600671 (+1131868us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:22.712700 (+112029us) raft_consensus.cc:1685] finished
0709 13:16:22.712727 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.775209 (+ 62482us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6427,"raft.queue_time_us":7263,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10823,"spinlock_wait_cycles":16724864,"thread_start_us":49389,"threads_started":1,"wal-append.queue_time_us":101594}
I20260709 13:16:22.739953  7861 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:22.781008  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.781418 14608 raft_consensus.cc:2804] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:22.782030 14608 raft_consensus.cc:697] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:22.740772  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 93485.9us
I20260709 13:16:22.743129 14674 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.690237 14692 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:22.743852  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2523) took 1070 ms. Trace:
I20260709 13:16:22.746788 14607 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:22.747071 14684 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:22.710446 14671 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.752460 14299 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:22.755112 14572 consensus_queue.cc:260] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.722736  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:22.759023  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:22.765911  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 165278us
I20260709 13:16:22.767215  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.781864 14620 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:22.713267 14554 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:22.784428  7258 rpcz_store.cc:276] 0709 13:16:21.673933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.521382 (+847449us) service_pool.cc:224] Handling call
0709 13:16:22.743608 (+222226us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54002170d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:22.743783 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423922944}
I20260709 13:16:22.790764  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3906) took 1351 ms. Trace:
I20260709 13:16:22.783743  7336 pending_rounds.cc:85] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 11
I20260709 13:16:22.842567  7336 pending_rounds.cc:107] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:16:22.843005  7336 raft_consensus.cc:2889] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.804267  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.709787 14634 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.847323  7187 raft_consensus.cc:1275] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:16:22.824258  7327 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:16:22.829352  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:22.798907 14148 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.712s	user 0.007s	sys 0.007s
I20260709 13:16:22.806515 14299 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:22.825220 14671 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:22.864181  7081 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: config changed from index 11 to 5, term changed from 18 to 9, leader changed from <none> to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from VOTER to NON_VOTER. New cstate: current_term: 9 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:16:22.823457 14528 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.873978 14327 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:22.829669 14651 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:16:22.827556  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.850504  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.907039  7336 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:22.798784 14607 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.855844  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.876379  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:22.877141  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 164241us
I20260709 13:16:22.844261  7253 rpcz_store.cc:276] 0709 13:16:21.438996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.388909 (+949913us) service_pool.cc:224] Handling call
0709 13:16:22.410840 (+ 21931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.411090 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:16:22.486185 (+ 75095us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.790212 (+304027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.790292 (+    80us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:22.790358 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.790458 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.790675 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156469,"prepare.queue_time_us":119226,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":2761,"thread_start_us":368019,"threads_started":2}
I20260709 13:16:22.825958 14552 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:16:22.798352 14652 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.880402  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:22.917562  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:22.917900  7256 raft_consensus.cc:1275] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:16:22.879509 14620 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:16:22.874336 14528 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:22.874778 14554 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:22.884402 14634 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:22.911898 14607 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:22.942871  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.943620  7077 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47542 (request call id 237) took 27372 ms (client timeout 15000 ms). Trace:
I20260709 13:16:22.944133  7333 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 29.
I20260709 13:16:22.947013  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.948879  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.950277 14657 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:22.952023  7254 raft_consensus.cc:1240] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:22.953562  7254 raft_consensus.cc:1240] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 14. Current term is 15. Ops: []
W20260709 13:16:22.954507  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 125251us
I20260709 13:16:22.955782  7258 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:16:22.957314  7329 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:22.958541  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.827204 14608 consensus_queue.cc:237] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.877460 14604 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:16:22.931511 14620 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.930680 14344 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:22.967535  7334 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:22.968107  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:22.972100  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2524) took 1297 ms. Trace:
I20260709 13:16:22.975268 14301 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.975951 14301 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.940646 14572 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:22.975297  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 99087.6us
I20260709 13:16:22.978581 14301 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:22.985073 14652 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:22.984797 14655 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:22.984567 14299 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:22.986667  7336 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:16:22.974156  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:22.979749 14620 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:16:23.001278  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:23.001113 14327 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:16:23.005897  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.036652  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.981856  7259 rpcz_store.cc:276] 0709 13:16:21.674372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.455990 (+781618us) service_pool.cc:224] Handling call
0709 13:16:22.468039 (+ 12049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.477237 (+  9198us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:16:22.542425 (+ 65188us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.971015 (+428590us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.971763 (+   748us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.971815 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:22.971866 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.971934 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.972045 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82848,"prepare.queue_time_us":223219,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":91,"raft.queue_time_us":618,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":236,"thread_start_us":446180,"threads_started":2}
I20260709 13:16:23.037990  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:22.944476  7077 rpcz_store.cc:269] 0709 13:15:55.577141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.592662 (+ 15521us) service_pool.cc:224] Handling call
0709 13:15:56.588480 (+995818us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b5400002490. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117e9c 00007fece61180f6 00007fecef091a89 00007fecef029da6 00007feceeffb088 00007fecef0f937e 00007feced5ba2a4 00007feced5ba232 00007feced5ba161 00007feced5ba0dc
0709 13:15:56.596916 (+  8436us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b54000aa354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a6090 00007fece9244f3a 00007feceeffb1cc 00007fecef0f937e 00007feced5ba2a4 00007feced5ba232 00007feced5ba161 00007feced5ba0dc 00007feced5b9392 00007fece757748c 00007fece75768c6
0709 13:15:57.353804 (+756888us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5400002490. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6118640 00007feceefefb76 00007fecef0f9c3e 00007feced5ba2a4 00007feced5ba232 00007feced5ba161 00007feced5ba0dc 00007feced5b9392 00007fece757748c 00007fece75768c6
0709 13:16:22.937744 (+25583940us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:11.671737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:11.673024 (+  1287us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:11.673107 (+    83us) write_op.cc:435] Acquired schema lock
0709 13:16:11.673160 (+    53us) tablet.cc:662] Decoding operations
0709 13:16:12.009904 (+336744us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:12.010026 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:12.010055 (+    29us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:16:12.012466 (+  2411us) tablet.cc:701] Row locks acquired
0709 13:16:12.012518 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:16:12.012726 (+   208us) write_op.cc:270] Start()
0709 13:16:12.012893 (+   167us) write_op.cc:276] Timestamp: P: 1783602972012654 usec, L: 0
0709 13:16:12.012932 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:16:12.127123 (+114191us) log.cc:844] Serialized 11755 byte log entry
0709 13:16:12.717803 (+590680us) op_driver.cc:464] REPLICATION: finished
0709 13:16:13.305938 (+588135us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece61320ac 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fececc72ef0
0709 13:16:13.419783 (+113845us) write_op.cc:301] APPLY: starting
0709 13:16:13.419915 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:13.964058 (+544143us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:13.964108 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:15.283835 (+1319727us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:15.284322 (+   487us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=0,mrs_lookups=0
0709 13:16:15.284406 (+    84us) write_op.cc:312] APPLY: finished
0709 13:16:15.284997 (+   591us) log.cc:844] Serialized 260 byte log entry
0709 13:16:15.336636 (+ 51639us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:15.337031 (+   395us) write_op.cc:454] Released schema lock
0709 13:16:15.337238 (+   207us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:15.337976 (+   738us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:15.338033 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4082404,"reported_tablets":50,"spinlock_wait_cycles":94020096,"child_traces":[["op",{"apply.queue_time_us":698064,"apply.run_cpu_time_us":78693,"apply.run_wall_time_us":1918104,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129707,"num_ops":30,"prepare.queue_time_us":155578,"prepare.run_cpu_time_us":36051,"prepare.run_wall_time_us":600887,"raft.queue_time_us":246804,"raft.run_cpu_time_us":35399,"raft.run_wall_time_us":876155,"replication_time_us":685388,"spinlock_wait_cycles":11854848,"thread_start_us":1108750,"threads_started":5,"wal-append.queue_time_us":179344,"wal-append.run_cpu_time_us":62675,"wal-append.run_wall_time_us":2322811}]]}
W20260709 13:16:23.039692  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 251986us
I20260709 13:16:23.000056 14569 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:23.008031 14299 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:23.076327  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 363860us
I20260709 13:16:23.062724  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:23.048691 14528 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:22.981218 14409 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:23.048946 14301 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:23.079945  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:23.080328  7332 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:16:23.078591  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:23.091185  7225 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:16:23.098577  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.100713  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:23.085037 14528 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.103739 14528 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:23.121775 14671 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.122900  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 114976us
I20260709 13:16:23.122617 14671 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:23.124629  7150 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:23.125497 14671 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:23.126824 14344 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:23.127384 14344 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:23.127795  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:23.128365 14344 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:23.133976  7253 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 26: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:16:23.135340  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 65898.8us
I20260709 13:16:23.085594 14634 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:16:23.140527  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49475.1us
W20260709 13:16:23.145984  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 374409us
I20260709 13:16:23.160209  7182 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:16:23.102029 14569 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:16:23.086454 14301 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:23.074226 14652 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:16:23.192653  7182 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:16:23.138957 14634 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.164147 14348 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:23.175671 14301 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:23.212021  7150 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:23.180987 14638 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:23.227178 14638 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.227928 14638 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:23.228250 14528 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:23.230137 14523 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:16:23.230852  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54150.8us
I20260709 13:16:23.231851  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:23.211330 14327 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.218720 14569 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.220415  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 143277us
W20260709 13:16:23.224308  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.225556 14148 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:23.199488 14634 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:23.250249  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:23.271718  7185 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:23.269315  7182 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:16:23.175972 14637 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:16:23.208623 14655 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:23.288141  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:23.292610  7182 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:16:23.279850  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:23.245301 14652 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:23.307298  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2525) took 1622 ms. Trace:
W20260709 13:16:23.278028 14685 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.005s
I20260709 13:16:23.301772  7332 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 25.
I20260709 13:16:23.263090 14148 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:23.316630  7257 rpcz_store.cc:276] 0709 13:16:21.685608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.599639 (+914031us) service_pool.cc:224] Handling call
0709 13:16:22.599988 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.600270 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:22.761877 (+161607us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.306473 (+544596us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:23.306540 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:23.306604 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.306707 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.307203 (+   496us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147707,"prepare.queue_time_us":263995,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":40835,"thread_start_us":406112,"threads_started":1}
I20260709 13:16:23.326579  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:23.328137  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.330058  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 415540us
I20260709 13:16:23.276549 14677 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.308954  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:23.339108  7181 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:23.325414  7302 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:23.317548  7184 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:23.305438 14528 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:23.262482 14327 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:23.344656  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.271128 14569 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:23.387399  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 110386us
I20260709 13:16:23.327776 14348 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:23.332711 14621 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.403517  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:23.398803 14680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.665s	user 0.015s	sys 0.025s
I20260709 13:16:23.324865 14684 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:16:23.439141  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 212374us
I20260709 13:16:23.401428 14652 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:16:23.407640 14680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.892s	user 0.016s	sys 0.025s
I20260709 13:16:23.433344  7185 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 26.
I20260709 13:16:23.449498  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:23.370995 14677 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:23.434319 14728 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:16:23.454113  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46422.2us
W20260709 13:16:23.457070  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.407442 14555 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:23.471485  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:23.451684 14652 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:23.474613  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 246026us
I20260709 13:16:23.442691 14744 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:23.435196 14684 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:16:23.465592  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.405337 14590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.026s
I20260709 13:16:23.434235 14655 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
W20260709 13:16:23.483306 14590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.007s	sys 0.027s
I20260709 13:16:23.481236  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:23.481492  7890 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:16:23.484865  7891 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:23.486312  7261 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:23.484189 14684 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:23.487754  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1539) took 1683 ms. Trace:
I20260709 13:16:23.489202  7255 rpcz_store.cc:276] 0709 13:16:21.804740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.629756 (+825016us) service_pool.cc:224] Handling call
0709 13:16:22.630057 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.630296 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:23.234269 (+603973us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.487362 (+253093us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:23.487432 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:23.487479 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.487550 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.487674 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161696,"prepare.queue_time_us":234455,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":27,"thread_start_us":561519,"threads_started":2}
I20260709 13:16:23.470178  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3913) took 1795 ms. Trace:
I20260709 13:16:23.481303  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:23.463109 14528 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.494680  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.498909  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1538) took 1779 ms. Trace:
I20260709 13:16:23.504189  7260 rpcz_store.cc:276] 0709 13:16:21.720038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.626530 (+906492us) service_pool.cc:224] Handling call
0709 13:16:22.626905 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.627172 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:16:23.168182 (+541010us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.498464 (+330282us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:23.498527 (+    63us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:23.498579 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.498669 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.498821 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147241,"prepare.queue_time_us":237375,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"thread_start_us":651749,"threads_started":2}
I20260709 13:16:23.444109 14607 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:23.513959  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:23.515187  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:23.513558  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:23.515708  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.515573  7184 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:23.445394 14621 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:23.523597  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:23.477788 14744 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.477053 14652 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:23.460052 14554 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:16:23.509579 14655 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:16:23.570089 14655 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:23.570803 14655 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:23.560757 14674 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:23.466704 14148 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:23.573201 14148 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:23.574859  7328 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:23.575332  7328 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:23.576208  7328 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:23.577558  7328 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:23.579489  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:23.580201  7329 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:23.582891  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 73408.3us
W20260709 13:16:23.583271 14572 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.003s
I20260709 13:16:23.583441  7335 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:16:23.557577 14692 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
W20260709 13:16:23.584329  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 390071us
I20260709 13:16:23.585613  7335 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:16:23.562397 14744 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:23.514883 14528 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:23.571946 14655 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:23.589109 14528 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:23.590137 14725 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 13:16:23.590538 14726 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 13:16:23.508342 14736 consensus_queue.cc:1048] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.279s
I20260709 13:16:23.591657  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3708) took 1248 ms. Trace:
I20260709 13:16:23.592083  7186 rpcz_store.cc:276] 0709 13:16:22.342837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.423424 (+ 80587us) service_pool.cc:224] Handling call
0709 13:16:22.437626 (+ 14202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.459171 (+ 21545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.459198 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.486185 (+ 26987us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.008304 (+522119us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:23.008365 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.008462 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.591425 (+582963us) raft_consensus.cc:1685] finished
0709 13:16:23.591449 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.591594 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":483275,"threads_started":1,"wal-append.queue_time_us":769834}
I20260709 13:16:23.558969 14348 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:23.593602 14740 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:16:23.590091 14655 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:23.513527 14743 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.595110 14743 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:23.596258  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:23.586336  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:23.571307 14732 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:16:23.606550  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2940) took 1001 ms. Trace:
I20260709 13:16:23.607684  7179 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:23.586539  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:23.607051  7178 rpcz_store.cc:276] 0709 13:16:22.605092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.605260 (+   168us) service_pool.cc:224] Handling call
0709 13:16:22.605581 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.684453 (+ 78872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.684484 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.739645 (+ 55161us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.749649 (+ 10004us) spinlock_profiling.cc:243] Waited 8.73 ms on lock 0x7b4800003fd8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:16:23.146314 (+396665us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:23.146395 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.146509 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.606147 (+459638us) raft_consensus.cc:1685] finished
0709 13:16:23.606170 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.606462 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78474,"raft.queue_time_us":79078,"raft.run_cpu_time_us":2420,"raft.run_wall_time_us":59582,"spinlock_wait_cycles":20073344,"thread_start_us":406178,"threads_started":1,"wal-append.queue_time_us":580071}
I20260709 13:16:23.615450 14651 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:23.616187 14651 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:23.617462 14651 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:23.619549 14301 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:23.622013 14301 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:23.623070  7180 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:23.633149  7891 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:23.561350 14684 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:23.645020  7887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1284) took 1373 ms. Trace:
W20260709 13:16:23.647122  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.650594  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 169438us
I20260709 13:16:23.652511  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:23.645541  7887 rpcz_store.cc:276] 0709 13:16:22.271676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.272573 (+   897us) service_pool.cc:224] Handling call
0709 13:16:22.272993 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.273529 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.273564 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.545097 (+271533us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b2c000474b8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece7b35a11 00007fece7b45372 00007fece9277a01 00007fece923c43a 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2
0709 13:16:22.545663 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.998881 (+453218us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:23.331492 (+332611us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.632325 (+300833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.632413 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.632476 (+    63us) raft_consensus.cc:1685] finished
0709 13:16:23.644780 (+ 12304us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.644947 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":863,"prepare.queue_time_us":475821,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":65,"raft.queue_time_us":135374,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":13514,"spinlock_wait_cycles":25627904,"thread_start_us":1038950,"threads_started":3,"wal-append.queue_time_us":665847}
I20260709 13:16:23.686769  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:23.693135  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:23.695133  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.689214  7301 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:23.692492  7334 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:23.712170  7329 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:23.636250 14409 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:23.647166 14528 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 13:16:23.731140 14737 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:23.635468 14637 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:16:23.732259  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:23.732510  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 146352us
I20260709 13:16:23.733126  7891 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 26: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:23.733853  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:23.733775 14751 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:23.734980 14327 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:23.735381  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 83027.5us
I20260709 13:16:23.736636  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:23.737033  7181 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:23.687043 14685 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.719851 14299 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.645s	user 0.013s	sys 0.000s
I20260709 13:16:23.739073 14685 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:23.490733  7262 rpcz_store.cc:276] 0709 13:16:21.675265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.488179 (+812914us) service_pool.cc:224] Handling call
0709 13:16:22.491846 (+  3667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.518745 (+ 26899us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:23.179446 (+660701us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.469702 (+290256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:23.469787 (+    85us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:23.469854 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.469945 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.470104 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13134,"prepare.queue_time_us":338652,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":13588,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":11473,"thread_start_us":674926,"threads_started":2}
I20260709 13:16:23.745945  7890 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 28. Current term is 29. Ops: []
I20260709 13:16:23.747543  7895 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:23.749524  7892 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 13:16:23.752940  7331 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:16:23.754406  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2567) took 1028 ms. Trace:
I20260709 13:16:23.754877  7331 rpcz_store.cc:276] 0709 13:16:22.726173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.726501 (+   328us) service_pool.cc:224] Handling call
0709 13:16:22.763428 (+ 36927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.753447 (+990019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.754099 (+   652us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54001f4ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:23.754335 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274675072}
I20260709 13:16:23.755420 14761 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:23.756510 14761 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:23.756886  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:23.757918  7894 raft_consensus.cc:2393] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 26: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:23.677590 14650 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.759150  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:23.759416 14650 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:23.733979 14554 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:23.728674 14755 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:23.762494 14554 raft_consensus.cc:697] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:23.769586 14554 consensus_queue.cc:237] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:23.763038 14533 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 13:16:23.772190 14607 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:23.774751 14755 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.678007 14301 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:23.655799 14692 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.079s
I20260709 13:16:23.729485  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:23.767180  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:23.648773 14596 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:16:23.788280  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49908.5us
I20260709 13:16:23.792481  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:23.522400 14555 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:23.792843  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 145970us
I20260709 13:16:23.794721  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:23.826998  7888 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:23.827716  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:23.731180 14409 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:23.742202 14685 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:23.822350  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 88600.7us
I20260709 13:16:23.793048 14755 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:23.834676  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:23.836208  7327 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 13:16:23.766433 14743 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:23.793565 14621 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:23.768167 14569 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:23.635179 14590 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.159s
I20260709 13:16:23.847152  7891 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:23.850229  7894 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:16:23.823318 14596 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:23.866923  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 270592us
I20260709 13:16:23.867905  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:23.839556 14552 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:16:23.870992  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:23.837568 14752 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:23.872609  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:23.841672 14753 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:23.828256 14607 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:16:23.893007  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:23.861261 14596 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:23.907315  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 72848us
I20260709 13:16:23.904798  7255 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 29.
I20260709 13:16:23.852162 14523 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 13:16:23.844903 14416 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 13:16:23.873764 14637 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:16:23.873903 14736 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:16:23.924902  7299 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:23.910751  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:23.875787 14608 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:16:23.894610 14677 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:23.968735 14743 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:23.969846  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:23.970657  7331 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 29.
I20260709 13:16:23.758330 14761 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:23.973944  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:23.975891 14634 consensus_meta.cc:287] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.001s
I20260709 13:16:23.976440 14634 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:23.978415  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 101192us
I20260709 13:16:23.979259  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:23.979336 14677 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:23.958678 14148 consensus_queue.cc:1048] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:16:23.980265  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:23.981151 14344 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:23.981694 14344 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:23.982091 14772 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:23.982656 14344 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:23.984771 14763 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:23.985575  7889 raft_consensus.cc:2393] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 17: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:23.952702 14637 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.986860 14637 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:16:23.988030 14760 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:23.988471 14760 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:23.989414 14760 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:23.991693 14474 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:23.992381 14474 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:23.993476 14555 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:23.985765 14409 raft_consensus.cc:2764] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 13:16:23.999760 14409 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:24.000867 14299 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.980274 14677 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:23.936194 14737 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:16:23.983386 14766 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:16:24.001020 14751 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:23.905520 14745 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:23.964960  7150 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:24.054068  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:24.054407  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.959362  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:24.038897  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:23.918062  7334 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:16:24.014820  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:23.928756 14650 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:24.055681  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:24.062568  7258 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:23.929311 14758 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:23.933228 14739 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:16:24.001892 14299 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.072345  7253 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
W20260709 13:16:23.979501 14638 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.751s	user 0.007s	sys 0.006s
I20260709 13:16:24.079489  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:24.079733  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 120516us
I20260709 13:16:23.982688 14772 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:24.012892  7888 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:24.056953  7329 raft_consensus.cc:2410] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:16:24.066792  7178 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:24.070026  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:24.005604 14737 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.075176  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:24.076529  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:24.077447  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:24.048365  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:24.056260  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:24.082198  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:24.088073  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 123101us
I20260709 13:16:24.048235 14684 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.088840  7180 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:16:24.048604 14751 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:24.071244 14743 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.068384 14148 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.107254  7331 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:24.090696  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:24.091856  7260 raft_consensus.cc:2410] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:16:24.109477  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:24.081378 14736 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.080220  7327 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:24.090404  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:24.068768 14555 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.093451  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:24.133388  7184 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:24.070807 14758 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:24.087916 14772 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:24.094515 14608 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:24.086236 14591 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:24.098875 14760 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:24.061597 14416 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:24.154318  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:24.047827 14759 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:16:24.093492 14737 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:23.956182 14652 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.084095 14474 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:24.093158 14552 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.933446 14572 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.160s
W20260709 13:16:24.144539  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 88355us
I20260709 13:16:24.110392 14327 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.178341  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.108815 14684 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.082099 14650 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:16:24.093686 14301 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:24.083536 14638 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.123876 14409 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:24.134071 14753 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:16:24.163401  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 82684.7us
W20260709 13:16:24.146102 14674 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.001s
W20260709 13:16:24.182113  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 112774us
I20260709 13:16:24.181319  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:24.183344  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 93038.3us
I20260709 13:16:24.231424  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:24.231776  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:24.111040 14569 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:16:24.122520 14528 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
W20260709 13:16:24.162710 14620 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.118s	user 0.017s	sys 0.000s
I20260709 13:16:24.144352 14523 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:24.154953  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 287151us
I20260709 13:16:24.245476  7862 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:24.160451 14416 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.117873 14148 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.160737 14767 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:24.093917 14677 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.162170 14752 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:16:24.222818  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.086198 14745 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.252583 14692 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:16:24.233124  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 47317us
W20260709 13:16:24.230018  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 149558us
I20260709 13:16:24.175191 14591 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:24.144141 14555 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.239464 14674 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:24.117638 14743 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.289981  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:24.290733  7260 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
W20260709 13:16:24.291137 14775 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:16:24.292491 14765 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.293031 14555 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:24.284539 14767 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:24.293303 14765 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.156540 14608 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:24.296747 14774 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:16:24.177973 14552 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.265384 14621 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 13:16:24.247309  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 66066.8us
I20260709 13:16:24.152458 14736 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.184194 14327 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.279177 14474 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:24.288655 14591 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.260855 14416 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:24.314569 14608 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:24.280047 14409 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:24.278509  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.268150 14739 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.326334 14752 consensus_queue.cc:1059] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:16:24.346249 14752 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:24.346923 14752 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:24.347144 14767 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.331904 14677 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:24.259467 14620 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.329370 14299 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:24.300128 14744 consensus_meta.cc:287] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.699s	user 0.013s	sys 0.000s
I20260709 13:16:24.347409 14752 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.328586  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:24.350025 14739 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.281903 14692 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.356745  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:24.357353  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 203098us
I20260709 13:16:24.371968  7261 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:24.321764 14621 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:24.362668 14779 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:16:24.240821 14753 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.338547 14785 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:24.264827 14523 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:24.331363 14768 log.cc:927] Time spent T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
W20260709 13:16:24.315412 14771 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:16:24.319761 14533 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:24.368505  7260 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:24.344700 14638 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:24.376282  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 144979us
I20260709 13:16:24.376760  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:24.378240  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:24.343338 14745 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:24.384061  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 106290us
I20260709 13:16:24.239743 14758 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.370272 14569 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.362717 14765 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:24.373234 14692 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:24.389776  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 144448us
I20260709 13:16:24.444339  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:24.389056 14674 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.359440 14555 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:16:24.376725 14621 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:16:24.363870 14409 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.416379 14793 raft_consensus.cc:3055] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:24.468007  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:24.418213 14752 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:24.422158  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.426420  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48298.2us
I20260709 13:16:24.440258  7261 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:16:24.444703  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:24.399633 14685 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:24.385385 14785 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:24.366760 14744 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.416245 14523 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:24.386801 14684 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:24.385149 14299 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
W20260709 13:16:24.453220  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 221543us
I20260709 13:16:24.460134  7259 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
W20260709 13:16:24.447875 14779 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:16:24.504921  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:24.506451  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:24.508124  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63517.9us
I20260709 13:16:24.416245 14736 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:24.509451  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:24.503098  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51497.5us
I20260709 13:16:24.523224  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:24.523736  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:24.512465  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 107533us
I20260709 13:16:24.516227  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:24.464318 14533 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:24.516638  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:24.448541 14650 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:24.488265 14793 raft_consensus.cc:740] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:24.507519 14148 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:24.513962 14572 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:24.557039  7334 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:24.614861  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.622886  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:24.623927  7184 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:24.598893  7894 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:24.514792 14685 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.465945 14638 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:16:24.402662 14792 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.127s
I20260709 13:16:24.559124  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:24.517318 14652 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:24.562354  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:24.467283 14674 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.667049  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:24.668022  7329 raft_consensus.cc:2410] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 21 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 13:16:24.668303 14674 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:24.459488 14569 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:24.669433 14655 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.074s	user 0.012s	sys 0.004s
I20260709 13:16:24.562222 14523 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.635166  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 74326.1us
W20260709 13:16:24.681669  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 162737us
I20260709 13:16:24.681826  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:24.637832  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:24.654934 14796 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.689159 14674 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:24.689751 14770 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.698s	user 0.004s	sys 0.008s
I20260709 13:16:24.690827 14523 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.691895  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2943) took 1544 ms. Trace:
I20260709 13:16:24.693297 14523 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:24.695431 14596 consensus_meta.cc:287] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.002s
I20260709 13:16:24.695925 14596 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.563351 14736 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.113s
W20260709 13:16:24.699661 14802 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:24.655706  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:24.700704  7331 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:24.692502  7187 rpcz_store.cc:276] 0709 13:16:23.147658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.147842 (+   184us) service_pool.cc:224] Handling call
0709 13:16:23.175535 (+ 27693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.436383 (+260848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.436531 (+   148us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.461434 (+ 24903us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.871371 (+409937us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:23.871415 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.871494 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.423627 (+552133us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:24.691448 (+267821us) raft_consensus.cc:1685] finished
0709 13:16:24.691491 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.691806 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75904,"raft.queue_time_us":368793,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":80233,"spinlock_wait_cycles":119918976,"thread_start_us":590844,"threads_started":2,"wal-append.queue_time_us":495964}
W20260709 13:16:24.658658 14782 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:16:24.659816 14800 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:16:24.661711 14680 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:24.734870  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:24.735607  7187 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:24.663544 14327 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:24.663643  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:24.748981  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 67297.5us
I20260709 13:16:24.665545 14744 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:24.665632 14743 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:24.666024 14755 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.821s	user 0.007s	sys 0.006s
I20260709 13:16:24.530105  7254 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:16:24.764022 14621 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.603680 14572 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.767107 14572 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:24.770790 14786 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:24.772261 14739 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:24.786681  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:24.788730  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:24.795722 14409 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:24.702987 14620 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:24.689159 14796 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.821537 14685 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:24.823706 14569 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:24.697983 14793 consensus_queue.cc:260] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.675804 14533 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.675408 14684 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:24.843174 14684 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:24.851851  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 168997us
I20260709 13:16:24.853175  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:24.855434 14808 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:24.672448  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2583) took 1147 ms. Trace:
I20260709 13:16:24.679703  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1434) took 1397 ms. Trace:
W20260709 13:16:24.864418  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 114553us
I20260709 13:16:24.865976  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:24.678853  7330 pending_rounds.cc:85] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 13
W20260709 13:16:24.706231  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 107832us
I20260709 13:16:24.906774 14621 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:24.909749 14474 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:24.910317 14474 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.910750 14474 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:24.707084  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.698294 14596 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:24.716791  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.719098  7184 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:24.917127  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:24.730356 14783 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.451s	user 0.001s	sys 0.002s
W20260709 13:16:24.676918 14637 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.005s
I20260709 13:16:24.920710 14637 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.920323 14785 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.922982 14637 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 30 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:24.923873  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:24.670009 14148 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.924789 14148 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:24.658756 14778 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:16:24.758662 14776 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.515s	user 0.000s	sys 0.002s
I20260709 13:16:24.906901  7330 pending_rounds.cc:107] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:16:24.927203  7330 raft_consensus.cc:2889] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:24.760334 14752 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.761062  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:24.764173 14755 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.683457  7179 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:24.790513  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:24.875694 14301 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:24.871835 14758 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:24.889544 14751 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:24.859817  7336 rpcz_store.cc:276] 0709 13:16:23.524924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.525097 (+   173us) service_pool.cc:224] Handling call
0709 13:16:23.589361 (+ 64264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.662252 (+ 72891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.662282 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.712289 (+ 50007us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.869529 (+157240us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b48001bc258. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:16:23.935298 (+ 65769us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:23.935363 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.671808 (+736445us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b54001f4854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:24.672009 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.672094 (+    85us) raft_consensus.cc:1685] finished
0709 13:16:24.672117 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.672331 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43494,"raft.queue_time_us":27569,"raft.run_cpu_time_us":2364,"raft.run_wall_time_us":196273,"spinlock_wait_cycles":25362560,"thread_start_us":200115,"threads_started":1,"wal-append.queue_time_us":251466}
I20260709 13:16:24.863384  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:24.735217 14680 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:24.918510  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:24.933413  7181 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:24.957192  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:24.810317 14796 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:24.937054  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2591) took 1290 ms. Trace:
I20260709 13:16:24.861392  7183 rpcz_store.cc:276] 0709 13:16:23.282402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.282639 (+   237us) service_pool.cc:224] Handling call
0709 13:16:23.283143 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.526999 (+243856us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:16:23.860847 (+333848us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.058072 (+197225us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.066059 (+  7987us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.066254 (+   195us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:24.066305 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.066403 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.679370 (+612967us) raft_consensus.cc:1685] finished
0709 13:16:24.679406 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.679605 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21414,"prepare.queue_time_us":456636,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":444590,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":11425,"thread_start_us":617583,"threads_started":3,"wal-append.queue_time_us":280991}
I20260709 13:16:24.961536  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:24.965598  7187 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:24.971411  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:24.972088  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.975762  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 112486us
I20260709 13:16:24.975930  7185 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 26. Current term is 27. Ops: [26.14-26.14]
I20260709 13:16:24.978428  7183 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 30: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:24.972355  7894 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:24.988325  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:24.990669  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:24.939404 14301 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:24.958849  7335 rpcz_store.cc:276] 0709 13:16:23.646342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.719111 (+ 72769us) service_pool.cc:224] Handling call
0709 13:16:23.818086 (+ 98975us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.828423 (+ 10337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.828460 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.831490 (+  3030us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.087532 (+256042us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:24.087590 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.087666 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.734489 (+646823us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:24.928410 (+193921us) raft_consensus.cc:1685] finished
0709 13:16:24.928442 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.936935 (+  8493us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9715,"raft.queue_time_us":10550,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":11796,"spinlock_wait_cycles":15817088,"thread_start_us":196097,"threads_started":1,"wal-append.queue_time_us":288059}
I20260709 13:16:24.997824  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:25.001047  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 85055.5us
I20260709 13:16:25.001571  7180 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:16:24.998309  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:24.970711 14299 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:25.011293  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:25.014032  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:25.003177  7183 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:24.993883 14637 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:24.992681 14671 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.992082 14652 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.943353 14752 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.041288  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:25.058868  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:25.043171  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:25.060526  7254 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:25.002391 14751 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:25.031854  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:25.046540  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:25.062491  7262 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:25.048739  7261 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:25.043334  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:25.008229 14148 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:25.063761  7183 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:25.004443 14792 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:25.054745  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:25.054746  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51724.8us
I20260709 13:16:25.060243  7255 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:25.006826 14685 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:16:25.021592 14684 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:25.095609  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 54426.2us
W20260709 13:16:25.092650  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.098245  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:25.100343  7256 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:25.101258  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:25.102203  7260 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:25.104487  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:25.109339  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:25.105276  7150 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:25.110157  7183 raft_consensus.cc:2393] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:25.044979 14299 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:25.119491  7262 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
W20260709 13:16:25.070386 14677 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.722s	user 0.013s	sys 0.001s
I20260709 13:16:25.031163 14790 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.102s
I20260709 13:16:25.103873 14655 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:25.098732 14604 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:25.133100  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:25.135536  7254 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:16:25.098369 14637 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:25.053566 14523 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 13:16:25.131938  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:25.107673 14591 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:25.031103 14812 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.111s
I20260709 13:16:25.060647 14671 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.121960 14743 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:25.148188  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:25.163913  7258 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:16:25.165508  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:25.167097  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 155912us
I20260709 13:16:25.094739 14652 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.168267  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:25.168296 14743 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.188731 14803 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:25.189393 14803 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:25.189899  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:25.190261 14416 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.002s
I20260709 13:16:25.129417 14552 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:25.191855  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 86720.6us
I20260709 13:16:25.191855  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:25.126358 14650 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:16:25.237571  7260 raft_consensus.cc:2410] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:16:25.114609 14792 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.150427 14789 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:25.142565 14409 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:25.147724 14555 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:25.095782 14301 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.161857 14655 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:25.241003  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:25.129941 14745 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:16:25.142416 14812 consensus_queue.cc:1243] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 24.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:16:25.170010 14604 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:25.284363  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.221530 14743 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:25.190852 14416 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:25.301438  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 60609.5us
I20260709 13:16:25.308612 14652 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:25.311353 14634 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:25.242648 14552 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:25.258697 14638 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.324760 14760 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.164s	user 0.014s	sys 0.001s
W20260709 13:16:25.384099  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 215956us
I20260709 13:16:25.300992 14755 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:25.302778 14344 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:25.299841 14810 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:25.386793 14752 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:25.388809  7225 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:25.426338  7183 raft_consensus.cc:2410] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:16:25.300474 14797 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.348s
I20260709 13:16:25.447983  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1212) took 1095 ms. Trace:
I20260709 13:16:25.391832 14637 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.450410  7330 rpcz_store.cc:276] 0709 13:16:24.352205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.673936 (+321731us) service_pool.cc:224] Handling call
0709 13:16:24.678550 (+  4614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.927785 (+249235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.927833 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.932089 (+  4256us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.141666 (+209577us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:25.141713 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.141817 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.447625 (+305808us) raft_consensus.cc:1685] finished
0709 13:16:25.447660 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.447887 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":208697,"threads_started":1,"wal-append.queue_time_us":351947}
I20260709 13:16:25.452653 14416 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:25.457480  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2602) took 1074 ms. Trace:
I20260709 13:16:25.457985  7333 rpcz_store.cc:276] 0709 13:16:24.387173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.820168 (+432995us) service_pool.cc:224] Handling call
0709 13:16:24.820533 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.890617 (+ 70084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.890694 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.929650 (+ 38956us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.147546 (+217896us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:25.147590 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.147887 (+   297us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.457152 (+309265us) raft_consensus.cc:1685] finished
0709 13:16:25.457175 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.457380 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88056,"raft.queue_time_us":78402,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":30598,"thread_start_us":163950,"threads_started":1,"wal-append.queue_time_us":356737}
W20260709 13:16:25.459180 14737 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.276s	user 0.010s	sys 0.004s
I20260709 13:16:25.387383 14677 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:25.459656 14737 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.387530 14638 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.463872 14638 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:25.464448 14638 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.464895 14638 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:25.467602 14772 consensus_meta.cc:287] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.311s	user 0.014s	sys 0.000s
I20260709 13:16:25.467185 14604 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.468052 14772 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.470249 14772 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:25.448215 14819 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:16:25.472007 14792 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:25.472851  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:25.473694  7186 raft_consensus.cc:2410] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:16:25.300392 14555 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.477633  7182 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 16. Current term is 17. Ops: []
W20260709 13:16:25.479101  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 90420.1us
W20260709 13:16:25.479672  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 62596.9us
I20260709 13:16:25.474522  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:25.489526  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:25.485582  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:25.387858 14652 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.478966 14523 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:25.314028 14299 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:25.449051 14822 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:16:25.476796 14474 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.001s
I20260709 13:16:25.492785  7186 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:25.417013 14344 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:25.489473 14572 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.721s	user 0.012s	sys 0.001s
I20260709 13:16:25.528352 14572 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.488090 14810 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:25.512523  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:25.512208  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 210464us
I20260709 13:16:25.442845 14671 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:25.479272 14677 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:25.391038 14409 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.125s
I20260709 13:16:25.498991 14301 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:25.526763 14474 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.542055 14677 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.527614 14344 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:25.415723 14552 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.533352  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:25.514961 14796 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:25.562963  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:25.551227 14758 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.001s
I20260709 13:16:25.443324 14655 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.550107 14638 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:25.554616 14812 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.556213 14569 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.553836 14416 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.562471 14796 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.518618 14652 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.561343 14572 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:25.567380 14831 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.592442  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2603) took 1056 ms. Trace:
I20260709 13:16:25.569169 14795 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:25.586309 14692 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.109s	user 0.010s	sys 0.003s
I20260709 13:16:25.600114  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:25.596067  7332 rpcz_store.cc:276] 0709 13:16:24.535954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.922758 (+386804us) service_pool.cc:224] Handling call
0709 13:16:24.923282 (+   524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.923581 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.923619 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.924251 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.055297 (+131046us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:25.055336 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.055431 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.592104 (+536673us) raft_consensus.cc:1685] finished
0709 13:16:25.592127 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.592344 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":130596,"threads_started":1,"wal-append.queue_time_us":244493}
I20260709 13:16:25.576052 14591 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:25.593044 14796 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:25.611008 14792 raft_consensus.cc:2764] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:16:25.613163 14652 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:25.601472 14831 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.592128 14416 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.605019 14692 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:25.644662  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 44595.9us
W20260709 13:16:25.646723  7254 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.003s
I20260709 13:16:25.647316  7254 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 30.
W20260709 13:16:25.632736  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56759.8us
I20260709 13:16:25.640852  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1210) took 1289 ms. Trace:
I20260709 13:16:25.589119 14569 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.650882  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:25.656571  7891 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26. Ops: [23.16-25.17]
I20260709 13:16:25.660400  7150 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:25.584693 14812 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.664067 14831 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:25.648736  7327 rpcz_store.cc:276] 0709 13:16:24.351418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.359622 (+  8204us) service_pool.cc:224] Handling call
0709 13:16:24.361491 (+  1869us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.379171 (+ 17680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.379221 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.382656 (+  3435us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.313738 (+931082us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b18003dab60. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc0d1 00007fece91f7a0f
0709 13:16:25.516736 (+202998us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:25.516801 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.516906 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.617269 (+100363us) raft_consensus.cc:1685] finished
0709 13:16:25.617302 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.640726 (+ 23424us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17118,"raft.queue_time_us":20086,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":19271,"spinlock_wait_cycles":19985664,"thread_start_us":202729,"threads_started":1,"wal-append.queue_time_us":1192404}
I20260709 13:16:25.666302  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:25.666518  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:25.661481  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:25.668922  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:25.669749  7260 raft_consensus.cc:2376] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23. Re-sending same reply.
I20260709 13:16:25.600986 14755 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 13:16:25.678651 14692 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:25.680579  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:25.681134  7253 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: []
W20260709 13:16:25.678923 14751 consensus_meta.cc:287] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.004s
I20260709 13:16:25.682025  7254 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:16:25.615754 14591 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.687543  7260 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:25.693662  7253 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:16:25.662415 14760 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:16:25.692632  7180 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:25.681449 14604 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.682333 14792 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:25.704725  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 44431us
I20260709 13:16:25.711306 14604 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.715091 14416 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:25.716756 14604 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:25.717765 14820 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.433s	user 0.000s	sys 0.001s
I20260709 13:16:25.723206 14737 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:25.695122 14751 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:25.733930  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:25.736081  7891 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:25.738410  7150 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:25.747797  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:25.670799 14810 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.712224 14812 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:25.749122  7891 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 24: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:25.750453  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:25.752408  7889 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 30: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:25.760403  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:25.763083  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:25.767270  7150 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:25.742364 14772 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:25.774482  7889 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:16:25.772327 14755 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:25.777741 14841 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:16:25.785298  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:25.786108  7181 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:25.756762 14845 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:25.787443 14845 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:25.789090 14823 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.412s	user 0.000s	sys 0.001s
I20260709 13:16:25.790211 14845 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:25.787493  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:25.749756 14833 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:25.740761 14760 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:16:25.740310 14751 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.739645 14792 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:16:25.800086  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:25.819767 14554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.857s	user 0.015s	sys 0.029s
I20260709 13:16:25.837388  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2950) took 1133 ms. Trace:
I20260709 13:16:25.839411  7181 rpcz_store.cc:276] 0709 13:16:24.704118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.801058 (+1096940us) service_pool.cc:224] Handling call
0709 13:16:25.836783 (+ 35725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.837001 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.837031 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.837076 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:25.837105 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.837161 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.837303 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.841508  7891 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:16:25.797767 14552 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:25.839157 14554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.876s	user 0.016s	sys 0.029s
I20260709 13:16:25.834863 14652 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.857652  7181 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:25.860937  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2952) took 1156 ms. Trace:
I20260709 13:16:25.861609  7181 rpcz_store.cc:276] 0709 13:16:24.704637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.842677 (+1138040us) service_pool.cc:224] Handling call
0709 13:16:25.857174 (+ 14497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.860324 (+  3150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.860759 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.865705  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:25.858525 14569 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:25.866494  7891 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:25.799430 14833 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.838554 14743 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.872043  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3733) took 1167 ms. Trace:
I20260709 13:16:25.875038  7181 rpcz_store.cc:276] 0709 13:16:24.704663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.863282 (+1158619us) service_pool.cc:224] Handling call
0709 13:16:25.871068 (+  7786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.871634 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.871656 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.871700 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:25.871727 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.871789 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.871927 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.876447  7896 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:25.878054 14755 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:25.878962 14755 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:25.881429 14751 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:25.883773 14591 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:25.897850 14344 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.901794 14344 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:25.905500 14743 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:25.887825 14831 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:25.907421 14831 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.910830 14760 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:25.913054 14760 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:25.913678 14760 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:25.915191 14831 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:25.928576 14833 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:25.948516 14796 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.868188 14652 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:25.997437 14652 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:25.960197  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2951) took 1255 ms. Trace:
I20260709 13:16:25.966051 14843 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:25.998358  7183 rpcz_store.cc:276] 0709 13:16:24.704382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.191499 (+487117us) service_pool.cc:224] Handling call
0709 13:16:25.959891 (+768392us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540017d754. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:25.960080 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456698624}
I20260709 13:16:26.000130  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:26.001605 14769 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 2.028s	user 0.019s	sys 0.000s
I20260709 13:16:26.003393 14796 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:26.004807  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1556) took 2595 ms. Trace:
I20260709 13:16:25.966964 14760 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.969566  7302 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:25.970500 14759 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:25.972173  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3718) took 1908 ms. Trace:
I20260709 13:16:25.942080  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:25.975147  7895 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:16:26.020769  7895 pending_rounds.cc:85] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 14
I20260709 13:16:26.021101  7895 pending_rounds.cc:107] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:16:26.021369  7895 raft_consensus.cc:2889] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:25.980370  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1207) took 2058 ms. Trace:
I20260709 13:16:25.988617 14767 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:16:25.992935 14826 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.608s	user 0.003s	sys 0.000s
I20260709 13:16:25.998602 14843 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:25.966606 14831 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.005367  7257 rpcz_store.cc:276] 0709 13:16:23.409490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.409671 (+   181us) service_pool.cc:224] Handling call
0709 13:16:23.443063 (+ 33392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.443301 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.443329 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.461863 (+ 18534us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.832120 (+370257us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:23.832164 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.832241 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.000791 (+2168550us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:26.004336 (+  3545us) raft_consensus.cc:1685] finished
0709 13:16:26.004369 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.004715 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142388480,"thread_start_us":311749,"threads_started":1,"wal-append.queue_time_us":419230}
I20260709 13:16:26.010445  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1449) took 1534 ms. Trace:
I20260709 13:16:26.019255  7185 rpcz_store.cc:276] 0709 13:16:24.063559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.076095 (+ 12536us) service_pool.cc:224] Handling call
0709 13:16:24.094470 (+ 18375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.976914 (+882444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.971756 (+994842us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5400246b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:25.972087 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026097920}
I20260709 13:16:26.022389  7328 rpcz_store.cc:276] 0709 13:16:23.920516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.920758 (+   242us) service_pool.cc:224] Handling call
0709 13:16:23.921202 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.325858 (+404656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.325892 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.346757 (+ 20865us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:24.346834 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.978349 (+1631515us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b5400191ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:25.978401 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.978569 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907981056}
I20260709 13:16:26.041813  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.043803  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.044871  7185 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:26.046025  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.039994  7182 rpcz_store.cc:276] 0709 13:16:24.475789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.477025 (+  1236us) service_pool.cc:224] Handling call
0709 13:16:24.510488 (+ 33463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.488784 (+978296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.010162 (+521378us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400257954. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:26.010374 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2223662976}
I20260709 13:16:26.007458 14523 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:26.059114  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:26.059984  7896 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:26.036015 14652 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:26.035120 14767 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:26.068161  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 195194us
I20260709 13:16:26.069633  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:26.056303 14523 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.048094 14148 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.052773 14855 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:26.066793 14760 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:26.078595  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.088665  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2601) took 1706 ms. Trace:
I20260709 13:16:26.091696  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.089651 14792 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:16:26.089174  7334 rpcz_store.cc:276] 0709 13:16:24.382654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.732205 (+349551us) service_pool.cc:224] Handling call
0709 13:16:24.732605 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.863401 (+130796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.863454 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.864167 (+   713us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.140693 (+276526us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:25.140748 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.140824 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.992006 (+851182us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:26.082972 (+ 90966us) raft_consensus.cc:1685] finished
0709 13:16:26.083008 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.088575 (+  5567us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130185,"raft.queue_time_us":133819,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":187,"spinlock_wait_cycles":60040576,"thread_start_us":182342,"threads_started":1,"wal-append.queue_time_us":311262}
I20260709 13:16:26.096655  7185 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 30: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:26.055763 14831 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.077867 14652 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:26.104003  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2960) took 1187 ms. Trace:
I20260709 13:16:26.080044 14778 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.089561 14572 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:26.094058 14792 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:26.067821 14621 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:16:26.057539 14759 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.130471 14778 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.132755 14752 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:26.133180 14752 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:26.073211 14552 consensus_queue.cc:1059] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:16:26.133795 14778 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:26.124918 14572 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:26.103664  7299 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.132:39125 timed out after 1.825s (SENT) [suppressed 10 similar messages]
I20260709 13:16:26.119696  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:26.126477  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.134850  7183 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:26.127736  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:26.076090 14148 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.122128  7181 rpcz_store.cc:276] 0709 13:16:24.916653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.876580 (+959927us) service_pool.cc:224] Handling call
0709 13:16:25.876947 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.877184 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:26.005818 (+128634us) log.cc:844] Serialized 14 byte log entry
0709 13:16:26.103480 (+ 97662us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:26.103567 (+    87us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:26.103642 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.103740 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.103919 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":845,"prepare.queue_time_us":128619,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":5991,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":12668,"thread_start_us":219507,"threads_started":2}
I20260709 13:16:26.116962 14299 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.120285 14833 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:26.090788 14855 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.134407 14552 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:16:26.121558 14789 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:26.149940  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.150674  7888 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:26.128662 14792 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:26.151296  7896 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:26.140379 14572 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:26.133834 14759 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:26.157428  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.134096 14752 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.159971  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:26.159380  7182 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:26.162485  7181 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:26.165611  7859 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:26.151271 14552 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:26.149554 14743 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:26.146054 14299 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.169785  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:26.177446  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:26.173203  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.178431  7182 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:26.190671 14736 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:16:26.191057  7921 heartbeater.cc:646] Failed to heartbeat to 127.5.227.190:45419 (6 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.5.227.190:45419 timed out after 15.000s (SENT)
I20260709 13:16:26.191250 14736 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.191638 14736 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:26.125262 14767 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.195393 14767 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:26.152755 14833 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.198817  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 2958) took 1283 ms. Trace:
I20260709 13:16:26.199358  7180 rpcz_store.cc:276] 0709 13:16:24.915933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.049860 (+133927us) service_pool.cc:224] Handling call
0709 13:16:26.198492 (+1148632us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54001b3ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:26.198693 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337705856}
I20260709 13:16:26.200649  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.201376  7180 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:16:26.203382  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:26.184796 14652 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.204083  7184 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:26.202360  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.205962  7180 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:26.152946 14789 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.214210  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.212632  7186 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:16:26.223567  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.171861 14621 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:26.129984 14803 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.228229  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.229611  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.230268  7180 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:26.188949 14523 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:26.188799 14752 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:26.231117  7180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:16:26.185348 14778 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:26.231999 14803 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:26.233407  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.234560 14299 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:26.235194 14299 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:26.235728  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:26.238205 14528 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:26.238701 14528 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.239101 14528 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:26.242782 14790 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:26.243327 14790 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.243691 14790 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:26.245170 14843 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:26.246866 14552 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.247330 14680 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.248306 14552 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:26.248767 14680 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:26.250315 14554 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:26.235728 14299 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.251808  7180 raft_consensus.cc:606] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Received request to transfer leadership to TS c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:26.195453 14474 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:26.264205  7182 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 27: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:16:26.251966 14862 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.058s	user 0.003s	sys 0.000s
I20260709 13:16:26.253582 14299 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:26.234611 14789 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:26.255089  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3734) took 1305 ms. Trace:
I20260709 13:16:26.259410 14843 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:26.259982 14855 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:26.261147 14148 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:26.262145  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.262742 14833 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:26.186779 14743 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.223349 14555 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:26.273036 14737 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:26.278061  7181 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
W20260709 13:16:26.282773  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.298359  7895 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:16:26.298761  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.283612  7185 rpcz_store.cc:276] 0709 13:16:24.949782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.253946 (+1304164us) service_pool.cc:224] Handling call
0709 13:16:26.254304 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.254693 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:16:26.254730 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:26.254778 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:26.254809 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.254884 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.255026 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4229,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98}
I20260709 13:16:26.299921  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.300412  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.276177  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3736) took 1325 ms. Trace:
I20260709 13:16:26.301831  7179 rpcz_store.cc:276] 0709 13:16:24.950542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.275168 (+1324626us) service_pool.cc:224] Handling call
0709 13:16:26.275504 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.275686 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.275724 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:26.275897 (+   173us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:26.275938 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.276000 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.276121 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.303565  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.251322 14554 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.225973 14808 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:26.226377 14637 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:26.263207 14785 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:26.293666  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.295362  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.295092 14572 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:26.297119  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 193499us
I20260709 13:16:26.304265  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.304314  7179 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 26.
I20260709 13:16:26.319867  7261 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:26.319145  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.286019  7184 raft_consensus.cc:2410] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:16:26.315868  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.300930  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.321300  7258 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:26.307592  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.322156  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.322585  7181 raft_consensus.cc:2410] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:16:26.307330  7185 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:26.308516  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.324111  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.325282  7889 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:16:26.315225  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.325637  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:26.328787  7254 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:26.324733  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.307765  7260 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:26.287626  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:26.310451  7255 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:16:26.332017  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.332369  7255 pending_rounds.cc:85] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 13
I20260709 13:16:26.332803  7255 pending_rounds.cc:107] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:16:26.263837  7180 raft_consensus.cc:614] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:26.307262  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:26.333050  7255 raft_consensus.cc:2889] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:26.330410  7887 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:26.330775  7184 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:26.311712  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:26.333662  7228 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.330957  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:26.334940  7258 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:26.297996 14737 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:26.309598 14674 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:26.309734 14843 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:26.340210  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1455) took 1356 ms. Trace:
I20260709 13:16:26.350243  7184 rpcz_store.cc:276] 0709 13:16:24.977980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.330246 (+1352266us) service_pool.cc:224] Handling call
0709 13:16:26.330571 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.334005 (+  3434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.334237 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.223109 14792 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.355705  7333 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
W20260709 13:16:26.339205  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 51762.2us
I20260709 13:16:26.357987  7225 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:26.313575 14684 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:26.289144 14528 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.351714  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.363695  7184 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
I20260709 13:16:26.329916 14796 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:26.352174  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.352730  7328 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:26.367249  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:26.367457  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:26.343636 14829 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:26.340808  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:26.343293 14591 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:26.340834 14810 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:26.366402  7181 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:26.380264  7181 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:26.365068  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.313982 14808 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.367874  7332 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:26.348455 14674 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.362035  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.385308  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:26.373941  7334 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:16:26.385808  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.386075  7333 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Advancing to term 30
W20260709 13:16:26.386970  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.375597  7889 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:26.344385 14327 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:26.319121 14637 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.371151  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.368248  7327 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:16:26.394493  7180 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:26.395946  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.397137  7180 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 24: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:26.371987  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:26.380810  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.350107 14843 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:26.345160 14867 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:26.362818 14684 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.359798 14789 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:26.393064  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.423097  7184 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:26.366196 14569 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:26.366042 14796 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:26.398000  7887 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:26.403090  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:26.404858  7180 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:26.407423 14652 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:26.410413  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:26.428149  7334 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:26.390408 14674 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:26.430200  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2966) took 1372 ms. Trace:
I20260709 13:16:26.423759  7889 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 26: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:26.431538  7261 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:16:26.421239  7181 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.432384  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.391784 14327 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.456758  7180 rpcz_store.cc:276] 0709 13:16:25.057959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.404335 (+1346376us) service_pool.cc:224] Handling call
0709 13:16:26.404674 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.429915 (+ 25241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.430136 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.461793  7896 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 30: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:26.435132  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:26.442947  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.477780 14859 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:26.478776 14859 consensus_queue.cc:1243] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:16:26.479946 14743 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:26.367635 14849 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.068s
I20260709 13:16:26.409657 14843 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:26.480041 14637 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:26.485843  7891 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:16:26.424249 14684 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:26.493551  7333 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 30.
I20260709 13:16:26.433806 14829 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:26.503177  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:26.498394  7181 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:26.430258 14652 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.501201  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:26.429680 14796 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:26.376878 14737 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.515496  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.506347  7896 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:16:26.484413 14327 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:26.505505  7328 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:26.519820  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:26.515829  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.520714  7329 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:16:26.521178  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:26.522050  7330 raft_consensus.cc:2410] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 26 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 13:16:26.434540 14344 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:16:26.523195  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 161268us
I20260709 13:16:26.516755  7888 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:26.528520  7328 raft_consensus.cc:2410] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 26 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 13:16:26.529428  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.523813  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.531467  7896 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:26.483331 14759 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:16:26.545475  7181 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:16:26.548440  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1457) took 1553 ms. Trace:
I20260709 13:16:26.541699  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.430410 14789 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.548875  7181 rpcz_store.cc:276] 0709 13:16:24.995324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.337977 (+1342653us) service_pool.cc:224] Handling call
0709 13:16:26.355114 (+ 17137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.548159 (+193045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.548374 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.542387  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.503671 14829 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.510712 14760 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.556712  7332 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:26.549433  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.545236  7331 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:26.549875  7181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:16:26.522125 14604 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.508358 14652 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:26.560652  7181 raft_consensus.cc:606] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Received request to transfer leadership to TS c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:26.564904  7181 raft_consensus.cc:614] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:26.561236  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:26.566684  7330 raft_consensus.cc:2410] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 27 because replica has last-logged OpId of term: 26 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
I20260709 13:16:26.574337  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.554111 14737 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:26.535235 14591 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:16:26.580894  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.589349  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.557631 14829 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:26.559989 14528 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:26.589090  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 217596us
I20260709 13:16:26.598354  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:26.599232  7331 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:26.604789  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:26.606220  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:26.575181 14808 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:26.611541  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:26.613330  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:26.636057  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.640024  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.642570  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:26.645658  7336 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:26.660526  7329 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:16:26.668161  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1454) took 1706 ms. Trace:
I20260709 13:16:26.564298 14760 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:26.668853  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 208994us
W20260709 13:16:26.677505  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.572258 14604 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.682662  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:26.614952 14555 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:16:26.693789  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 83128.6us
I20260709 13:16:26.701256  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.591564 14736 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.706377  7329 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:26.668704  7182 rpcz_store.cc:276] 0709 13:16:24.961769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.278672 (+1316903us) service_pool.cc:224] Handling call
0709 13:16:26.279001 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.279208 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:16:26.311552 (+ 32344us) log.cc:844] Serialized 14 byte log entry
0709 13:16:26.667731 (+356179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:26.667811 (+    80us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:26.667865 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.667935 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.668087 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20291,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":12548,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":8439,"thread_start_us":355745,"threads_started":2,"wal-append.queue_time_us":276249}
W20260709 13:16:26.711548 14872 log.cc:927] Time spent T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:26.675395 14878 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:16:26.717087 14796 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.699687 14555 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:26.718904 14876 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:26.719058 14555 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:26.719662 14876 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.720232 14876 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:26.690270 14874 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:16:26.728966  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2967) took 1483 ms. Trace:
W20260709 13:16:26.730259 14873 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:16:26.729506  7180 rpcz_store.cc:276] 0709 13:16:25.245201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.460484 (+1215283us) service_pool.cc:224] Handling call
0709 13:16:26.460934 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.484533 (+ 23599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.484570 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.485068 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.669197 (+184129us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:26.669256 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.669349 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.728725 (+ 59376us) raft_consensus.cc:1685] finished
0709 13:16:26.728752 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.728894 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30181,"raft.queue_time_us":24062,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":8080,"thread_start_us":136633,"threads_started":1,"wal-append.queue_time_us":218712}
I20260709 13:16:26.731632  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:26.732280  7180 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:16:26.736176 14604 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:26.730559 14796 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:26.738891 14760 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:26.729118 14555 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.740870  7180 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:26.741698 14555 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:26.741809  7180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:16:26.745872  7180 raft_consensus.cc:606] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:26.714288 14878 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:16:26.766330  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 83754.7us
W20260709 13:16:26.767401  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 66293.3us
I20260709 13:16:26.769871  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:26.771201 14555 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:16:26.805919  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.771554 14877 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:26.812705  7892 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 25: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:16:26.814723  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.771713 14555 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.760681 14879 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:26.771217 14655 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:26.834538  7329 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:26.773212 14878 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:26.772054 14767 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:26.705111 14743 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.121s
W20260709 13:16:26.844508  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.851326  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.857272  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 333482us
W20260709 13:16:26.857685  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.848927  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:26.846426 14753 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:26.875645 14789 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:26.876158 14736 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:26.828855 14555 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:26.828488 14882 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:26.839208 14878 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:26.879745 14870 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.471s	user 0.000s	sys 0.002s
I20260709 13:16:26.881021 14621 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:26.885422 14871 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.478s	user 0.001s	sys 0.000s
I20260709 13:16:26.836880 14879 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:26.887444 14554 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:26.745474 14591 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.840034 14767 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:26.914528 14767 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:26.916635  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 75089.8us
I20260709 13:16:26.878088 14882 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:26.931872  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.935827  7258 consensus_meta.cc:287] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.010s
I20260709 13:16:26.914774 14881 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.917739  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:26.930824  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 81998.5us
W20260709 13:16:26.928222  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 158408us
I20260709 13:16:26.845592 14831 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:26.936674  7258 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:26.952621  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.928706  7887 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25. Ops: [24.17-24.17]
W20260709 13:16:26.937896  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 79612.9us
I20260709 13:16:26.939797  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:26.928997  7299 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:26.940575  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3731) took 2309 ms. Trace:
I20260709 13:16:26.955276  7186 rpcz_store.cc:276] 0709 13:16:24.631160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.531889 (+900729us) service_pool.cc:224] Handling call
0709 13:16:26.204770 (+672881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.227416 (+ 22646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.940345 (+712929us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54001b3ad0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:26.940515 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534221184}
I20260709 13:16:26.930065  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:26.927910 14760 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.935003 14793 raft_consensus.cc:3060] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:26.929569 14859 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.959952  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:26.961881  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:26.966775  7894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 1043) took 1458 ms. Trace:
I20260709 13:16:26.970293  7299 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:26.935539 14348 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:26.931406 14849 consensus_queue.cc:1243] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 24.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:16:26.967190  7894 rpcz_store.cc:276] 0709 13:16:25.508178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.508339 (+   161us) service_pool.cc:224] Handling call
0709 13:16:26.939624 (+1431285us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5800125498. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee2020a0 00007fecee201984 00007fece777c6d4 00007fece777c662
0709 13:16:26.966703 (+ 27079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29338496}
W20260709 13:16:26.976429  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 370291us
I20260709 13:16:26.969413  7861 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:26.977922  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:26.893595 14879 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:26.975260 14789 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:26.985121 14879 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:26.985534  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.985702 14810 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.986208 14810 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:26.986657 14621 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:16:26.972858 14760 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.969178 14743 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:27.019869 14867 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:27.021705  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:27.022243 14759 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.964905 14877 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:16:27.022886 14759 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.023370  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:26.956816 14655 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:16:27.025043  7261 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:16:27.026607  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:26.992072  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:27.034301 14344 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:27.034917 14344 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:27.035092  7894 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:16:26.965601 14880 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:27.036016 14344 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.037446 14344 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:27.039572 14572 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:27.040453 14572 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:27.042424  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3740) took 1084 ms. Trace:
I20260709 13:16:27.043012  7183 rpcz_store.cc:276] 0709 13:16:25.958468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.999794 (+ 41326us) service_pool.cc:224] Handling call
0709 13:16:27.042141 (+1042347us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54002b4dd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:27.042342 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308190592}
W20260709 13:16:27.007911  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.018143  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.044739  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:27.048380  7183 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:27.068135  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2969) took 1496 ms. Trace:
I20260709 13:16:27.068796  7181 rpcz_store.cc:276] 0709 13:16:25.571505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.614105 (+1042600us) service_pool.cc:224] Handling call
0709 13:16:26.676929 (+ 62824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.677200 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:26.703914 (+ 26714us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.067669 (+363755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.067752 (+    83us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:27.067820 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.067910 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.068057 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27007,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":278,"thread_start_us":362959,"threads_started":1}
I20260709 13:16:26.951257 14881 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.095577  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:27.094350  7331 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:27.097502  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:27.044432 14621 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:27.082775  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 112568us
I20260709 13:16:27.114179  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:26.958200  7333 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:27.068210 14880 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:27.116367 14554 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:27.116523 14880 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.117156 14554 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.086603  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:26.957969  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:26.976889 14859 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:27.102022  7327 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.708s	user 0.018s	sys 0.012s
I20260709 13:16:27.122238  7327 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 30.
I20260709 13:16:27.104624  7336 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:26.981921 14348 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:26.993171 14849 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:16:27.098963  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:27.123184  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:27.127776  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 169864us
I20260709 13:16:27.128070  7333 raft_consensus.cc:2410] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 26 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:16:27.124639  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.132748  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:27.135537  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:27.141999  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.143044  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.145064  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:27.148016 14554 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:27.150838 14348 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:27.137503 14789 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:27.151908 14789 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.152292 14789 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:27.156232 14752 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.925s	user 0.020s	sys 0.004s
W20260709 13:16:27.156527 14829 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.003s
I20260709 13:16:27.156701 14760 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:27.157086  7185 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:27.157075 14829 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:27.158670 14790 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.915s	user 0.012s	sys 0.012s
I20260709 13:16:27.159128 14790 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:27.150893 14327 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.006s
I20260709 13:16:27.160883 14327 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.161847  7262 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 24: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:27.162750 14621 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.163507  7179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0"
dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
mode: GRACEFUL
new_leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
 from {username='slave'} at 127.0.0.1:50580
I20260709 13:16:27.164214  7179 raft_consensus.cc:606] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Received request to transfer leadership to TS efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.164615  7179 raft_consensus.cc:614] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:27.166131  7179 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:16:27.166384 14655 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:27.167696  7258 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:16:27.169703  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:27.170470 14572 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:27.170724 14778 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:27.171195 14778 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.171582 14778 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:27.171751 14829 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:27.163694 14327 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:27.148850 14859 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:27.175493  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.094694 14831 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.199472 14759 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:27.199993  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:27.200656  7894 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:27.203599 14792 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:27.207849 14680 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.959s	user 0.022s	sys 0.005s
I20260709 13:16:27.187125  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 13:16:27.210122 14652 consensus_meta.cc:287] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.003s
I20260709 13:16:27.210695 14652 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.213434 14652 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:27.191869  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3738) took 1233 ms. Trace:
I20260709 13:16:27.237099  7186 rpcz_store.cc:276] 0709 13:16:25.957969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.140868 (+1182899us) service_pool.cc:224] Handling call
0709 13:16:27.191196 (+ 50328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.191453 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.191482 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.191537 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:27.191570 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.191632 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.191781 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.156234 14881 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:27.208015 14674 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.716s	user 0.016s	sys 0.000s
I20260709 13:16:27.187345 14554 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:27.218859 14655 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:27.219470 14882 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:27.221009 14552 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.972s	user 0.020s	sys 0.007s
I20260709 13:16:27.179646 14758 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:16:27.222407  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.256886  7333 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
W20260709 13:16:27.257076  7187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.004s	sys 0.017s
W20260709 13:16:27.257422  7187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.004s	sys 0.017s
I20260709 13:16:27.257905  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.223453 14572 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:16:27.223521  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53907.4us
I20260709 13:16:27.262198  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:27.197940  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.262825  7335 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 27 because replica has last-logged OpId of term: 26 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 13.
I20260709 13:16:27.183171  7259 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:27.227237  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.227831  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3747) took 1111 ms. Trace:
I20260709 13:16:27.265337  7179 rpcz_store.cc:276] 0709 13:16:26.116248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.165378 (+1049130us) service_pool.cc:224] Handling call
0709 13:16:27.165742 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.166548 (+   806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.227747 (+ 61199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.242543  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:27.246261  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.197875 14831 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:27.235572 14737 consensus_meta.cc:287] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.002s
W20260709 13:16:27.242324 14843 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.737s	user 0.009s	sys 0.009s
I20260709 13:16:27.251902  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:27.274034  7181 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:27.251251  7183 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:27.276067  7183 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:27.276785  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2981) took 1132 ms. Trace:
I20260709 13:16:27.277073  7183 rpcz_store.cc:276] 0709 13:16:26.144344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.275451 (+1131107us) service_pool.cc:224] Handling call
0709 13:16:27.275833 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.276565 (+   732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.276733 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.280557  7183 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:16:27.280985  7183 pending_rounds.cc:85] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 14
I20260709 13:16:27.281275  7183 pending_rounds.cc:107] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:16:27.286286  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.287853  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:27.297482  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.298415  7327 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:27.242817 14789 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.300729  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2977) took 1157 ms. Trace:
I20260709 13:16:27.300946 14789 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:27.301259  7181 rpcz_store.cc:276] 0709 13:16:26.142925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.274814 (+1131889us) service_pool.cc:224] Handling call
0709 13:16:27.300089 (+ 25275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.300326 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.300361 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.300414 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:27.300456 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.300521 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.300643 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.307071 14655 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.307690 14778 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.284044 14843 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.309634 14555 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.310580 14778 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:27.311975  7253 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:27.270984 14790 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:27.254899  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 301007us
I20260709 13:16:27.250774 14674 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.265902  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.239363  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2970) took 1638 ms. Trace:
I20260709 13:16:27.310369 14843 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:27.319952  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1458) took 1053 ms. Trace:
I20260709 13:16:27.337782  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:27.345086  7333 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:27.345041  7181 rpcz_store.cc:276] 0709 13:16:26.266340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.302456 (+1036116us) service_pool.cc:224] Handling call
0709 13:16:27.319217 (+ 16761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.319469 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.319508 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.319570 (+    62us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:27.319616 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.319689 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.319868 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.342770  7180 rpcz_store.cc:276] 0709 13:16:25.601219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.772673 (+1171454us) service_pool.cc:224] Handling call
0709 13:16:26.773029 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.773250 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:16:26.815750 (+ 42500us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.238993 (+423243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.239052 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:27.239102 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.239172 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.239307 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51175,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":682,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4616,"thread_start_us":422046,"threads_started":1,"wal-append.queue_time_us":487187}
I20260709 13:16:27.348126  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:27.348919  7180 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:27.351626  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:27.336479 14803 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.092s	user 0.014s	sys 0.000s
I20260709 13:16:27.259248  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:27.251765  7330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.002s	sys 0.019s
W20260709 13:16:27.360646  7330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.002s	sys 0.019s
I20260709 13:16:27.360852  7328 raft_consensus.cc:2368] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22.
I20260709 13:16:27.338320  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:27.357328  7331 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:27.361272  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:27.366535  7333 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:27.371845  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.373481  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.374079  7328 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:27.375245  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.375692  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3947) took 1075 ms. Trace:
I20260709 13:16:27.376310  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.377401  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.378304  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.381122  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1461) took 1105 ms. Trace:
I20260709 13:16:27.381599  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.381552  7184 rpcz_store.cc:276] 0709 13:16:26.275934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.380192 (+1104258us) service_pool.cc:224] Handling call
0709 13:16:27.380537 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.380744 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.380777 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.380825 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:27.380861 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.380923 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.381062 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.376168  7262 rpcz_store.cc:276] 0709 13:16:26.300184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.308263 (+  8079us) service_pool.cc:224] Handling call
0709 13:16:27.375484 (+1067221us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b5400058054. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:27.375627 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1926273792}
I20260709 13:16:27.380092  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.384343  7328 raft_consensus.cc:2410] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:16:27.382447  7331 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:27.389176  7181 raft_consensus.cc:1240] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:27.390161  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1459) took 1123 ms. Trace:
I20260709 13:16:27.390779  7181 rpcz_store.cc:276] 0709 13:16:26.266752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.350060 (+1083308us) service_pool.cc:224] Handling call
0709 13:16:27.388927 (+ 38867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.389827 (+   900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.390083 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.285310  7183 raft_consensus.cc:2889] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.392963  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:27.393937  7331 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:27.313457 14893 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:27.336597 14882 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:27.395289  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3959) took 1027 ms. Trace:
I20260709 13:16:27.400779  7259 rpcz_store.cc:276] 0709 13:16:26.368082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.368352 (+   270us) service_pool.cc:224] Handling call
0709 13:16:27.395073 (+1026721us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54001a2a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:27.395227 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1816359680}
W20260709 13:16:27.396522  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 58298.2us
I20260709 13:16:27.397123 14843 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:27.398017 14327 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.407869  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:27.408293  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 404329us
I20260709 13:16:27.404438  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2982) took 1242 ms. Trace:
I20260709 13:16:27.402884  7180 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 27.
I20260709 13:16:27.409919  7225 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:27.411334  7181 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 26. Current term is 27. Ops: []
I20260709 13:16:27.412012  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2986) took 1076 ms. Trace:
I20260709 13:16:27.409919  7183 rpcz_store.cc:276] 0709 13:16:26.161958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.278005 (+1116047us) service_pool.cc:224] Handling call
0709 13:16:27.278408 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.404086 (+125678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.404360 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.412544  7181 rpcz_store.cc:276] 0709 13:16:26.336033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.410806 (+1074773us) service_pool.cc:224] Handling call
0709 13:16:27.411133 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.411778 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.411960 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.428844  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.385269 14889 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.408001 14785 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.082s	user 0.021s	sys 0.003s
I20260709 13:16:27.435509  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:27.386369 14555 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:27.436887  7335 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:27.433063  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.434556  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:27.441951  7262 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:27.442751  7178 raft_consensus.cc:1275] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:16:27.443207  7178 pending_rounds.cc:85] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 11
I20260709 13:16:27.443449  7178 pending_rounds.cc:107] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:16:27.443701  7178 raft_consensus.cc:2889] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.399624 14893 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:27.403968 14737 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.480916  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.415515 14897 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.480878  7262 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:16:27.485687  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.486315  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.481652 14893 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:27.479285 14621 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:16:27.488444  7181 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:16:27.488834  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.491209  7334 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:16:27.505541  7334 pending_rounds.cc:85] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 13
I20260709 13:16:27.505914  7334 pending_rounds.cc:107] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:16:27.492301  7258 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:27.494539  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.510413  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.506285  7334 raft_consensus.cc:2889] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.497622  7333 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:27.494292  7331 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
W20260709 13:16:27.498135  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 355885us
I20260709 13:16:27.513480  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:27.500146  7257 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 17: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:27.439561 14803 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:27.430277 14843 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:27.504971  7335 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 27.
I20260709 13:16:27.428088 14778 consensus_queue.cc:1059] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:16:27.520902  7253 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:27.415102 14327 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.522390  7181 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:27.415066 14829 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.083s
I20260709 13:16:27.407649 14882 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:27.527639  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 258617us
I20260709 13:16:27.529006  7328 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:27.521761  7333 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:27.532970 14900 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:27.533526  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3748) took 1395 ms. Trace:
I20260709 13:16:27.499799 14755 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.519960 14878 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.005s
I20260709 13:16:27.539319  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.539439  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2968) took 1982 ms. Trace:
I20260709 13:16:27.558916  7187 rpcz_store.cc:276] 0709 13:16:25.556712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.600308 (+1043596us) service_pool.cc:224] Handling call
0709 13:16:26.600786 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.601332 (+   546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.601375 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.602037 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.257757 (+655720us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:27.257799 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.257863 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.539140 (+281277us) raft_consensus.cc:1685] finished
0709 13:16:27.539174 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.539361 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38666,"raft.queue_time_us":122,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":10456,"thread_start_us":574775,"threads_started":1,"wal-append.queue_time_us":784295}
I20260709 13:16:27.540617  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.542281  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:27.561342  7887 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:27.546018  7894 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 26. Current term is 27. Ops: []
W20260709 13:16:27.518757 14876 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.798s	user 0.010s	sys 0.024s
I20260709 13:16:27.548259  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:27.551853  7183 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:16:27.564786 14876 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.509508 14680 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:27.565850  7183 pending_rounds.cc:85] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 13
I20260709 13:16:27.566548 14792 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:27.566728  7183 pending_rounds.cc:107] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:16:27.538164  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1460) took 1271 ms. Trace:
I20260709 13:16:27.567082 14792 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.567801 14792 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:27.567389  7186 rpcz_store.cc:276] 0709 13:16:26.267061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.377989 (+1110928us) service_pool.cc:224] Handling call
0709 13:16:27.378310 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.378535 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:16:27.378833 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.537756 (+158923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.537820 (+    64us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:16:27.537868 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.537937 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.538093 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7934,"prepare.queue_time_us":4081,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2731,"raft.queue_time_us":8178,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":105,"thread_start_us":150106,"threads_started":1}
I20260709 13:16:27.569756 14876 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:27.570454  7183 raft_consensus.cc:2889] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.566926  7329 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 25. Current term is 26. Ops: []
I20260709 13:16:27.572381 14759 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:16:27.573366 14881 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:27.573743 14881 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:27.573972  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.517028 14148 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.523514 14569 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.094s	user 0.014s	sys 0.016s
I20260709 13:16:27.576440  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.574585 14881 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.582098  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:27.495257 14889 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.524933 14831 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:27.587919  7328 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:16:27.590459  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:27.498071 14737 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.584636 14148 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.584148 14569 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:27.625541  7187 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:16:27.625820  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.595235 14327 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:27.597213  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1223) took 1143 ms. Trace:
I20260709 13:16:27.628330  7334 rpcz_store.cc:276] 0709 13:16:26.454140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.488783 (+ 34643us) service_pool.cc:224] Handling call
0709 13:16:26.489296 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.511999 (+1022703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.596932 (+ 84933us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b540036ae54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:27.597145 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279963520}
I20260709 13:16:27.630538  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:27.631235  7894 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:27.632330  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1465) took 1080 ms. Trace:
W20260709 13:16:27.632653  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.599371 14896 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:27.600831  7887 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
I20260709 13:16:27.640882  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1227) took 1048 ms. Trace:
I20260709 13:16:27.632728  7183 rpcz_store.cc:276] 0709 13:16:26.552064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.412872 (+860808us) service_pool.cc:224] Handling call
0709 13:16:27.413236 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.571220 (+157984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.632097 (+ 60877us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54000ed3d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:27.632269 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317950848}
I20260709 13:16:27.644629  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:27.604127  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:27.503654 14897 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.607177 14881 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:27.612740  7185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54396 (request call id 1462) took 1327 ms. Trace:
I20260709 13:16:27.653527  7185 rpcz_store.cc:276] 0709 13:16:26.285413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.324388 (+ 38975us) service_pool.cc:224] Handling call
0709 13:16:27.612401 (+1288013us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400256a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:27.612619 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898134272}
I20260709 13:16:27.613950 14753 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.627321  7332 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26. Ops: []
I20260709 13:16:27.655066  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:27.580603 14759 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.633139  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.646610  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 3962) took 1150 ms. Trace:
I20260709 13:16:27.586328 14778 raft_consensus.cc:3055] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:27.657763  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:27.590006 14767 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.651s	user 0.007s	sys 0.012s
W20260709 13:16:27.605360  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.641386  7330 rpcz_store.cc:276] 0709 13:16:26.592204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.592426 (+   222us) service_pool.cc:224] Handling call
0709 13:16:26.596374 (+  3948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.596723 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:16:26.689876 (+ 93153us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.640500 (+950624us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.640559 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:27.640610 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.640684 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.640818 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":279329,"prepare.queue_time_us":46932,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"thread_start_us":747339,"threads_started":2,"wal-append.queue_time_us":696850}
I20260709 13:16:27.649678  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1447) took 3154 ms. Trace:
I20260709 13:16:27.651571  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:27.652245  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.657763  7255 rpcz_store.cc:276] 0709 13:16:26.496314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.517649 (+ 21335us) service_pool.cc:224] Handling call
0709 13:16:27.633732 (+1116083us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54002170d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:27.646547 (+ 12815us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020158720}
I20260709 13:16:27.659978  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:27.663659  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.662261  7178 rpcz_store.cc:276] 0709 13:16:24.475082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.476063 (+   981us) service_pool.cc:224] Handling call
0709 13:16:24.476535 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.499417 (+3022882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.628733 (+129316us) spinlock_profiling.cc:243] Waited 2.96 s on lock 0x7b5400117e54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:27.628928 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6804963072}
I20260709 13:16:27.666893 14803 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 13:16:27.667455 14903 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:16:27.668007 14803 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:16:27.668378 14803 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:27.576292 14755 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.580705 14878 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.669245  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2971) took 2054 ms. Trace:
I20260709 13:16:27.689146  7328 raft_consensus.cc:2393] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:27.694408  7262 raft_consensus.cc:1240] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:27.693998  7182 rpcz_store.cc:276] 0709 13:16:25.614452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.814061 (+1199609us) service_pool.cc:224] Handling call
0709 13:16:26.814477 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:26.814974 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.815008 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:26.857518 (+ 42510us) log.cc:844] Serialized 52 byte log entry
0709 13:16:27.358848 (+501330us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:27.370607 (+ 11759us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.371103 (+   496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.371183 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.668984 (+297801us) raft_consensus.cc:1685] finished
0709 13:16:27.669007 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.669178 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11206,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":209,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":11949,"thread_start_us":405516,"threads_started":1,"wal-append.queue_time_us":569963}
I20260709 13:16:27.651223 14409 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.704002  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.659188 14793 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.708141  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50545.8us
I20260709 13:16:27.706027  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:27.660820 14778 raft_consensus.cc:740] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:27.664120 14833 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:27.717969  7254 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:27.711133  7253 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:27.706751 14637 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:27.720044  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:27.720693  7259 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:27.722154  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:27.732272  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:27.732735  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:27.733207  7329 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:27.733974  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.734397  7887 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26. Ops: [23.16-25.17]
I20260709 13:16:27.734988  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.735627  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:27.734015  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.735924  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:27.736639  7332 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 30.
I20260709 13:16:27.738214  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:27.743966  7328 raft_consensus.cc:2393] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:27.744192  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:27.719410 14879 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.724s	user 0.018s	sys 0.000s
I20260709 13:16:27.669775 14523 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:16:27.717137 14882 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:27.671078 14759 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.761909  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:27.778963  7255 raft_consensus.cc:1240] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 16. Current term is 17. Ops: []
W20260709 13:16:27.763564  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.669879 14753 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:27.770342  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.782980  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:27.784641  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.771528  7260 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:16:27.785565  7260 pending_rounds.cc:85] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 9
I20260709 13:16:27.785882  7260 pending_rounds.cc:107] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:16:27.786187  7260 raft_consensus.cc:2889] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.714732 14916 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:16:27.784574  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:27.672186 14767 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.787528  7178 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:27.802192  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:27.789335  7259 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:27.791996 14878 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:27.792557 14914 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:27.711409 14843 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.711109 14409 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.797519  7894 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:27.798921 14916 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:27.799885 14897 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:27.801918  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2985) took 1466 ms. Trace:
I20260709 13:16:27.803306 14758 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:27.805475 14759 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:27.723037 14803 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.20, Last appended by leader: 20, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:27.808640 14684 consensus_meta.cc:287] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.298s	user 0.006s	sys 0.019s
W20260709 13:16:27.809800 14810 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.822s	user 0.014s	sys 0.008s
I20260709 13:16:27.809253 14778 consensus_queue.cc:260] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.810334 14876 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:27.717636 14793 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.811333 14737 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:27.813262 14889 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:27.737473 14833 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.815375  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:27.817874  7187 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 22
W20260709 13:16:27.810352  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 522561us
I20260709 13:16:27.821061  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.823725  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:27.871822  7328 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 30: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:27.825104  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:27.872560  7330 raft_consensus.cc:2376] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23. Re-sending same reply.
I20260709 13:16:27.872843  7178 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
W20260709 13:16:27.828713  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 128955us
I20260709 13:16:27.840651  7258 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:16:27.843842  7184 rpcz_store.cc:276] 0709 13:16:26.335738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.386322 (+1050584us) service_pool.cc:224] Handling call
0709 13:16:27.386692 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.407100 (+ 20408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.407135 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.418718 (+ 11583us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.580382 (+161664us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:27.580705 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.580785 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.801686 (+220901us) raft_consensus.cc:1685] finished
0709 13:16:27.801712 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.801855 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5217,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":117,"thread_start_us":93002,"threads_started":1,"wal-append.queue_time_us":222890}
I20260709 13:16:27.846212  7334 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26. Ops: []
I20260709 13:16:27.851823  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:27.856930  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 212357us
W20260709 13:16:27.861130  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 201242us
W20260709 13:16:27.861490  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 125825us
I20260709 13:16:27.839823 14916 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:27.877732  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.878762  7181 raft_consensus.cc:3060] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:27.861901 14785 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:27.855788 14637 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:27.891860  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 157959us
I20260709 13:16:27.897877  7301 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.893803  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:27.857985 14810 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.856237 14759 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:16:27.855389 14758 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.866531 14474 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:16:27.867146 14803 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:27.856431 14684 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.929138  7327 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:27.936689  7150 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.893224  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:27.943338  7178 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:27.944793  7178 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:16:27.947997  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61096.3us
I20260709 13:16:27.882899 14778 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:27.912823  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:27.901257  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:27.950680  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52839.2us
I20260709 13:16:27.903375  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:27.948952  7302 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:27.920011  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:27.929167 14789 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:16:27.953991 14637 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.960373 14927 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:27.961267  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:27.962767 14911 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:16:27.963569  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.963763 14793 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:27.964434 14793 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:27.964949 14409 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:27.965350 14759 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:27.965760 14759 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:27.966162  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.966585 14759 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:27.968021  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.969522  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.971378  7261 raft_consensus.cc:2393] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:27.961687 14927 consensus_queue.cc:1059] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:27.973392  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.974071 14793 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:27.973033  7186 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:16:27.988112  7302 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:27.988657 14655 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:27.989676  7256 raft_consensus.cc:1240] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:16:27.899537 14652 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:27.991209  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:27.890869 14785 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:27.968120 14759 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:28.014469 14789 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:28.017956  7187 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:27.996510 14655 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.020570  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:28.021216  7895 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:27.995759  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:27.998142  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46213.9us
I20260709 13:16:27.999533  7331 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:27.975414 14554 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:16:28.001598 14552 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:28.001618 14869 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:27.975234 14928 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:28.005259 14930 raft_consensus.cc:3055] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:28.004951 14792 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.007809 14753 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:27.983968 14793 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:28.009176  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:28.009449 14893 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:27.993974 14916 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.012827  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:28.024787 14785 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:28.013916 14572 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:27.985683 14409 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:28.026298  7181 raft_consensus.cc:2468] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:27.974650 14299 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:28.034744  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:28.031109  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:28.043556  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:28.029614 14927 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:28.064276  7178 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:28.027161 14552 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:28.126328 14552 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:28.074400  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:28.079628  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:28.004915  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:28.140779  7186 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:28.081285  7183 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:16:28.067879 14474 consensus_queue.cc:1059] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:16:28.143692  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:28.081884  7329 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:28.082808 14753 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:28.031540 14869 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:28.084072  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:28.085151  7225 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:28.087029 14810 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:28.092051 14758 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:28.035430 14930 raft_consensus.cc:740] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:28.153144 14767 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:28.152742 14930 consensus_queue.cc:260] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.107934 14927 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:28.060111 14793 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:28.108616 14736 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.112414 14876 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:28.122884 14655 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:28.066542  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 436741us
I20260709 13:16:28.133872  7862 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:16:28.133901  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 102890us
I20260709 13:16:28.139370 14572 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:28.135108  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:28.175382  7178 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:28.135798  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:28.155553 14930 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:28.145813  7181 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:28.132848 14684 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:28.149578  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 64505.2us
I20260709 13:16:28.188964  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:16:28.158538  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 145099us
I20260709 13:16:28.190728  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:28.192039  7302 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:28.161181  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 187906us
I20260709 13:16:28.193394  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.195142  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:28.197154  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.131343 14792 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:28.127352  7257 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:28.168948  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:28.160054 14927 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:28.142449 14878 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:28.176812  7331 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:28.139575  7332 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:16:28.154021 14753 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.178732  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:28.160576 14897 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:28.213621  7302 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.225088  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:28.225654  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:28.227188  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 57970.8us
I20260709 13:16:28.227363  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.229647  7181 pending_rounds.cc:85] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 12
I20260709 13:16:28.200955 14904 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:28.200383 14759 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:28.230044  7181 pending_rounds.cc:107] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:16:28.236332  7181 raft_consensus.cc:2889] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:28.214937 14843 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:28.233196  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.230268  7228 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:28.207897 14409 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:28.232373  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.164278 14736 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.212656 14876 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:28.238792  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:28.241372  7331 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:28.235256 14889 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:16:28.208602 14737 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:16:28.230587 14652 raft_consensus.cc:2804] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:28.248382  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.233096 14792 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:28.225514 14869 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.252076  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:28.254021  7895 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:28.233062 14684 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:28.256357 14299 raft_consensus.cc:3055] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:28.239280 14938 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:28.240439 14843 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:28.260892  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.286515  7331 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:28.261539  7225 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:28.265579 14897 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:28.262693  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:28.265075 14474 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:28.230002 14555 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:28.272943 14523 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:28.270429 14876 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:28.293706  7331 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 26. Current term is 27. Ops: []
I20260709 13:16:28.293824  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:28.260840  7178 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:16:28.265167  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:28.207568 14569 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:16:28.268189  7333 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:28.207214 14604 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:16:28.269171  7329 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:16:28.301637  7331 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 13:16:28.267897  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:28.271286  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.283694 14916 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:28.270689 14409 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:28.291126  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:28.259279 14572 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.296397  7258 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 25: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:28.313297  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:28.285655 14652 raft_consensus.cc:697] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:28.298476  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:28.315889  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:28.277755 14684 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:28.248216 14736 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:28.331348  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:28.331918 14736 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.332444 14736 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.334594 14767 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:28.334839 14889 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:28.335268 14767 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.297066 14801 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:28.296669 14523 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.305335  7150 leader_election.cc:400] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22.
I20260709 13:16:28.339299  7150 leader_election.cc:403] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:28.286690 14869 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:28.282873 14299 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:28.268404 14785 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.288774 14843 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:28.284121 14938 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:28.296690 14474 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.291716 14919 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.322113 14652 consensus_queue.cc:237] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.324635 14947 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:28.326316  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:28.297333 14528 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:28.370714 14947 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:28.371219 14528 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:28.371841 14947 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.373383 14947 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:28.327651 14753 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:28.326818  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:28.328680  7891 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:16:28.326920  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:28.375980  7894 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:28.329401 14897 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.330749 14876 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.382264 14785 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:28.298029 14904 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:28.329149  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:28.384400  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.383838 14904 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.343672 14767 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:28.389672  7253 raft_consensus.cc:2410] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 27 because replica has last-logged OpId of term: 26 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 19.
W20260709 13:16:28.398162  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.405257 14755 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:28.333846  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:28.342074  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:28.344913  7150 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.307130 14555 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:28.414353  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 69629us
I20260709 13:16:28.309024 14879 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:28.415061 14879 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.415266  7150 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.415565 14879 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:28.416636  7150 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.417024 14409 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:28.417486 14409 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.417827 14409 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:28.419341 14299 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.356624  7888 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:28.357225  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:28.422283  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:28.422485  7887 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:28.337842 14684 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:28.338430 14945 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:16:28.341097 14523 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:28.272722 14878 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:16:28.316771 14810 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:28.370750 14919 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.313010 14759 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:28.340396  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 112306us
W20260709 13:16:28.384909  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.424547  7301 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.434120  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.423053  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:28.426605  7186 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:28.351647 14928 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22.
I20260709 13:16:28.370061 14938 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:28.436836  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:28.437194  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.349112 14737 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 13:16:28.437650  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:28.429940 14930 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:16:28.424264 14637 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:28.474289  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.424283 14755 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:16:28.491074 14810 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:16:28.494969 14932 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.410s	user 0.006s	sys 0.000s
I20260709 13:16:28.495812 14810 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:28.497573 14893 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:28.503003  7259 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 13:16:28.488924 14950 consensus_queue.cc:1048] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:16:28.497056 14810 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.444628 14877 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:16:28.525831  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:28.531050  7257 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
W20260709 13:16:28.508688  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 177350us
W20260709 13:16:28.522228  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 208985us
I20260709 13:16:28.549703  7225 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:28.550078  7859 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.439256 14940 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:16:28.473708 14655 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:28.414553 14555 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.398305 14927 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.488281  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:28.486271 14831 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:28.506570 14299 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:28.486003 14759 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:16:28.581163 14737 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:16:28.588990  7182 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:16:28.613072  7182 pending_rounds.cc:85] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 13
I20260709 13:16:28.613543  7182 pending_rounds.cc:107] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:16:28.613917  7182 raft_consensus.cc:2889] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:28.596519  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.598877  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3968) took 1467 ms. Trace:
W20260709 13:16:28.599644  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 50055.3us
I20260709 13:16:28.615890  7254 rpcz_store.cc:276] 0709 13:16:27.131757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.131941 (+   184us) service_pool.cc:224] Handling call
0709 13:16:27.163134 (+ 31193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.718420 (+555286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.598588 (+880168us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54002260d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:28.598807 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275491584}
I20260709 13:16:28.616639  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:28.487509 14793 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.623327  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:28.627180  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:28.619041  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 173509us
I20260709 13:16:27.552405  7179 rpcz_store.cc:276] 0709 13:16:26.137806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.266938 (+1129132us) service_pool.cc:224] Handling call
0709 13:16:27.267340 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.269660 (+  2320us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:27.284970 (+ 15310us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.531689 (+246719us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.532074 (+   385us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.532222 (+   148us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:27.532490 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.532744 (+   254us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.533155 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14378,"prepare.queue_time_us":15571,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":2036,"spinlock_wait_cycles":42070400,"thread_start_us":237323,"threads_started":1}
I20260709 13:16:28.629765  7179 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:28.529495 14893 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:16:28.632854  7180 raft_consensus.cc:2393] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 25: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:28.626699  7887 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:28.634584  7225 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:28.635673  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 212670us
I20260709 13:16:28.594451 14148 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:28.607398 14875 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:28.643079  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:28.650015  7187 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:28.622172 14897 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.651309  7182 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:28.634547 14569 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:16:28.606447 14831 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.637279 14803 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:28.647161 14790 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:28.674660  7182 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:16:28.663303  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.658892 14897 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.639225 14956 raft_consensus.cc:2764] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:16:28.689208  7150 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.664053 14569 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:28.695895  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 50766.7us
W20260709 13:16:28.702730  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.702697  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.704059  7332 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:28.642460 14801 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:16:28.654403 14655 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:16:28.707502  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:28.728291  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:28.727962  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 221937us
W20260709 13:16:28.709955 14552 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.554s	user 0.015s	sys 0.010s
I20260709 13:16:28.699932 14569 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:16:28.695619 14963 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:28.708901 14474 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:28.728717 14919 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:28.734264 14889 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:28.711146 14955 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 20.18, Next index: 19, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 13:16:28.729620 14930 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:28.734543 14881 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.786494  7861 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:28.747169 14889 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.734350 14552 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:28.758001 14961 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:16:28.740620 14875 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.049s
W20260709 13:16:28.799984  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 52292.7us
I20260709 13:16:28.786281 14344 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.800814 14960 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:16:28.807013  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 257351us
I20260709 13:16:28.809720  7327 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:28.799808 14889 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:28.799345 14968 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:28.815690  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:28.816385  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:28.804236 14928 raft_consensus.cc:3055] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:28.790954 14930 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.827289  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:28.805631 14927 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:28.798656 14881 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.831313 14963 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:28.816197 14957 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:16:28.800951 14955 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:16:28.809207 14793 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:28.865358  7332 raft_consensus.cc:1240] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 13:16:28.866695  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.867805  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:28.868191  7332 raft_consensus.cc:2376] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24. Re-sending same reply.
I20260709 13:16:28.868852  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.815340 14968 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:28.832508 14969 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:28.848156 14680 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:28.832556 14949 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
I20260709 13:16:28.826704 14972 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:28.809798 14344 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.833847 14919 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:28.827689 14928 raft_consensus.cc:740] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:28.862731  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:28.862511  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:28.852540 14674 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:28.868852  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:28.869794  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:28.901338  7329 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:28.832727  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:28.849435 14971 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:16:28.879253  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.884922  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.888253 14963 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:28.891723  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:28.910247  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 77597.3us
I20260709 13:16:28.872961 14969 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:28.894336  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 67135.2us
I20260709 13:16:28.898290  7225 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:28.899290  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:28.903424 14947 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 13:16:28.901530 14979 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:28.853645 14976 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:16:28.939632  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:28.941951  7895 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:28.942994  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.915724 14793 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:28.912503  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:28.893098  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.946686  7335 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:28.947073  7331 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 17.
I20260709 13:16:28.884696 14680 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.908820 14919 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:28.960566  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:28.894971 14790 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
W20260709 13:16:28.886816 14905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.001s	sys 0.023s
I20260709 13:16:28.958469  7329 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:28.935194 14945 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:16:28.960472  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48069.7us
I20260709 13:16:28.961949  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:28.926981 14969 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:28.959867 14680 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:28.980774 14881 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:28.945889 14869 consensus_meta.cc:287] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.003s
I20260709 13:16:28.982237  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.985257  7335 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 26: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:28.973551  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.973534  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.975247  7859 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:28.978157  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:28.971494 14905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.002s	sys 0.023s
I20260709 13:16:28.988582  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:28.997689  7331 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:28.970754 14552 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:29.001917  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:28.990348  7332 raft_consensus.cc:2410] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:16:28.961454 14875 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:29.004161  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:29.005554  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 74213.2us
I20260709 13:16:28.980898 14919 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.998220  7887 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:28.999845  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:28.918181 14974 consensus_queue.cc:1059] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:16:29.006654  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:29.010070  7329 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:28.985482 14621 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.000008 14569 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:28.984031 14981 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:29.014652  7331 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:16:29.058789  7329 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:29.054589 14621 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.130278 14621 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:29.132252 14927 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:29.133147  7185 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:16:29.137136  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3983) took 1103 ms. Trace:
W20260709 13:16:29.066612 14523 consensus_meta.cc:287] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.002s
I20260709 13:16:29.137663  7261 rpcz_store.cc:276] 0709 13:16:28.033910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.165359 (+131449us) service_pool.cc:224] Handling call
0709 13:16:28.165798 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.233700 (+ 67902us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:28.267259 (+ 33559us) log.cc:844] Serialized 14 byte log entry
0709 13:16:28.439744 (+172485us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:28.439824 (+    80us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:28.439889 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.136846 (+696957us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b540009a6d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:29.136900 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.137064 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18465,"prepare.queue_time_us":33578,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":8718,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":11664,"spinlock_wait_cycles":155626752,"thread_start_us":167933,"threads_started":1,"wal-append.queue_time_us":93711}
I20260709 13:16:29.139035 14523 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.141366 14523 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:28.939741 14968 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.18, Last appended by leader: 18, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.147501 14968 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:28.993464 14810 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:16:29.151763 14833 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:29.152343 14986 log.cc:927] Time spent T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:16:29.153865  7187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 3005) took 1146 ms. Trace:
I20260709 13:16:29.154357  7187 rpcz_store.cc:276] 0709 13:16:28.007836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.028015 (+ 20179us) service_pool.cc:224] Handling call
0709 13:16:28.066927 (+ 38912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.651247 (+584320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.153386 (+502139us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b540017cd54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:29.153767 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340436864}
I20260709 13:16:29.159543 14344 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:29.160689  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:29.065938 14684 consensus_meta.cc:287] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.629s	user 0.012s	sys 0.000s
I20260709 13:16:29.082810 14736 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:28.950711 14979 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.066859 14987 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:29.067655  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:29.121861 14957 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:16:29.064149 14569 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 31 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:29.068280 14978 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:16:29.067137 14977 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:16:29.071664  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3978) took 1367 ms. Trace:
I20260709 13:16:29.190579  7260 rpcz_store.cc:276] 0709 13:16:27.704023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.704163 (+   140us) service_pool.cc:224] Handling call
0709 13:16:27.714515 (+ 10352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.786771 (+ 72256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.071311 (+1284540us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b54002f7454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:29.071578 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130242304}
I20260709 13:16:29.068442  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:29.077040 14936 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.992s	user 0.005s	sys 0.000s
W20260709 13:16:29.069372 14980 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:16:28.997035 14972 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:29.016578 14945 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:29.067036  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:29.195393  7891 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:29.072430 14974 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:29.057350  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 50890.2us
I20260709 13:16:29.009858 14930 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:29.132931 14927 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.202960 14810 consensus_queue.cc:1243] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 24.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:16:29.204632 14927 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:29.205492 14916 consensus_meta.cc:287] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.892s	user 0.008s	sys 0.003s
I20260709 13:16:29.166378  7329 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26. Ops: []
I20260709 13:16:29.177649 14684 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:29.207372 14975 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:16:29.208873 14684 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:29.209910  7257 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:29.198959 14945 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:29.211428 14945 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:29.214452 14974 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.199527 14972 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:29.083971 14985 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:16:29.081548  7328 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:29.158052 14889 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.163152 14793 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:29.245211 14793 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.246572 14889 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:29.057541 14967 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.128s
I20260709 13:16:29.201972 14990 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:29.263056 14990 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:29.263484 14990 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:29.264261 14990 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.265489 14990 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:29.266072  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:29.230973  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:29.266845  7253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1585) took 1551 ms (client timeout 1837 ms). Trace:
I20260709 13:16:29.241868  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2640) took 1241 ms. Trace:
W20260709 13:16:29.267292  7253 rpcz_store.cc:269] 0709 13:16:27.715913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.721896 (+  5983us) service_pool.cc:224] Handling call
0709 13:16:29.266605 (+1544709us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54002d4454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:29.266784 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1532835584}
I20260709 13:16:29.267763  7327 rpcz_store.cc:276] 0709 13:16:28.000354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.288585 (+288231us) service_pool.cc:224] Handling call
0709 13:16:28.303240 (+ 14655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.810159 (+506919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.241576 (+431417us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b540036b354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:29.241792 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164265728}
I20260709 13:16:29.248138 14793 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:29.200917 14928 consensus_queue.cc:260] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.269717  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:29.271485 14796 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:29.271729 14790 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:29.272032 14796 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:29.272393 14790 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:16:29.235754 14879 consensus_meta.cc:287] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.820s	user 0.005s	sys 0.008s
I20260709 13:16:29.273394 14790 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.251340  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:29.259689  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2623) took 1780 ms. Trace:
I20260709 13:16:29.279074  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3771) took 1017 ms. Trace:
I20260709 13:16:29.283588  7334 rpcz_store.cc:276] 0709 13:16:27.479366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.650286 (+170920us) service_pool.cc:224] Handling call
0709 13:16:27.650789 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.879300 (+228511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.259417 (+1380117us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54001b8d54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:29.259618 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448906496}
I20260709 13:16:29.284174  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:29.281759  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:29.287254  7186 rpcz_store.cc:276] 0709 13:16:28.261778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.435736 (+173958us) service_pool.cc:224] Handling call
0709 13:16:28.438310 (+  2574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.701520 (+263210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.701553 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:28.706360 (+  4807us) log.cc:844] Serialized 26 byte log entry
0709 13:16:28.895288 (+188928us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:28.895346 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.895684 (+   338us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.278816 (+383132us) raft_consensus.cc:1685] finished
0709 13:16:29.278839 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.279010 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51546,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"thread_start_us":409053,"threads_started":2,"wal-append.queue_time_us":212966}
I20260709 13:16:29.290545  7332 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:29.284245  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:29.282122  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:29.275206  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:29.285436  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:29.280757  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:29.266875  7336 raft_consensus.cc:2368] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:29.287256  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:29.299758  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:29.302986  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:29.296845  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:29.305540  7150 leader_election.cc:400] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:29.305996  7150 leader_election.cc:403] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:29.285476  7891 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:29.283337  7890 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:29.274751 14879 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.315557  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:29.321424  7254 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:29.197669 14680 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.335120  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:29.344303  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:29.344614  7332 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:16:29.345103  7255 raft_consensus.cc:2368] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:29.346484  7254 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:29.277611 14945 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.193650 14969 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.348512  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:29.349182  7330 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:16:29.349735 14753 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:29.350153 14753 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:29.350512  7336 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 26. Current term is 27. Ops: []
I20260709 13:16:29.351006 14753 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.351923 14979 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:29.342069 14831 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:29.318696 14930 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:16:29.355187  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:29.356305 14801 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:16:29.356809 14801 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:29.359179 14680 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:29.311688 14637 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:29.360098 14637 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.360530 14637 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:29.363644  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 3003) took 1356 ms. Trace:
I20260709 13:16:29.364177  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:29.364758  7187 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:16:29.308676 14793 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:29.357754 14801 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.374840  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:29.375567  7327 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:29.366765  7891 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:29.352110 14753 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:29.370968  7258 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 24: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:29.365008  7185 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
W20260709 13:16:29.373409 14792 consensus_meta.cc:287] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.095s	user 0.019s	sys 0.000s
I20260709 13:16:29.273469 14796 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.373791 14793 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:29.403540  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:29.404605  7336 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:29.406121  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.364082  7183 rpcz_store.cc:276] 0709 13:16:28.007187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.009684 (+  2497us) service_pool.cc:224] Handling call
0709 13:16:28.010057 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.141525 (+131468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.363432 (+1221907us) spinlock_profiling.cc:243] Waited 70.9 ms on lock 0x7b54002b43d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:29.363592 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163070720}
I20260709 13:16:29.367372  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:29.350400 14969 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:29.380406  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:29.380744  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:29.386171  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:29.389475 14843 consensus_meta.cc:287] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.021s	user 0.020s	sys 0.000s
I20260709 13:16:29.378660 14680 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:29.391150 14974 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:29.378969 14979 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.429360  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:29.429661  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:29.410392  7178 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:29.431059  7330 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 31.
I20260709 13:16:29.431591  7891 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:16:29.416680  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3951) took 3113 ms. Trace:
W20260709 13:16:29.426241  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 45939.4us
I20260709 13:16:29.434262  7327 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:29.427892  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:29.427798  7890 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:16:29.433470  7256 rpcz_store.cc:276] 0709 13:16:26.303139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.303424 (+   285us) service_pool.cc:224] Handling call
0709 13:16:26.319499 (+ 16075us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.992813 (+1673314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.416351 (+1423538us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54002265d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:29.416613 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840216320}
I20260709 13:16:29.399842 14792 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:29.431360  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:29.437984  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:29.439145 14831 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:29.439447 14793 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.429352 14736 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.011s
I20260709 13:16:29.429055 14927 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:29.427554 14843 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.441334  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:29.441579  7889 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:29.442104  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:29.416761 14409 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.998s	user 0.020s	sys 0.001s
I20260709 13:16:29.397948 14945 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:29.399017 14801 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:29.443064  7862 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:16:29.448328  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.448132  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:29.449275  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:29.535362  7330 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:29.537024  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:29.537046  7183 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:29.537201  7302 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:29.470212  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:29.538069 14299 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.539001 14787 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.538771 14299 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.539753 14787 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.541716 14299 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:29.481588  7178 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:29.450083  7225 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:29.492763  7327 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:29.495163  7336 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:29.430296 14344 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:29.542603 14299 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:16:29.545819 14344 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:29.547748  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 104777us
W20260709 13:16:29.545431  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 95420.4us
I20260709 13:16:29.545511 14790 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:29.552893  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:29.556241  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:29.558662  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:29.560491  7225 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:29.565150  7225 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:29.444618 14879 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:29.436214 14979 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.450244 14674 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:29.546510 14344 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:29.520807 14792 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:29.547183 14555 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:29.567817 14987 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:29.567071 14831 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:16:29.618369  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 290588us
I20260709 13:16:29.576382 14927 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:29.568364 14945 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:29.533480 14409 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.567086 14992 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:29.607182 14787 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:29.611749 14755 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:29.617159 14759 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:29.648762  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.389644  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:29.650125  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:29.626574 14674 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:29.663542  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.547355 14528 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:29.671383 14755 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:29.636557 14963 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.625788 14552 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:16:29.642326 14831 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:29.712039 14831 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:29.670646  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:29.683348  7888 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
W20260709 13:16:29.684365  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 119371us
I20260709 13:16:29.654748 14945 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.716079 14945 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:29.719364 14997 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:16:29.724633 14993 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:16:29.725033 14992 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:16:29.672703  7184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.008s
I20260709 13:16:29.664376 14974 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:29.625993 14637 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:29.731884  7184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.004s	sys 0.009s
I20260709 13:16:29.652177 14792 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.703181 14979 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:29.728735  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1479) took 1129 ms. Trace:
I20260709 13:16:29.732795  7184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 2997) took 1807 ms. Trace:
I20260709 13:16:29.694665 14787 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.680991 14674 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:29.695818  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:29.749719  7181 rpcz_store.cc:276] 0709 13:16:28.599636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.131484 (+531848us) service_pool.cc:224] Handling call
0709 13:16:29.131846 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.223046 (+ 91200us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:16:29.223346 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.534250 (+310904us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:29.561726 (+ 27476us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:29.566069 (+  4343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.728386 (+162317us) spinlock_profiling.cc:243] Waited 90.9 ms on lock 0x7b5400248454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:29.728464 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.728648 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":578,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":48,"raft.queue_time_us":404,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5688,"spinlock_wait_cycles":209085312,"thread_start_us":309721,"threads_started":1,"wal-append.queue_time_us":431495}
I20260709 13:16:29.749871  7184 rpcz_store.cc:276] 0709 13:16:27.925221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.941733 (+ 16512us) service_pool.cc:224] Handling call
0709 13:16:27.942074 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.942296 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:16:27.989613 (+ 47317us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.161885 (+1172272us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b18001eb320. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a 00007fece9246a2a
0709 13:16:29.732368 (+570483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:29.732427 (+    59us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:29.732474 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.732610 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.732736 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47063,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":4770,"spinlock_wait_cycles":6839040,"thread_start_us":570253,"threads_started":1}
I20260709 13:16:29.736112  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:29.693482 14755 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:29.731371 14637 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:29.681936 14759 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.692616 14879 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:16:29.760161  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 64440us
I20260709 13:16:29.779131  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:29.761196  7225 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:29.782330 14792 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:29.782755 14833 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:29.783763 14792 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.785768 14790 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:29.786402 14790 raft_consensus.cc:697] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:29.787398 14790 consensus_queue.cc:237] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.748818 14299 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.807832 14833 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:29.807802 14792 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.811436 14792 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:29.768224 14528 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:29.735533 14962 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:29.764416 14968 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 31 FOLLOWER]: Leader election won for term 31
W20260709 13:16:29.827912  7260 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.101s	sys 0.072s
I20260709 13:16:29.747165 14989 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:16:29.747591 14591 consensus_queue.cc:1059] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 13:16:29.749342 14992 consensus_queue.cc:1059] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.057s
W20260709 13:16:29.914762  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 377794us
I20260709 13:16:29.929198  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:29.929935  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:29.733382 14963 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:29.930219  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:29.919808  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 363674us
I20260709 13:16:29.930658  7333 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:29.935087  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 486991us
I20260709 13:16:29.933815  7335 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:29.939273  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:29.940179 14833 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:29.940593 14833 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.941093 14833 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:29.943080  7299 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:29.946949  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:29.947484  7336 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:29.947845  7335 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 27: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:29.947688  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:29.950991 14637 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.951813 14637 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.955998  7150 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:29.963169  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:29.805724 14843 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:29.975970  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:29.977499  7894 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:29.769551 14787 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:29.979300  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44509.9us
I20260709 13:16:29.979228  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:30.007949  7333 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:29.826617 14299 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:29.954556 14979 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:30.000681 14972 consensus_meta.cc:287] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.004s
W20260709 13:16:30.025414  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 46294.2us
I20260709 13:16:30.016016 15007 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:30.035439  7150 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:30.071688  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:30.083276  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 322181us
I20260709 13:16:30.084987  7225 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:30.029989 14555 raft_consensus.cc:2764] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:16:30.093055  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:30.094297  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 58997.3us
I20260709 13:16:30.100548  7150 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:30.018141 14979 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.138669  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:30.025084 14972 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.042038 14793 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:30.166494  7895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1308) took 1841 ms (client timeout 1825 ms). Trace:
W20260709 13:16:30.159986  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 59598.3us
W20260709 13:16:30.264982  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 320032us
W20260709 13:16:30.228368  7895 rpcz_store.cc:269] 0709 13:16:28.325505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.341698 (+ 16193us) service_pool.cc:224] Handling call
0709 13:16:30.166262 (+1824564us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b540043a8d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:30.166397 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216364416}
W20260709 13:16:30.162091 14996 log.cc:927] Time spent T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260709 13:16:30.090032 14829 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:30.164376 15005 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.166308 14569 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:30.093871 15008 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.225s
I20260709 13:16:30.272904  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:30.103660 14409 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.089510 14879 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:30.179531 14792 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:30.170194 14893 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:30.227994 14897 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.291712  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:30.292544  7254 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:16:30.293376  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:30.317600  7255 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:30.096208 15006 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:16:30.285049  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 329911us
I20260709 13:16:30.297088  7253 raft_consensus.cc:1275] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:30.260865 14759 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.308403  7260 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
W20260709 13:16:30.284590 14978 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.087s	user 0.012s	sys 0.010s
I20260709 13:16:30.315330  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:30.319612  7327 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 27.
I20260709 13:16:30.091652 15007 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.318121  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:30.331849  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:30.334612  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:30.287655 14793 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.374189  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:30.367036  7253 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:30.310390 14792 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.308154 14591 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.382514  7254 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 17. Current term is 18. Ops: []
W20260709 13:16:30.316591 15013 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:16:30.306689 14637 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.305835 14569 raft_consensus.cc:697] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:30.312961 14963 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:30.382054  7255 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:16:30.333695 14409 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:30.389523  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:30.415239  7260 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:30.312525 14893 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:30.403470 14787 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:30.403288 14879 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.388579 14792 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:30.397925 15006 consensus_queue.cc:1059] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:16:30.404623 14591 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.440869 14591 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:30.287735 15005 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.441383  7253 raft_consensus.cc:2468] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:30.443037  7255 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 20. (term mismatch)
I20260709 13:16:30.443430  7255 pending_rounds.cc:85] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 19
I20260709 13:16:30.443634  7255 pending_rounds.cc:107] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 26.20
I20260709 13:16:30.443838  7255 raft_consensus.cc:2889] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:30.405866 15004 log.cc:927] Time spent T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.385s	user 0.000s	sys 0.001s
I20260709 13:16:30.445358  7260 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:30.406540 14569 consensus_queue.cc:237] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.448647  7179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1481) took 1089 ms. Trace:
I20260709 13:16:30.407510 14963 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:30.450999 14963 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.454027 14963 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.374864 14759 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:30.455379 14893 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.455729 14759 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.457104 14893 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:30.459467 15016 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:30.424530 15018 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:30.463654 15018 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:30.424880 14945 consensus_meta.cc:287] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.708s	user 0.008s	sys 0.004s
I20260709 13:16:30.467221 14945 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:30.408682 14990 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.143s	user 0.014s	sys 0.000s
I20260709 13:16:30.409382 15017 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:16:30.411389 15010 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:16:30.471397 14945 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.449165  7179 rpcz_store.cc:276] 0709 13:16:29.359533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.361502 (+  1969us) service_pool.cc:224] Handling call
0709 13:16:29.361872 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.362226 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.362254 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.370541 (+  8287us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.645479 (+274938us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:29.668319 (+ 22840us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.668598 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.668705 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.448443 (+779738us) raft_consensus.cc:1685] finished
0709 13:16:30.448465 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.448590 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8847,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":88660,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":11690,"thread_start_us":242000,"threads_started":1,"wal-append.queue_time_us":541175}
I20260709 13:16:30.480124 15005 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:30.483469 14759 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.388652 14793 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.493259 14793 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:30.493839 14963 raft_consensus.cc:3055] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:30.411600 15007 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.413000  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 3014) took 1978 ms. Trace:
W20260709 13:16:30.413516 14930 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.058s	user 0.007s	sys 0.003s
I20260709 13:16:30.424280  7257 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:30.366415 14897 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.404383 15011 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:16:30.435658 14833 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:30.438334 14680 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 1.006s	user 0.010s	sys 0.000s
W20260709 13:16:30.499990  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.497699  7182 rpcz_store.cc:276] 0709 13:16:28.434911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.706927 (+272016us) service_pool.cc:224] Handling call
0709 13:16:28.730081 (+ 23154us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:28.733038 (+  2957us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:28.744911 (+ 11873us) log.cc:844] Serialized 14 byte log entry
0709 13:16:28.830871 (+ 85960us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:28.831516 (+   645us) log.cc:844] Serialized 52 byte log entry
0709 13:16:28.831667 (+   151us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:28.831699 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.831774 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.182174 (+1350400us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b2400175808. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece5fd59c4 00007fece5fd3acb 00007fece618edc9 00007fece618ea55 00007fece618e09d 00007fece8dc010e 00007fece8dd788c 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221
0709 13:16:30.412671 (+230497us) raft_consensus.cc:1685] finished
0709 13:16:30.412787 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.412939 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12204,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":3384,"raft.queue_time_us":18536,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":4699,"spinlock_wait_cycles":118035712,"thread_start_us":41541,"threads_started":1,"wal-append.queue_time_us":116427}
I20260709 13:16:30.509403  7261 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
W20260709 13:16:30.510988  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 238153us
W20260709 13:16:30.512156  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 248571us
I20260709 13:16:30.576126  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:30.424139 14409 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:30.415338 15019 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.495980 14344 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.779s	user 0.012s	sys 0.000s
I20260709 13:16:30.584195  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:30.572340  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:30.431152 14299 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:30.594740 15025 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:30.575915  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:30.582604  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:30.602200 15025 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.602756 15025 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:30.602849  7299 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:30.603215  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:30.604736  7336 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:16:30.605664  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:30.606217  7336 raft_consensus.cc:2376] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 30. Re-sending same reply.
I20260709 13:16:30.584280 14409 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:30.606880  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:30.607142  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:30.607618  7332 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 19.
I20260709 13:16:30.607802  7336 raft_consensus.cc:2368] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 30. Current term is 31.
I20260709 13:16:30.584939  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:30.608640  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:30.609323  7332 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:30.610247 15023 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:30.612497 15023 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:30.616629 14755 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.838s	user 0.009s	sys 0.001s
I20260709 13:16:30.617127 14755 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:30.617983 14801 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.056s	user 0.013s	sys 0.000s
W20260709 13:16:30.620533 14831 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.908s	user 0.012s	sys 0.000s
I20260709 13:16:30.621742 14831 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.598178  7184 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:30.596989  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:30.608640  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:30.600997  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:30.601971  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:30.610822 15017 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:30.598398 15019 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.598560 14344 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.611929  7332 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: []
W20260709 13:16:30.545107  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.623054 14833 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:30.568331 14930 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:30.623703 14979 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.623538 15025 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.569242 14897 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.620568 14409 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:30.669277  7181 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.005s	sys 0.010s
I20260709 13:16:30.600814  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:30.669754  7181 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.005s	sys 0.010s
I20260709 13:16:30.670312  7329 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:30.629170  7333 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:16:30.598944  7334 raft_consensus.cc:2393] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 25: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:16:30.585098 15014 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:16:30.494604 14963 raft_consensus.cc:740] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:30.583724 15007 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.639147  7299 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Timed out: RequestConsensusVote RPC to 127.5.227.132:39125 timed out after 1.825s (SENT)
I20260709 13:16:30.633246  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:30.575016 15018 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.639868  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:30.680331  7336 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:30.613646 15023 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.18, Last appended by leader: 18, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.643097  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:30.685317  7332 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:30.643277  7331 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 30. Current term is 31. Ops: [30.18-30.18]
W20260709 13:16:30.600015 14674 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.001s
I20260709 13:16:30.583405 14680 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:30.667181  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:30.688238  7327 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:30.660996 14344 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:30.625660 14528 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.713s	user 0.012s	sys 0.000s
W20260709 13:16:30.671959  7302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.000s	sys 0.015s
I20260709 13:16:30.633066 15017 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:30.675534  7184 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:30.640897 14793 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:30.678612  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:30.681991  7260 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:30.633527 15005 consensus_queue.cc:1059] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
W20260709 13:16:30.689406  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56238us
W20260709 13:16:30.761480 15009 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.489s	user 0.001s	sys 0.002s
I20260709 13:16:30.783342  7862 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:16:30.694594  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:30.686233 14753 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 1.286s	user 0.009s	sys 0.006s
W20260709 13:16:30.686591 14938 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 2.212s	user 0.016s	sys 0.000s
W20260709 13:16:30.700795  7860 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.007s	sys 0.010s
W20260709 13:16:30.819805  7860 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.008s	sys 0.010s
W20260709 13:16:30.706239  7859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.010s	sys 0.010s
W20260709 13:16:30.821089  7859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.011s	sys 0.010s
I20260709 13:16:30.821565  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:30.728353  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 361632us
I20260709 13:16:30.804176  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:30.694057 15012 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.684583 15007 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.692523 14674 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.738057 14755 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.738730 14409 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:30.741307 14992 raft_consensus.cc:3055] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:30.837177  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:30.837837  7331 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:30.743635 15025 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:30.743772 14897 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.747368 15019 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.747675 14831 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:30.750296 14792 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.845314 14299 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:30.841308 14930 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:30.829454 14787 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.846935 14930 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:30.847462 14930 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:30.694156 15026 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:16:30.729863 14963 consensus_queue.cc:260] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.849555 14963 raft_consensus.cc:3060] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:30.707434 15022 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:30.837663 14979 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:30.850924 15022 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.851430 15022 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:30.851337 14979 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.827593 14938 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.853953 14979 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.854233 14938 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.756985 14928 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:30.841475 14755 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.857065 14755 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:30.770305  7887 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:30.742383 14829 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:16:30.775506  7302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.000s	sys 0.016s
I20260709 13:16:30.777069  7332 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
W20260709 13:16:30.859859  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 919231us
I20260709 13:16:30.861599  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:30.804116  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 164998us
I20260709 13:16:30.864667  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:30.865228  7253 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:30.865410  7332 raft_consensus.cc:3060] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:30.808591  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2568) took 1526 ms. Trace:
I20260709 13:16:30.867177  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:30.809342  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:30.810082  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:30.868988  7262 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 27.
I20260709 13:16:30.870167  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:30.811182  7257 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:16:30.812213  7259 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:16:30.812728  7336 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:30.816555 14879 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:16:30.829833  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:30.829698  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46518.5us
I20260709 13:16:30.836105  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:30.875311  7330 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:30.839675  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:30.826721 14893 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:30.802616 15017 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:30.847313 14787 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:30.866192  7258 rpcz_store.cc:276] 0709 13:16:29.281708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.281841 (+   133us) service_pool.cc:224] Handling call
0709 13:16:30.808372 (+1526531us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b5400125a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:30.808526 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171710336}
I20260709 13:16:30.893409  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:30.894158  7896 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:30.834115 14793 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:30.833952 14344 raft_consensus.cc:3055] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:30.899722  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:30.847577 14792 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:30.837561 14992 raft_consensus.cc:740] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:30.905583  7152 leader_election.cc:400] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 19. Current term is 20.
I20260709 13:16:30.916567  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:30.901602  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:30.898476  7255 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 27.
W20260709 13:16:30.916980  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 95535.6us
I20260709 13:16:30.878752  7332 raft_consensus.cc:2468] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:30.934994  7184 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:16:30.935544  7184 pending_rounds.cc:85] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 11
I20260709 13:16:30.935811  7184 pending_rounds.cc:107] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:16:30.936088  7184 raft_consensus.cc:2889] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:30.883292 15009 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:30.936965  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:30.919384  7892 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
I20260709 13:16:30.939770  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:30.940445  7183 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:30.951793  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:30.953703  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:30.953963  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:30.961151  7185 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:30.961596  7179 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:30.885229 15019 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.963876  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:30.965229  7179 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:30.966127  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 104156us
I20260709 13:16:30.901233 15035 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.901033 15028 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.969573  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:30.903817 14948 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.903048 15032 raft_consensus.cc:2804] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:30.974249  7888 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:30.978021  7178 raft_consensus.cc:2393] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 27: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:30.978458  7182 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: [21.16-21.16]
W20260709 13:16:30.973505  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 99733.3us
I20260709 13:16:30.918227 14344 raft_consensus.cc:740] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:30.924775 15025 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:30.990514  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:30.996330  7894 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:30.891489 14879 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.006047  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:30.917765 15023 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 13:16:31.006920  7336 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:30.998152 15033 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:30.996259  7331 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:16:31.020031  7178 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:16:31.024307  7330 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:31.024645  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:31.004669  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:31.028833  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:31.039975  7336 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:31.045082  7185 raft_consensus.cc:2410] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 25 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:16:31.043807  7894 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
W20260709 13:16:31.002529  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48892.6us
I20260709 13:16:30.971922 15019 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.054610  7896 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:16:31.059401  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:31.060377  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:31.065143  7185 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:16:31.068046  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:31.070943 15051 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:31.071538 15051 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:31.071938 15051 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:31.073410 14755 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:30.994895 14948 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.076161 14948 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:31.076359 15045 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:30.980512 15035 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.078763 15049 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:31.079090 15035 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:31.079535 15049 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:30.830935 15012 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.080488 15049 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.083068  7333 raft_consensus.cc:2410] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:16:31.083695 14787 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:31.084769 15046 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:16:31.086719 15043 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:16:31.025987 14793 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.090603 15052 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:31.093339 15019 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.094165 15019 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.098359 14674 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:31.099116  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.032253 15033 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.101524 15007 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.014397 14992 consensus_queue.cc:260] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:31.104463  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.104956 14992 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:31.106791 14801 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.107530 15037 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.107440 14801 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.107981 15020 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:31.026163 14753 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:31.108168 15037 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.108829 14753 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.030858 14893 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:16:31.059140 14344 consensus_queue.cc:260] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.111131 14753 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:31.108342  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.111845 14344 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:31.112478  7225 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:31.007037 15025 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.113590 14803 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:31.048231 14938 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:31.115118 14938 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:31.116534  7261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2574) took 1817 ms (client timeout 2160 ms). Trace:
I20260709 13:16:31.116314 14938 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:31.117110  7261 rpcz_store.cc:269] 0709 13:16:29.299122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.299395 (+   273us) service_pool.cc:224] Handling call
0709 13:16:31.116262 (+1816867us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400057b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:31.116451 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2699371392}
I20260709 13:16:30.989954 15028 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.124472  7895 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:31.127349  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:31.132836  7331 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 28 because replica has last-logged OpId of term: 26 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 13.
I20260709 13:16:31.139125  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.139564  7261 raft_consensus.cc:1240] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:31.141546  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:31.142762  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:31.142820  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:31.146409  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.147374  7255 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:31.148451  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:31.148818  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.149693  7255 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:31.098191  7179 raft_consensus.cc:2410] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:16:31.098050 14299 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:16:31.066895 14759 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:31.156288  7859 leader_election.cc:400] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 30. Current term is 31.
I20260709 13:16:31.157778  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.103119 15023 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:31.162833  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:31.164655  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.134207 15007 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.170456  7258 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 27.
I20260709 13:16:31.048163 15050 consensus_queue.cc:1059] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.137s
I20260709 13:16:31.178850  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.167069  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.236295  7258 raft_consensus.cc:2468] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
W20260709 13:16:31.175410  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.236944 15032 raft_consensus.cc:697] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:31.237998 15032 consensus_queue.cc:237] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.239584  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1488) took 1433 ms. Trace:
I20260709 13:16:31.240041  7181 rpcz_store.cc:276] 0709 13:16:29.806696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.806967 (+   271us) service_pool.cc:224] Handling call
0709 13:16:29.920103 (+113136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.670187 (+750084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.670223 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:30.690252 (+ 20029us) log.cc:844] Serialized 26 byte log entry
0709 13:16:30.831789 (+141537us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:16:30.831826 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.239143 (+407317us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b540017e154. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:31.239191 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.239245 (+    54us) raft_consensus.cc:1685] finished
0709 13:16:31.239260 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.239515 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27103,"raft.queue_time_us":164745,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":5609,"spinlock_wait_cycles":171457408,"thread_start_us":741763,"threads_started":2,"wal-append.queue_time_us":235077}
I20260709 13:16:31.103077 15017 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.179699 14759 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:31.242543 14759 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.243510 15017 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:31.245195 14569 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:16:31.180346  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 112364us
I20260709 13:16:31.247541  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:31.248358  7301 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:31.159271 14801 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.181255 15055 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:31.173298  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:31.249447 14833 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:31.190826 15038 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:16:31.250128  7179 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:31.192286 14778 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:31.200764 15034 consensus_queue.cc:1059] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:31.203513  7150 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:31.251861 14569 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:16:31.252105  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 48680.6us
I20260709 13:16:31.252849  7150 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:16:31.203539 15047 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:16:31.205221  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:31.206467  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:31.211331 15028 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:31.212546 14796 raft_consensus.cc:3055] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:31.213229 15050 raft_consensus.cc:3055] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:31.214180 15025 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.143128 14831 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:16:31.136853 14674 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.078s
I20260709 13:16:31.220911 15007 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:31.216117 15001 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.230s	user 0.004s	sys 0.000s
W20260709 13:16:31.217352  7887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 1071) took 1790 ms (client timeout 2139 ms). Trace:
I20260709 13:16:31.219295  7890 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:16:31.219635  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:31.144905 14948 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:31.161283 15021 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:16:31.141640 15019 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.212595 14879 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.236323  7261 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 27.
W20260709 13:16:31.284129 15045 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:16:31.173929  7256 raft_consensus.cc:1240] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:31.249698 14893 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:16:31.242537  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:31.312361  7181 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 25.
W20260709 13:16:31.248798  7152 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.701s (SENT) [suppressed 19 similar messages]
I20260709 13:16:31.253644  7179 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:16:31.199292 14736 consensus_queue.cc:1059] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:16:31.254271  7187 raft_consensus.cc:2410] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 25 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:16:31.255862  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:31.255025  7186 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 15.
I20260709 13:16:31.255594  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.261066  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:31.188577 15003 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.150s	user 0.001s	sys 0.001s
I20260709 13:16:31.263412  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.253785  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:31.326330  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 72617.6us
I20260709 13:16:31.285660 15050 raft_consensus.cc:740] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:31.284339 14344 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:16:31.298589  7887 rpcz_store.cc:269] 0709 13:16:29.427443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.427625 (+   182us) service_pool.cc:224] Handling call
0709 13:16:31.217054 (+1789429us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000bc7d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:31.217256 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2918693632}
I20260709 13:16:31.290833 14796 raft_consensus.cc:740] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:31.300050  7180 raft_consensus.cc:2410] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 23 because replica has last-logged OpId of term: 20 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:16:31.332816  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:31.334013  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.259697 15006 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:31.311110  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:31.329119  7253 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:31.338478  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2664) took 2001 ms. Trace:
I20260709 13:16:31.338992  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:31.274612  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.342207  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.335186  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:31.305676 14948 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:31.313700 14893 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.288414 15028 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:16:31.340802  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:31.340659  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 84908.4us
I20260709 13:16:31.338927  7328 rpcz_store.cc:276] 0709 13:16:29.336991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.337387 (+   396us) service_pool.cc:224] Handling call
0709 13:16:29.337898 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.338529 (+   631us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:29.338579 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.339265 (+   686us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.643915 (+304650us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:29.643968 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.644058 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.215194 (+1571136us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:31.338199 (+123005us) raft_consensus.cc:1685] finished
0709 13:16:31.338221 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.338417 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":6981,"spinlock_wait_cycles":66954112,"thread_start_us":304163,"threads_started":1,"wal-append.queue_time_us":473724}
I20260709 13:16:31.330935  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:31.286746  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 316708us
I20260709 13:16:31.347020  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.360000  7255 raft_consensus.cc:2393] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:31.360508  7253 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 24: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:16:31.363603  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.358412  7256 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
I20260709 13:16:31.337117 14879 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:31.365613  7256 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:16:31.350489  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 171409us
I20260709 13:16:31.332913 15021 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:31.371932  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:31.372452  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.373064  7256 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:31.376612  7859 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:31.380920  7859 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:31.352784 14962 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:31.347345 14344 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:31.337384 14831 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:16:31.359043 14893 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:31.318229 15022 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:31.365046 14928 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.509s	user 0.013s	sys 0.000s
I20260709 13:16:31.356528 14927 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:31.412338  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:31.386854 14968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.395s	user 0.009s	sys 0.007s
I20260709 13:16:31.369520 14879 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.366991 15006 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:31.348981 14987 consensus_queue.cc:1059] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:16:31.421922  7186 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:31.388375 14947 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:31.406471  7184 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:31.348644 14569 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:16:31.416286  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:31.429776  7182 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
W20260709 13:16:31.417819 14968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.009s	sys 0.008s
I20260709 13:16:31.401924 14962 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.412318 14552 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.525440  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 75979.6us
I20260709 13:16:31.415817 14637 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.413897  7256 raft_consensus.cc:2410] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 28 because replica has last-logged OpId of term: 26 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 13.
I20260709 13:16:31.402868 15026 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.411160 15017 consensus_queue.cc:1048] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.051s
W20260709 13:16:31.430282  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49453.9us
I20260709 13:16:31.431813  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1605) took 1127 ms. Trace:
I20260709 13:16:31.433089  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 1076) took 1993 ms. Trace:
I20260709 13:16:31.434435  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.440395 15032 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:31.444203 14344 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.382910 14736 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 13:16:31.417485 14927 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:31.533109  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 284302us
I20260709 13:16:31.421916 14801 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:31.596339  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:31.424083 14879 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:31.604344  7889 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 21 index: 19. (index mismatch)
I20260709 13:16:31.557878 14928 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.416975  7181 raft_consensus.cc:1275] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:16:31.574523  7260 rpcz_store.cc:276] 0709 13:16:30.304230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.446102 (+141872us) service_pool.cc:224] Handling call
0709 13:16:30.446436 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.788567 (+342131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.431461 (+642894us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540009abd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:31.431720 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541130112}
I20260709 13:16:31.575165  7890 rpcz_store.cc:276] 0709 13:16:29.439571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.439716 (+   145us) service_pool.cc:224] Handling call
0709 13:16:31.218785 (+1779069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.298947 (+ 80162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.432797 (+133850us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54000bc7d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:31.433009 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4090566528}
I20260709 13:16:31.583978  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:31.585289  7887 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:16:31.585774  7861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.018s	sys 0.036s
I20260709 13:16:31.544431 14987 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.528525 14947 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:31.529443 14968 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 31 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:31.541224 14962 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:31.415887 14948 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.593591  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2675) took 1452 ms. Trace:
I20260709 13:16:31.594375  7228 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:31.648025  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53739.1us
I20260709 13:16:31.595413  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:31.595739  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.595952  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:31.650453  7896 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
I20260709 13:16:31.650815  7182 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 24: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:31.542510  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:31.557631 14833 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.546896 14569 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.598474  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:31.604813 15071 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.657827  7894 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:31.601953  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:31.610805  7861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.019s	sys 0.036s
I20260709 13:16:31.612146  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:31.596727 14801 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:31.568346 14793 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:31.620034  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 3994) took 1326 ms. Trace:
I20260709 13:16:31.667644  7259 rpcz_store.cc:276] 0709 13:16:30.293401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.294819 (+  1418us) service_pool.cc:224] Handling call
0709 13:16:30.811964 (+517145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.871693 (+ 59729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.619502 (+747809us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b5400125a50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:31.619951 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188539136}
I20260709 13:16:31.613548 15032 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:31.697687  7894 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:31.616305  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:31.701584  7891 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:31.404341 15050 consensus_queue.cc:260] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.639469  7328 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:31.641443  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:31.610747 14930 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.763s	user 0.014s	sys 0.000s
W20260709 13:16:31.654692  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 112311us
I20260709 13:16:31.651865  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:31.659351  7333 raft_consensus.cc:2410] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 27 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 13:16:31.569516 14552 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.442814 15006 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.645148  7335 rpcz_store.cc:276] 0709 13:16:30.140828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.141022 (+   194us) service_pool.cc:224] Handling call
0709 13:16:30.141601 (+   579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.375671 (+234070us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:30.727790 (+352119us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.367802 (+640012us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.368505 (+   703us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.368701 (+   196us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:31.368752 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.368851 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.593305 (+224454us) raft_consensus.cc:1685] finished
0709 13:16:31.593330 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.593520 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13274,"prepare.queue_time_us":320022,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":360337,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":233,"thread_start_us":1073254,"threads_started":4,"wal-append.queue_time_us":287450}
W20260709 13:16:31.708833  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.574890 14637 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.664094  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:31.659082  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 663500us
I20260709 13:16:31.738193  7182 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 27.
I20260709 13:16:31.739490  7861 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:31.739698  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:31.577642 15026 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.621637  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:31.668807 14569 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.668938 14897 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:16:31.683470 15019 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.684291 15007 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.683844 15067 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:16:31.660660 14528 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:31.685030 14968 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.664217 14833 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.674937 14793 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.687377 14759 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.693367 14992 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.001s
I20260709 13:16:31.694847 14801 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.687588 15071 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.703482  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:31.704326  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52564.5us
I20260709 13:16:31.834677  7332 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:31.835103  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:31.836802  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:31.745154 14736 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 13:16:31.813977 14528 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:31.749131  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.698005 15062 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.135s
I20260709 13:16:31.635897 14987 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:31.806107  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 184560us
I20260709 13:16:31.853581  7225 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:31.582762 15021 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.709220 14963 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:31.709998 15028 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:31.710158 14930 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.803030 14843 raft_consensus.cc:3055] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:31.615537  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:31.809839 14897 consensus_queue.cc:1243] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 23.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:16:31.758332 15063 raft_consensus.cc:2804] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:31.708096  7299 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:31.843493 15020 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:31.817258 15050 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:31.623224 14928 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.759840 15023 consensus_queue.cc:1059] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:16:31.850926 14801 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:31.827251 15019 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.028s
I20260709 13:16:31.832404 14759 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.852028 14528 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:31.933288 15085 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:31.933883 15085 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.936088 15085 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:31.933282 14552 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:31.936101 15071 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:31.810106 14831 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:31.938478  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:31.859900 14927 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.940692  7891 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:16:31.941305 14927 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:31.858328 14963 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.942082 15063 raft_consensus.cc:697] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:31.942296  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:31.943197 15063 consensus_queue.cc:237] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.944643  7891 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:31.946161  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:31.947224 15075 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:16:31.948468  7891 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: [19.15-21.16]
I20260709 13:16:31.948055 14962 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.856398 15022 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:31.859549 15057 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.959388 15057 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.820204 14947 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:31.912554 15068 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:16:31.913262 14569 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.913801 15026 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.915019 14833 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:31.916630 14930 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.905961 14987 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:31.919505 15051 consensus_meta.cc:287] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.847s	user 0.009s	sys 0.002s
I20260709 13:16:31.970304 15051 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.972150 14962 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:31.931946 14680 raft_consensus.cc:3055] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:31.975102 14680 raft_consensus.cc:740] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:31.976583  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.976289 14680 consensus_queue.cc:260] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:31.932456 15069 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:16:31.932550 14759 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:31.866076 15049 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:31.929318 14893 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.984654 14893 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:31.950218  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:31.857839 15025 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:31.951349  7862 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:31.985735 15025 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.986199 15025 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:31.987495 15057 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.951633 14793 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.952929  7894 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 23. Current term is 24. Ops: [21.15-23.16]
I20260709 13:16:31.859056 15032 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:31.908175 15020 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.955485 15071 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:31.997099 15071 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 27 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:31.998589 15071 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:31.999675 15025 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.003180 15020 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.956969 14928 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.942363 14963 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:31.972781 15051 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:31.864082 14843 raft_consensus.cc:740] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:32.007962 14843 consensus_queue.cc:260] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.009344 14843 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:32.008677 15025 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.973609 14879 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.016741 14879 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:31.988493 15057 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:32.024026 15057 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.024622 15057 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:32.090468  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 340889us
I20260709 13:16:32.092871  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:31.861889  7178 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:32.095934  7179 raft_consensus.cc:2393] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 22: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:31.868249  7181 raft_consensus.cc:2393] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:31.843815  7182 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:32.099529  7183 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:32.101649  7181 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:16:32.104563  7187 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:16:32.106330  7187 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: []
W20260709 13:16:32.098429  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 261587us
I20260709 13:16:32.112543  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:32.112938  7187 raft_consensus.cc:1240] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:32.116242  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:32.118980  7187 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:16:31.868621  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 219185us
I20260709 13:16:32.127193  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:32.136189  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:32.137156  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.139483  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:31.834372  7258 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
W20260709 13:16:31.884755  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 176731us
I20260709 13:16:31.890141  7327 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:31.890750  7328 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:31.907189  7329 raft_consensus.cc:1240] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26. Ops: []
I20260709 13:16:31.897192  7330 raft_consensus.cc:1240] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:32.329906  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:32.330436  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:31.895313  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:32.334856  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 195673us
I20260709 13:16:32.336836  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:31.892182  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:32.340658  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:31.888299  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:32.345386  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:31.893787  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:32.351814  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:32.136751  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 3026) took 1170 ms. Trace:
I20260709 13:16:32.175086 14928 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:32.357009 14928 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:32.176786 14962 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.332173 14930 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:16:32.359292 14962 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.353370  7336 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:16:32.361284 15057 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.178723 15022 raft_consensus.cc:2804] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:16:32.179440  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 437491us
I20260709 13:16:32.185143  7257 raft_consensus.cc:1240] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:16:32.185977  7254 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 31 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 30. Current term is 31. Ops: [30.18-30.18]
I20260709 13:16:32.190326 14528 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.204134 14759 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.211308  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 3033) took 1007 ms. Trace:
I20260709 13:16:32.219427 14299 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:32.223834 14833 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:32.225696 15023 raft_consensus.cc:3055] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:32.388656 15023 raft_consensus.cc:740] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:32.390746 15023 consensus_queue.cc:260] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.207039 14879 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:32.207959 14758 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:16:32.279397 15084 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:32.399937 15084 consensus_queue.cc:1243] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d log is divergent from this leader: its last log entry 24.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:16:32.401213 15037 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:32.401413 14972 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:32.279480  7334 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:32.403062  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:32.403470 15012 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:32.404819  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:32.406869 14759 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.409518 15061 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 13:16:32.410097 15061 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:32.406913 14299 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:32.418916  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:32.422086  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:32.423183  7185 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:32.428930 14948 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:32.431463  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:32.433041  7179 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 27 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 13.
I20260709 13:16:32.435245 15015 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:32.435971 15023 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:32.437327 15106 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 13:16:32.362534 14962 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:32.439728  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 102672us
I20260709 13:16:32.441043  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:32.442406 15066 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:32.443025 15066 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:32.443392 14528 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:32.300390  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 415841us
I20260709 13:16:32.446718  7184 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:32.444461 15066 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:32.303315  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.450452  7179 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:32.303059 15006 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:32.452970 15085 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:16:32.453701 15006 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:32.454196 15006 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:32.454316 15085 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:32.454828 15057 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:32.308604  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:32.456329 14938 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:32.463341  7327 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 26: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:32.463685  7336 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:32.309791 14344 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.466027 14344 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.456521  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:32.467641  7184 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 26: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:16:32.317574  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.454876 15085 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:32.471653 15085 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.320308 14945 raft_consensus.cc:3055] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:32.472824  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:32.474561 15007 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:32.478109 15028 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.478870 15085 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:32.458582 14930 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:32.483384 14930 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:32.473227 14945 raft_consensus.cc:740] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:32.487056 14897 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.488247 14897 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.492300 14897 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:32.500285 15061 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.18, Last appended by leader: 18, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.502005 15061 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Advancing to term 31
W20260709 13:16:32.328249  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 474604us
I20260709 13:16:32.376889  7178 rpcz_store.cc:276] 0709 13:16:31.203988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.204338 (+   350us) service_pool.cc:224] Handling call
0709 13:16:31.204696 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.095773 (+891077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.210678 (+114905us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b5400118354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:32.211068 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1510790528}
W20260709 13:16:32.506541  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.515584 14680 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:32.519320  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:32.521756 15098 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 13:16:32.523114  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50513.6us
I20260709 13:16:32.478927 15028 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:32.460438  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:32.525275  7253 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 27 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 13.
I20260709 13:16:32.459482  7262 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:32.523677  7184 pending_rounds.cc:85] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 11
I20260709 13:16:32.527086  7184 pending_rounds.cc:107] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:16:32.527432  7184 raft_consensus.cc:2889] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.435967 15015 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:16:32.528411 15078 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.650s	user 0.002s	sys 0.000s
I20260709 13:16:32.529178 15015 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.513429  7861 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:32.532742 15092 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:32.534348  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 4013) took 1186 ms. Trace:
I20260709 13:16:32.523701  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:32.341763  7333 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 16.
I20260709 13:16:32.348201  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:32.349300  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:32.515008  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1599) took 2219 ms. Trace:
I20260709 13:16:32.346763  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:32.334221  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:32.358126 14928 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.374257 15022 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:32.555234 15022 raft_consensus.cc:3060] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:32.393869 14833 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.555675  7327 raft_consensus.cc:1275] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:16:32.449525 15066 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:32.398797 14879 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:32.418295  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 4011) took 1144 ms. Trace:
I20260709 13:16:32.485888 14945 consensus_queue.cc:260] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.178331 14843 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:32.355305  7183 rpcz_store.cc:276] 0709 13:16:30.966415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.966583 (+   168us) service_pool.cc:224] Handling call
0709 13:16:30.967069 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.100448 (+1133379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.136133 (+ 35685us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002c4554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:32.136527 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2602626304}
I20260709 13:16:32.547039  7331 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:32.560622  7258 rpcz_store.cc:276] 0709 13:16:31.273629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.333796 (+ 60167us) service_pool.cc:224] Handling call
0709 13:16:32.417729 (+1083933us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54002274d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:32.418014 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149331712}
I20260709 13:16:32.585405  7185 raft_consensus.cc:2468] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 28.
I20260709 13:16:32.525306  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:32.462399  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 4008) took 1189 ms. Trace:
W20260709 13:16:32.545755  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.298985  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:32.542382  7254 rpcz_store.cc:276] 0709 13:16:30.295369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.414771 (+119402us) service_pool.cc:224] Handling call
0709 13:16:30.415223 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.513511 (+2098288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.514462 (+   951us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54001a2554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:32.514821 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4070437760}
I20260709 13:16:32.560510  7328 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:32.424629 14796 consensus_queue.cc:260] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.535051 14950 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
W20260709 13:16:32.595161  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.596758  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:32.543383 15015 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:32.558526 14833 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:32.559562 15019 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 13:16:32.602658 15019 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:16:32.602844 15021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.009s	sys 0.026s
I20260709 13:16:32.603245 15019 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:32.603502 15021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.009s	sys 0.026s
I20260709 13:16:32.604547 15019 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.606256 15019 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:32.616074  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:32.608938 15104 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.413260 14299 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.398311 15033 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:32.615789  7332 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:32.588470  7257 rpcz_store.cc:276] 0709 13:16:31.272648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.345363 (+ 72715us) service_pool.cc:224] Handling call
0709 13:16:31.345776 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.404682 (+1058906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.461991 (+ 57309us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54002f7454. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:32.462297 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872171392}
I20260709 13:16:32.541236 14528 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
W20260709 13:16:32.606906  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.620810  7333 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:16:32.617729  7260 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 21 index: 19. (index mismatch)
I20260709 13:16:32.616576  7336 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:16:32.534862  7261 rpcz_store.cc:276] 0709 13:16:31.347700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.372942 (+ 25242us) service_pool.cc:224] Handling call
0709 13:16:31.374041 (+  1099us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:31.374442 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.374477 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:31.379166 (+  4689us) log.cc:844] Serialized 52 byte log entry
0709 13:16:31.711111 (+331945us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:31.711400 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.711832 (+   432us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.527444 (+815612us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:32.533768 (+  6324us) raft_consensus.cc:1685] finished
0709 13:16:32.533796 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.534175 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2820,"raft.queue_time_us":3895,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":21336,"spinlock_wait_cycles":17134720,"thread_start_us":282735,"threads_started":1,"wal-append.queue_time_us":417112}
I20260709 13:16:32.547508 14759 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:32.618695 14928 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:32.614151 15051 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.595052 14950 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:16:32.669395  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 55001.7us
W20260709 13:16:32.620674  7081 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 154) took 94585 ms (client timeout 15000 ms). Trace:
I20260709 13:16:32.629658 15102 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:32.630826 15059 consensus_queue.cc:1048] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:32.610023 15056 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.634121 15067 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:32.667069  7330 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:32.695729 15067 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.697587  7332 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:16:32.669831 14950 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:32.679167 15104 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.576555 14879 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:32.680269 14552 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.704066  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:32.687366 14945 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:32.688529  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 163289us
I20260709 13:16:32.691236 14793 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:32.691929 15051 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:32.693511  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.693723 15062 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:32.694454 15056 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:32.699321  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 400917us
I20260709 13:16:32.679343 14843 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.701231  7335 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
I20260709 13:16:32.675226 15102 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:32.725871  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:32.727346  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:32.728183  7336 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
W20260709 13:16:32.737860  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.718343 15062 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:32.745904  7256 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:32.753883 14552 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.759402  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:32.760273  7888 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:32.760597 14963 consensus_meta.cc:287] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.710s	user 0.002s	sys 0.020s
I20260709 13:16:32.761204  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:32.761813  7225 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:32.762530  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:32.763425  7892 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 26: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:32.766857 15025 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.767772 15025 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.770462 14990 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.771116 15051 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:32.771315 14990 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.772964 14528 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:32.773418 14528 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:32.773975 14990 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:32.776439 15022 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.782727  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:32.783002  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:32.783937  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:32.785018  7257 raft_consensus.cc:2410] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 27 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 13:16:32.790309  7888 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:32.732349  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:32.794277  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 117247us
I20260709 13:16:32.795500  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:32.761199 14963 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.752740 15062 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:32.798583 15059 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:32.798998  7181 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:32.800578  7301 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:32.801364  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 3791) took 1402 ms. Trace:
I20260709 13:16:32.802127  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:32.802956  7894 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
W20260709 13:16:32.803740 15063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.017s	sys 0.004s
I20260709 13:16:32.803642  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:32.804239 15063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.017s	sys 0.004s
W20260709 13:16:32.805307  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 128945us
I20260709 13:16:32.805758 14968 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:32.806749 14968 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:32.807184  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:32.808091 15104 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:32.808881 15104 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:32.810194 14674 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:32.760640  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:32.793071  7889 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:16:32.733337 15067 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:32.728892 15102 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:32.751935  7329 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 30.
I20260709 13:16:32.810938  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:32.801793  7181 rpcz_store.cc:276] 0709 13:16:31.398619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.102940 (+704321us) service_pool.cc:224] Handling call
0709 13:16:32.103513 (+   573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.799422 (+695909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.801113 (+  1691us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b540039d5d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:32.801304 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599005056}
I20260709 13:16:32.807987 14968 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:32.794822 15028 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:32.846135  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.815483 14796 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:32.819626 14938 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:32.856597  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.810904 14674 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:32.812896 14893 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:16:32.872642  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.814711 15037 consensus_queue.cc:1048] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:16:32.810577 15104 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:32.876744  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:32.811709 14833 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:32.889430  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:32.896806  7887 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:16:32.899982  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:32.901221 14962 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.839635 14793 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:32.901937  7889 raft_consensus.cc:2410] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:16:32.862319 14637 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:32.774470 14528 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.919396  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:32.910652  7257 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:16:32.872682 14972 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:32.877556 15022 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:32.912096  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 111596us
I20260709 13:16:32.872262 15007 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:32.920686  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 178788us
I20260709 13:16:32.819504 14930 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.754788 14950 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:32.875150 14893 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:32.906349 14928 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:32.951695  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:32.918123 15104 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.922920 14972 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.923409 14963 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:32.966240  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:32.986232  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.970431  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:32.976325 14974 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:32.964847 14972 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:33.002810  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:33.002913 14950 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:32.991082 14833 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.021s
W20260709 13:16:32.670333  7081 rpcz_store.cc:269] 0709 13:14:58.035314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.076075 (+ 40761us) service_pool.cc:224] Handling call
0709 13:16:32.620254 (+94544179us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:23.509034 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:23.571443 (+ 62409us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:23.571504 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:16:23.571524 (+    20us) tablet.cc:662] Decoding operations
0709 13:16:23.571993 (+   469us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:23.572100 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:23.572139 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:23.572493 (+   354us) tablet.cc:701] Row locks acquired
0709 13:16:23.572539 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:16:23.572769 (+   230us) write_op.cc:270] Start()
0709 13:16:23.572929 (+   160us) write_op.cc:276] Timestamp: P: 1783602983572681 usec, L: 0
0709 13:16:23.572971 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:16:23.643774 (+ 70803us) log.cc:844] Serialized 599 byte log entry
0709 13:16:23.985811 (+342037us) spinlock_profiling.cc:243] Waited 69.9 ms on lock 0x7b54000aa354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9237e28 00007fececc72581 00007fececc71d58 00007fececc769f1 00007fececc769a9 00007fececc76939 00007fececc76901 00007fececc75b2d 000000000038f354 000000000038f199
0709 13:16:24.857432 (+871621us) op_driver.cc:464] REPLICATION: finished
0709 13:16:25.476702 (+619270us) write_op.cc:301] APPLY: starting
0709 13:16:25.476810 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:25.478478 (+  1668us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:25.478519 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:25.531271 (+ 52752us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:25.587725 (+ 56454us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:16:25.600738 (+ 13013us) write_op.cc:312] APPLY: finished
0709 13:16:25.622123 (+ 21385us) log.cc:844] Serialized 25 byte log entry
0709 13:16:25.677110 (+ 54987us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:25.677207 (+    97us) write_op.cc:454] Released schema lock
0709 13:16:25.677280 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:25.677732 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:25.677771 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4119402,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":618864,"apply.run_cpu_time_us":16483,"apply.run_wall_time_us":201021,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":509150,"prepare.run_cpu_time_us":70825,"prepare.run_wall_time_us":520865,"raft.queue_time_us":558529,"raft.run_cpu_time_us":128267,"raft.run_wall_time_us":261834,"replication_time_us":1284173,"spinlock_wait_cycles":160719616,"thread_start_us":1136989,"threads_started":5,"wal-append.queue_time_us":518886,"wal-append.run_cpu_time_us":13255,"wal-append.run_wall_time_us":2541500}]]}
I20260709 13:16:33.019119 15056 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:32.925494 14793 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:32.967347 15104 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:33.029785  7331 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:33.022986  7894 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:16:32.998304 15006 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.543s	user 0.016s	sys 0.000s
W20260709 13:16:33.041611  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 119312us
I20260709 13:16:33.045709  7334 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:32.977283 14552 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:33.052578  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.977851 15025 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:33.062724 14344 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:33.083398  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.084126  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.021862 14928 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:16:33.064445  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.065454  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 87256.5us
I20260709 13:16:33.067129  7896 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:16:33.076015  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 130425us
I20260709 13:16:32.968187 14962 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.063679 14833 consensus_queue.cc:1059] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:33.111495  7256 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:33.136595  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:33.137224  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.062244 14793 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:33.152108  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 108963us
I20260709 13:16:33.047240 14974 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:33.162129  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:33.128652  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:33.082099 15085 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:33.194819  7253 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
W20260709 13:16:33.198426  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 391378us
I20260709 13:16:33.149137 15066 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:33.199381  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:33.180613 15061 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.677s	user 0.014s	sys 0.002s
I20260709 13:16:33.205464  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:33.196802  7150 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:16:33.208473  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.055011 15006 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:33.210155  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 259509us
I20260709 13:16:33.182658 14843 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:33.203558 14948 consensus_meta.cc:287] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.774s	user 0.011s	sys 0.007s
I20260709 13:16:33.208294  7255 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 17.
W20260709 13:16:33.231057  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 224685us
I20260709 13:16:33.202900 15066 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.203992 14552 raft_consensus.cc:3055] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:16:33.244447  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 91488us
I20260709 13:16:33.244004  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:33.210598 15051 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.254179  7888 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:16:33.252409  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:33.076316 14674 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.251650  7253 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 27.
I20260709 13:16:33.192785 15062 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:33.266198  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.290256  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:33.247008 15012 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.007s	sys 0.022s
I20260709 13:16:33.292505  7331 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:16:33.296078  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:33.297072  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69389.7us
I20260709 13:16:33.301009  7335 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:16:33.303274  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50983.9us
W20260709 13:16:33.304239  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.227648 14833 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.297035  7258 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:33.306699  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:33.307551  7255 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:33.254884 15066 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:33.253811 14552 raft_consensus.cc:740] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:33.314878  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2740) took 1083 ms. Trace:
I20260709 13:16:33.310328  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:33.311739  7894 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:16:33.267081 14930 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:33.326284 14833 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.327515  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:33.329236 15111 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260709 13:16:33.264998 14928 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:33.326813  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:33.299592 15012 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.007s	sys 0.023s
I20260709 13:16:33.320150  7333 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:33.341320  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:33.321453  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:33.314528 15019 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.001s
I20260709 13:16:33.334357  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:33.370908  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 179278us
I20260709 13:16:33.369791  7150 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:33.317487 14759 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:33.292196 15025 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 13:16:33.321236 14793 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:16:33.355566 15109 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.160s	user 0.000s	sys 0.002s
W20260709 13:16:33.418529  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.292487 14344 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.074s
W20260709 13:16:33.368788  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 155553us
I20260709 13:16:33.369987  7332 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
W20260709 13:16:33.355654 15108 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.280s	user 0.001s	sys 0.001s
I20260709 13:16:33.301227 14963 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:16:33.417413  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:33.330854 15007 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
W20260709 13:16:33.435073  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 69037.2us
I20260709 13:16:33.369902 14796 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.455204 14796 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.455904 14833 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:33.364744 15067 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.458905  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 4020) took 1005 ms. Trace:
I20260709 13:16:33.215843 14893 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.424175  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:33.459394  7256 rpcz_store.cc:276] 0709 13:16:32.453270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.518649 (+ 65379us) service_pool.cc:224] Handling call
0709 13:16:33.458513 (+939864us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540034b2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:33.458675 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518662912}
I20260709 13:16:33.460211 14893 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:33.460944  7260 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:33.370034 14938 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.093s
I20260709 13:16:33.462800 15035 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.463534 15035 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.459394 14962 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:33.379613 15054 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.465183 15054 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:33.466182 15035 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:33.338965 15059 consensus_queue.cc:1059] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
I20260709 13:16:33.440923 15101 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:16:33.444602 14945 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.730s	user 0.006s	sys 0.006s
W20260709 13:16:33.444973 15112 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.396s	user 0.000s	sys 0.002s
W20260709 13:16:33.421232  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.439500  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:33.490444  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51870us
I20260709 13:16:33.319617  7327 rpcz_store.cc:276] 0709 13:16:32.221142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.556814 (+335672us) service_pool.cc:224] Handling call
0709 13:16:32.557485 (+   671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.558116 (+   631us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:16:33.009214 (+451098us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b18004baf60. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fececc343c7 00007fece92469a7 00007fece92560bf
0709 13:16:33.009451 (+   237us) log.cc:844] Serialized 14 byte log entry
0709 13:16:33.295225 (+285774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.295298 (+    73us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:33.303881 (+  8583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.303969 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.304106 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15437,"prepare.queue_time_us":311125,"prepare.run_cpu_time_us":262,"prepare.run_wall_time_us":13809,"raft.queue_time_us":61454,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":10965,"spinlock_wait_cycles":6074752,"thread_start_us":533735,"threads_started":2}
I20260709 13:16:33.467209  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:33.492214  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55732.1us
W20260709 13:16:33.468302  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.472564  7895 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
W20260709 13:16:33.473536  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.475270  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:33.332069 15051 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:33.458438 14796 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:33.482060  7328 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.803s	user 0.012s	sys 0.002s
W20260709 13:16:33.495855 15109 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:16:33.497638 15006 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:33.485615 15101 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.499737 15062 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:33.499310 14552 consensus_queue.cc:260] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.500777  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:33.435863 14299 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.506705  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.418126 14793 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.508798  7894 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:33.513335  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:33.515511  7328 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:33.464013 15007 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:16:33.538787 15059 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:33.512070 14637 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:16:33.474160 14974 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:33.563462  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 186976us
I20260709 13:16:33.502924 15056 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:16:33.555346  7891 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.004s
I20260709 13:16:33.508136 14833 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.525363 14928 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:16:33.528693 15102 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.002s
I20260709 13:16:33.525743 15101 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:33.459193 15067 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.564862  7891 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
W20260709 13:16:33.568130  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 76691.3us
I20260709 13:16:33.575537  7327 raft_consensus.cc:1240] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:33.526264 15035 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:33.485905 15022 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.064s
I20260709 13:16:33.544175 14793 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:33.592120  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:33.567463 14879 consensus_meta.cc:287] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.842s	user 0.013s	sys 0.000s
I20260709 13:16:33.517742 14759 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:33.598182  7333 raft_consensus.cc:1240] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:16:33.600296 14759 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:33.558918 14637 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:33.567716 15056 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.558033 14843 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.568140 14928 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:33.612831  7150 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:33.631867  7255 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 27.
W20260709 13:16:33.634707  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.582693 15019 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:33.582880 14963 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:33.589915 15006 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:33.609354 14879 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:33.664038  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:33.661085  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 160453us
I20260709 13:16:33.595813 15059 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.563163 14299 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.663635  7329 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 30. Current term is 31. Ops: [30.18-30.18]
W20260709 13:16:33.692026  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.613833 15056 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:33.576481 15102 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.630934 15007 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:33.696502  7333 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:16:33.701660  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:33.639995 14928 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:33.663172 15127 raft_consensus.cc:3055] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:33.697129 14759 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:33.658872 15118 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:33.657367 14963 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.684804 15006 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.707110  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:33.714298  7261 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:33.706521 15054 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:33.719650  7327 raft_consensus.cc:1275] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:16:33.661773 15126 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.722776  7262 raft_consensus.cc:1275] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:33.724699  7336 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:16:33.614092 14637 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:16:33.728817  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:33.716660 15007 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:33.732293  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:33.737426  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.728652  7301 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:33.732064  7329 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 20.
W20260709 13:16:33.731093 15050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.010s	sys 0.009s
I20260709 13:16:33.665362 14833 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:33.721973 14963 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:33.666486 14843 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.660590 15062 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:16:33.659153 15035 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:33.718003 15025 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:33.714056 15127 raft_consensus.cc:740] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:33.717864 14759 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.756434  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:33.719358 15118 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:33.726723 15006 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:33.697530 15059 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.750010  7150 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:33.756253  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:33.706843 14962 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:16:33.757220  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:33.746060 15050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.011s	sys 0.010s
I20260709 13:16:33.763464  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:33.761063  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:33.763367  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1503) took 1324 ms. Trace:
I20260709 13:16:33.769888  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:33.786341 15051 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:33.783861 15019 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:33.781668  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:33.783146  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:33.760808 15025 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:33.806944 15025 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:33.809293 14972 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.727s	user 0.010s	sys 0.002s
I20260709 13:16:33.792083  7335 raft_consensus.cc:2410] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:16:33.791894  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:33.811064  7890 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:33.811564  7329 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 27: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:33.812417  7225 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:33.812603  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:33.813553 14796 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.764825 14759 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:33.795517  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2687) took 1601 ms. Trace:
I20260709 13:16:33.809820 14972 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.799723 14843 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:33.817589  7334 rpcz_store.cc:276] 0709 13:16:32.187647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.406408 (+218761us) service_pool.cc:224] Handling call
0709 13:16:33.038464 (+632056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.057407 (+ 18943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.787217 (+729810us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54001f4ad0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:33.788662 (+  1445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1139185536}
I20260709 13:16:33.800223 15102 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:33.749193 14930 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:16:33.802546 15028 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:33.810366 15019 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:33.798779 14938 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:33.814211 14796 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:33.824205  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:33.826062  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.814589  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:33.832629  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 168628us
I20260709 13:16:33.818991 15071 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:16:33.852003  7334 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:16:33.880164  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.881026  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.812285 15035 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:33.740731 15126 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:33.820940 14963 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.857980 14972 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:33.819543 15051 raft_consensus.cc:2804] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:33.817221 14803 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:16:33.860473 14950 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.824s	user 0.012s	sys 0.000s
I20260709 13:16:33.861358  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 1214) took 1103 ms. Trace:
I20260709 13:16:33.820117 15025 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.854353 14930 consensus_queue.cc:1243] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:16:33.909621  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:33.860019  7887 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 31 index: 18. (term mismatch)
I20260709 13:16:33.910919  7887 pending_rounds.cc:85] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 17
I20260709 13:16:33.911206  7887 pending_rounds.cc:107] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 30.18
I20260709 13:16:33.911468  7887 raft_consensus.cc:2889] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:33.867136  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:33.869275 14759 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.913131  7259 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:33.873136 15019 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:33.853252  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.776821  7180 rpcz_store.cc:276] 0709 13:16:32.401978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.402213 (+   235us) service_pool.cc:224] Handling call
0709 13:16:32.402649 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.403230 (+   581us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:16:32.403693 (+   463us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.526582 (+122889us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b4800003fd8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:16:32.701968 (+175386us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.703956 (+  1988us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.733145 (+ 29189us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.733524 (+   379us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:32.733579 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.733679 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:33.013545 (+279866us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b18003b72e0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece611d2a6 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f
0709 13:16:33.014766 (+  1221us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b4800003fd8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:16:33.726335 (+711569us) raft_consensus.cc:1685] finished
0709 13:16:33.726360 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.726536 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1707,"prepare.queue_time_us":908,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":5746,"raft.queue_time_us":5665,"raft.run_cpu_time_us":6767,"raft.run_wall_time_us":435633,"spinlock_wait_cycles":35579520,"thread_start_us":297226,"threads_started":1,"wal-append.queue_time_us":791147}
I20260709 13:16:33.884238  7889 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 26.
W20260709 13:16:33.817569 15116 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.584s	user 0.001s	sys 0.010s
I20260709 13:16:33.835400 14962 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:33.893345 14963 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:33.893869 15022 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:33.895948 14938 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:33.900310  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 130962us
I20260709 13:16:33.812520 15007 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.915170 15118 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:33.957628  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:33.958046 15118 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:33.957242  7082 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.905146  7891 rpcz_store.cc:276] 0709 13:16:32.757716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.760809 (+  3093us) service_pool.cc:224] Handling call
0709 13:16:33.861100 (+1100291us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54004fa1d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:33.861254 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349063040}
W20260709 13:16:33.932175  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.936038  7334 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: []
W20260709 13:16:33.936262  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.931792  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 275901us
I20260709 13:16:33.908934 15067 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:33.946198  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 195526us
I20260709 13:16:33.909240 14972 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:33.975979  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.980963  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33208 (request call id 1224) took 1078 ms. Trace:
I20260709 13:16:33.814872 15012 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.102s
I20260709 13:16:33.897199 15101 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.981719  7888 rpcz_store.cc:276] 0709 13:16:32.902982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.903116 (+   134us) service_pool.cc:224] Handling call
0709 13:16:33.980689 (+1077573us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54005b22d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:33.980877 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767914752}
W20260709 13:16:33.934768 15123 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:16:33.951614  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:33.911360 15071 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.896499 14793 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:33.954979 14803 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:33.948599 14879 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:33.938645 15051 raft_consensus.cc:697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:33.903091  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 88578.1us
I20260709 13:16:33.932006 14968 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:33.823060 15127 consensus_queue.cc:260] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:33.968792  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1611) took 1187 ms. Trace:
W20260709 13:16:33.994683  7328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2734) took 1762 ms (client timeout 1687 ms). Trace:
I20260709 13:16:34.019605  7261 rpcz_store.cc:276] 0709 13:16:32.781538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.781724 (+   186us) service_pool.cc:224] Handling call
0709 13:16:32.782153 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.722532 (+940379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.968472 (+245940us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b5400124654. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:33.968685 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2132711168}
W20260709 13:16:34.019774  7328 rpcz_store.cc:269] 0709 13:16:32.206343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.329412 (+123069us) service_pool.cc:224] Handling call
0709 13:16:33.968905 (+1639493us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54000212d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:33.969014 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528553856}
I20260709 13:16:34.023058  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:33.971459 15059 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:34.026039  7302 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:34.025166  7336 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:33.996121 15035 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:33.993484 14833 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:34.033535  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 311833us
I20260709 13:16:34.036809  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:34.040187  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 159564us
W20260709 13:16:34.040495  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.044194  7328 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 26.
I20260709 13:16:34.009738 14950 consensus_queue.cc:1048] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:16:34.033576 15127 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:34.024576 14299 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:34.011556 15056 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.059154  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:34.112850  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:34.069429  7301 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:34.114876  7184 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 27. Current term is 28. Ops: []
W20260709 13:16:34.116040  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56919.5us
W20260709 13:16:34.116335  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 98739.9us
I20260709 13:16:34.017578 15022 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.121521  7256 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:16:34.112987  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.123448  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:34.030516 14972 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.019142 14803 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:34.126432 15123 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:16:34.034878 15071 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.132170  7327 raft_consensus.cc:2368] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 27. Current term is 28.
W20260709 13:16:34.138411  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:34.151643  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 94872.1us
I20260709 13:16:34.113102 15133 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.161777 14759 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:34.161844 15133 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.162552  7082 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:34.164253 15132 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 13:16:34.164624 15133 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:34.166778 15140 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:34.167755  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1618) took 1241 ms. Trace:
I20260709 13:16:34.167934  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.123257 14930 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:34.148557  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:34.167426 15140 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.115485 14833 raft_consensus.cc:2804] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:16:34.165114  7082 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 8 to 10, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 10 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:34.168206  7257 rpcz_store.cc:276] 0709 13:16:32.926185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.926348 (+   163us) service_pool.cc:224] Handling call
0709 13:16:32.959111 (+ 32763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.011056 (+ 51945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.011094 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.011790 (+   696us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.242726 (+230936us) raft_consensus.cc:1645] Marking committed up to 20
0709 13:16:33.598899 (+356173us) log.cc:844] Serialized 14 byte log entry
0709 13:16:33.599155 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.599232 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.167503 (+568271us) raft_consensus.cc:1685] finished
0709 13:16:34.167524 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.167678 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":333826,"prepare.queue_time_us":334075,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":4293,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":231,"thread_start_us":230288,"threads_started":1,"wal-append.queue_time_us":641081}
I20260709 13:16:34.181351  7184 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: [22.10-22.10]
I20260709 13:16:34.127703 14968 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:16:34.196506  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:34.185110 15135 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:16:34.205744  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.176045 14930 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:34.196344  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 43799.8us
I20260709 13:16:34.183187 14299 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:34.173683 14759 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:34.212788  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:34.216228  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.219153  7185 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:34.220082  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.221881  7187 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:34.214740  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:34.223805 14833 raft_consensus.cc:697] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:34.246765  7182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.247540  7182 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:34.244447  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:34.248442  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.249177  7178 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:34.249399  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:34.250582  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:34.251092  7329 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:16:34.245599  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.255620  7082 catalog_manager.cc:5697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 13 to 14, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 14 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.197961 15025 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:34.221047  7184 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 27.
I20260709 13:16:34.131803 14938 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.181897 15061 consensus_queue.cc:1059] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 27.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.041s
W20260709 13:16:34.264155  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 147552us
I20260709 13:16:34.213501 14930 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:34.244194 15131 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.296s	user 0.000s	sys 0.002s
I20260709 13:16:34.212733 15020 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:34.306701  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.276253  7186 raft_consensus.cc:1240] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:16:34.304647  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.171427 15051 consensus_queue.cc:237] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.305377  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:34.323668 15056 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:34.326406 15066 consensus_meta.cc:287] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.963s	user 0.014s	sys 0.000s
I20260709 13:16:34.326975 15066 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:34.329396 15141 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:34.329530 15066 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:34.331933  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 4031) took 1121 ms. Trace:
I20260709 13:16:34.334900 15149 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:34.335577  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:34.336326 15022 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:34.336925  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 127036us
I20260709 13:16:34.337386 15028 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:34.337805 14299 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:34.338164 14803 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:34.339527 15115 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 1.116s	user 0.003s	sys 0.000s
I20260709 13:16:34.340998 14674 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:34.341638  7333 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:34.344169 15063 raft_consensus.cc:3055] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:16:34.398334  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:34.346896  7258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1613) took 1564 ms (client timeout 1613 ms). Trace:
I20260709 13:16:34.347225 15140 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:34.348100 15120 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.997s	user 0.000s	sys 0.005s
I20260709 13:16:34.353449  7328 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:16:34.354080  7329 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:16:34.304911  7082 catalog_manager.cc:5697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:34.356904 15071 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:34.360049 14528 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:34.360765 14637 consensus_meta.cc:287] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.001s
W20260709 13:16:34.366307 15006 consensus_meta.cc:287] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.001s
I20260709 13:16:34.431836 15006 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.432655  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.433917  7180 raft_consensus.cc:2410] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:16:34.434193 15006 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:34.366683 15138 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.434919 15138 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.437261 15138 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:34.438011 14552 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:34.438827 15035 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.439111  7894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1332) took 1023 ms. Trace:
I20260709 13:16:34.439421 15035 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.439590  7894 rpcz_store.cc:276] 0709 13:16:33.415981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.424505 (+  8524us) service_pool.cc:224] Handling call
0709 13:16:34.438921 (+1014416us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b54005631d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:34.439044 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30689664}
I20260709 13:16:34.440982  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1616) took 1573 ms. Trace:
I20260709 13:16:34.441418  7260 rpcz_store.cc:276] 0709 13:16:32.867189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.867343 (+   154us) service_pool.cc:224] Handling call
0709 13:16:33.460742 (+593399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.461444 (+   702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.440767 (+979323us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540034b2d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:34.440916 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312916224}
I20260709 13:16:34.442212 15136 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:34.442708 15136 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:34.443667 15136 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:34.444358  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:34.445256  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.445624  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:34.446523 14974 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:34.447175 14974 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:34.370499 14947 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.447659 15060 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:34.447993  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:34.447944 14947 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.448989  7253 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 24: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:34.371331  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.450035  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:34.371618 14972 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:34.246780 14833 consensus_queue.cc:237] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.451000  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:34.372694  7336 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260709 13:16:34.452190  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:34.452832  7257 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:34.453703  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:34.454305  7257 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:34.362027 14930 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.270861 15143 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.378144  7254 rpcz_store.cc:276] 0709 13:16:33.210688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.309762 (+ 99074us) service_pool.cc:224] Handling call
0709 13:16:33.345131 (+ 35369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.425449 (+ 80318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.425492 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.475357 (+ 49865us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.687421 (+212064us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:16:33.687545 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.687736 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.331708 (+643972us) raft_consensus.cc:1685] finished
0709 13:16:34.331730 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.331872 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42058,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":47417,"thread_start_us":152698,"threads_started":1,"wal-append.queue_time_us":270333}
I20260709 13:16:34.275565 15101 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:34.273445 14796 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:34.391216  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.446566 15126 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:34.481534 15066 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.481823  7253 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:34.482172  7253 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:34.447626  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:34.482585 14299 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.483042  7253 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.483588 15054 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.484061  7253 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:34.484580 14843 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:34.447623 14974 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:34.485296  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:34.486967  7082 catalog_manager.cc:5697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 7 to 9, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 9 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:34.489291 14930 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:34.450420 14947 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:34.489634  7082 catalog_manager.cc:5697] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:16:34.450050 15128 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.676s	user 0.002s	sys 0.000s
I20260709 13:16:34.459595  7184 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:34.208518 15139 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.113s
W20260709 13:16:34.461102  7258 rpcz_store.cc:269] 0709 13:16:32.782244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.782715 (+   471us) service_pool.cc:224] Handling call
0709 13:16:34.346725 (+1564010us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54002d3a54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:34.346833 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180713344}
I20260709 13:16:34.369506 15020 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.463670  7179 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 18: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:16:34.393926 15112 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:16:34.473073  7186 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:16:34.471256  7150 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:34.475435  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.390437 15028 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:34.476812  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.484176 15054 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:34.490188  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 154691us
I20260709 13:16:34.486454 15062 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:16:34.490989  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.491004  7187 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:34.491813  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:34.548674  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:34.556416  7336 raft_consensus.cc:2393] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:34.492600  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:34.557047  7254 raft_consensus.cc:3060] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:34.494138  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:34.495370  7302 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:34.557900  7327 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:34.557958  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 62682.4us
W20260709 13:16:34.558486  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.558997  7302 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:34.559926  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.560055  7302 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:34.560453  7336 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:16:34.562516  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:34.563290  7895 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:34.563644  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:34.564407  7894 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:34.567257  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.497310 15056 consensus_queue.cc:1059] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:34.568110  7186 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:34.568688  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:34.569344  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:34.497778  7335 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:34.456805 14637 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.455165 15019 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:34.498365 15115 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:16:34.422081 15119 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.398473 15063 raft_consensus.cc:740] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:34.498884  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 369511us
I20260709 13:16:34.500273  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:34.549819 15028 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:34.482191 15066 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.593680  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:34.504328 15118 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.000s
I20260709 13:16:34.504616 15101 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.505262  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:34.506398 14928 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.773s	user 0.012s	sys 0.000s
W20260709 13:16:34.417956 14893 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.957s	user 0.008s	sys 0.006s
W20260709 13:16:34.418576 15104 consensus_meta.cc:287] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.331s	user 0.005s	sys 0.011s
I20260709 13:16:34.507180  7330 raft_consensus.cc:2410] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:16:34.507139  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:34.526861  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.617894  7257 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:34.537493  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.548393  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:34.550289  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 79159.3us
I20260709 13:16:34.618831  7334 raft_consensus.cc:2410] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:16:34.528049 14344 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:34.555282  7180 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:34.495980 14793 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:34.568034  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:34.575013  7895 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 27.
I20260709 13:16:34.577754  7254 raft_consensus.cc:2468] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:16:34.391680 15149 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.590708 15051 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:34.532866 15060 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.589663  7336 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
W20260709 13:16:34.589707  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.502900 15143 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.504522 14974 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.557698 15006 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:34.657608  7150 leader_election.cc:400] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 27. Current term is 28.
I20260709 13:16:34.600709  7302 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:34.601900  7889 pending_rounds.cc:85] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 14
I20260709 13:16:34.603111  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:34.528554 14948 consensus_queue.cc:1048] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:16:34.607029  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:34.661775  7890 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:34.608017  7182 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 30. Current term is 31. Ops: [30.20-30.20]
I20260709 13:16:34.594478  7887 raft_consensus.cc:2376] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23. Re-sending same reply.
I20260709 13:16:34.584321 15023 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:34.616328  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:34.585548 15035 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:34.585109 15133 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:34.590176 15059 raft_consensus.cc:3055] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:34.631194  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:34.621564  7892 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 31.
I20260709 13:16:34.569423  7896 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
W20260709 13:16:34.643967  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.647876  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.650668  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:34.650437  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.653309  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:34.658058  7150 leader_election.cc:403] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
I20260709 13:16:34.658502  7889 pending_rounds.cc:107] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 13:16:34.588227 15138 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:16:34.679359  7889 raft_consensus.cc:2889] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:34.665031  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:34.664871  7082 catalog_manager.cc:5697] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 10 to 11, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 11 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:34.670892  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 70287.8us
I20260709 13:16:34.672509  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:34.675174  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.680406  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:34.682444  7185 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:34.683588  7331 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:34.682300  7187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.686578  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:34.619801 15101 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.689982  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:34.692349  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 73106.7us
I20260709 13:16:34.618091 14928 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.695149  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:34.743938  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.669835 15023 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.740433  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:34.634681 15104 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.649251 15019 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:16:34.865644  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:34.607647 15119 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.670962 15006 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:34.634923 14344 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.865942  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.753882  7259 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:16:34.869890  7336 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 31.
I20260709 13:16:34.675240 15133 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.865564  7328 raft_consensus.cc:2376] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23. Re-sending same reply.
I20260709 13:16:34.682132 15056 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:34.673113 15059 raft_consensus.cc:740] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:34.745896  7887 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 19: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:34.651141 14950 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:16:34.881848  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:34.743713 15127 consensus_meta.cc:287] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.685s	user 0.006s	sys 0.005s
I20260709 13:16:34.920395  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:34.921160  7179 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:34.885470 15133 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:34.923368 15054 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:34.924500 15160 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 13:16:34.927035 15019 consensus_queue.cc:1243] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:16:34.927676 15019 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:16:34.931120  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:34.932078  7336 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:34.933028  7179 raft_consensus.cc:2410] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:16:34.684932 15012 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:34.934180 15163 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:16:34.933909 15012 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:34.939002  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2698) took 1171 ms. Trace:
I20260709 13:16:34.934420  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:34.905854  7183 raft_consensus.cc:2393] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 26: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:34.906795  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:34.913318 15104 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:34.686177 15063 consensus_queue.cc:260] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:34.685310 15061 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.229s
I20260709 13:16:34.891749 15056 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.996794  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:34.997293  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 332331us
I20260709 13:16:35.002164  7185 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 28.
I20260709 13:16:34.915866 14974 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:34.916405 15136 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:34.887761 14879 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:34.886404  7299 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:34.941728  7179 raft_consensus.cc:2410] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:16:34.943342  7082 catalog_manager.cc:5697] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 9 to 13, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 13 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:34.945281  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 202360us
I20260709 13:16:34.898293  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
W20260709 13:16:34.954008  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.939556  7331 rpcz_store.cc:276] 0709 13:16:33.768014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.781325 (+ 13311us) service_pool.cc:224] Handling call
0709 13:16:34.938809 (+1157484us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b540031b5d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:34.938931 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938521344}
I20260709 13:16:34.974581  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:34.975265  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 305360us
I20260709 13:16:34.975662  7261 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:16:34.880376 15023 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:34.984659  7186 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 21.
W20260709 13:16:35.035274  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.990074  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1264) took 1074 ms. Trace:
W20260709 13:16:34.990437  7253 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.001s
W20260709 13:16:35.037204  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 294138us
W20260709 13:16:35.037642  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 139445us
I20260709 13:16:35.038033  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:35.039260  7253 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:16:35.006402 15056 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:34.941403  7893 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:34.993605  7894 raft_consensus.cc:2468] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:35.005155  7184 raft_consensus.cc:2468] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:35.010699  7180 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:16:35.003683  7302 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:35.044888  7336 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:16:34.878961 15051 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:35.045596 15051 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:35.041553 14945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.011s	sys 0.012s
I20260709 13:16:35.029707  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:35.042243  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:35.004953 14759 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 27. Current term is 28.
I20260709 13:16:35.046015 15051 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:35.046960  7331 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:34.933135 15162 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:16:35.036367  7334 rpcz_store.cc:276] 0709 13:16:33.916154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.010244 (+ 94090us) service_pool.cc:224] Handling call
0709 13:16:34.978445 (+968201us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b540032aad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:34.990005 (+ 11560us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367516928}
I20260709 13:16:35.073629  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:35.048978  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45452.8us
I20260709 13:16:35.050513  7301 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:35.047652  7179 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26. Ops: [25.19-25.19]
I20260709 13:16:35.178843  7184 raft_consensus.cc:1217] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Deduplicated request from leader. Original: 19.15->[21.16-21.16]   Dedup: 21.16->[]
I20260709 13:16:35.047843  7181 raft_consensus.cc:1240] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:16:35.183148  7184 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:16:35.183254  7336 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:16:35.180020  7302 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:35.177546  7330 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:16:35.047289 14945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.012s	sys 0.012s
I20260709 13:16:35.123899  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:35.042752 15063 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:35.043303 15007 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:16:35.206979  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.043545 15067 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:35.075625 14528 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.005s
W20260709 13:16:35.223896  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 104967us
W20260709 13:16:35.125569 15141 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:16:35.079576 15104 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:16:35.235086  7184 raft_consensus.cc:1240] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:35.229681  7082 catalog_manager.cc:5697] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:35.229847  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 150371us
I20260709 13:16:35.245600  7255 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
I20260709 13:16:35.233073  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:35.126004 15102 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:35.042987 14879 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:35.286777  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53812.3us
I20260709 13:16:35.254102 14637 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 31 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:35.290748  7183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 3805) took 1059 ms. Trace:
I20260709 13:16:35.291373  7183 rpcz_store.cc:276] 0709 13:16:34.184789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.184955 (+   166us) service_pool.cc:224] Handling call
0709 13:16:35.243420 (+1058465us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54002b52d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:35.243579 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596891520}
I20260709 13:16:35.285755  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:35.298481  7082 catalog_manager.cc:5697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:35.286265 15007 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:35.237965 15156 raft_consensus.cc:3055] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:35.218442 14930 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.228914 14974 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.186951 15020 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:35.306365  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:35.312444  7184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.305371  7331 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
W20260709 13:16:35.318261 15157 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 13:16:35.324710  7179 raft_consensus.cc:1240] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: [22.10-22.10]
I20260709 13:16:35.284251 14796 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.329012  7183 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:35.344801  7894 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 18.
I20260709 13:16:35.351848  7336 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 31.
I20260709 13:16:35.297652 15054 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:35.298867 14793 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:35.297946 15066 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:35.306134 15142 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:35.310254 14879 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:35.319245 15102 raft_consensus.cc:2804] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:35.318661 15067 raft_consensus.cc:2804] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:35.307164 14928 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:35.319378 14803 raft_consensus.cc:2764] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 13:16:35.315160 15156 raft_consensus.cc:740] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:35.430888 15101 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:35.431453 15143 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:35.437650  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:35.439486 15170 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:16:35.321962 15060 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:35.306267 15149 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:35.445576  7181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 3044) took 1046 ms. Trace:
I20260709 13:16:35.446139  7181 rpcz_store.cc:276] 0709 13:16:34.399459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.487172 (+ 87713us) service_pool.cc:224] Handling call
0709 13:16:35.044781 (+557609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:35.187163 (+142382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.441582 (+254419us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b540017d750. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:35.445488 (+  3906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281363328}
I20260709 13:16:35.318395 14930 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.384631 14793 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:35.188835 15006 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.298650 14528 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.105s
I20260709 13:16:35.236153 15059 consensus_queue.cc:260] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.331091 15172 consensus_queue.cc:1059] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.116s
W20260709 13:16:35.427289  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 404626us
W20260709 13:16:35.428113 15150 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:16:35.373126 14796 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:35.442575  7890 consensus_meta.cc:287] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.775s	user 0.011s	sys 0.001s
I20260709 13:16:35.329614 14950 raft_consensus.cc:3055] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:16:35.464943  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.448863  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.470160  7180 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 27.
I20260709 13:16:35.472862  7183 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:35.427161 15012 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:35.409165 15142 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:35.488035  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:35.330894 14974 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:35.306730 14674 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.889s	user 0.011s	sys 0.000s
I20260709 13:16:35.548452  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:35.490978  7890 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:16:35.457285 15118 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.537928  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:35.441915 15102 raft_consensus.cc:697] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:35.459559 15067 raft_consensus.cc:697] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:35.307749 15007 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:35.527880 14950 raft_consensus.cc:740] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:35.475696 14793 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:35.566962  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 387026us
I20260709 13:16:35.577571  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:35.539352 15142 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:35.584120  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2753) took 1870 ms. Trace:
I20260709 13:16:35.587898  7262 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:35.537582 15059 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:35.588604  7893 raft_consensus.cc:1240] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 22. Current term is 23. Ops: [22.14-22.14]
W20260709 13:16:35.590461  7254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.003s	sys 0.012s
I20260709 13:16:35.599550  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:35.599952  7254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.003s	sys 0.012s
I20260709 13:16:35.600418  7180 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 27: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
W20260709 13:16:35.590804  7859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.009s
I20260709 13:16:35.591761  7890 raft_consensus.cc:1240] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26. Ops: [23.18-25.19]
W20260709 13:16:35.564112 15161 log.cc:927] Time spent T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.684s	user 0.000s	sys 0.002s
W20260709 13:16:35.561362  7257 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.926s	user 0.011s	sys 0.000s
I20260709 13:16:35.593938  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:35.699213  7257 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 28.
W20260709 13:16:35.699504  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 105661us
I20260709 13:16:35.699802  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 4048) took 1230 ms. Trace:
I20260709 13:16:35.557140 14344 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:35.593358 15104 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:35.608215  7859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.005s	sys 0.009s
W20260709 13:16:35.598449  7887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.000s	sys 0.013s
W20260709 13:16:35.683434  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.593849  7332 rpcz_store.cc:276] 0709 13:16:33.713378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.713619 (+   241us) service_pool.cc:224] Handling call
0709 13:16:33.728405 (+ 14786us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.032679 (+304274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.032717 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.117621 (+ 84904us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.258249 (+140628us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:34.258303 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.258376 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.583802 (+1325426us) raft_consensus.cc:1685] finished
0709 13:16:35.583836 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.584032 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4398,"raft.queue_time_us":73971,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":379433,"threads_started":2,"wal-append.queue_time_us":514923}
W20260709 13:16:35.593230 15035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.017s	sys 0.038s
I20260709 13:16:35.685843  7180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.685843  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:35.694494  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.717780  7178 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:35.696213  7181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.695253  7302 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:35.700189  7257 rpcz_store.cc:276] 0709 13:16:34.469487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.506745 (+ 37258us) service_pool.cc:224] Handling call
0709 13:16:35.699734 (+1192989us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.700341  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:35.601941  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.597491 15071 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.705842  7185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.719476  7183 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
W20260709 13:16:35.706990  7887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.000s	sys 0.013s
I20260709 13:16:35.720615  7887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1237) took 1031 ms. Trace:
I20260709 13:16:35.706372  7179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.573169 15118 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.722998  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.723698  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:35.473461 14928 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.100s
W20260709 13:16:35.548035 14893 consensus_queue.cc:1175] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" responder_term: 22 status { last_received { term: 22 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 22 index: 10 } }
I20260709 13:16:35.694788 15101 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.686291 15143 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.598102 15056 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.733618 15118 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:35.726260 15020 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.736083  7893 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:16:35.727535  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:35.739727  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:35.760741  7891 raft_consensus.cc:2410] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:16:35.739698  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:35.763577  7334 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 27: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:35.726924 15025 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:16:35.767549  7891 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:16:35.768373  7178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
W20260709 13:16:35.721982  7225 connection.cc:256] RPC call timeout handler was delayed by -1.0554003539998575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20260709 13:16:35.743357  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:35.740877 14950 consensus_queue.cc:260] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:35.703073 14674 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:35.773073  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.773169 14674 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.774003  7183 raft_consensus.cc:2393] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 27: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:35.774986  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.774868 15067 consensus_queue.cc:237] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.775478 14674 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:35.775815  7183 raft_consensus.cc:2393] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:35.776952  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:35.779105 15023 consensus_meta.cc:287] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.000s
I20260709 13:16:35.779575 15023 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:35.781888 15023 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:35.783218 15178 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:16:35.784708 15063 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.547s	user 0.005s	sys 0.005s
I20260709 13:16:35.751675 14879 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:35.785547 14879 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.787228 14974 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:35.787676 14879 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:35.788386 15179 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 13:16:35.788789 15179 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.789167 15179 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:16:35.697592 15149 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:35.790278 15149 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.751350 15143 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:35.791442 15104 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.792775 15149 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:35.793560 15143 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:35.749229  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54066.1us
I20260709 13:16:35.794381  7256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1623) took 1797 ms. Trace:
I20260709 13:16:35.797358  7256 rpcz_store.cc:276] 0709 13:16:33.996942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.147673 (+150731us) service_pool.cc:224] Handling call
0709 13:16:34.168454 (+ 20781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.168689 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.168720 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.169271 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.470000 (+300729us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:34.479559 (+  9559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.479698 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.794153 (+1314455us) raft_consensus.cc:1685] finished
0709 13:16:35.794173 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.794320 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":300282,"threads_started":1,"wal-append.queue_time_us":438549}
I20260709 13:16:35.801458 15188 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:35.721145  7887 rpcz_store.cc:276] 0709 13:16:34.689107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.917172 (+228065us) service_pool.cc:224] Handling call
0709 13:16:34.917489 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.917720 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:16:34.978051 (+ 60331us) log.cc:844] Serialized 14 byte log entry
0709 13:16:35.720167 (+742116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:35.720244 (+    77us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:35.720309 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.720399 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.720548 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99336,"prepare.queue_time_us":73711,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":5416,"raft.queue_time_us":340719,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":40865,"thread_start_us":730486,"threads_started":1}
I20260709 13:16:35.705775 14637 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:16:35.807518 15028 consensus_meta.cc:287] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.194s	user 0.008s	sys 0.005s
I20260709 13:16:35.724160 14528 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.757113  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:35.758468 15054 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:35.809125 15054 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:35.809015 14528 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:35.809605 15028 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.810909  7330 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:35.762768  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.741488  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:35.723107 14344 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.771965  7890 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 18.
I20260709 13:16:35.751609 15101 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:35.728050 15071 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.807456 14637 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:35.821395 14637 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.821959 15101 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:35.778503  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
I20260709 13:16:35.812573  7178 raft_consensus.cc:2410] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:16:35.827255  7183 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 18: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:35.753474  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:35.811350 14528 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:35.816004  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 3051) took 1135 ms. Trace:
W20260709 13:16:35.767696 15169 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.580s	user 0.000s	sys 0.011s
W20260709 13:16:35.829772  7328 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.012s	sys 0.011s
W20260709 13:16:35.833246  7328 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.013s	sys 0.012s
W20260709 13:16:35.831933  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 67804.5us
I20260709 13:16:35.830202  7186 rpcz_store.cc:276] 0709 13:16:34.680958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.683491 (+  2533us) service_pool.cc:224] Handling call
0709 13:16:35.815747 (+1132256us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001b3fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:35.815923 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237790464}
I20260709 13:16:35.834859  7186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d"
I20260709 13:16:35.834973  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:35.835450  7186 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:35.836686  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:35.837836  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 4
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:16:35.816768 15020 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:35.838867  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:35.839674 14552 raft_consensus.cc:3055] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:35.845652 15056 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:35.846122  7186 raft_consensus.cc:2468] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 16.
I20260709 13:16:35.833732  7225 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:35.847335  6030 tablet_server.cc:179] TabletServer@127.5.227.129:0 shutting down...
I20260709 13:16:35.847668 15063 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:16:35.848872 15184 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.053s	user 0.001s	sys 0.001s
I20260709 13:16:35.825484 14344 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:35.847325  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:35.885524  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:35.885775  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 56453.2us
W20260709 13:16:35.886018  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.868868  7183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" is_pre_election: true
W20260709 13:16:35.851521 15133 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.928s	user 0.013s	sys 0.000s
I20260709 13:16:35.888585  7183 raft_consensus.cc:2410] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:16:35.877383  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:35.880635  7178 raft_consensus.cc:1240] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 24. Current term is 25. Ops: [22.13-24.14]
I20260709 13:16:35.881814  7186 raft_consensus.cc:1217] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Deduplicated request from leader. Original: 19.10->[21.11-25.13]   Dedup: 21.11->[22.12-25.13]
I20260709 13:16:35.828243 15102 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:35.882709 14930 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:35.883749  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:35.893034  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:35.889818  7186 pending_rounds.cc:85] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 11
I20260709 13:16:35.899111  7186 pending_rounds.cc:107] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 23.12
I20260709 13:16:35.899631  7186 raft_consensus.cc:2889] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.900528  7334 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 25: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:35.901309  7178 raft_consensus.cc:1240] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:16:35.901854  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:35.902284 14528 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:35.902726 14528 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.902845  7334 raft_consensus.cc:2410] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:16:35.903107 14528 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:35.903579  7178 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26. Ops: []
I20260709 13:16:35.904420  7334 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
I20260709 13:16:35.905714 15133 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:35.909605 15133 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:35.912056 15169 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:16:35.913130 15063 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:16:35.913894  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:35.922247  7299 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:35.924800 15142 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:35.926311 15056 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 13:16:35.926765 15056 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.927111 15056 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:16:35.931483 15059 raft_consensus.cc:2804] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:35.932303 15059 raft_consensus.cc:697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:35.933312 15059 consensus_queue.cc:237] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:35.934979  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1230) took 1358 ms. Trace:
I20260709 13:16:35.935400  7889 rpcz_store.cc:276] 0709 13:16:34.576220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.577213 (+   993us) service_pool.cc:224] Handling call
0709 13:16:34.593877 (+ 16664us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:34.945696 (+351819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.945734 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:34.990985 (+ 45251us) log.cc:844] Serialized 52 byte log entry
0709 13:16:35.444757 (+453772us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:35.444821 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.444903 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.934700 (+489797us) raft_consensus.cc:1685] finished
0709 13:16:35.934722 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.934898 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53079,"raft.queue_time_us":402190,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":17076,"spinlock_wait_cycles":6272,"thread_start_us":331207,"threads_started":1,"wal-append.queue_time_us":730582}
I20260709 13:16:35.939059 15056 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:35.916245 15136 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.890s	user 0.008s	sys 0.004s
I20260709 13:16:35.964324  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 4042) took 1520 ms. Trace:
I20260709 13:16:35.917623  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:35.965627  7895 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:35.914237 15020 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:35.946043  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2756) took 1886 ms. Trace:
W20260709 13:16:35.940330  7301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.017s	sys 0.023s
I20260709 13:16:35.835918 14879 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:16:35.921025 15188 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:35.952620  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 4035) took 2054 ms. Trace:
I20260709 13:16:35.877065 14552 raft_consensus.cc:740] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:35.956943  7182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54396 (request call id 1518) took 1570 ms. Trace:
I20260709 13:16:35.990886  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:35.963224  7185 raft_consensus.cc:1240] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 15. Current term is 16. Ops: []
W20260709 13:16:35.967307  7301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.017s	sys 0.023s
I20260709 13:16:35.967042  7327 rpcz_store.cc:276] 0709 13:16:34.059669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.567149 (+507480us) service_pool.cc:224] Handling call
0709 13:16:34.567500 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.668022 (+100522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.668055 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:34.668099 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:34.668117 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.945683 (+1277566us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400319cd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:35.945771 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.945965 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230673152}
I20260709 13:16:35.972110  7178 raft_consensus.cc:1275] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:16:35.982256  7255 rpcz_store.cc:276] 0709 13:16:33.897955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.898091 (+   136us) service_pool.cc:224] Handling call
0709 13:16:35.952392 (+2054301us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540034a3d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:35.952551 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3070137728}
I20260709 13:16:35.980166  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2759) took 1865 ms. Trace:
I20260709 13:16:35.993549  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:35.974120  7184 raft_consensus.cc:1240] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 27. Current term is 28. Ops: []
I20260709 13:16:35.964799  7262 rpcz_store.cc:276] 0709 13:16:34.443600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.517812 (+ 74212us) service_pool.cc:224] Handling call
0709 13:16:35.964139 (+1446327us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540021a2d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:35.964259 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372007808}
I20260709 13:16:35.977754  7302 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:35.978750  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:35.976913  7332 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:35.961323  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:35.997555  7330 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 17.
I20260709 13:16:35.993283  7178 pending_rounds.cc:85] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting all ops after (but not including) 13
I20260709 13:16:35.998834  7178 pending_rounds.cc:107] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:16:35.999245  7178 raft_consensus.cc:2889] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.975471  7183 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 27. Current term is 28. Ops: []
W20260709 13:16:36.006281  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 955753us
I20260709 13:16:35.996595  7889 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
W20260709 13:16:36.020524  7861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.017s	sys 0.053s
I20260709 13:16:36.020793  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:36.021179  7861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.017s	sys 0.053s
I20260709 13:16:36.021539  7890 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
W20260709 13:16:36.021612  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 1.03534e+06us
W20260709 13:16:36.022846  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 57326.9us
I20260709 13:16:35.990708  7182 rpcz_store.cc:276] 0709 13:16:34.386465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.393876 (+  7411us) service_pool.cc:224] Handling call
0709 13:16:34.419010 (+ 25134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.662645 (+243635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.956514 (+1293869us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540039dad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:35.956856 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426409344}
I20260709 13:16:36.023622  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:35.994288  7327 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
W20260709 13:16:36.029263  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 51607.8us
I20260709 13:16:35.993868  7333 rpcz_store.cc:276] 0709 13:16:34.114344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.664652 (+550308us) service_pool.cc:224] Handling call
0709 13:16:34.741488 (+ 76836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.995977 (+254489us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:16:34.996033 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:35.014940 (+ 18907us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.685215 (+670275us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:35.685271 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.848187 (+162916us) spinlock_profiling.cc:243] Waited 9.67 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:35.979704 (+131517us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54001928d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:35.979787 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.979857 (+    70us) raft_consensus.cc:1685] finished
0709 13:16:35.979877 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.980083 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1147,"raft.queue_time_us":208,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":14136,"spinlock_wait_cycles":583521408,"thread_start_us":413142,"threads_started":1,"wal-append.queue_time_us":753079}
W20260709 13:16:36.032902  7335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.289s	user 0.011s	sys 0.060s
I20260709 13:16:35.961508 15071 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:36.037318  7335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.298s	user 0.011s	sys 0.060s
I20260709 13:16:36.025698  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:36.047433  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:36.055418  7895 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:36.060647 15190 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:36.066164  7336 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:16:36.019701 15175 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:36.082733  7333 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:16:36.086758  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:36.088230  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.031774 15191 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:36.059409 15133 raft_consensus.cc:2804] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:36.058557 14680 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:36.088863 15118 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:36.022338 15192 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.162s
I20260709 13:16:36.033669 15020 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:16:36.115164  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:36.041679 14803 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:16:36.117204  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2768) took 1647 ms. Trace:
I20260709 13:16:36.124615  7328 rpcz_store.cc:276] 0709 13:16:34.470030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.937645 (+467615us) service_pool.cc:224] Handling call
0709 13:16:34.937925 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.938133 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:16:35.833762 (+895629us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.116324 (+282562us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.116710 (+   386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.116781 (+    71us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:36.116849 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.116943 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.117120 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51317,"prepare.queue_time_us":95778,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":974,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":6700,"thread_start_us":1091626,"threads_started":2}
I20260709 13:16:36.094853 14793 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.128726  7327 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 30. Current term is 31. Ops: [30.20-30.20]
I20260709 13:16:36.041280 14674 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:16:36.116032  7887 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:16:36.108484 15028 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:36.131253  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 31 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:36.112195 15118 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.102465 15143 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:36.109099 15133 raft_consensus.cc:697] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:36.117241 15149 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:16:36.144912 15118 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:36.146013 15025 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:36.104918 14552 consensus_queue.cc:260] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:36.146308 14833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.214s	user 0.039s	sys 0.018s
W20260709 13:16:36.199890 14833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.277s	user 0.039s	sys 0.018s
I20260709 13:16:36.265007  7329 raft_consensus.cc:1240] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 LEADER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 27. Current term is 28. Ops: []
W20260709 13:16:36.269390  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 382485us
I20260709 13:16:36.205310 15142 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:36.216183 15056 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 32 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:36.170171 15054 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.204792 15188 consensus_queue.cc:1059] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:16:36.215941 14344 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:36.277480  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.279510  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 238819us
W20260709 13:16:36.270593  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 236812us
I20260709 13:16:36.286861  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:36.279101 14803 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:36.287506  7302 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 17 similar messages]
W20260709 13:16:36.322036  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46693us
W20260709 13:16:36.336805  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 44836.9us
W20260709 13:16:36.307284 15051 consensus_meta.cc:287] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 1.069s	user 0.013s	sys 0.001s
I20260709 13:16:36.296123 14674 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.297933 14344 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.345655  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:36.275542 15133 consensus_queue.cc:237] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.304840 15025 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:36.361398 15197 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:16:36.362696  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2757) took 2249 ms. Trace:
I20260709 13:16:36.303103 15175 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:36.363817  7334 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21. Ops: []
W20260709 13:16:36.371691  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.363142  7335 rpcz_store.cc:276] 0709 13:16:34.113665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.575338 (+461673us) service_pool.cc:224] Handling call
0709 13:16:34.593508 (+ 18170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.606585 (+ 13077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.606639 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.647511 (+ 40872us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.042064 (+1394553us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:36.042128 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.042215 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.362401 (+320186us) raft_consensus.cc:1685] finished
0709 13:16:36.362422 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.362598 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1231,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":5741,"thread_start_us":1302712,"threads_started":1,"wal-append.queue_time_us":1478268}
I20260709 13:16:36.377941 14793 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:36.321038 14803 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.370972 15190 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.344930 15126 consensus_queue.cc:1059] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:16:36.344749 15051 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.373690 15191 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.363502 15218 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.357838 14674 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.405349 15023 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.363862 14344 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.422678 15220 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.018s
W20260709 13:16:36.413782  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 87642.1us
I20260709 13:16:36.406168 15222 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:16:36.415838 15199 log.cc:927] Time spent T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:16:36.441607 14637 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.460150 14637 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.367748 15175 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.462577 14637 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:36.463294 15171 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.203s	user 0.003s	sys 0.008s
W20260709 13:16:36.472707 14528 consensus_meta.cc:287] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.003s
I20260709 13:16:36.473307 14528 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.475811 14803 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:36.476536 14803 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:36.477265 14803 consensus_queue.cc:1243] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:16:36.477748 14803 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:36.478183 14803 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:36.434816 15218 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.412413 15190 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.409174 14680 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.030s
W20260709 13:16:36.509706  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 133598us
I20260709 13:16:36.519217  7186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 3053) took 1521 ms. Trace:
I20260709 13:16:36.519876  7186 rpcz_store.cc:276] 0709 13:16:34.997591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.878647 (+881056us) service_pool.cc:224] Handling call
0709 13:16:35.881559 (+  2912us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:36.026605 (+145046us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:36.302918 (+276313us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.376985 (+ 74067us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:36.377617 (+   632us) log.cc:844] Serialized 52 byte log entry
0709 13:16:36.377770 (+   153us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:36.377811 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.377881 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.518954 (+141073us) raft_consensus.cc:1685] finished
0709 13:16:36.518976 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.519147 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25152,"prepare.queue_time_us":347045,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":242725,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":5304,"thread_start_us":233202,"threads_started":2,"wal-append.queue_time_us":116743}
W20260709 13:16:36.465844 15205 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:16:36.451766 15222 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.450173 15054 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:36.542181 14803 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.420032 15191 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:36.539499 15207 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:16:36.541285 14674 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:36.532639 15126 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.566573  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2705) took 2554 ms. Trace:
I20260709 13:16:36.567013 15232 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:36.567430  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:36.568055  7255 raft_consensus.cc:3060] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:16:36.536423  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 95335.4us
I20260709 13:16:36.570034 14344 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:36.567031  7329 rpcz_store.cc:276] 0709 13:16:34.011803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.496792 (+484989us) service_pool.cc:224] Handling call
0709 13:16:34.497126 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.265536 (+1768410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.566338 (+300802us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54001919d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:36.566514 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4065095936}
I20260709 13:16:36.556833  7178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50456 (request call id 3058) took 1248 ms. Trace:
I20260709 13:16:36.543668 15222 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:36.560791 15051 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:36.564122  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:36.545107 15234 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:16:36.443642 15023 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.553086 15156 consensus_queue.cc:260] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.579217  7259 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:16:36.581311  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:36.594403  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:36.583060  7178 rpcz_store.cc:276] 0709 13:16:35.307892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.904619 (+596727us) service_pool.cc:224] Handling call
0709 13:16:35.904986 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.081638 (+176652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.556483 (+474845us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b5400256554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:36.556730 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138062208}
W20260709 13:16:36.576236 15179 consensus_meta.cc:287] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.787s	user 0.015s	sys 0.000s
I20260709 13:16:36.596685  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:36.597090  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:36.597482  7258 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:36.601269  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:36.601979  7257 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:36.602345  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:36.602962  7253 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:36.565742 15126 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.601080 15104 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:36.548576 14674 consensus_queue.cc:1059] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:16:36.605922  7255 raft_consensus.cc:2468] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 27.
I20260709 13:16:36.608148  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:36.608707  7258 raft_consensus.cc:3055] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:16:36.644002  7260 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:36.617728 15023 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:36.618448 15193 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.819s	user 0.002s	sys 0.000s
I20260709 13:16:36.619725  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:36.619910 14796 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:36.623123 15119 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:36.672194  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 220482us
I20260709 13:16:36.683017  7260 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:36.683629  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2709) took 1069 ms. Trace:
I20260709 13:16:36.684077  7331 rpcz_store.cc:276] 0709 13:16:35.614722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.689216 (+ 74494us) service_pool.cc:224] Handling call
0709 13:16:35.689691 (+   475us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:35.695191 (+  5500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.695224 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:35.723714 (+ 28490us) log.cc:844] Serialized 52 byte log entry
0709 13:16:36.041075 (+317361us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:36.049476 (+  8401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.049638 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.683334 (+633696us) raft_consensus.cc:1685] finished
0709 13:16:36.683358 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.683537 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5004,"raft.queue_time_us":44043,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"thread_start_us":283082,"threads_started":1,"wal-append.queue_time_us":401631}
I20260709 13:16:36.624920 14879 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:16:36.626479 15177 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.198s	user 0.006s	sys 0.005s
I20260709 13:16:36.606520 15179 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.614838 15104 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:36.608673  7256 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:36.634897 15220 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:16:36.636484 14893 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.712749 14893 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.714913 14803 raft_consensus.cc:3055] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:36.715385 14803 raft_consensus.cc:740] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:36.716405 14803 consensus_queue.cc:260] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.637295 15234 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:16:36.649497  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:36.643932  7258 raft_consensus.cc:740] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 27 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:36.717983  7261 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:36.689796 14879 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:36.719352 14879 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.720937 14879 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:36.723454 15118 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260709 13:16:36.723938 15118 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.726151 15218 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:36.727480  7888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1234) took 2113 ms. Trace:
I20260709 13:16:36.728288 15179 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 32 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:36.728575  7895 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 31. Current term is 32. Ops: [31.18-31.18]
I20260709 13:16:36.729627  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2714) took 1031 ms. Trace:
I20260709 13:16:36.730319 15191 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:36.729832  7261 raft_consensus.cc:2468] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:36.731098 14674 consensus_queue.cc:1059] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:36.731765  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:36.732486  7262 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 18.
I20260709 13:16:36.733078 15104 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:36.733457  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:36.733840  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:36.680050  7302 leader_election.cc:336] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:36.686422  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 117143us
I20260709 13:16:36.689354  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:36.737772  7896 raft_consensus.cc:2410] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:16:36.668915  7257 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 24: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:36.705227  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:36.740446  7260 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:36.741082  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:36.741742  7260 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
W20260709 13:16:36.738703  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 58712.2us
I20260709 13:16:36.708987  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:36.742969 15012 consensus_queue.cc:1059] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:36.743786  7889 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:36.710047 14928 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:36.744168 15012 consensus_queue.cc:1059] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:36.745105 15012 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:36.744876 14928 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.745879 15012 raft_consensus.cc:3055] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:36.746279 15012 raft_consensus.cc:740] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:36.747747 14928 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:36.713157 15190 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:36.736014 15126 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:36.736428 15185 log.cc:927] Time spent T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 1.009s	user 0.000s	sys 0.002s
I20260709 13:16:36.750186 15020 raft_consensus.cc:3055] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:36.750528  7228 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:36.738660  7261 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:36.750726 15020 raft_consensus.cc:740] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:36.787838  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:36.717689 15234 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:36.752023 15224 raft_consensus.cc:3055] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:36.667646  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:36.718422  7258 consensus_queue.cc:260] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.730020  7332 rpcz_store.cc:276] 0709 13:16:35.698178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.850949 (+152771us) service_pool.cc:224] Handling call
0709 13:16:36.729457 (+878508us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b540031bad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:36.729568 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198848384}
I20260709 13:16:36.755472  7256 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:16:36.727898  7888 rpcz_store.cc:276] 0709 13:16:34.613822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.686375 (+ 72553us) service_pool.cc:224] Handling call
0709 13:16:34.865141 (+178766us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:35.078972 (+213831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.079007 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:35.260609 (+181602us) log.cc:844] Serialized 52 byte log entry
0709 13:16:35.695510 (+434901us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:35.695549 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.695616 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.617751 (+922135us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:36.727149 (+109398us) raft_consensus.cc:1685] finished
0709 13:16:36.727174 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.727413 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13639,"raft.queue_time_us":157676,"raft.run_cpu_time_us":4223,"raft.run_wall_time_us":71990,"spinlock_wait_cycles":40966016,"thread_start_us":484316,"threads_started":2,"wal-append.queue_time_us":479881}
I20260709 13:16:36.798812  7889 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:16:36.760183  7187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50456 (request call id 3047) took 2252 ms (client timeout 2017 ms). Trace:
I20260709 13:16:36.763412  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2773) took 1038 ms. Trace:
I20260709 13:16:36.771420  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:36.734083  7262 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:36.800033  7336 rpcz_store.cc:276] 0709 13:16:35.724653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.741167 (+ 16514us) service_pool.cc:224] Handling call
0709 13:16:36.763181 (+1022014us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001b9254. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:36.763326 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515494144}
I20260709 13:16:36.800783 15172 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:36.800909  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:36.801237 15172 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.801702 15172 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:36.802532 15190 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 28.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260709 13:16:36.773804  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 80768.2us
I20260709 13:16:36.803984  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:36.777154  7891 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:16:36.780157  7887 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:16:36.780730  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:36.799399  7187 rpcz_store.cc:269] 0709 13:16:34.507928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.655151 (+147223us) service_pool.cc:224] Handling call
0709 13:16:36.759798 (+2104647us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400247554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:36.760013 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3618047872}
W20260709 13:16:36.766362 15205 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 13:16:36.784626  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:36.699332  7253 raft_consensus.cc:2468] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
W20260709 13:16:36.791704  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:36.707526  7259 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:16:36.809285  7228 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:36.809823  7258 raft_consensus.cc:3060] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:36.796706  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:36.812215  7896 raft_consensus.cc:2368] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25.
I20260709 13:16:36.811455  7150 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:36.813055  7262 raft_consensus.cc:2468] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:36.814177  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:36.809449  7302 leader_election.cc:336] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:36.814908  7261 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:36.815285  7302 leader_election.cc:336] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:36.816665  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:36.815721  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:36.798581 14674 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:36.797782 15224 raft_consensus.cc:740] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:36.823611  7893 raft_consensus.cc:1275] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:16:36.810463 14528 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:36.798283 14928 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:36.827167  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:36.822002  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:36.822697  7302 leader_election.cc:336] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:36.813980 15147 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:36.831029  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:36.812634 15126 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:36.835419  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:36.837702  7259 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 27.
I20260709 13:16:36.843885 15213 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:36.846951  7261 raft_consensus.cc:2468] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:36.821178 14674 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.848830  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:36.827668 15035 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:36.859751  7893 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:36.852710  7228 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:36.836856  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:36.850531 15147 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:36.829066 14759 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:16:36.873409  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:36.875176  7330 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:16:36.877573  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:16:36.876387  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 47274.9us
W20260709 13:16:36.879426  7302 leader_election.cc:336] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:36.880055  7302 leader_election.cc:336] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:36.881448  7336 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:36.881644  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:36.881815  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:36.884578  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:36.887568  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:36.858865 14674 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:36.892197  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:36.882361  7259 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:36.891489  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:36.893847  7301 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:36.898100  7862 leader_election.cc:336] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:36.866168 15173 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.900259  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:36.897505  7302 leader_election.cc:336] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:36.903122  7301 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:36.909035  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:36.870347 15139 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:36.910998  7861 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:36.828205 15020 consensus_queue.cc:260] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.917023  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:36.923981  7861 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:36.926295  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:36.888475 15025 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:36.928632  7330 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 32: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:36.929523  7301 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:36.930256  7302 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:36.937031  7302 leader_election.cc:336] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:36.938458  7302 leader_election.cc:336] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:36.940150  7336 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:36.850244 14928 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:36.829803 15012 consensus_queue.cc:260] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:36.898569 15119 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:36.892072 14528 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:16:36.941527  7302 leader_election.cc:336] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:36.898800 14299 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:36.891913 15023 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:36.891773 14759 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:36.979019  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.948417  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 95864.2us
I20260709 13:16:36.949452 15238 raft_consensus.cc:2764] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:16:36.912542 15133 raft_consensus.cc:2804] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:36.912295 15059 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:36.912794 15127 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:36.913074 15179 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:36.915344 15062 raft_consensus.cc:2804] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:36.964376  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:36.961158  7302 leader_election.cc:336] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:36.965663  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 436014us
I20260709 13:16:36.971385  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:36.908934 15217 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.085s
I20260709 13:16:36.891932 15206 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
I20260709 13:16:36.981781  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:36.935725 15025 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.899363 15191 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:16:37.001818 15059 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.942230 15051 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:36.999536 15127 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:37.001036  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:37.051117  7331 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:36.956189 15149 raft_consensus.cc:2804] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:36.959175 15119 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:37.004371  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:37.012861 15012 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:37.008713  7258 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:36.891148 15060 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.061s
W20260709 13:16:37.057664  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 53485.8us
I20260709 13:16:37.058779  7299 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:37.007712  7330 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:37.010177  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:37.060194  7892 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
W20260709 13:16:37.060942  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 50873.9us
W20260709 13:16:37.008013  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46911.4us
I20260709 13:16:36.988263 14759 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:37.062188  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:36.942617 15035 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 13:16:37.035981  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54332.6us
I20260709 13:16:36.936230 15019 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:16:37.039230 15020 raft_consensus.cc:3060] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:36.916886 15102 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
W20260709 13:16:37.072880  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.045257 15059 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:36.962600 14299 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.008919 15179 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:37.007681 15133 raft_consensus.cc:697] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:36.987279 15104 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.066619  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.039036 15025 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:37.069597  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:37.039897 15238 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:37.098305  7259 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:37.079569  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:36.912963 15173 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.068159 15213 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:37.040009 15062 raft_consensus.cc:697] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:37.056742 15127 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:37.056301 15119 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:37.034890 14528 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:16:37.070204 14680 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:36.845106 15224 consensus_queue.cc:260] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.067360 15101 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:36.843763 15234 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.072732 15019 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.105496  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:37.107928  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.086452 14299 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:37.013561 15147 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.113420  7258 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
W20260709 13:16:37.082273  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:37.088271 15179 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:37.119845  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.124171  7259 raft_consensus.cc:2410] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:16:37.120754  7862 leader_election.cc:336] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:37.101996 15213 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.104832 15187 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.129415  7862 leader_election.cc:336] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:37.115087 15181 raft_consensus.cc:2804] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:37.115713 15019 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:37.157907  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.116052 15101 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.142061  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.137655 15071 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:37.164878 15071 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:37.166181 15071 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.167982 15071 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:37.117292 14796 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:37.171895 15234 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:37.174952 15231 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:37.178663  7253 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:37.137920 15219 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:37.145743 15225 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 13:16:37.146149 15133 consensus_queue.cc:237] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.149515  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.149940 15136 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:37.149807 15251 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.184099  7150 leader_election.cc:400] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25.
I20260709 13:16:37.150354  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.184536  7150 leader_election.cc:403] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:16:37.185014  7260 raft_consensus.cc:2368] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27.
W20260709 13:16:37.182029  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 76615.8us
I20260709 13:16:37.186111  7228 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:37.151149  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.152637 15252 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.155702  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.156224 14680 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.156423  7255 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:16:37.141031  7862 leader_election.cc:336] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:37.195050  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 54060.9us
W20260709 13:16:37.144928 15222 consensus_meta.cc:287] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.007s
W20260709 13:16:37.182211  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 122948us
I20260709 13:16:37.197631  7299 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:37.129168 15213 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:37.186606  7260 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:16:37.187376  7256 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:37.197345  7862 consensus_peers.cc:597] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:37.161361 15101 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:37.162344 15102 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.187827  7259 raft_consensus.cc:2376] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22. Re-sending same reply.
W20260709 13:16:37.215153  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.218446  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:37.176708 15181 raft_consensus.cc:697] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:37.218461  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:37.212092  7228 leader_election.cc:336] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:37.227499  7255 raft_consensus.cc:2410] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:16:37.159451 15187 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:37.224684  7302 leader_election.cc:336] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:37.202005 14680 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:37.235915  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:37.238042  7299 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:37.187036 15136 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:37.187999 15225 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:37.242978  7302 leader_election.cc:336] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:37.208081 15245 raft_consensus.cc:2804] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:16:37.246985  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.252483  7226 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.246795  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 167300us
I20260709 13:16:37.201498 15219 raft_consensus.cc:697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:37.246191 15051 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:37.218084 15149 raft_consensus.cc:697] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:37.254848  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.217101 15222 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.193514 15217 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
W20260709 13:16:37.264899 15248 log.cc:927] Time spent T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:16:37.265877 14552 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:37.248651  7302 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:37.189805 15062 consensus_queue.cc:237] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:37.276808 15235 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.582s	user 0.003s	sys 0.000s
I20260709 13:16:37.207120 15252 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.252720 15139 consensus_queue.cc:1048] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:16:37.283530 15173 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:37.222369 15102 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:37.284791 14879 consensus_meta.cc:287] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.000s
I20260709 13:16:37.284894  7261 pending_rounds.cc:85] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 14
I20260709 13:16:37.341476  7261 pending_rounds.cc:107] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 27.15
I20260709 13:16:37.341853  7261 raft_consensus.cc:2889] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:37.285784 15225 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.20, Last appended by leader: 20, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.287123 15149 consensus_queue.cc:237] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:37.288251  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 50337.7us
I20260709 13:16:37.208506 14796 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:16:37.249296 15136 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:37.204434 15251 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.338246  7255 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 27: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:37.300777  7256 raft_consensus.cc:2410] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:16:37.249830 15256 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:37.295456  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46889.9us
I20260709 13:16:37.368279  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:37.370311  7302 leader_election.cc:336] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:37.371284  7302 leader_election.cc:336] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:37.331272 15139 consensus_queue.cc:1243] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 24.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:16:37.290387 15245 raft_consensus.cc:697] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:37.373554  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.381615  7256 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:37.287644 14893 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:37.374143  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 137288us
W20260709 13:16:37.397955  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.400274  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.346768 15262 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 13:16:37.373236 15104 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:37.412412  7887 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:16:37.383641 15060 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:37.384899  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:37.414469  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 186637us
I20260709 13:16:37.420974  7258 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:37.356531 14674 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.432540  7256 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 28.
I20260709 13:16:37.449551 15222 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:37.391093 15258 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.19, Next index: 20, Last known committed idx: 17, Time since last communication: 0.080s
I20260709 13:16:37.386714 15186 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.459673 15186 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.459412 15245 consensus_queue.cc:237] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.413546 15225 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:16:37.462970 14879 consensus_queue.cc:1048] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:16:37.493584 14674 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:37.497047  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.499728  7262 raft_consensus.cc:2368] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19.
I20260709 13:16:37.502024  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.504050  7256 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 18.
I20260709 13:16:37.509372  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.466339 15060 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:37.516702  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.378891 15181 consensus_queue.cc:237] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.494944 15213 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.537472  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.561785  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.416327 15219 consensus_queue.cc:237] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.560904  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.580408  7256 raft_consensus.cc:2368] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 27. Current term is 28.
I20260709 13:16:37.593513  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.594584  7256 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:37.596781 15252 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:37.573046 15264 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.597961 15060 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.587900 15127 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.603112  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:37.604228 15020 consensus_meta.cc:287] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.001s
I20260709 13:16:37.604859 15251 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:37.607378 15172 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.805s	user 0.016s	sys 0.000s
I20260709 13:16:37.610530  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:37.564379 15277 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:37.640272  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:37.641429  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.582173 15187 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:37.638238  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.638761  7261 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:37.642760  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 234491us
I20260709 13:16:37.644268  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:37.644733  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:37.645421  7889 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:37.649657  7256 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 21: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:37.654170  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:37.640138 15071 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.656864 15059 consensus_meta.cc:287] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.000s
I20260709 13:16:37.664559 15071 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.668835 15213 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:37.670451 15071 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:37.672298  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.672894 15174 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:37.673395 15174 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.656662 15102 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:37.656749 15271 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 13:16:37.679190  7225 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:37.673743  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.681257  7225 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:37.681747  7261 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:37.675199  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.675483  7895 pending_rounds.cc:85] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 15
I20260709 13:16:37.682777  7895 pending_rounds.cc:107] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 13:16:37.683177  7895 raft_consensus.cc:2889] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:37.684469  7225 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:37.685446  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:37.692951  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.694316  7253 raft_consensus.cc:2410] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:16:37.698874  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.699991  7253 raft_consensus.cc:2368] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19.
I20260709 13:16:37.702612 15251 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.703258 15251 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:37.703532 15025 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 13:16:37.689193 15071 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:37.643507 15172 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.647593 15245 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.029s
W20260709 13:16:37.727286 15288 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:16:37.728178 15253 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:37.732242 15133 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.636211 15264 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.741858  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:37.742897  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:37.743462  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:37.825845  7329 raft_consensus.cc:2468] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:37.827280  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:37.706373 15119 consensus_meta.cc:287] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.002s
I20260709 13:16:37.888888  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:37.677217 15174 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:37.681206 15277 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:37.662719 15062 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:16:37.819079  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:37.819589  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 133100us
I20260709 13:16:37.684190 15213 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:37.824831  7228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.823464 15012 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.752s	user 0.004s	sys 0.009s
I20260709 13:16:37.706453 15251 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:37.889019  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:37.697184 15020 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:37.891990  7335 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:37.896922  7225 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:37.727867 15256 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) with higher term. Message: Invalid argument: T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25.
I20260709 13:16:37.894004  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:37.909685  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.869002  7261 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
W20260709 13:16:37.905481 15234 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.003s
I20260709 13:16:37.906994  7327 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:37.913587 15127 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:37.678236 15059 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.928102 15186 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:37.974968  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.935204 15222 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:37.937181 15181 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:37.938212 15172 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:37.940093  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:37.941428  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:37.987761  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46424.4us
I20260709 13:16:37.736387 15136 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.947880 15250 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.894935 15119 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.989847 15250 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:37.991674 15119 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:37.991748  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.992295 15250 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:37.993348  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.993955  7256 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:37.949020 15290 log.cc:927] Time spent T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:37.818768 15139 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:37.951941  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:37.910321  7330 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:37.951303  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2713) took 2253 ms. Trace:
W20260709 13:16:37.901588 14680 consensus_meta.cc:287] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.639s	user 0.013s	sys 0.000s
I20260709 13:16:37.968446  7259 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:37.970621  7891 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:37.973088  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:37.704401 15025 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:37.975888  7261 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:37.977494  7262 raft_consensus.cc:2410] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:16:37.943447 15101 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.003s
I20260709 13:16:37.988422  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:37.986483  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:37.994549 15136 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:38.000553  7329 raft_consensus.cc:2368] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26.
I20260709 13:16:37.979030 15222 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:37.892668 15133 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:38.003376  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.039394  7330 raft_consensus.cc:2393] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:38.002833  7334 rpcz_store.cc:276] 0709 13:16:35.697828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.905295 (+207467us) service_pool.cc:224] Handling call
0709 13:16:36.363611 (+458316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.369558 (+  5947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.926557 (+1556999us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54001f4850. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:37.951208 (+ 24651us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053330688}
I20260709 13:16:37.994841 15102 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.985790 15179 consensus_meta.cc:287] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.846s	user 0.013s	sys 0.000s
I20260709 13:16:38.012740  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:38.014595  7301 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:38.015131 14950 raft_consensus.cc:3060] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:38.016551 15025 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:38.016991 15085 raft_consensus.cc:3055] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:37.999220 15259 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:38.020723  7335 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:16:38.027930  7889 raft_consensus.cc:2468] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
I20260709 13:16:38.018280 15071 raft_consensus.cc:3055] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 31 LEADER]: Stepping down as leader of term 31
I20260709 13:16:38.029837  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.040937  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:38.044202  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:37.907168 15277 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.072482  7328 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:16:38.067993  7301 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:38.065933 15071 raft_consensus.cc:740] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 31 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:38.035051 15222 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:38.074160  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:37.995971 15181 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.054804 15186 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:38.109361  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.061424 15085 raft_consensus.cc:740] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:38.054324  7253 raft_consensus.cc:2393] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 18: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:38.058471  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:38.052122  7261 raft_consensus.cc:2410] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 22 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 9.
I20260709 13:16:38.062083  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:38.117537  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 59163.8us
W20260709 13:16:38.102562 14299 consensus_meta.cc:287] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.976s	user 0.013s	sys 0.000s
I20260709 13:16:38.067693 15259 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.112613  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.097536 15056 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:38.122103  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:38.125958  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:38.128014 15025 consensus_queue.cc:1059] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:38.128243 15289 consensus_queue.cc:1059] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.160s
I20260709 13:16:38.037177 15119 consensus_queue.cc:1059] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.19, Next index: 20, Last known committed idx: 17, Time since last communication: 0.065s
I20260709 13:16:38.117987  7260 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:38.064194 15102 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:38.059530  7225 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:38.069854  7327 raft_consensus.cc:2393] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:38.010035 15139 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.034487 15101 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.128518  7253 raft_consensus.cc:2393] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 27: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:38.093755 15187 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:38.130498  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:38.136904  7330 raft_consensus.cc:3060] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:38.063408 15179 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.139111  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:38.132843  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:38.140234  7260 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:38.141217  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:38.115720  7256 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
W20260709 13:16:38.135295  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 75894.3us
I20260709 13:16:38.106580 15126 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.123322 15006 raft_consensus.cc:2804] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:38.135764  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:38.023274 14680 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.122648 15259 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:38.147482  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:38.133626 15019 consensus_meta.cc:287] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.954s	user 0.011s	sys 0.002s
I20260709 13:16:38.152567  7327 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:16:38.154420 15295 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:16:38.158550  7887 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 25: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:38.160274 15277 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:38.140007 15245 raft_consensus.cc:2764] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:16:38.122164 15071 consensus_queue.cc:260] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.18, Last appended by leader: 18, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.165977 14680 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:38.125083 14299 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:38.167022 14680 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.167732 14680 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.168869 14299 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:38.172333 14680 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:38.154270  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:38.174233 15139 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:38.175045  7331 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:16:38.176043 15101 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:38.178822  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:38.180449  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:38.180938  7331 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:16:38.181844  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:38.133775 15206 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:38.183771 15206 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.184211 15206 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:38.188814  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:38.190271  7256 raft_consensus.cc:2393] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 18: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:38.193343  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:38.138516 15187 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:38.194995  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 50642.4us
I20260709 13:16:38.195855  7327 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26. Ops: []
I20260709 13:16:38.210212  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:38.211388  7887 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:38.222879  7260 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:16:38.148849 15126 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:38.232324  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1626) took 3603 ms. Trace:
I20260709 13:16:38.226044  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:38.188031 15019 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.238901 14674 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:38.239642 15019 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:38.239959 14674 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.187359 15264 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:38.236186  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:38.249140 14299 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:38.249804 14299 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:38.228673  7260 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:16:38.250324 14299 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:38.149121 15006 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:38.230274  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.251088  7260 pending_rounds.cc:85] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 15
I20260709 13:16:38.232775  7254 rpcz_store.cc:276] 0709 13:16:34.629371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.673742 (+ 44371us) service_pool.cc:224] Handling call
0709 13:16:34.674092 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.867453 (+193361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.867485 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.890257 (+ 22772us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.600497 (+710240us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:36.642770 (+1042273us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b18001eb020. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fececc343c7 00007fece92469a7 00007fece92560bf 00007fece9256038
0709 13:16:36.869685 (+226915us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.231733 (+1362048us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b18001eb020. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece8de44bc 00007fece613248b 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b 00007fece8ddbd23 00007fece8ddc23a
0709 13:16:38.231955 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.232047 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.232111 (+    64us) raft_consensus.cc:1685] finished
0709 13:16:38.232123 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.232263 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1367296,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":6292,"raft.queue_time_us":182241,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14509,"spinlock_wait_cycles":20557824,"thread_start_us":951033,"threads_started":3,"wal-append.queue_time_us":905114,"wal-append.run_cpu_time_us":2468,"wal-append.run_wall_time_us":1095453}
I20260709 13:16:38.261956  7260 pending_rounds.cc:107] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:16:38.262318  7260 raft_consensus.cc:2889] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:38.285112  7255 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:38.286135  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2621) took 1005 ms. Trace:
I20260709 13:16:38.286583  7255 rpcz_store.cc:276] 0709 13:16:37.280771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.231249 (+950478us) service_pool.cc:224] Handling call
0709 13:16:38.284865 (+ 53616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.285808 (+   943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.286076 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:38.206120 15187 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:38.225694 15190 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:38.281961 15006 raft_consensus.cc:3060] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:38.344121  7255 raft_consensus.cc:1275] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:38.328553  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2619) took 1048 ms. Trace:
I20260709 13:16:38.339453 15181 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:38.346894  7260 rpcz_store.cc:276] 0709 13:16:37.280185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.227768 (+947583us) service_pool.cc:224] Handling call
0709 13:16:38.228176 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.328197 (+100021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.328479 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:38.312536 15059 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:38.327442 15274 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.342286 15275 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.341743 15234 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:38.373356 15102 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:38.381281  7330 raft_consensus.cc:2468] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 27.
I20260709 13:16:38.382975  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.385953  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.389559 14299 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.391959  7330 raft_consensus.cc:2393] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 25: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:38.341137 15190 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.373282 15133 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:38.419090  7335 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19.
I20260709 13:16:38.420835  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:38.429618  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:38.430660  7887 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:38.431411 14299 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:38.375062 15274 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.447198  7335 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:16:38.378545 15234 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.429975 15181 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:38.463138  7335 raft_consensus.cc:1240] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 31. Current term is 32. Ops: [31.18-31.18]
W20260709 13:16:38.466409  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.450773 15056 raft_consensus.cc:697] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:38.375626 15275 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:38.474689  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 288475us
I20260709 13:16:38.472808 15181 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:38.464294 14974 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 13:16:38.467374 14637 consensus_queue.cc:1059] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 13:16:38.488885 15179 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:38.516331 15296 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.139s	user 0.001s	sys 0.001s
W20260709 13:16:38.531699  7336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1280) took 1640 ms (client timeout 1528 ms). Trace:
W20260709 13:16:38.532254  7336 rpcz_store.cc:269] 0709 13:16:36.890890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.891220 (+   330us) service_pool.cc:224] Handling call
0709 13:16:38.531467 (+1640247us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b540036ae54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:38.531611 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107074304}
I20260709 13:16:38.560843  7335 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:16:38.566663 15012 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.598928  7336 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 31 index: 20. (index mismatch)
I20260709 13:16:38.600139  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1284) took 1595 ms. Trace:
W20260709 13:16:38.607553  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:38.608855  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:38.610380  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.611742 14833 raft_consensus.cc:3055] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:38.612663  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:38.610145 15174 consensus_meta.cc:287] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.702s	user 0.015s	sys 0.000s
I20260709 13:16:38.613212 14974 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 13:16:38.615687 15298 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:16:38.616475 15301 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:16:38.620744 15291 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.909s	user 0.004s	sys 0.000s
I20260709 13:16:38.621191  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 4079) took 1363 ms. Trace:
I20260709 13:16:38.626940  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.628084  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2609) took 1506 ms. Trace:
I20260709 13:16:38.628238 15259 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:38.632081  7152 connection.cc:256] RPC call timeout handler was delayed by -1.3711821389999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 13:16:38.656623  7152 connection.cc:256] RPC call timeout handler was delayed by -1.3675821389999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 13:16:38.657301  7152 connection.cc:256] RPC call timeout handler was delayed by -1.353182138999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 13:16:38.657706  7152 connection.cc:256] RPC call timeout handler was delayed by -1.3450821389999419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260709 13:16:38.658090  7152 connection.cc:256] RPC call timeout handler was delayed by -1.3180821389998982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:16:38.633988 15234 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:38.555663 15056 consensus_queue.cc:237] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:38.654309  7253 rpcz_store.cc:276] 0709 13:16:37.257492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.214878 (+957386us) service_pool.cc:224] Handling call
0709 13:16:38.215256 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.215770 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.215816 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.216502 (+   686us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.485523 (+269021us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:38.485581 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.485677 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.620943 (+135266us) raft_consensus.cc:1685] finished
0709 13:16:38.620968 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.621120 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9783,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":29885,"thread_start_us":248239,"threads_started":1,"wal-append.queue_time_us":372723}
I20260709 13:16:38.603996  7333 rpcz_store.cc:276] 0709 13:16:37.003599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.003917 (+   318us) service_pool.cc:224] Handling call
0709 13:16:37.035396 (+ 31479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.035674 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:16:37.053328 (+ 17654us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.124000 (+1070672us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b1800324160. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fececc343c7 00007fece92469a7 00007fece92560bf 00007fece9256038
0709 13:16:38.124343 (+   343us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.138932 (+ 14589us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.587669 (+448737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.587730 (+    61us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:38.587774 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.587848 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.599275 (+ 11427us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1053342,"prepare.queue_time_us":1333788,"prepare.run_cpu_time_us":170,"prepare.run_wall_time_us":180,"raft.queue_time_us":81614,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":174,"spinlock_wait_cycles":26055168,"thread_start_us":448003,"threads_started":1,"wal-append.queue_time_us":4380}
I20260709 13:16:38.638549  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:38.591316 15190 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:38.588987 15119 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:38.690809  7334 raft_consensus.cc:2368] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19.
I20260709 13:16:38.644197  7888 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:38.604281 15118 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:38.606920 15303 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.608745 15304 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.656383  7258 rpcz_store.cc:276] 0709 13:16:37.121245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.122145 (+   900us) service_pool.cc:224] Handling call
0709 13:16:38.627855 (+1505710us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400217ad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:38.628005 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462813568}
I20260709 13:16:38.643751 14833 raft_consensus.cc:740] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:38.707142  7258 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:38.707832  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2646) took 1099 ms. Trace:
I20260709 13:16:38.708214  7258 rpcz_store.cc:276] 0709 13:16:37.608296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.706607 (+1098311us) service_pool.cc:224] Handling call
0709 13:16:38.706967 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.707569 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.707775 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:38.708787  7862 leader_election.cc:336] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:38.709627  7862 leader_election.cc:336] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:38.710110  7862 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:38.711733  7862 leader_election.cc:336] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:38.645016 14803 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:38.607874 15012 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:38.689762  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.577546 15181 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.612888  7893 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 31 index: 20. (term mismatch)
W20260709 13:16:38.690277  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 51806.6us
I20260709 13:16:38.751514  7893 pending_rounds.cc:85] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting all ops after (but not including) 19
I20260709 13:16:38.751916  7893 pending_rounds.cc:107] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Aborting uncommitted NO_OP operation due to leader change: 30.20
I20260709 13:16:38.751998  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:38.752298  7893 raft_consensus.cc:2889] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:38.691309  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1278) took 1817 ms. Trace:
I20260709 13:16:38.700424  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.703619  7253 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:16:38.756074  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2640) took 1248 ms. Trace:
I20260709 13:16:38.756788  7253 rpcz_store.cc:276] 0709 13:16:37.507822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.702614 (+1194792us) service_pool.cc:224] Handling call
0709 13:16:38.703121 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.755794 (+ 52673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.756015 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:38.758517  7253 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:16:38.686050  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:38.719360  7862 leader_election.cc:336] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:38.714066  7887 raft_consensus.cc:2468] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:38.759177  7328 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:38.760025  7891 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25. Ops: []
W20260709 13:16:38.761179  7862 leader_election.cc:336] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:38.762051  7862 leader_election.cc:336] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:38.646528 15025 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:16:38.789463  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:38.759202 15222 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.641s	user 0.013s	sys 0.000s
I20260709 13:16:38.771255 15139 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:38.791625 15025 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:16:38.791987 15139 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.794893 15274 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:38.802016  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:38.803006  7333 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 27: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:38.803926  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.805048  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:38.699827 15234 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.752980 15190 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:38.806763  7888 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 27.
W20260709 13:16:38.809288 15206 consensus_meta.cc:287] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.006s
I20260709 13:16:38.809825 15206 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:38.810393  7895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1354) took 1149 ms. Trace:
I20260709 13:16:38.810815  7895 rpcz_store.cc:276] 0709 13:16:37.660689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.660873 (+   184us) service_pool.cc:224] Handling call
0709 13:16:37.675248 (+ 14375us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:37.899941 (+224693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.900002 (+    61us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:37.908770 (+  8768us) log.cc:844] Serialized 78 byte log entry
0709 13:16:38.329121 (+420351us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:38.329181 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.329280 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.810145 (+480865us) raft_consensus.cc:1685] finished
0709 13:16:38.810167 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.810335 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155234,"raft.queue_time_us":164589,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":45853,"thread_start_us":329329,"threads_started":1,"wal-append.queue_time_us":504378}
I20260709 13:16:38.813259  7895 raft_consensus.cc:1240] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:38.753274  7332 rpcz_store.cc:276] 0709 13:16:36.873398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.873542 (+   144us) service_pool.cc:224] Handling call
0709 13:16:36.890890 (+ 17348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:36.910556 (+ 19666us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:16:36.953610 (+ 43054us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.194552 (+240942us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:37.214314 (+ 19762us) log.cc:844] Serialized 52 byte log entry
0709 13:16:37.214548 (+   234us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:38.441207 (+1226659us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.648137 (+206930us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.690913 (+ 42776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.691008 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.691050 (+    42us) raft_consensus.cc:1685] finished
0709 13:16:38.691062 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.691214 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1017880,"prepare.queue_time_us":974990,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":7580,"raft.queue_time_us":63208,"raft.run_cpu_time_us":687,"raft.run_wall_time_us":78155,"spinlock_wait_cycles":15407232,"thread_start_us":693416,"threads_started":3,"wal-append.queue_time_us":265620,"wal-append.run_cpu_time_us":2539,"wal-append.run_wall_time_us":1025291}
I20260709 13:16:38.809135 15012 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:38.820719  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:38.821895  7335 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:38.749003 14928 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:38.823783  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:38.754812 15303 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:38.823849 14833 consensus_queue.cc:260] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 21.19, Last appended by leader: 19, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.825977 14928 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:38.826131 15303 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:38.826792 14928 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:38.827281 14928 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:38.828233 14928 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.833802 15259 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:38.806185 15234 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.837388 15234 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:38.651872 15174 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.839326  7888 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:16:38.840291 15174 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:38.840483  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:38.842204 15204 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:38.842612 15204 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.842998 15204 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:38.841089 15025 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:16:38.847530 15025 consensus_queue.cc:1243] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer 9a54ecc9fb4541df915f9f8c01e19429 log is divergent from this leader: its last log entry 22.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:16:38.833803 15206 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:38.848865 15126 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.001s
I20260709 13:16:38.849310 15126 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.850618  7889 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 22: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:38.760211 15304 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.837972 15006 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:38.857672 15304 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:38.748642 15119 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:38.861780  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2718) took 1116 ms. Trace:
I20260709 13:16:38.862299  7329 rpcz_store.cc:276] 0709 13:16:37.745858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.888269 (+142411us) service_pool.cc:224] Handling call
0709 13:16:38.861575 (+973306us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400288cd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:38.861716 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254032768}
I20260709 13:16:38.863428 15264 raft_consensus.cc:3055] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:38.863893 15264 raft_consensus.cc:740] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:38.870934  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:38.794457 15139 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:38.875114  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:38.877017  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:38.878786  7335 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:38.881022  7333 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:16:38.857717 15006 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:38.791085 15222 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:38.877305 15303 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:38.880748 14974 consensus_queue.cc:1059] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:16:38.923775  7261 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
W20260709 13:16:38.921871  7862 leader_election.cc:336] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:38.886467 15206 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:16:38.909967 15025 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:16:38.918777 15303 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:38.932169 15222 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:38.932335  7890 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:16:38.944092  7260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 4085) took 1456 ms. Trace:
W20260709 13:16:38.944986  7862 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:38.944917 15012 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:38.947211  7260 rpcz_store.cc:276] 0709 13:16:37.487399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.348213 (+860814us) service_pool.cc:224] Handling call
0709 13:16:38.348697 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.348992 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:16:38.555464 (+206472us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.942797 (+387333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.942905 (+   108us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:16:38.942981 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.943761 (+   780us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.943996 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":474114,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":37,"thread_start_us":591216,"threads_started":2}
I20260709 13:16:39.001089  7335 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:38.912019 15264 consensus_queue.cc:260] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:39.004766 15264 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:39.009616 15275 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:39.010880 15283 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:39.011523 15283 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:39.013801 15283 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:38.945240 15222 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:39.016034 15174 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.082376  7335 raft_consensus.cc:1240] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: []
W20260709 13:16:39.065075 15187 consensus_meta.cc:287] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.752s	user 0.015s	sys 0.000s
I20260709 13:16:39.015878 15126 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:39.052604 15149 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.071110  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 431423us
I20260709 13:16:39.099825 15245 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:39.100677 15245 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:39.102909 15245 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:39.103464 15245 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:39.103926 15245 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:39.106115 15245 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:39.108301  7302 leader_election.cc:336] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:39.114106  7302 leader_election.cc:336] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:39.116111 15085 consensus_queue.cc:260] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:39.122997  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.999852 15204 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:39.143811  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 485171us
W20260709 13:16:39.146646  7152 connection.cc:256] RPC call timeout handler was delayed by -1.2955821390000892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 13:16:39.151223  7152 connection.cc:256] RPC call timeout handler was delayed by -1.2946821390000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 13:16:39.128018 15222 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.935607 15285 consensus_queue.cc:1175] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" responder_term: 22 status { last_received { term: 22 index: 15 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:16:39.142144  7862 leader_election.cc:336] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:39.091841 15174 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:39.096863 15187 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:39.124135 15149 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:39.165411  7152 leader_election.cc:336] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Timed out: RequestConsensusVote RPC to 127.5.227.130:40351 timed out after 1.701s (SENT)
I20260709 13:16:39.163889 15222 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:39.211745  7257 raft_consensus.cc:2410] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 26 because replica has last-logged OpId of term: 25 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 18.
I20260709 13:16:39.207574 14528 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:39.230729 14528 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:39.232333 14528 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:39.235494 14637 raft_consensus.cc:3055] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:39.237634  7328 raft_consensus.cc:1240] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: [21.17-21.17]
W20260709 13:16:39.239990 15316 log.cc:927] Time spent T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:16:39.241354  7262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2627) took 1958 ms (client timeout 1757 ms). Trace:
I20260709 13:16:39.218792 14796 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.210494 15056 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.216008 15303 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:39.330265  7262 rpcz_store.cc:269] 0709 13:16:37.282567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.561420 (+278853us) service_pool.cc:224] Handling call
0709 13:16:39.241062 (+1679642us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b5400226fd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:39.241270 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952942976}
I20260709 13:16:39.329381  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:39.349891  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.351251  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 122171us
W20260709 13:16:39.352679  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 71110us
W20260709 13:16:39.354421  7228 leader_election.cc:336] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.627s (SENT)
I20260709 13:16:39.356091  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:39.359475  7228 leader_election.cc:336] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.756s (SENT)
I20260709 13:16:39.289963 14637 raft_consensus.cc:740] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:39.365250  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 204587us
W20260709 13:16:39.365890  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.377431  7152 connection.cc:256] RPC call timeout handler was delayed by -1.2649821390000398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260709 13:16:39.366852  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.036s	sys 0.072s
I20260709 13:16:39.341018 15275 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.367587  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:39.365847 15317 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:16:39.372098 15149 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:39.391399  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.039s	sys 0.075s
W20260709 13:16:39.363039 15318 log.cc:927] Time spent T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:16:39.360049 14528 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:39.401239  7152 connection.cc:256] RPC call timeout handler was delayed by -1.2541821390000223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
I20260709 13:16:39.403190 15323 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:16:39.420657  7152 connection.cc:256] RPC call timeout handler was delayed by -1.2415821390000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 13:16:39.421116  7152 connection.cc:256] RPC call timeout handler was delayed by -1.2325821389999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260709 13:16:39.421456  7152 connection.cc:256] RPC call timeout handler was delayed by -1.2082821389999481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 13:16:39.421818  7152 connection.cc:256] RPC call timeout handler was delayed by -1.1884821389999161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 13:16:39.361132 14803 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:39.415866  7261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2648) took 1806 ms (client timeout 2111 ms). Trace:
W20260709 13:16:39.418022  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 666067us
W20260709 13:16:39.427922  7261 rpcz_store.cc:269] 0709 13:16:37.608934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.138830 (+529896us) service_pool.cc:224] Handling call
0709 13:16:39.415546 (+1276716us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54002e7f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:39.415769 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788938624}
I20260709 13:16:39.428354  7225 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:39.403278  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 43859.3us
I20260709 13:16:39.352816 15056 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:39.400358 14344 consensus_queue.cc:1059] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:16:39.390108 14928 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:39.350895 14796 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:39.449473  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 96062.5us
I20260709 13:16:39.423831 15226 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:39.423094 15224 raft_consensus.cc:3060] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:39.489303  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.439967 15323 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.495316  7895 raft_consensus.cc:1240] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
I20260709 13:16:39.400849 15334 consensus_queue.cc:1059] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.107s
I20260709 13:16:39.499043  7888 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:16:39.416524 15275 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:39.480247 15192 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.342s	user 0.016s	sys 0.027s
I20260709 13:16:39.439682 15320 raft_consensus.cc:2804] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:39.473680 14928 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:39.508567  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.501497 15174 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:39.488202 15226 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:39.507679 15192 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.369s	user 0.017s	sys 0.028s
I20260709 13:16:39.494025 15187 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:39.540194  7228 leader_election.cc:336] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.879s (SENT)
I20260709 13:16:39.504513 15323 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:39.548647 15347 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:39.549160 15333 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:39.549585 15347 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:39.568274  7225 connection.cc:256] RPC call timeout handler was delayed by -1.1669857440001579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
W20260709 13:16:39.574265  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.574541  7225 connection.cc:256] RPC call timeout handler was delayed by -1.0886857440000313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
W20260709 13:16:39.575371  7225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.583009  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.530189 15320 raft_consensus.cc:697] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:39.533136 15204 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:39.579273 14803 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:39.592865  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.607257  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1247) took 1017 ms. Trace:
W20260709 13:16:39.608824  7334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33690 (request call id 2730) took 1606 ms (client timeout 1925 ms). Trace:
I20260709 13:16:39.609102  7331 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: []
W20260709 13:16:39.609247  7334 rpcz_store.cc:269] 0709 13:16:38.002474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.040530 (+ 38056us) service_pool.cc:224] Handling call
0709 13:16:39.608614 (+1568084us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b540020fdd4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:39.608767 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434019072}
I20260709 13:16:39.563323 15324 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.603312  7302 leader_election.cc:336] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:39.613905  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:39.607746  7890 rpcz_store.cc:276] 0709 13:16:38.589930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.590764 (+   834us) service_pool.cc:224] Handling call
0709 13:16:38.932045 (+341281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.945508 (+ 13463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.607046 (+661538us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540043a8d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:39.607195 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783859584}
I20260709 13:16:39.622346  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:39.623446  7334 raft_consensus.cc:2368] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 23. Current term is 24.
W20260709 13:16:39.649482  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 173527us
I20260709 13:16:39.651265  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:39.655226  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:39.655983  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:39.712580  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 58667.6us
I20260709 13:16:39.529913 14637 consensus_queue.cc:260] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:39.660465 15335 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:16:39.733050  7895 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 27: Already voted for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in this term.
I20260709 13:16:39.604694 14803 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:39.661921 15326 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:16:39.661394 15320 consensus_queue.cc:237] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:39.662541 15329 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:16:39.663089  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:39.663303 15325 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:16:39.665903 15119 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:39.668159  7255 raft_consensus.cc:1275] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:16:39.615274 15245 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.668673 15224 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.670161 15347 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:39.671748 15226 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:39.657748 14928 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:39.678377  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:39.751678 15056 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:39.681650  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:39.682319 14674 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:39.683516  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1288) took 1491 ms. Trace:
I20260709 13:16:39.684669  7329 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:39.647092 15324 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:39.687317 14796 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:39.688277 14974 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:16:39.690732 15264 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.006s
I20260709 13:16:39.699290  7299 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:39.786514  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 87389.8us
I20260709 13:16:39.679365 15275 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:39.702584  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:39.712497  7334 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 19.
W20260709 13:16:39.744908  7228 leader_election.cc:336] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.988s (SENT)
W20260709 13:16:39.790346  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45485.2us
I20260709 13:16:39.762184 15334 consensus_queue.cc:1059] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
W20260709 13:16:39.755390  7302 leader_election.cc:336] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:39.658636 15327 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:16:39.780725  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:39.779927  7330 rpcz_store.cc:276] 0709 13:16:38.192451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.385482 (+193031us) service_pool.cc:224] Handling call
0709 13:16:39.683255 (+1297773us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b54001d29d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:39.683438 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9110912}
I20260709 13:16:39.789451  7328 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:39.748334  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2719) took 2002 ms. Trace:
I20260709 13:16:39.796792  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:39.797035  7327 rpcz_store.cc:276] 0709 13:16:37.746102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.153419 (+407317us) service_pool.cc:224] Handling call
0709 13:16:38.153829 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.196520 (+ 42691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.748049 (+1551529us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b54001b9254. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:39.748273 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79619328}
I20260709 13:16:39.797873  7330 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:39.762483 15204 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:16:39.791890  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:39.802102  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2801) took 1204 ms. Trace:
W20260709 13:16:39.800935  7302 leader_election.cc:336] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:39.791072 15056 raft_consensus.cc:2804] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:39.785874 14674 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.806141  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:39.808715  7336 raft_consensus.cc:2468] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:39.809216  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:39.785725 14974 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:39.770387 15245 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:39.773537 15224 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:39.808235  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:39.802736  7333 rpcz_store.cc:276] 0709 13:16:38.597969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.905906 (+307937us) service_pool.cc:224] Handling call
0709 13:16:38.915768 (+  9862us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:38.916309 (+   541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.916372 (+    63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:38.976391 (+ 60019us) log.cc:844] Serialized 52 byte log entry
0709 13:16:39.436477 (+460086us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:39.542249 (+105772us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.610916 (+ 68667us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.611124 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.611208 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.801826 (+190618us) raft_consensus.cc:1685] finished
0709 13:16:39.801852 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.802031 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50463,"prepare.queue_time_us":273394,"prepare.run_cpu_time_us":202,"prepare.run_wall_time_us":204,"raft.queue_time_us":21674,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":35895,"thread_start_us":399767,"threads_started":2,"wal-append.queue_time_us":496466}
I20260709 13:16:39.809899  7895 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 27.
I20260709 13:16:39.815479  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:39.816756  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:39.817780  7302 leader_election.cc:336] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:39.819690  7302 leader_election.cc:336] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:39.820185  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:39.820423  7302 leader_election.cc:336] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:39.821210  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:39.823930  7253 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:16:39.824364  7253 pending_rounds.cc:85] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 11
I20260709 13:16:39.824931  7253 pending_rounds.cc:107] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:16:39.825196  7253 raft_consensus.cc:2889] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:39.824343  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:39.829947  7260 raft_consensus.cc:2393] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 25: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:39.832700  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:39.833993  7225 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:39.834892  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:39.833969  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:39.835546  7261 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 28.
I20260709 13:16:39.836262  7258 raft_consensus.cc:2393] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:39.837035  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 342103us
I20260709 13:16:39.834136  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:39.837121  7225 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:39.811610 15259 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:16:39.841135  7330 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
W20260709 13:16:39.827610  7302 leader_election.cc:336] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:39.841778  7262 raft_consensus.cc:2393] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:39.842278  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:39.844273  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.817557 15056 raft_consensus.cc:697] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:39.823407 14879 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:39.839738  7256 raft_consensus.cc:1275] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:39.850186  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:39.837288  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:39.857923  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:39.858958  7330 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:39.857138  7302 leader_election.cc:336] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:39.862124  7302 leader_election.cc:336] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:39.863525  7302 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:39.817373 14674 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:39.865248  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:39.867794  7259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2625) took 2573 ms (client timeout 1711 ms). Trace:
I20260709 13:16:39.864087  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:39.874776  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:39.877097  7259 rpcz_store.cc:269] 0709 13:16:37.281968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.509097 (+227129us) service_pool.cc:224] Handling call
0709 13:16:39.855638 (+2346541us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54002170d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:39.855783 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053798784}
I20260709 13:16:39.895339  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 33 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:39.896565  7333 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 32.
W20260709 13:16:39.901017  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63121.4us
I20260709 13:16:39.902112  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:39.903512  7302 leader_election.cc:336] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:39.904228  7302 leader_election.cc:336] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:39.860178 14344 raft_consensus.cc:3055] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:16:39.900085 15335 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:39.925521  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:39.923784  7302 leader_election.cc:336] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:39.928530  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:39.931455  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:39.879654 15354 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:16:39.937891  7228 leader_election.cc:336] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 2.197s (SENT)
I20260709 13:16:39.917771 15259 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:16:39.941489  7228 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:39.923440 14344 raft_consensus.cc:740] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:39.946594  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 179647us
I20260709 13:16:39.875538 14879 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:39.952575 15361 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:39.941838  7302 leader_election.cc:336] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:39.933095 14803 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:39.947384 15315 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.797s	user 0.004s	sys 0.001s
I20260709 13:16:39.970072  7302 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:39.943925 15204 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:39.978430  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:39.860844 14974 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:39.986413  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 46082.7us
I20260709 13:16:39.990125  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:39.944269 15355 raft_consensus.cc:2804] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:39.986662 15358 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.981423 14803 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.001722  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:39.996482  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 58661.1us
W20260709 13:16:39.991884  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 152104us
W20260709 13:16:40.003069  7302 leader_election.cc:336] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:39.995883 14974 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:40.006332  7254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2630) took 2596 ms. Trace:
I20260709 13:16:39.973567 15354 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:16:40.006795  7254 rpcz_store.cc:276] 0709 13:16:37.409513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.281342 (+871829us) service_pool.cc:224] Handling call
0709 13:16:38.281749 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.307180 (+ 25431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.307216 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.346043 (+ 38827us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.750122 (+404079us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:39.004891 (+254769us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b480033c3d8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecee165aa1 00007fecee15cb37 00007fecee15c9ca 00007fecee25426f 00007fecee253f37 00007fecee26855c 00007fecee268508 00007fecee268488 00007fecee268443 00007fecee2676ec 00007feced191a96
0709 13:16:39.148081 (+143190us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.148392 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.148479 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.807588 (+659109us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:40.006082 (+198494us) raft_consensus.cc:1685] finished
0709 13:16:40.006104 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.006269 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24884,"prepare.queue_time_us":73442,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":26882,"raft.run_cpu_time_us":7319,"raft.run_wall_time_us":698253,"spinlock_wait_cycles":336838272,"thread_start_us":696278,"threads_started":2,"wal-append.queue_time_us":719488}
I20260709 13:16:40.008206 15354 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:40.009006 15354 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.009136 15358 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:40.009507 15354 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:39.971421 15360 consensus_queue.cc:1059] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.045s
I20260709 13:16:40.011857 15358 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:40.014679  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:40.016010 15006 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:40.016577 15245 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:40.016782 15006 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:40.017911  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:40.003878  7302 leader_election.cc:336] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:39.988895 15305 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.000957 15355 raft_consensus.cc:697] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:40.021391 15355 consensus_queue.cc:237] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.033731 14879 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:40.019944 14674 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:40.019134  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:40.019946  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:40.037056  7302 leader_election.cc:336] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:40.037847  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:40.001861 15204 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:40.039512 15204 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:40.020160 15224 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:39.975759 15056 consensus_queue.cc:237] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:40.041200  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:40.037895  7302 leader_election.cc:336] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:40.042666  7302 leader_election.cc:336] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:40.044476  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.049286  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:40.018296 15259 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:40.039788 15362 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:40.053231  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:40.065908  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:40.043603 15361 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:16:40.099407  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 96375us
I20260709 13:16:40.103597  7225 leader_election.cc:400] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19.
I20260709 13:16:40.104189  7225 leader_election.cc:403] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:16:40.106068  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52981.5us
I20260709 13:16:40.107473  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:40.064138 15204 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:40.097158 15358 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:40.114750  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:40.026904 14803 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:40.135890  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.136766  7254 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 25: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:40.097486 15224 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:40.026134 15305 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:40.137789  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.109689 15259 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:40.153785  7259 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:16:40.154810  7259 pending_rounds.cc:85] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 13
I20260709 13:16:40.155088  7259 pending_rounds.cc:107] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:16:40.155336  7259 raft_consensus.cc:2889] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:40.112879 15362 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:16:40.155773  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.156428  7254 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:40.023325 14344 consensus_queue.cc:260] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:40.135339 15204 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:40.159947  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.134497 15342 raft_consensus.cc:3055] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:40.161533  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.138010 15361 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:16:40.163800  7253 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 21.
I20260709 13:16:40.168144  7253 raft_consensus.cc:1240] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:16:40.171187  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.171904  7256 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
W20260709 13:16:40.153344 14528 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.713s	user 0.012s	sys 0.002s
I20260709 13:16:40.176486  7262 raft_consensus.cc:1275] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:16:40.179463  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:40.181908  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 80991.3us
I20260709 13:16:40.183151  7225 leader_election.cc:400] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 23. Current term is 24.
I20260709 13:16:40.183264 15012 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:40.183503  7225 leader_election.cc:403] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:16:40.185724 15368 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:40.186692 15250 raft_consensus.cc:3055] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:40.187134 15250 raft_consensus.cc:740] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:40.188038 15250 consensus_queue.cc:260] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.189100 15250 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:40.151405 15224 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.191033 15358 consensus_queue.cc:1059] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:16:40.191975 15370 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:40.163053 14974 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:40.166878 15204 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:40.194546 15362 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:40.166901 15342 raft_consensus.cc:740] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:40.199004  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:40.200256  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.201241  7258 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:40.202581 15305 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:40.200012 15342 consensus_queue.cc:260] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:40.199932  7890 raft_consensus.cc:2468] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:40.192570 15370 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.209084  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:40.163067  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 61278.8us
I20260709 13:16:40.216850  7261 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:40.218529  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.220938  7254 raft_consensus.cc:2468] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 29.
I20260709 13:16:40.226226  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 33 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.226598  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.227444  7261 raft_consensus.cc:2376] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 19. Re-sending same reply.
I20260709 13:16:40.228312  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.228870  7258 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:16:40.230777  7890 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:40.234123  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:40.215910 14674 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:16:40.221697 15342 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:16:40.253096  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.238358 14674 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:40.255743 14674 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:40.255527 15305 consensus_queue.cc:1048] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:40.256366 15365 raft_consensus.cc:3060] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:40.235082 15254 consensus_queue.cc:1059] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:16:40.259342 15358 raft_consensus.cc:3055] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:40.259789 15358 raft_consensus.cc:740] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:40.241541  7890 raft_consensus.cc:1240] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:40.260666 15358 consensus_queue.cc:260] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.243619  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.262120 15358 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:40.244143 14803 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:40.247705 15370 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:40.264305  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.264989  7261 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:40.265754 15299 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 1.730s	user 0.005s	sys 0.014s
I20260709 13:16:40.254421  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.268376 15025 raft_consensus.cc:3055] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:40.268937 15025 raft_consensus.cc:740] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:40.270026 15254 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:16:40.270519 15254 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.271003 15254 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:40.274163 15323 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:40.236397 15224 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:40.270720 15356 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:40.272897  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:40.291247  7892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1356) took 2325 ms. Trace:
I20260709 13:16:40.298957  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.296597  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:40.303768  7256 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:40.279928  7260 raft_consensus.cc:1275] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:16:40.269927 15025 consensus_queue.cc:260] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.297852  7261 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:40.283401  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.305927  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.298738  7892 rpcz_store.cc:276] 0709 13:16:37.966357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.966503 (+   146us) service_pool.cc:224] Handling call
0709 13:16:37.987180 (+ 20677us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:37.987746 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.987791 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:37.988553 (+   762us) log.cc:844] Serialized 52 byte log entry
0709 13:16:38.308106 (+319553us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:38.308152 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.308231 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.265143 (+1956912us) spinlock_profiling.cc:243] Waited 9.92 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:40.290849 (+ 25706us) raft_consensus.cc:1685] finished
0709 13:16:40.290874 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.291152 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1121,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":5982,"spinlock_wait_cycles":22824960,"thread_start_us":271634,"threads_started":1,"wal-append.queue_time_us":470892}
I20260709 13:16:40.306941  7253 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
I20260709 13:16:40.305156 15259 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.004s
I20260709 13:16:40.309515 15361 raft_consensus.cc:3060] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:40.310920 15362 consensus_queue.cc:1048] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:40.297852 15352 raft_consensus.cc:3060] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:40.315001 15268 raft_consensus.cc:3055] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:40.315577 15268 raft_consensus.cc:740] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:40.316682 15268 consensus_queue.cc:260] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:40.317972 15268 raft_consensus.cc:3060] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:40.322794  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.319943 15254 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.237958 15347 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:16:40.327270 14674 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:40.328764  7254 raft_consensus.cc:2393] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 28: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:40.329823 15365 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:40.331079 14674 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:40.331386  7258 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 27. Current term is 28. Ops: []
I20260709 13:16:40.333667 15254 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:40.337389 15338 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.794s	user 0.000s	sys 0.011s
I20260709 13:16:40.339211  7887 raft_consensus.cc:1240] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:16:40.341820 15204 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.359313  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:40.361774  7887 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260709 13:16:40.333761 15319 log.cc:927] Time spent T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 1.187s	user 0.000s	sys 0.007s
I20260709 13:16:40.327358 15368 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 23. Current term is 24.
I20260709 13:16:40.306085  7262 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:40.364383  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.349398  7255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 4084) took 2869 ms. Trace:
I20260709 13:16:40.365312  7255 rpcz_store.cc:276] 0709 13:16:37.479603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.345400 (+865797us) service_pool.cc:224] Handling call
0709 13:16:38.366260 (+ 20860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.762776 (+1396516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.348975 (+586199us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400218ed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:40.349288 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2993161088}
I20260709 13:16:40.365337  7254 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:40.379133  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:40.395581  7333 raft_consensus.cc:2368] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26.
I20260709 13:16:40.437057  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:40.319370 15012 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 18. Current term is 19.
I20260709 13:16:40.456995  7255 raft_consensus.cc:1275] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:16:40.457625  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.460510  7262 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:40.437633 15306 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:40.470197  7262 raft_consensus.cc:1275] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:16:40.468724  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:40.473587  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:40.481976  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:40.483378  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:40.484093  7333 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:40.485188  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:40.466358 15217 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.027s	sys 0.025s
I20260709 13:16:40.501336  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.518606  7255 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:40.469889 15306 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:40.495221 15012 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.516858  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.506608 15352 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:40.522264 15359 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.544s	user 0.004s	sys 0.004s
I20260709 13:16:40.523573  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:40.525132 15297 log.cc:927] Time spent T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 2.045s	user 0.002s	sys 0.019s
I20260709 13:16:40.527470  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:40.549088  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:40.549796  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.529584  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:40.530941  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.554096  7253 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:40.532545  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:40.533185  7150 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:40.556089  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.557121  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:40.536423  7256 raft_consensus.cc:2468] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
I20260709 13:16:40.537503  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:40.518131 15217 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.028s	sys 0.025s
I20260709 13:16:40.562546  7333 raft_consensus.cc:2393] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:40.564319  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:40.509785 15204 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:40.510205 15361 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:40.507462 15085 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:40.567420  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2796) took 1970 ms. Trace:
I20260709 13:16:40.572197  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.571337  7261 raft_consensus.cc:1275] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:16:40.573354  7331 rpcz_store.cc:276] 0709 13:16:38.597226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.832947 (+235721us) service_pool.cc:224] Handling call
0709 13:16:39.608822 (+775875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.609862 (+  1040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.567182 (+957320us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b540020fdd0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:40.567358 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783353600}
I20260709 13:16:40.574436  7260 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:40.576828 15323 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.543669 15012 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.577504  7332 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:40.577943 15224 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:40.578231  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2810) took 1300 ms. Trace:
I20260709 13:16:40.577512 15323 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.578702  7332 rpcz_store.cc:276] 0709 13:16:39.277986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.576888 (+1298902us) service_pool.cc:224] Handling call
0709 13:16:40.577323 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.577983 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.578179 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:40.579201 15012 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:40.578402 15224 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:40.580366  7332 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 16. (term mismatch)
I20260709 13:16:40.580541 15224 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:40.588125  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:40.581211 15378 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:16:40.581477 15222 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:40.583491  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2803) took 1977 ms. Trace:
I20260709 13:16:40.589740  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.602159  7260 raft_consensus.cc:3060] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:40.590267  7332 pending_rounds.cc:85] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 15
I20260709 13:16:40.603015  7332 pending_rounds.cc:107] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 25.16
I20260709 13:16:40.603333  7332 raft_consensus.cc:2889] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:40.601933  7335 rpcz_store.cc:276] 0709 13:16:38.605842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.091083 (+485241us) service_pool.cc:224] Handling call
0709 13:16:39.240129 (+149046us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b5800094b98. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6117b71 00007fece6117a22 00007fecef030c09 00007fecee18aee0 00007fecee2540ab 00007fecee254131 00007fecee215fc0 00007fecee200929 00007fecee2003d2 00007fece7777bd4
0709 13:16:39.240391 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.440031 (+199640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.440086 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.450433 (+ 10347us) log.cc:844] Serialized 26 byte log entry
0709 13:16:39.825762 (+375329us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:39.825828 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.355249 (+529421us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54000212d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:40.355313 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.515942 (+160629us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:40.583248 (+ 67306us) raft_consensus.cc:1685] finished
0709 13:16:40.583273 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.583426 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":158,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":11243,"spinlock_wait_cycles":457102336,"thread_start_us":297662,"threads_started":1,"wal-append.queue_time_us":417036}
W20260709 13:16:40.605113  7257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 2611) took 3457 ms (client timeout 2030 ms). Trace:
I20260709 13:16:40.571308 15358 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:40.592242  7225 leader_election.cc:400] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26.
I20260709 13:16:40.565953 14674 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:40.568022 15342 raft_consensus.cc:2804] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:16:40.596932  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 289322us
I20260709 13:16:40.602857  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2799) took 2005 ms. Trace:
W20260709 13:16:40.605540  7257 rpcz_store.cc:269] 0709 13:16:37.147630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.149207 (+  1577us) service_pool.cc:224] Handling call
0709 13:16:40.600000 (+3450793us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b540009a1d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:40.605033 (+  5033us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4661884160}
I20260709 13:16:40.613775  7334 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:40.613802  7329 rpcz_store.cc:276] 0709 13:16:38.597665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.863216 (+265551us) service_pool.cc:224] Handling call
0709 13:16:39.684451 (+821235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.780675 (+ 96224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.602606 (+821931us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54001d29d0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:40.602794 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887791360}
I20260709 13:16:40.591127  7255 raft_consensus.cc:2468] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:40.615810  7329 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:16:40.615998  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.609275  7225 leader_election.cc:403] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:40.610499  7335 raft_consensus.cc:1240] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:40.592229  7333 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: []
I20260709 13:16:40.620522  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2811) took 1144 ms. Trace:
I20260709 13:16:40.620935  7333 rpcz_store.cc:276] 0709 13:16:39.475885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.587640 (+1111755us) service_pool.cc:224] Handling call
0709 13:16:40.589262 (+  1622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.620293 (+ 31031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.620470 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48768}
I20260709 13:16:40.627262  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.628187  7258 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:40.612993 14674 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.651034  7257 raft_consensus.cc:1275] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:16:40.652840  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:40.643999  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.613304 15342 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:40.659950  7329 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
W20260709 13:16:40.657743  7228 leader_election.cc:336] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 3.219s (SENT)
I20260709 13:16:40.674079  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.671694  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:40.618866 15358 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:40.681360  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.682055  7261 raft_consensus.cc:2376] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25. Re-sending same reply.
I20260709 13:16:40.678797  7260 raft_consensus.cc:2468] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:40.629508 15368 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 25. Current term is 26.
I20260709 13:16:40.620313 15352 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
I20260709 13:16:40.676662 15222 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.662684 14674 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:40.693300  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.676363 15342 raft_consensus.cc:3060] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:40.679270  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 461519us
I20260709 13:16:40.660732 15012 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 13:16:40.701539  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 43861.8us
I20260709 13:16:40.697180 14528 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:40.702211 15204 raft_consensus.cc:2804] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:40.723883 15368 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:40.701462 15222 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:40.727031 15204 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.743634  7332 raft_consensus.cc:1275] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:16:40.713346 15336 consensus_queue.cc:1059] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.146s
W20260709 13:16:40.750317 15330 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 1.199s	user 0.008s	sys 0.000s
I20260709 13:16:40.752085  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1257) took 1958 ms. Trace:
I20260709 13:16:40.714100 15382 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 13:16:40.752554  7891 rpcz_store.cc:276] 0709 13:16:38.793966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.861045 (+ 67079us) service_pool.cc:224] Handling call
0709 13:16:38.861464 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.863268 (+  1804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.863316 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.863912 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:16:39.317892 (+453980us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:16:39.317959 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.318064 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.749614 (+1431550us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:40.751708 (+  2094us) raft_consensus.cc:1685] finished
0709 13:16:40.751732 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.752010 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1301,"raft.queue_time_us":12836,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4495,"spinlock_wait_cycles":11262336,"thread_start_us":453562,"threads_started":1,"wal-append.queue_time_us":629200}
I20260709 13:16:40.738826 15306 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:40.747159 15204 raft_consensus.cc:3060] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:40.740974 15368 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:16:40.765592  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.755950 15361 raft_consensus.cc:3055] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:16:40.795341  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.796583  7254 raft_consensus.cc:2410] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:16:40.797642  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.798501  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.799218  7255 raft_consensus.cc:2368] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 28. Current term is 29.
I20260709 13:16:40.800171  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.801218  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.801949  7253 raft_consensus.cc:2368] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27.
I20260709 13:16:40.802729  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:40.802968  7228 leader_election.cc:336] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:40.803331  7253 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:40.803488  7228 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.804632  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.805383  7255 raft_consensus.cc:2368] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 27. Current term is 28.
I20260709 13:16:40.737157 15358 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.807961  7258 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 19. (term mismatch)
I20260709 13:16:40.811532  7258 pending_rounds.cc:85] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 18
I20260709 13:16:40.811831  7258 pending_rounds.cc:107] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 25.19
I20260709 13:16:40.812062  7258 raft_consensus.cc:2889] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:40.808600  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.811550 15368 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.814425 15368 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:40.817240  7228 leader_election.cc:336] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:40.817752  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.809267  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.810316  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.810971  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.820237  7255 raft_consensus.cc:2368] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22.
I20260709 13:16:40.822947  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.826867  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.827062  7262 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 21.
I20260709 13:16:40.827690  7256 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 24: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:40.827917 14528 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:40.823365  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.828644 14528 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:16:40.830147  7228 leader_election.cc:336] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:40.831133  7228 leader_election.cc:336] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:40.824734  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.831543  7228 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:40.823016  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.768383 15361 raft_consensus.cc:740] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:40.837037  7228 leader_election.cc:336] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:40.837786 14528 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:40.841425 14637 raft_consensus.cc:3060] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:40.837543  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.843958 15361 consensus_queue.cc:260] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:40.845489 15245 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:40.845587 15361 raft_consensus.cc:3060] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:16:40.853582  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.854140  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.856458  7253 raft_consensus.cc:2410] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 26 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 12.
I20260709 13:16:40.858729  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:40.859494  7254 raft_consensus.cc:2468] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 17.
W20260709 13:16:40.860911 15353 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.892s	user 0.008s	sys 0.005s
I20260709 13:16:40.864127  7256 raft_consensus.cc:1240] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:16:40.871383  7254 raft_consensus.cc:1240] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:16:40.872681  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.873297  7254 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:40.874863  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:40.875451  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 1.03814e+06us
I20260709 13:16:40.876031  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.876230  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.876609  7255 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:16:40.879056  7861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.880079  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:40.880419  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:40.881045  7892 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:40.881807  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:40.882115 15174 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:40.882476  7892 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:40.882922 15174 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:40.885023 15324 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:40.885409  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:40.886674  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:40.887727 15323 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:40.888180  7893 raft_consensus.cc:1275] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:40.889124 14344 raft_consensus.cc:3060] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:40.889518  7893 raft_consensus.cc:1275] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:16:40.890544  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:40.891247  7887 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:40.891410  7892 raft_consensus.cc:2468] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 28.
I20260709 13:16:40.892161 15222 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:40.881712  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:40.896612  7261 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:40.896754  7859 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.897791  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:40.898691  7261 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 25: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
W20260709 13:16:40.858968  7228 leader_election.cc:336] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:40.874537  7889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1361) took 1259 ms. Trace:
I20260709 13:16:40.900990  7257 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:16:40.900414  7889 rpcz_store.cc:276] 0709 13:16:39.615365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.645096 (+ 29731us) service_pool.cc:224] Handling call
0709 13:16:39.658958 (+ 13862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.659201 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:16:39.659473 (+   272us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.837009 (+177536us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.343098 (+506089us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b18002fa820. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:16:40.874039 (+530941us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b18002fa820. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece60c9c0a 00007fecef809219 00007fece6151a40 00007fece614c4e4 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:16:40.874194 (+   155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:40.874255 (+    61us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:16:40.874300 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.874364 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.874480 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1019621,"prepare.queue_time_us":1572,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":85,"raft.queue_time_us":1039366,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":9739,"spinlock_wait_cycles":14716544,"thread_start_us":176918,"threads_started":1,"wal-append.queue_time_us":305524}
I20260709 13:16:40.905157  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:40.909768  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.912156  7261 raft_consensus.cc:1240] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:40.881717 15156 raft_consensus.cc:3060] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:40.921103  7859 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.923326  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.927038  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:40.929801  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:40.940114  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:40.942895  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.950990  7255 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 29.
I20260709 13:16:40.924799 14680 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:40.976624  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:40.979305  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:40.979912  7887 raft_consensus.cc:1240] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 27. Current term is 28. Ops: []
I20260709 13:16:40.984414  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:40.987612  7887 raft_consensus.cc:1275] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:16:40.925019 15181 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:40.990592  7254 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:40.965351 15360 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:40.980932 15283 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 13:16:41.005708  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:40.998167  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:40.972968 15222 consensus_queue.cc:1048] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:16:40.973330 15174 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:16:41.002585  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.980887 15323 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:41.004622  7892 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 24: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:41.009061  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:41.012224 15368 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:41.012647 15368 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.013010 15368 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:41.013300  7336 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:16:41.005343 15324 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:40.981104 14948 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:16:41.003706 15360 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.016669  7225 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:41.005815 15283 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.023180  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:41.025020 15245 raft_consensus.cc:2804] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:16:41.030545 15245 raft_consensus.cc:697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 28 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:41.031831 15245 consensus_queue.cc:237] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.030685 14528 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:40.997306 15224 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:41.042853  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 163118us
W20260709 13:16:41.046734  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.026005 15360 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:41.014218 14796 consensus_queue.cc:1048] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:16:41.052831  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:41.014808 15323 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.063378  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:41.065366  7861 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:41.029215 15283 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:16:41.069504 15226 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:41.058189 15181 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.037386 15363 consensus_queue.cc:1048] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:16:41.088374 15226 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:41.098639 15191 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.099471 15191 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.102989  7894 raft_consensus.cc:2468] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:41.057331 14674 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.113340 14674 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:41.090860 15085 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.004s
I20260709 13:16:41.122246 15126 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.122872 15126 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.123771 15224 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:41.095400 15226 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:41.124787  7895 raft_consensus.cc:2410] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:16:41.127162 15323 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:41.070369 15275 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:41.127949 15275 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.128392 15275 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:41.132743 15342 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:41.090994 15274 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:41.147418 15368 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.150858 15368 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:41.145823 15204 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:41.162608  7150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.166884  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.091444 15181 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.170460 15181 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:41.172621 15025 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:41.175385 15354 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:41.178453 15191 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:41.181461 15126 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:41.182854  7894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33224 (request call id 1091) took 5695 ms (client timeout 1952 ms). Trace:
W20260709 13:16:41.183286  7894 rpcz_store.cc:269] 0709 13:16:35.487457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.487656 (+   199us) service_pool.cc:224] Handling call
0709 13:16:41.182576 (+5694920us) spinlock_profiling.cc:243] Waited 5.57 s on lock 0x7b5400521f54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:41.182741 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12802107264}
I20260709 13:16:41.184629  7896 raft_consensus.cc:1275] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:16:41.189448 15226 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.194077 15071 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:16:41.196568  7890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33208 (request call id 1262) took 1241 ms. Trace:
W20260709 13:16:41.165472  7862 leader_election.cc:336] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:41.202504  7334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2819) took 1025 ms. Trace:
I20260709 13:16:41.202976  7334 rpcz_store.cc:276] 0709 13:16:40.177369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.614651 (+437282us) service_pool.cc:224] Handling call
0709 13:16:40.631108 (+ 16457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.631342 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:16:40.687723 (+ 56381us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.202107 (+514384us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.202170 (+    63us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:41.202221 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.202307 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.202444 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":555312,"prepare.queue_time_us":65574,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"wal-append.queue_time_us":7854}
I20260709 13:16:41.205094  7331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2735) took 1632 ms. Trace:
W20260709 13:16:41.206943  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 503190us
I20260709 13:16:41.208359  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:41.209980  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:41.211042 15376 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:41.211198  7327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2815) took 1245 ms. Trace:
I20260709 13:16:41.211786 15376 consensus_queue.cc:1048] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:41.211598  7327 rpcz_store.cc:276] 0709 13:16:39.965480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.600677 (+635197us) service_pool.cc:224] Handling call
0709 13:16:40.601170 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.601483 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:16:40.702921 (+101438us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.210822 (+507901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.210878 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:41.210919 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.210989 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.211126 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":483587,"prepare.queue_time_us":16596,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"thread_start_us":144801,"threads_started":2,"wal-append.queue_time_us":68234}
I20260709 13:16:41.213384 15306 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:41.213816 15306 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.214136 15306 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:16:41.216217  7302 leader_election.cc:336] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:41.216652 15379 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:41.217160  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 215546us
I20260709 13:16:41.217250 15379 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:41.217608 15259 consensus_queue.cc:1059] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:16:41.219506  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:41.219858 15379 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:41.220391 15118 raft_consensus.cc:3055] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:41.220428 15379 consensus_queue.cc:1059] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:41.221029 15118 raft_consensus.cc:740] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:41.197156  7890 rpcz_store.cc:276] 0709 13:16:39.955133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.260857 (+305724us) service_pool.cc:224] Handling call
0709 13:16:40.261232 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.893179 (+631947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.893231 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:40.894021 (+   790us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.076483 (+182462us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:41.076543 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.076624 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:41.196185 (+119561us) raft_consensus.cc:1685] finished
0709 13:16:41.196231 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.196471 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":631358,"raft.queue_time_us":634275,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":181944,"threads_started":1,"wal-append.queue_time_us":270018}
I20260709 13:16:41.221203 15139 consensus_queue.cc:1048] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:16:41.221897 15119 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:41.222074 15187 raft_consensus.cc:3055] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:16:41.222566 15187 raft_consensus.cc:740] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:41.223485 15187 consensus_queue.cc:260] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.224696 15187 raft_consensus.cc:3060] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:41.225898 15225 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:41.216652  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:41.228754 15118 consensus_queue.cc:260] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.230062 15118 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:41.230728  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:41.234603  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:41.205538  7331 rpcz_store.cc:276] 0709 13:16:39.572649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.580016 (+1007367us) service_pool.cc:224] Handling call
0709 13:16:40.580304 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.580511 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:40.580893 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.697981 (+117088us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.204741 (+506760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.204798 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:41.204844 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.204915 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.205035 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1042068,"prepare.queue_time_us":52643,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":92,"raft.queue_time_us":508799,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":5412,"thread_start_us":94552,"threads_started":1,"wal-append.queue_time_us":132884}
I20260709 13:16:41.246955  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:41.251423  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:41.252278  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:41.253285  7328 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:41.254118  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1350) took 4436 ms. Trace:
I20260709 13:16:41.254863  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:41.258383  7331 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:41.261839  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:41.262506  7301 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:41.264429  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:41.235821 15360 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:41.238059 15226 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:41.239367  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:41.271354  7895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33196 (request call id 1365) took 1583 ms. Trace:
I20260709 13:16:41.271999  7895 rpcz_store.cc:276] 0709 13:16:39.687873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.000260 (+312387us) service_pool.cc:224] Handling call
0709 13:16:41.271145 (+1270885us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400a1a754. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:41.271290 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543352576}
I20260709 13:16:41.254608  7896 rpcz_store.cc:276] 0709 13:16:36.803936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.819535 (+ 15599us) service_pool.cc:224] Handling call
0709 13:16:41.184267 (+4364732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.185040 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.186568 (+  1528us) spinlock_profiling.cc:243] Waited 4.35 s on lock 0x7b5400521f50. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923b8ad 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:41.239890 (+ 53322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9998365056}
I20260709 13:16:41.267590  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:41.270107  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:41.262516  7892 raft_consensus.cc:3060] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:41.265623 15259 consensus_queue.cc:1048] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:16:41.287613 15259 consensus_queue.cc:1243] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer efc9ee9e1d86480790fa83f6ad0c295c log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:16:41.289758 15342 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:41.290831 15149 consensus_queue.cc:1048] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:41.291957 15307 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:41.292495 15307 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.292840 15307 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:41.265237 15356 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.311621  7299 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:41.266052 15060 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:41.313138 15060 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:41.313618 15060 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:41.314119 14833 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:41.296229 14893 consensus_queue.cc:1048] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:16:41.295698 15186 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:41.317472 15186 raft_consensus.cc:697] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:41.317487 15360 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:41.318459 15186 consensus_queue.cc:237] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:41.324182  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.334069  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.335462  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:41.344159  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:41.345016  7327 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:41.346776  7888 raft_consensus.cc:1275] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:16:41.347265  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:41.347612  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 80146.3us
I20260709 13:16:41.348268  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:41.349941  7301 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:41.359833  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:41.350034  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:41.378793  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.395095  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.399535  7301 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:41.399595  7892 raft_consensus.cc:2468] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:41.332216 15234 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.404966  7225 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:41.349184 15303 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:41.357159 14637 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.390846 15368 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:41.357055 15360 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:41.295830 15356 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:41.452286 15401 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:41.392848 14796 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:41.398808 15133 raft_consensus.cc:2804] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:41.393066 15149 consensus_queue.cc:1048] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:16:41.456933 15204 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:41.393869 15259 consensus_queue.cc:1048] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:16:41.401273  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:41.406657 15396 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:16:41.483181 15330 log.cc:927] Time spent T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:41.401278 15305 consensus_queue.cc:1048] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.081s
W20260709 13:16:41.513957  7862 leader_election.cc:336] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:41.399922 15387 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:41.411571 15380 raft_consensus.cc:2804] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:41.442427 15119 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:41.409705 15363 raft_consensus.cc:2804] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:41.486851  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:41.460340  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:41.502909  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 285905us
I20260709 13:16:41.510633  7330 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
W20260709 13:16:41.516076  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 114889us
W20260709 13:16:41.524565  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:41.484642 14796 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:41.523154  7862 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 151 similar messages]
W20260709 13:16:41.529218  7082 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47556 (request call id 256) took 85406 ms (client timeout 15000 ms). Trace:
I20260709 13:16:41.424017 15234 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.528313 15133 raft_consensus.cc:697] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:41.534053 15133 consensus_queue.cc:237] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:41.534879 15234 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:41.535215 15324 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.001s
I20260709 13:16:41.535657 15324 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:41.537304  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:41.463586 14637 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:41.544822 15380 raft_consensus.cc:697] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:41.552165 15380 consensus_queue.cc:237] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:41.558895 15363 raft_consensus.cc:697] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:41.560228 15363 consensus_queue.cc:237] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:41.556840  7862 leader_election.cc:336] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:41.564793 15307 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:41.526899 15303 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:41.545082  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:41.558231  7259 raft_consensus.cc:2410] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 33 because replica has last-logged OpId of term: 31 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
I20260709 13:16:41.576805  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:41.581447  7896 raft_consensus.cc:1240] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:41.531939 14796 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:41.525629 15192 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:41.587515  7152 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.016s	sys 0.030s
W20260709 13:16:41.588575  7152 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.016s	sys 0.030s
I20260709 13:16:41.558164 15283 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:41.591643  7861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.042s	sys 0.060s
W20260709 13:16:41.617944  7861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.043s	sys 0.060s
I20260709 13:16:41.596230  7327 raft_consensus.cc:2468] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 26.
I20260709 13:16:41.575019 15354 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.580992 15362 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:16:41.619252  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 815205us
W20260709 13:16:41.529748  7082 rpcz_store.cc:269] 0709 13:15:16.117166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.117371 (+   205us) service_pool.cc:224] Handling call
0709 13:16:41.522873 (+85405502us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:36.380422 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:36.460642 (+ 80220us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:36.460701 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:16:36.460722 (+    21us) tablet.cc:662] Decoding operations
0709 13:16:36.461978 (+  1256us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:36.462082 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:36.462115 (+    33us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:16:36.632380 (+170265us) tablet.cc:701] Row locks acquired
0709 13:16:36.632444 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:16:36.632699 (+   255us) write_op.cc:270] Start()
0709 13:16:36.632894 (+   195us) write_op.cc:276] Timestamp: P: 1783602996632617 usec, L: 0
0709 13:16:36.633053 (+   159us) op_driver.cc:348] REPLICATION: starting
0709 13:16:36.634106 (+  1053us) log.cc:844] Serialized 4445 byte log entry
0709 13:16:37.102232 (+468126us) op_driver.cc:464] REPLICATION: finished
0709 13:16:37.735126 (+632894us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b18002748a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f3f3 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:16:37.735326 (+   200us) write_op.cc:301] APPLY: starting
0709 13:16:37.735429 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:37.990277 (+254848us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b18002748a0. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece614f557 00007fece61517c1 00007fece6151779 00007fece6151709 00007fece61516d1 00007fece61509cd 000000000038f354 000000000038f199 00007fece613283a
0709 13:16:38.178176 (+187899us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:38.178231 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:38.830452 (+652221us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:38.911041 (+ 80589us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:16:38.920375 (+  9334us) write_op.cc:312] APPLY: finished
0709 13:16:38.928530 (+  8155us) log.cc:844] Serialized 105 byte log entry
0709 13:16:39.168638 (+240108us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:39.176993 (+  8355us) write_op.cc:454] Released schema lock
0709 13:16:39.197166 (+ 20173us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:39.269892 (+ 72726us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:39.288462 (+ 18570us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":126452,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":179430,"apply.run_cpu_time_us":73842,"apply.run_wall_time_us":1483353,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50173,"num_ops":11,"prepare.queue_time_us":538673,"prepare.run_cpu_time_us":32257,"prepare.run_wall_time_us":467627,"raft.queue_time_us":190277,"raft.run_cpu_time_us":19289,"raft.run_wall_time_us":219313,"replication_time_us":448221,"spinlock_wait_cycles":21132032,"thread_start_us":942161,"threads_started":5,"wal-append.queue_time_us":713171,"wal-append.run_cpu_time_us":36489,"wal-append.run_wall_time_us":2260812}]]}
W20260709 13:16:41.621516  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 556233us
I20260709 13:16:41.632784  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:41.633571  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.639474  7152 leader_election.cc:400] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 28. Current term is 29.
I20260709 13:16:41.642271  7152 leader_election.cc:403] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 13:16:41.545198 15060 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:41.645226 14344 raft_consensus.cc:3060] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:41.646291  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:41.589358 15192 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.646540  7152 leader_election.cc:400] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27.
I20260709 13:16:41.678145  7152 leader_election.cc:403] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:41.604396 15204 consensus_queue.cc:1059] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
W20260709 13:16:41.654487 15275 consensus_meta.cc:287] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.526s	user 0.002s	sys 0.010s
I20260709 13:16:41.685160  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:41.732046 14344 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 28. Current term is 29.
W20260709 13:16:41.753103  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 227274us
I20260709 13:16:41.643788 14928 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:41.748697  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 63693.2us
I20260709 13:16:41.760675  7861 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:41.755412 15126 raft_consensus.cc:2764] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260709 13:16:41.766769 15362 raft_consensus.cc:3055] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:41.774966  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:41.653133 15156 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.106s
I20260709 13:16:41.690197 15181 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:41.627672 15354 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:41.785740  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:41.766965  7084 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:41.772914 15204 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27.
I20260709 13:16:41.776160 15126 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:41.748056 15324 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:41.768187 15307 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:41.647326 14680 consensus_queue.cc:1048] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.114s
I20260709 13:16:41.748673 15275 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:41.802732  7335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.021s	sys 0.020s
W20260709 13:16:41.784819 15397 log.cc:927] Time spent T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:16:41.785193 15181 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:41.805409  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.772615 15362 raft_consensus.cc:740] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:41.807009  7258 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.018s	sys 0.023s
W20260709 13:16:41.811885  7335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.022s	sys 0.020s
W20260709 13:16:41.812990  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.790165 15356 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:41.824517  7258 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.018s	sys 0.023s
I20260709 13:16:41.818892  7084 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 13 to 18, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 18 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:41.809265  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 285220us
I20260709 13:16:41.836586  7888 raft_consensus.cc:1240] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 23. Ops: []
I20260709 13:16:41.836982  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:41.788123 15404 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:16:41.823570 15181 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:41.829366 15306 consensus_meta.cc:287] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.012s
I20260709 13:16:41.825325 15126 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:41.849994  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:41.852828  7301 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:41.808728 15324 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:41.862370  7329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.023s	sys 0.048s
W20260709 13:16:41.863113  7329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.023s	sys 0.048s
I20260709 13:16:41.868732  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:41.873178  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:41.874017  7262 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 19.
I20260709 13:16:41.853615 15307 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:41.914705  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:41.875262 15406 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:16:41.856268 15379 raft_consensus.cc:2764] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election decision vote started in defunct term 25: won
I20260709 13:16:41.884925 14893 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:41.886930  7262 raft_consensus.cc:1240] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:41.863919 15305 raft_consensus.cc:2804] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:41.956486  7262 raft_consensus.cc:1217] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Deduplicated request from leader. Original: 15.12->[17.13-23.15]   Dedup: 17.13->[21.14-23.15]
I20260709 13:16:41.957088  7262 pending_rounds.cc:85] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 13
I20260709 13:16:41.957355  7262 pending_rounds.cc:107] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:16:41.957594  7262 raft_consensus.cc:2889] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:41.914860 15283 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 33 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:41.855561 15306 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:41.887205  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.886827  7254 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 13:16:41.986447  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:41.987249  7254 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:16:41.948262  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:41.989363  7261 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:41.991189  7261 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:41.854240 15056 consensus_queue.cc:1048] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:16:41.916128 15307 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:41.961107  7084 catalog_manager.cc:5697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:41.930335  7258 raft_consensus.cc:2376] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22. Re-sending same reply.
I20260709 13:16:41.914732 15362 consensus_queue.cc:260] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.012132  7084 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 16 to 17, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 17 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:42.014940  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 368539us
I20260709 13:16:42.017973  7152 leader_election.cc:400] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 27. Current term is 28.
W20260709 13:16:42.018811  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.019192  7332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2823) took 1258 ms. Trace:
I20260709 13:16:42.019615  7332 rpcz_store.cc:276] 0709 13:16:40.760357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.760484 (+   127us) service_pool.cc:224] Handling call
0709 13:16:40.769381 (+  8897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.208114 (+438733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.208148 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.208630 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.499712 (+291082us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:41.499757 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.499829 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.018992 (+519163us) raft_consensus.cc:1685] finished
0709 13:16:42.019013 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.019133 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":438275,"raft.queue_time_us":440539,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":290645,"threads_started":1,"wal-append.queue_time_us":479100}
I20260709 13:16:42.021486  7254 raft_consensus.cc:2468] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
I20260709 13:16:42.025378  7152 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:42.026780  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:42.004281 15361 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.988885 15305 raft_consensus.cc:697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:42.007277 15414 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:16:42.004488 15307 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:42.002970 15060 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:42.002990 15356 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.031673  7152 leader_election.cc:400] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22.
I20260709 13:16:42.110733  7152 leader_election.cc:403] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:42.013989 15245 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:42.041534  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:42.033924  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:42.029565 15362 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:42.138322  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 106787us
W20260709 13:16:42.033579 15187 consensus_meta.cc:287] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.808s	user 0.014s	sys 0.011s
I20260709 13:16:42.114708 14344 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.139573 14344 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.139935  7152 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:42.030172 15119 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:42.110610 14928 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.028659  7084 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 14 to 17, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129), now has a pending config: VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129), VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130), VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131), VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 17 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } } pending_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:42.148351  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:42.148957  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 363273us
I20260709 13:16:42.151666 14344 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:42.040668 15025 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:42.031018 15204 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 14, Time since last communication: 0.111s
I20260709 13:16:42.168154  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:42.180549 14344 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:42.118896 15275 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:42.106916 15071 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.153762 15346 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:42.046274 15059 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.119s
I20260709 13:16:42.043186 15361 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.152931 15060 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:16:42.179186 15414 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:42.159108 15119 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
W20260709 13:16:42.183439 15420 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:16:42.111744 15356 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:42.280989  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 112965us
I20260709 13:16:42.267748 15422 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:42.178341 14928 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.276049 15305 consensus_queue.cc:237] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.280507  7084 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.286770 15060 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:16:42.288151 15419 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260709 13:16:42.289459 15416 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:16:42.202739 15025 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:16:42.190913 15324 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:42.286422 14344 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:42.295276  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 261415us
I20260709 13:16:42.299137  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:42.295682 15119 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:42.320305  7330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44980 (request call id 1293) took 2506 ms (client timeout 3149 ms). Trace:
I20260709 13:16:42.320537 15139 raft_consensus.cc:493] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:42.320785  7330 rpcz_store.cc:269] 0709 13:16:39.813396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.913884 (+100488us) service_pool.cc:224] Handling call
0709 13:16:42.319986 (+2406102us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400421b54. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:42.320156 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3643689856}
I20260709 13:16:42.321063 15139 raft_consensus.cc:515] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.313834 15306 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:42.303841 15060 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:42.323800 15139 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:42.327915 14928 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:42.328588 14928 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:42.331656  7328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1305) took 1090 ms. Trace:
I20260709 13:16:42.332170  7328 rpcz_store.cc:276] 0709 13:16:41.240891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.254290 (+ 13399us) service_pool.cc:224] Handling call
0709 13:16:41.299569 (+ 45279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.300028 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.300068 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.347088 (+ 47020us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.816404 (+469316us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:41.816450 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.816533 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.331413 (+514880us) raft_consensus.cc:1685] finished
0709 13:16:42.331442 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.331593 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11040,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":21856,"thread_start_us":407532,"threads_started":1,"wal-append.queue_time_us":567797}
I20260709 13:16:42.302296 15376 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 LEADER]: Stepping down as leader of term 28
W20260709 13:16:42.334764 15424 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:16:42.285570 15204 raft_consensus.cc:2804] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:16:42.297380 15421 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:16:42.142707 15245 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.351222 15245 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:42.352011  7895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1373) took 1110 ms. Trace:
W20260709 13:16:42.353286 15436 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.053s	user 0.003s	sys 0.000s
I20260709 13:16:42.352449  7895 rpcz_store.cc:276] 0709 13:16:41.241634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.273122 (+ 31488us) service_pool.cc:224] Handling call
0709 13:16:41.273598 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.332991 (+ 59393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.333028 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.345425 (+ 12397us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.810370 (+464945us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:16:41.810449 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.810580 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.351750 (+541170us) raft_consensus.cc:1685] finished
0709 13:16:42.351775 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.351944 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63248,"raft.queue_time_us":74903,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":34389,"thread_start_us":352113,"threads_started":1,"wal-append.queue_time_us":578398}
W20260709 13:16:42.355969 15430 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:42.357373  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 33 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:42.357859  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:42.315765 15059 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:16:42.358693 15434 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
I20260709 13:16:42.359086 15059 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:42.359592 15059 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:42.360496 15059 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.361722 15059 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:42.363407  7259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1659) took 2137 ms (client timeout 2331 ms). Trace:
W20260709 13:16:42.363854  7259 rpcz_store.cc:269] 0709 13:16:40.225555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.225662 (+   107us) service_pool.cc:224] Handling call
0709 13:16:42.363164 (+2137502us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001a2554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:42.363345 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3060887808}
I20260709 13:16:42.337957  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:42.297035 15428 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.365057  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 33 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:42.365465  7260 raft_consensus.cc:2376] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 29. Re-sending same reply.
I20260709 13:16:42.365595 15428 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.367513 15060 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.369082  7329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44980 (request call id 1302) took 1133 ms. Trace:
I20260709 13:16:42.369493  7329 rpcz_store.cc:276] 0709 13:16:41.235393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.239985 (+  4592us) service_pool.cc:224] Handling call
0709 13:16:41.240276 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.256281 (+ 16005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.256333 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.256849 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.865541 (+608692us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:41.865654 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.865852 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.368691 (+502839us) raft_consensus.cc:1685] finished
0709 13:16:42.368714 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.368851 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15525,"raft.queue_time_us":15643,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8154,"thread_start_us":528998,"threads_started":1,"wal-append.queue_time_us":718617}
I20260709 13:16:42.372231 15361 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:42.374099 15356 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:42.365669  7259 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:16:42.377213  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:42.377817  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:42.341655 15204 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:42.378458  7260 raft_consensus.cc:3060] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:42.378599 15204 raft_consensus.cc:3060] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:42.313256 15405 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 13:16:42.380484 15354 leader_election.cc:290] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:42.381445 15433 log.cc:927] Time spent T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:16:42.383148  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:42.347177 15412 log.cc:927] Time spent T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:16:42.384032  7336 raft_consensus.cc:2393] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:42.347512 15437 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.385144  7335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33690 (request call id 2758) took 1155 ms. Trace:
I20260709 13:16:42.385246 15437 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:42.386410  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.385629  7335 rpcz_store.cc:276] 0709 13:16:41.229390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.236762 (+  7372us) service_pool.cc:224] Handling call
0709 13:16:41.237124 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:41.237556 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.237587 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:41.238207 (+   620us) log.cc:844] Serialized 52 byte log entry
0709 13:16:41.824167 (+585960us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:41.868570 (+ 44403us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.899129 (+ 30559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.899267 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.384903 (+485636us) raft_consensus.cc:1685] finished
0709 13:16:42.384925 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.385084 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22180,"prepare.queue_time_us":23870,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":59,"raft.queue_time_us":39263,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":10508,"spinlock_wait_cycles":5863680,"thread_start_us":585479,"threads_started":1,"wal-append.queue_time_us":683501}
I20260709 13:16:42.347440  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:42.307355 15422 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.389024  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:42.340222  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:42.389775  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:42.390904  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:42.315713  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:42.378525  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:42.392757  7327 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:42.358659  7332 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:42.394807 15259 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:42.395395 15259 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:42.284967 15071 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.396457 15259 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:42.392544  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 76919.9us
I20260709 13:16:42.398581  7301 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:42.388455  7258 raft_consensus.cc:2410] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:16:42.334900 15376 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:42.358093  7328 raft_consensus.cc:3060] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:16:42.414074  7225 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:42.400753  7888 raft_consensus.cc:1275] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:16:42.391506  7253 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:42.415337  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:42.417905  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:42.407661  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:42.399137  7260 raft_consensus.cc:2468] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:42.418576  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:42.419271  7327 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 26.
I20260709 13:16:42.419633  7260 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:16:42.420331  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:42.418076  7253 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23. Ops: []
W20260709 13:16:42.428054  7228 leader_election.cc:336] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.503s (SENT)
I20260709 13:16:42.428764  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:42.431774 15437 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:42.432031 15060 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:42.465476  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.466241  7329 raft_consensus.cc:2393] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 26: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:42.468634 15361 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:42.468883  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 169811us
I20260709 13:16:42.470248  7887 raft_consensus.cc:2393] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 33: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:16:42.471874  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 50182.8us
W20260709 13:16:42.486356  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.520758  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 33 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:42.398779 15181 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.002s
I20260709 13:16:42.526597  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:42.527063  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:42.527315  7258 raft_consensus.cc:3060] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:42.524695  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 96667.9us
I20260709 13:16:42.530488  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:42.531424  7892 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:42.388448 14637 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:42.532233  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:42.398200 15071 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:42.534125  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:42.412524 15025 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.535169 14344 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:42.535547  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:42.538179  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 126014us
I20260709 13:16:42.463616 15245 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.411597 15428 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:42.470132 15138 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:42.544952 14344 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:42.462960 14833 raft_consensus.cc:2804] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:42.462491 15354 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.463982 15324 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:42.470480 15360 raft_consensus.cc:2804] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:16:42.545725  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 147771us
I20260709 13:16:42.555178  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:42.529024 15192 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:42.565864  7328 raft_consensus.cc:2468] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 33.
I20260709 13:16:42.577579 14344 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:42.589419  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 124966us
I20260709 13:16:42.589608  7861 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:42.589138 14833 raft_consensus.cc:697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:42.596487 14833 consensus_queue.cc:237] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.477578 15119 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.525815 15361 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:42.560189 14796 consensus_meta.cc:287] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.004s
I20260709 13:16:42.608194  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:42.619464  7861 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:42.610430  7862 leader_election.cc:336] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:42.534693 15181 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.591862 15071 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:42.598809 14928 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:16:42.592008 15360 raft_consensus.cc:697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:42.548502 15025 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.623034 14796 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.560796 15354 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.559530 15376 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.635878  7256 raft_consensus.cc:2368] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 25. Current term is 26.
I20260709 13:16:42.613705 15428 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:42.639011 15428 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:42.639925 15428 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.642838 14928 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:42.643846 14928 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:42.618603 15307 consensus_meta.cc:287] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.000s
I20260709 13:16:42.650285  7332 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:42.549926 15245 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:42.628131  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 53378.6us
I20260709 13:16:42.576918 15324 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.650593  7259 raft_consensus.cc:2410] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 33 because replica has last-logged OpId of term: 31 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
W20260709 13:16:42.651298  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 58047us
I20260709 13:16:42.617115 15275 raft_consensus.cc:2804] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:16:42.622876 15226 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:42.667341 15181 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:42.668414 15435 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:42.668809 15360 consensus_queue.cc:237] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.657020 15283 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:42.638283 15204 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.687850  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:42.634490 14796 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:42.680264  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 151676us
I20260709 13:16:42.681213  7258 raft_consensus.cc:2468] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:42.690755  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:42.691891  7332 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 26
W20260709 13:16:42.693231  7228 leader_election.cc:336] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.650s (SENT)
I20260709 13:16:42.662254 15376 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:16:42.712738  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.704487  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 86695.7us
I20260709 13:16:42.716084  7861 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:42.719362  7861 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:42.725054  7332 raft_consensus.cc:2468] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 26.
I20260709 13:16:42.676373 15275 raft_consensus.cc:697] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:42.660156 15307 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.734333 15226 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:42.727236 15449 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:42.751245 15226 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.752055 15226 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:42.752833 15275 consensus_queue.cc:237] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.741585 15126 raft_consensus.cc:2804] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:42.758311 15204 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:42.758796 14893 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:42.759366 14893 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:42.759653 15346 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22.
I20260709 13:16:42.751350 15449 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.752394 15119 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:42.767164 15451 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:16:42.768525 15307 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:42.764143 15449 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:42.777316 15361 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:42.777981 15422 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:42.781701 15362 consensus_meta.cc:287] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.001s
W20260709 13:16:42.788549 15427 log.cc:927] Time spent T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.498s	user 0.001s	sys 0.001s
W20260709 13:16:42.792963 15407 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.930s	user 0.000s	sys 0.015s
W20260709 13:16:42.797696 15447 log.cc:927] Time spent T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:16:42.799723 15426 log.cc:927] Time spent T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.509s	user 0.000s	sys 0.002s
W20260709 13:16:42.801646 15423 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.623s	user 0.003s	sys 0.000s
W20260709 13:16:42.802047 15411 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.917s	user 0.012s	sys 0.012s
I20260709 13:16:42.917815  7893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 1123) took 1676 ms. Trace:
I20260709 13:16:42.918910  7893 rpcz_store.cc:276] 0709 13:16:41.240598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.240716 (+   118us) service_pool.cc:224] Handling call
0709 13:16:41.241004 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.241349 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.241381 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.252823 (+ 11442us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.615762 (+362939us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:41.615828 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.615933 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.801125 (+1185192us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:42.912508 (+111383us) raft_consensus.cc:1685] finished
0709 13:16:42.916803 (+  4295us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.917397 (+   594us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36775,"raft.queue_time_us":6441,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":14980,"spinlock_wait_cycles":8356224,"thread_start_us":322357,"threads_started":1,"wal-append.queue_time_us":551208}
W20260709 13:16:42.923471  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 187181us
I20260709 13:16:42.924201 15225 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:42.923533 15126 raft_consensus.cc:697] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:42.938572  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:42.950323  7255 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:42.952353  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:42.956420 15204 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.956892 15457 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.957487 15204 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.957679 15457 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.959079 15458 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.960011 15458 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:42.960690 15342 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:42.961737 15342 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.963286 15459 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.964656 15245 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:42.965246 15342 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:42.965966 15342 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.967274  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:42.968011  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 430172us
W20260709 13:16:42.968387  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 275081us
I20260709 13:16:42.969393  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:42.973086 15363 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.974375  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:42.975914  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.977833  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:42.954300  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:42.970876 15438 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:43.040604 15358 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:43.041844 15358 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.045439 15358 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:43.046684  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:43.047117 14680 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.047921  7259 raft_consensus.cc:2468] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:43.048213 14680 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.926498 15225 consensus_queue.cc:1059] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.052s
I20260709 13:16:42.944401 15346 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.971740 15217 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.984728 15452 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.956516 15428 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.056843  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:42.970561 15448 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.937834 15126 consensus_queue.cc:237] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.082530 15363 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:42.927237  7861 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:43.079267 15225 raft_consensus.cc:3055] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:43.086923 15225 raft_consensus.cc:740] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:42.964741 15459 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.091154 15428 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.094054 15428 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.094921 15452 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.095794 15457 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.096818 15358 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.097839 15324 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.080116 15204 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.081441 15275 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:43.040163 15438 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:43.098986  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 172547us
I20260709 13:16:43.114388 15428 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.115890 15428 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:43.117568 15059 consensus_meta.cc:287] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.755s	user 0.014s	sys 0.005s
I20260709 13:16:43.111239  7254 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:43.119602  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:43.097926 15358 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.124295  7257 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:16:43.127625 15475 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:43.127801  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:43.098176 15452 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.133347 15217 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.133905 14680 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.133973 15467 raft_consensus.cc:2804] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:43.136121 15363 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:43.136469  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.128612 15475 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.140774  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 33 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:43.114110 15459 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:43.126819  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 90183.5us
I20260709 13:16:43.141557  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:43.162678  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:43.164886 15059 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:43.168311 14680 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:43.168759 15059 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.171155 15467 raft_consensus.cc:697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:43.173301 15467 consensus_queue.cc:237] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.19, Last appended by leader: 19, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.180159 15387 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.181075 15387 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.183380 15358 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:43.183907 15387 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:43.174137 15475 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.169914 14680 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:43.186587  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.188490 15059 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:43.193506 15217 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:43.195039  7228 leader_election.cc:336] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.613s (SENT)
I20260709 13:16:43.195773  7228 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:43.197444  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 71381.9us
I20260709 13:16:43.199328  7261 raft_consensus.cc:2410] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for term 33 because replica has last-logged OpId of term: 31 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
I20260709 13:16:43.200666  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:43.201398 15354 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:43.202150  7257 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:43.209663 15303 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.210826  7332 raft_consensus.cc:1240] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:43.207098  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d735c64b62484486814db631ca028bdb" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 33 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:43.219895 15275 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.221807  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:43.224655  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:43.225100 15380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.232s	user 0.014s	sys 0.026s
W20260709 13:16:43.225668 15380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.422s	user 0.014s	sys 0.026s
I20260709 13:16:43.226006  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:43.227138  7334 raft_consensus.cc:2376] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23. Re-sending same reply.
I20260709 13:16:43.226058  7329 raft_consensus.cc:2393] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 26: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:43.141458 14893 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.231469  7330 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 19. Current term is 20. Ops: []
W20260709 13:16:43.208331 15469 log.cc:927] Time spent T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:16:43.241181  7261 raft_consensus.cc:2410] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 33 because replica has last-logged OpId of term: 31 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
I20260709 13:16:43.132108 15342 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.230827 15346 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.251224 14680 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:43.266105  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 299538us
I20260709 13:16:43.286468  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:43.276909  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:43.274598 15458 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.266201 15245 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:43.295761  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:43.292523  7896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33196 (request call id 1377) took 1516 ms. Trace:
I20260709 13:16:43.236016 15448 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.285809 15025 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:43.312289 15453 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.313411 15453 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.289496  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:43.293565 15428 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.292871 15303 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.341531  7260 raft_consensus.cc:2393] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:43.343502  7225 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:43.344751  7260 raft_consensus.cc:1275] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:16:43.346707 15363 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:43.346978 15303 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:43.347965 15363 consensus_queue.cc:1048] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:43.341533 15360 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:16:43.353335  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 68572.7us
I20260709 13:16:43.362479  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:43.373468  7254 raft_consensus.cc:2468] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
W20260709 13:16:43.378878  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 52580us
W20260709 13:16:43.384929  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 139299us
I20260709 13:16:43.394404 15025 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:43.394405 15156 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:43.395090  7258 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:43.395198 15156 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:43.396243 15303 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:43.397118 15346 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.396808 15156 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.397051 15303 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.398065 15138 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:43.398846 15138 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.399259  7859 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:43.399951 15303 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:43.400898 14680 raft_consensus.cc:2804] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 13:16:43.401597 14680 raft_consensus.cc:697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 33 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:43.403054 15156 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:43.404006 14680 consensus_queue.cc:237] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.17, Last appended by leader: 18, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:43.405795 15449 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Time spent flushing consensus metadata: real 0.523s	user 0.001s	sys 0.015s
I20260709 13:16:43.406322 15449 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.406872  7225 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:43.407641  7253 raft_consensus.cc:2393] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 27: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:43.409060 15245 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 13:16:43.411141 15476 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.092s	user 0.000s	sys 0.002s
I20260709 13:16:43.414235  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:43.417723  7862 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.420871 15342 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:43.425007 15226 consensus_meta.cc:287] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.672s	user 0.012s	sys 0.008s
I20260709 13:16:43.425711 15226 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.424898  7301 leader_election.cc:304] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:43.429623 15448 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.435978  7329 raft_consensus.cc:2410] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:16:43.395182 15025 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.300479  7896 rpcz_store.cc:276] 0709 13:16:41.613753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.613926 (+   173us) service_pool.cc:224] Handling call
0709 13:16:41.629884 (+ 15958us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.648582 (+ 18698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.648632 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.667634 (+ 19002us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.998794 (+331160us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:42.016874 (+ 18080us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.017133 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.017212 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.787651 (+770439us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:42.967462 (+179811us) raft_consensus.cc:1685] finished
0709 13:16:43.064450 (+ 96988us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.129627 (+ 65177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4194,"prepare.queue_time_us":17881,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1555,"raft.queue_time_us":605,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":15615,"spinlock_wait_cycles":4255616,"thread_start_us":308042,"threads_started":1,"wal-append.queue_time_us":459095}
I20260709 13:16:43.366751 14893 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:43.451639  7257 raft_consensus.cc:2468] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 27.
I20260709 13:16:43.401628 15138 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.459642  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:43.441428 15275 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.445319 15025 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:43.452816 15324 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.505350 15324 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.494518  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:43.521483  7257 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:43.527555 15226 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.528908  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:43.529987  7329 raft_consensus.cc:2393] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 22: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:43.531580  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:43.532492  7327 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:43.533953  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:43.538208  7260 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:16:43.540782 15429 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:43.592653  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 85401.9us
I20260709 13:16:43.499536 15449 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.464812 15438 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:43.617990 15139 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.618214 15363 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:43.620280  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.627650  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 202920us
W20260709 13:16:43.630928  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 174876us
I20260709 13:16:43.607678 15303 raft_consensus.cc:2749] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 33 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 13:16:43.643899  7257 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:43.649401  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:43.654004  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.632287 15139 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.662607  7257 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:43.663723 15139 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:43.677007  7257 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 25.
I20260709 13:16:43.685660  7301 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:43.670347 15478 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 13:16:43.720516  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.724377  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 67227.2us
I20260709 13:16:43.639539 15363 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.696756 15225 consensus_queue.cc:260] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.761157 15225 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:43.762961  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.772981  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 456085us
I20260709 13:16:43.777222  7262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 4126) took 1757 ms. Trace:
I20260709 13:16:43.657716 15429 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:43.785527  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 51635.6us
I20260709 13:16:43.776243 15453 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.781216  7262 rpcz_store.cc:276] 0709 13:16:41.955648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.955846 (+   198us) service_pool.cc:224] Handling call
0709 13:16:41.956254 (+   408us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:41.972742 (+ 16488us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:41.996908 (+ 24166us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.296072 (+299164us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:42.296770 (+   698us) log.cc:844] Serialized 52 byte log entry
0709 13:16:42.297002 (+   232us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:42.303278 (+  6276us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.210994 (+907716us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b180021fe80. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fecef017de1 00007fecef0245b1 00007fece6131e07 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614c455 00007fece9234060 00007fece9246716 00007fece9257287 00007fece9257208
0709 13:16:43.462198 (+251204us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.634569 (+172371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.656903 (+ 22334us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.696547 (+ 39644us) raft_consensus.cc:1685] finished
0709 13:16:43.696572 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.712538 (+ 15966us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74498,"prepare.queue_time_us":54615,"prepare.run_cpu_time_us":203,"prepare.run_wall_time_us":9160,"raft.queue_time_us":140118,"raft.run_cpu_time_us":603,"raft.run_wall_time_us":31074,"spinlock_wait_cycles":6759680,"thread_start_us":332839,"threads_started":2,"wal-append.queue_time_us":506000}
W20260709 13:16:43.814213  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 167151us
W20260709 13:16:43.810040 15305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.325s	user 0.010s	sys 0.017s
I20260709 13:16:43.831954  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:43.833824  7253 raft_consensus.cc:1275] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:16:43.835258 15259 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:43.835822  7253 raft_consensus.cc:1275] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 13:16:43.836988 15453 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.837060 15324 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:43.837828 15453 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:43.840416 15488 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:16:43.840588 15453 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:43.841776 15479 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.439s	user 0.000s	sys 0.004s
I20260709 13:16:43.841950  7225 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:43.828541 15305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.527s	user 0.011s	sys 0.017s
I20260709 13:16:43.854485 15443 raft_consensus.cc:2804] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:43.855942  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:43.866912  7228 leader_election.cc:336] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.792s (SENT)
W20260709 13:16:43.895097  7256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55506 (request call id 4118) took 2026 ms (client timeout 1736 ms). Trace:
I20260709 13:16:43.895943 15429 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:43.895825  7256 rpcz_store.cc:269] 0709 13:16:41.868144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.868317 (+   173us) service_pool.cc:224] Handling call
0709 13:16:43.871472 (+2003155us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54002170d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:43.894848 (+ 23376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762037120}
I20260709 13:16:43.897087 15133 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:43.897362  7228 leader_election.cc:336] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.865s (SENT)
I20260709 13:16:43.897902 15133 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:43.900488 15133 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:43.897917  7228 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:43.902041  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:43.916471  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51296.5us
I20260709 13:16:43.922706  7255 raft_consensus.cc:1240] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer 9a54ecc9fb4541df915f9f8c01e19429 for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:43.873142 15443 raft_consensus.cc:697] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
W20260709 13:16:43.933027 15472 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.656s	user 0.003s	sys 0.003s
I20260709 13:16:43.895102 15126 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:43.947763  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:43.922451 15453 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:43.952503  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:43.958057  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 60738.4us
I20260709 13:16:43.931893 15438 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:43.947044  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:43.924705 15429 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:43.964336  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:43.965472  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:43.973358  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:43.974239 15324 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:43.975243 15324 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:43.969363 15380 consensus_queue.cc:1048] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:16:43.973392  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:43.979588  7891 raft_consensus.cc:1240] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 24. Current term is 25. Ops: []
I20260709 13:16:43.980118  7332 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:43.982888 15226 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:43.984436  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:43.985193  7893 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:43.992048  7333 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 19. Preceding OpId from leader: term: 23 index: 20. (index mismatch)
I20260709 13:16:43.996454  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:43.932078 15156 consensus_queue.cc:1048] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:16:43.960502 15453 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:44.007454  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 55669.4us
I20260709 13:16:43.940891 15138 consensus_queue.cc:1048] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.057s
I20260709 13:16:44.010143  7332 raft_consensus.cc:2468] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 27.
I20260709 13:16:44.011999 14344 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.012427  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:44.012643  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.015573  7336 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:44.003657 15324 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:43.963244 15275 consensus_queue.cc:1059] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:16:44.032676  7327 raft_consensus.cc:1275] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:16:44.011413 15453 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:44.028105  7330 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 27.
I20260709 13:16:44.026835 14344 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.039885  7335 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:44.036895 15380 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:44.054668  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:44.057022 15443 consensus_queue.cc:237] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:44.061578 15481 log.cc:927] Time spent T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.253s	user 0.000s	sys 0.002s
I20260709 13:16:44.070837 14928 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:44.071692 14928 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.074775  7301 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:44.075904  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 48967.6us
I20260709 13:16:44.076246 15376 raft_consensus.cc:2804] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:44.077179 15376 raft_consensus.cc:697] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:44.077050  7301 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:44.078830  7301 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:44.079704 15303 raft_consensus.cc:2804] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:44.080300 15303 raft_consensus.cc:697] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:44.081383 15303 consensus_queue.cc:237] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:44.081974 15499 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:16:44.084776  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:44.086042  7891 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:44.085983  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:44.088445  7859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.088269  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:44.089484 15498 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:16:44.089701  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:44.076316 15485 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.682s	user 0.000s	sys 0.004s
I20260709 13:16:44.090894  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:44.091888  7888 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
W20260709 13:16:44.092898 14833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.060s	sys 0.096s
I20260709 13:16:44.094081  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:44.121654  7892 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:44.081775 15060 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:16:44.093401 14833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.060s	sys 0.096s
I20260709 13:16:44.128877  7890 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:44.009825 15126 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.031968 15429 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.137503  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.074522 14928 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:44.137777  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.137430  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.149020  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:44.145447 15259 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:16:44.146307  7327 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:44.147586  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.159531  7887 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
I20260709 13:16:44.133695 15363 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:44.135661 15467 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.166067  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.138288 15226 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:44.153468  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 514862us
I20260709 13:16:44.180308  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:44.182062  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.126997 15380 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:44.189090  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.166594 15060 raft_consensus.cc:697] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:44.200531  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.205483  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.197036 14344 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:44.208873  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 170333us
W20260709 13:16:44.255219  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49940.4us
I20260709 13:16:44.278986  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:44.285091  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:44.161682 15376 consensus_queue.cc:237] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:44.200831 15226 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.312925  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:44.314528 15259 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:44.315030 15259 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.315439 15259 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:44.206658 15467 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.322861 15226 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:44.325759  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.327307 14344 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.327908 14344 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:44.330055 14344 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:44.330533 14344 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.331601 14344 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.332168 15463 raft_consensus.cc:3055] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:16:44.332666 15463 raft_consensus.cc:740] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:44.334300 15503 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 13:16:44.333624 15225 consensus_meta.cc:287] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.008s
I20260709 13:16:44.335505  7332 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 25. Current term is 26. Ops: []
I20260709 13:16:44.299562 15059 consensus_queue.cc:1059] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
W20260709 13:16:44.361999  7257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.024s	sys 0.026s
W20260709 13:16:44.369225  7257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.025s	sys 0.026s
I20260709 13:16:44.372574  7335 raft_consensus.cc:2468] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 25.
I20260709 13:16:44.372838  7257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 4145) took 1098 ms. Trace:
I20260709 13:16:44.372989  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:44.339741 15380 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:44.373818  7887 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:44.377758  7890 raft_consensus.cc:2410] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
W20260709 13:16:44.370560 15498 log.cc:927] Time spent T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:44.337604 15467 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:44.388310  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.371308 15225 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:44.392869 15362 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.393502  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.395262  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.373433  7257 rpcz_store.cc:276] 0709 13:16:43.274180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.696606 (+422426us) service_pool.cc:224] Handling call
0709 13:16:43.697056 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.702851 (+  5795us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:43.716335 (+ 13484us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.370299 (+653964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.370373 (+    74us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:44.370428 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.372605 (+  2177us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.372770 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5621,"prepare.queue_time_us":14272,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":531,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":4733,"thread_start_us":653121,"threads_started":1}
I20260709 13:16:44.398860  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.403151  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:44.406800  7258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.022s	sys 0.029s
W20260709 13:16:44.386686  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 460179us
I20260709 13:16:44.333624 15463 consensus_queue.cc:260] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.424434 15225 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.425041  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:44.425927  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:44.406937 15060 consensus_queue.cc:237] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:44.430972  7259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 2689) took 1569 ms. Trace:
I20260709 13:16:44.434465  7257 raft_consensus.cc:1275] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 33 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 31 index: 18. Preceding OpId from leader: term: 33 index: 18. (term mismatch)
I20260709 13:16:44.393496 15362 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:44.435146  7257 pending_rounds.cc:85] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Aborting all ops after (but not including) 17
I20260709 13:16:44.437563  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.440388 14344 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:44.444746  7262 raft_consensus.cc:1275] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 19. Preceding OpId from leader: term: 23 index: 20. (index mismatch)
I20260709 13:16:44.406780 15453 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:44.436414  7257 pending_rounds.cc:107] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: Aborting uncommitted NO_OP operation due to leader change: 31.18
I20260709 13:16:44.441771  7260 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 25.
I20260709 13:16:44.448573  7257 raft_consensus.cc:2889] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.448097  7330 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:44.431619  7259 rpcz_store.cc:276] 0709 13:16:42.861862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.212456 (+350594us) service_pool.cc:224] Handling call
0709 13:16:43.257892 (+ 45436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.329712 (+ 71820us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:16:43.427084 (+ 97372us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.657096 (+230012us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.707262 (+ 50166us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.707734 (+   472us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.707839 (+   105us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.716348 (+  8509us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.716503 (+   155us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:16:43.716713 (+   210us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.716956 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.717041 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.088708 (+371667us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:44.430738 (+342030us) raft_consensus.cc:1685] finished
0709 13:16:44.430763 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.430910 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105497,"prepare.queue_time_us":60370,"prepare.run_cpu_time_us":181,"prepare.run_wall_time_us":185,"raft.queue_time_us":29313,"raft.run_cpu_time_us":823,"raft.run_wall_time_us":87001,"spinlock_wait_cycles":15134080,"thread_start_us":220673,"threads_started":1,"wal-append.queue_time_us":445620}
I20260709 13:16:44.467303  7301 leader_election.cc:400] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 25. Current term is 26.
I20260709 13:16:44.467828  7301 leader_election.cc:403] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:44.468509  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 412552us
I20260709 13:16:44.439819 15363 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.473207  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 58137.8us
I20260709 13:16:44.441349 15429 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:44.452214 15126 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:44.496603  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.507359 15192 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.508457 15192 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:44.515434 15192 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:44.520115  7302 leader_election.cc:336] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.736s (SENT)
I20260709 13:16:44.477586 14680 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.477041 15305 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351) with higher term. Message: Invalid argument: T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 25. Current term is 26.
W20260709 13:16:44.529418  7228 leader_election.cc:336] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.966s (SENT)
I20260709 13:16:44.535815  7228 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:44.539113 14344 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.539923  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44169.7us
W20260709 13:16:44.563328  7302 leader_election.cc:336] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 1.523s (SENT)
W20260709 13:16:44.569700  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 285143us
I20260709 13:16:44.571303  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:44.534420 15363 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:44.564152  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:44.541204 14928 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.580343 14344 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:44.584693  7299 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:44.554575 15448 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:44.554024 15275 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:44.593158  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:44.593703 15516 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:16:44.586802 15305 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:44.608816 14833 raft_consensus.cc:3055] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:44.631625 15275 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.609937 15362 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:44.545204 14680 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:44.618224 15025 consensus_meta.cc:287] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 1.105s	user 0.008s	sys 0.008s
I20260709 13:16:44.618825 14928 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.620617 15453 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:44.625877 15504 log.cc:927] Time spent T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:16:44.628069  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.692595  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.628575 15515 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.629926  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 4144) took 1396 ms. Trace:
W20260709 13:16:44.632732  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 48165.2us
I20260709 13:16:44.636464 15305 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.636816 15192 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:44.643818  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:44.706540  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 64004us
I20260709 13:16:44.692808 14344 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:44.638161  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 51671.9us
I20260709 13:16:44.695202  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:44.704923  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:44.639026 15059 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:44.713264  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:44.714862 14344 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.716720 15059 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.717111  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:44.717650  7253 raft_consensus.cc:1275] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 13:16:44.717991  7225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.025s	sys 0.033s
W20260709 13:16:44.718374  7225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.025s	sys 0.033s
I20260709 13:16:44.719731 14680 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:44.720275 15467 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:44.720729 15467 raft_consensus.cc:493] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.721102 15467 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:44.658298 15362 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.723237  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:44.705026 15305 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:44.710790 15515 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:44.726037 14893 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:44.726677 14893 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:44.727072  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:44.723003 15362 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:44.638183 14833 raft_consensus.cc:740] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:44.717253 15059 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:44.759130  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 237173us
I20260709 13:16:44.737473  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:44.754522  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 201158us
I20260709 13:16:44.641438 15225 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:44.693583  7258 rpcz_store.cc:276] 0709 13:16:43.233857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.677626 (+443769us) service_pool.cc:224] Handling call
0709 13:16:43.678151 (+   525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.796975 (+118824us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:43.853575 (+ 56600us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.409423 (+555848us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.409502 (+    79us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:44.409565 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.629661 (+220096us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54002265d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:44.629714 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.629856 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5636,"prepare.queue_time_us":53237,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":126,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":2930,"spinlock_wait_cycles":243938048,"thread_start_us":515563,"threads_started":1,"wal-append.queue_time_us":663787}
I20260709 13:16:44.727761  7259 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:44.763752  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:44.735656 15226 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.030s
I20260709 13:16:44.765915  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:44.766798  7891 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 27.
I20260709 13:16:44.767172 15226 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:44.756053 15138 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.768024 15226 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:44.768363 15138 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.768748 14680 consensus_queue.cc:1048] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:16:44.735936  7152 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:44.736480 15275 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:44.773239 14928 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:44.708895 15523 log.cc:927] Time spent T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.079s	user 0.000s	sys 0.010s
I20260709 13:16:44.768397 15226 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:44.709604 15516 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:16:44.707887 15303 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.784066  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:44.760138 14344 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.792479  7254 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 20: Already voted for candidate efc9ee9e1d86480790fa83f6ad0c295c in this term.
I20260709 13:16:44.730871 15133 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:44.798383  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:44.800386  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:44.805701  7892 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 25: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:44.658420 15025 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:44.782612 15226 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:44.818002 15518 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:44.818707  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.826066  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:44.819566  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 108132us
I20260709 13:16:44.808794 15521 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:16:44.821542  7228 leader_election.cc:336] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 2.034s (SENT)
I20260709 13:16:44.827189  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:44.822954  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:44.727661 14893 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.804976 15133 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:44.841856 14344 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:44.859369  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:44.860813  7331 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:44.795354 15520 consensus_queue.cc:1048] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.057s
I20260709 13:16:44.825661 15138 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:44.866422  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.806238 15380 consensus_queue.cc:1048] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:16:44.871205  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:44.878736  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:44.882125  7334 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:44.882758  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:44.887161 14344 raft_consensus.cc:2804] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:44.887302  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:44.887828 14344 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.888281 14344 raft_consensus.cc:3060] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:44.857169 15133 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:44.886063  7254 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:44.857987 14928 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.898069 14928 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:44.899596  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 78130.2us
I20260709 13:16:44.900349 14928 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:44.901100 15467 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.903231 15515 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:44.809670 15303 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:44.900424  7228 leader_election.cc:336] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 2.100s (SENT)
I20260709 13:16:44.896986 15059 raft_consensus.cc:515] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.858055 15453 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.892511 15362 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:44.906243  7228 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:44.909451  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:44.912643  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 156581us
I20260709 13:16:44.870278 15512 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:16:44.915447  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 151792us
I20260709 13:16:44.828047 15305 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:44.829705 14833 consensus_queue.cc:260] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:44.891181 15259 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.005s
W20260709 13:16:44.910023 15525 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.070s	user 0.008s	sys 0.003s
I20260709 13:16:44.943107  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.914708  7150 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:44.917985  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:44.944731  7859 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:44.927521  7331 raft_consensus.cc:2468] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 23.
I20260709 13:16:44.928228  7336 raft_consensus.cc:1240] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 24. Current term is 25. Ops: []
W20260709 13:16:44.928494  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.930735  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:44.916760 15511 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.939188  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.928498 15522 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:44.942891  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 92627.3us
I20260709 13:16:44.947917  7260 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 29.
I20260709 13:16:44.981694  7327 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 26: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:44.985522  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:44.992374  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.994585  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:44.963647 15138 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:16:44.985502  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:45.014402  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:44.987232 15275 raft_consensus.cc:2804] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:16:45.016793  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 151134us
I20260709 13:16:44.930253 15453 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.014292  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:45.030242  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:45.019523  7862 leader_election.cc:336] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.042410  7862 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:44.960079 15259 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:45.062321  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 48980us
I20260709 13:16:45.008172 15138 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:45.063898  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.013900 14833 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:44.987269 15511 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:45.065007  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:45.073511  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:45.074152  7259 raft_consensus.cc:3060] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:45.054348  7299 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:44.988961 15522 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:45.069485  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.038666 15362 raft_consensus.cc:3060] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:45.070294  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 84866.4us
I20260709 13:16:45.077351  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.043494 15467 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.079788  7254 raft_consensus.cc:2393] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 26: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:45.068091  7258 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 23.
I20260709 13:16:45.081516  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.083745  7333 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:45.087531  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:45.088675  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 188305us
I20260709 13:16:45.090468  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:45.068588 15138 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:45.066731 15443 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:45.061780 15275 raft_consensus.cc:697] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:45.090080  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.104281  7330 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 22.
I20260709 13:16:45.067421 15429 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
W20260709 13:16:45.116724  7228 leader_election.cc:336] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 2.124s (SENT)
I20260709 13:16:45.075243 14680 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:16:45.121472  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.153388  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 58484us
I20260709 13:16:45.125826  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.156188  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.158331  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.161726  7228 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:45.114743 15192 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:16:45.167163  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:45.164726  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 110419us
I20260709 13:16:45.097013 15025 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.159237  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:45.103920 15528 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:45.175997 15448 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:45.195295  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:45.199766  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 129425us
I20260709 13:16:45.200026  7256 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:16:45.201725  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:45.203142  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:45.174841 14928 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:45.173530 15192 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:45.207423  7859 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:45.180637 15059 leader_election.cc:290] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:45.160317 15429 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.235625 14928 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.171486 15529 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:45.182855 15528 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.208101 15376 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:16:45.240797  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.274125  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:45.241428  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.237365  7334 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27. Ops: []
I20260709 13:16:45.253317  7330 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27. Ops: []
I20260709 13:16:45.240159  7329 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: []
I20260709 13:16:45.234565 15305 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:45.246618  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 77069.3us
I20260709 13:16:45.206362 15303 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:45.241220 15526 log.cc:927] Time spent T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.310s	user 0.002s	sys 0.000s
W20260709 13:16:45.253213 15530 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:16:45.242815 15192 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:16:45.293334  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 172392us
I20260709 13:16:45.259044 15467 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:45.298183  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.305104  7328 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 25: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:45.295418  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:45.264207 14928 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:45.310559  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.306022  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.241969 15245 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:45.316098  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 146480us
I20260709 13:16:45.318603  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:45.281519 15376 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.323120  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:45.281198 15528 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:45.291780 15259 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:45.315138  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:45.315526 15532 log.cc:927] Time spent T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
I20260709 13:16:45.326026  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:45.334983  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:45.302826 15521 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:45.337307  7862 leader_election.cc:336] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.327198 15376 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:16:45.337788 15453 leader_election.cc:290] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:45.369570  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 53723.1us
I20260709 13:16:45.369899  7859 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:45.346261 15529 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:45.377308  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.273622 15275 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.379408  7152 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:45.330389 15245 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:45.399065  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:45.399190 15539 log.cc:927] Time spent T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:16:45.365777 15511 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.414170  7895 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 26: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:45.391808  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:45.415477  7335 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 26: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:45.407981  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:45.416253  7888 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:45.379739 15515 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:45.421016  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 86137.3us
W20260709 13:16:45.418493  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 301838us
W20260709 13:16:45.390499 15547 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:16:45.419301  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 45002.8us
W20260709 13:16:45.391439 15541 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:16:45.346417 15521 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:45.405939 15545 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:45.423545  7259 raft_consensus.cc:2468] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 26.
I20260709 13:16:45.401404 15245 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.408510 15448 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:45.429638  7225 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:45.413537 15025 raft_consensus.cc:3060] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:45.442948  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:45.434880 15545 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:45.456045  7228 leader_election.cc:336] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 2.152s (SENT)
I20260709 13:16:45.469278  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:45.400513 15528 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.463487 15453 raft_consensus.cc:2804] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:16:45.491923  7302 leader_election.cc:336] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.476514 15545 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:45.445578 15515 consensus_queue.cc:1059] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:16:45.482378 15550 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:45.512424 15521 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.449460 15448 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.515468  7225 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:45.513031 15565 consensus_queue.cc:1059] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:16:45.529467  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.530778 15560 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:16:45.531090 15537 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
W20260709 13:16:45.520785 15542 log.cc:927] Time spent T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:16:45.554417  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 72364.3us
I20260709 13:16:45.482275 15511 consensus_queue.cc:1048] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:16:45.558136 15521 raft_consensus.cc:3055] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:16:45.559492  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:45.560274  6030 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 7212)
W20260709 13:16:45.562134  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 70280.7us
W20260709 13:16:45.574913  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 131145us
I20260709 13:16:45.560240  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:45.536862 15515 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:45.589248  7302 leader_election.cc:336] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.586156 15515 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.572955 15521 raft_consensus.cc:740] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:45.577868 15565 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:45.572243 15453 raft_consensus.cc:697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:45.601035 15515 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:45.611886 15528 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:45.615518 15133 consensus_meta.cc:287] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.720s	user 0.013s	sys 0.000s
I20260709 13:16:45.616093 15133 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.620750 15521 consensus_queue.cc:260] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:45.622293 15521 raft_consensus.cc:3060] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:45.604873 15552 raft_consensus.cc:2804] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:45.633343 15552 raft_consensus.cc:697] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:45.634508 15552 consensus_queue.cc:237] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:45.636840 14928 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:45.639940 15538 log.cc:927] Time spent T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.454s	user 0.003s	sys 0.000s
W20260709 13:16:45.625420 15556 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:45.639504 15192 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:45.646934  7862 leader_election.cc:336] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.647420 15566 consensus_queue.cc:1059] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:45.648869 14833 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.002s
I20260709 13:16:45.648788 15376 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:45.672639 15518 raft_consensus.cc:3055] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:16:45.673056 15518 raft_consensus.cc:740] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:45.674124 15376 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 30 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:45.605191 15565 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.674016 15518 consensus_queue.cc:260] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:45.674882 15565 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:45.652376 15522 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:45.653928 15362 consensus_meta.cc:287] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.000s
I20260709 13:16:45.606016 15560 consensus_queue.cc:1059] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
W20260709 13:16:45.671452 15138 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.002s
I20260709 13:16:45.651306 15453 consensus_queue.cc:237] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:45.671514  7862 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:45.631826 14344 consensus_meta.cc:287] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.003s
W20260709 13:16:45.693136  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.727941  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 131715us
W20260709 13:16:45.729846  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 82969.4us
W20260709 13:16:45.666109 15226 consensus_meta.cc:287] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.829s	user 0.012s	sys 0.003s
W20260709 13:16:45.727591  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 189733us
W20260709 13:16:45.738903  7862 leader_election.cc:336] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.720911  7888 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
W20260709 13:16:45.738305  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 150553us
I20260709 13:16:45.732134 14344 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:45.740865  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:45.741688  7862 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.707734 15133 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:45.666087 15545 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.682811 15362 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:45.748335  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.749553  7330 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 22.
I20260709 13:16:45.750166  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.751161  7335 raft_consensus.cc:2393] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 30: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:45.745016  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:45.763114 15515 consensus_queue.cc:1059] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:45.764341 15515 raft_consensus.cc:3055] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:45.764739 15515 raft_consensus.cc:740] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:45.738054 15510 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:45.767069  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.768229  7336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33688 (request call id 2848) took 1561 ms. Trace:
I20260709 13:16:45.768730  7336 rpcz_store.cc:276] 0709 13:16:44.206769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.207008 (+   239us) service_pool.cc:224] Handling call
0709 13:16:44.207382 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.960010 (+752628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.767903 (+807893us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b540031bad4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:45.768126 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1652844800}
I20260709 13:16:45.738193 15560 consensus_queue.cc:1243] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:16:45.770478  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.737896 15138 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.772763  7333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33688 (request call id 2851) took 1379 ms. Trace:
I20260709 13:16:45.748195 15528 consensus_queue.cc:1059] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:16:45.773253  7333 rpcz_store.cc:276] 0709 13:16:44.393052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.393200 (+   148us) service_pool.cc:224] Handling call
0709 13:16:45.772449 (+1379249us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b540036b854. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:45.772653 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582180608}
I20260709 13:16:45.773859 15528 consensus_queue.cc:1243] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 27.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:16:45.774662 15528 raft_consensus.cc:3055] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:16:45.774915  7890 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 27. Current term is 28. Ops: []
I20260709 13:16:45.775089 15528 raft_consensus.cc:740] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:45.776300 15528 consensus_queue.cc:260] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:45.740253 15025 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:45.765782 15515 consensus_queue.cc:260] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:45.784551  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:45.781718  7862 leader_election.cc:336] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.788240 14928 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:45.789027 15515 raft_consensus.cc:3060] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:45.788247  7256 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
W20260709 13:16:45.791855  7860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.789597  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.789268  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.790737  7254 raft_consensus.cc:1240] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 21. Current term is 22. Ops: []
I20260709 13:16:45.742148 15226 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.795560 14344 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.774528 15138 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.797152 15226 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.785732  7862 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:45.793054  7257 raft_consensus.cc:2410] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:16:45.793043  7330 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 29. Current term is 30. Ops: []
I20260709 13:16:45.777685 15528 raft_consensus.cc:3060] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:16:45.800729  7302 leader_election.cc:336] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:45.802963  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49018.9us
W20260709 13:16:45.803714  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:45.803748  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 57571.8us
W20260709 13:16:45.806986  7862 leader_election.cc:336] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.807883  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.810034  7894 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 23: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:45.811159  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:45.812304 15226 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:45.813292  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.810050  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.814047  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.814523  7259 raft_consensus.cc:2393] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 25: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:45.807497  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:45.795081 15545 leader_election.cc:290] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.816226  7262 raft_consensus.cc:1240] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27. Ops: []
I20260709 13:16:45.816838 15545 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:45.817942  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.820865  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.821779  7255 raft_consensus.cc:1240] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27. Ops: []
W20260709 13:16:45.823544  7862 leader_election.cc:336] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.824039  7862 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:45.825567  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 150697us
I20260709 13:16:45.825837  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:45.826749  7888 raft_consensus.cc:2393] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 24: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:16:45.825942  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.828482 15138 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:45.833506  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:45.834365  7328 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:45.834548  7152 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:45.835589 15025 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:45.836264  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:45.837105  7330 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 25: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:45.837239 15559 raft_consensus.cc:3055] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:16:45.837102  7152 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:45.835484  7333 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 27. Current term is 28. Ops: []
I20260709 13:16:45.831266  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:45.831964  7862 leader_election.cc:336] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.840308  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:45.841004  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.843987  7260 raft_consensus.cc:2393] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 26: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:45.843765  7152 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:45.840353  7862 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:45.840124 15025 raft_consensus.cc:3060] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:45.847374  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:45.847559  7253 raft_consensus.cc:1240] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 22. Current term is 23. Ops: []
W20260709 13:16:45.848057  7228 leader_election.cc:336] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Timed out: RequestConsensusVote RPC to 127.5.227.129:44171 timed out after 2.448s (SENT)
I20260709 13:16:45.849431 14344 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:45.851742  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:45.847003  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:45.837730 15559 raft_consensus.cc:740] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:45.844933 15059 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:16:45.862025 14344 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:45.863579  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.855234 14928 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:45.862941  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:45.874855 15562 raft_consensus.cc:3060] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:45.864378  7862 leader_election.cc:336] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:45.882828  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 97483.7us
I20260709 13:16:45.852403 15133 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.859130 15560 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:16:45.862850 15545 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
W20260709 13:16:45.896586  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.898583  7333 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27. Ops: []
W20260709 13:16:45.899264  7862 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.852638 15226 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:45.919288  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 67653.9us
I20260709 13:16:45.920457  7152 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:45.920912  7227 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.897451 15133 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.924003 15133 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:45.924754  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 76737us
I20260709 13:16:45.925415  7258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1703) took 1070 ms. Trace:
I20260709 13:16:45.925727 15552 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.925863  7258 rpcz_store.cc:276] 0709 13:16:44.854501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.877877 (+ 23376us) service_pool.cc:224] Handling call
0709 13:16:45.925183 (+1047306us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54001e05d4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:16:45.925345 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354220416}
I20260709 13:16:45.926373 15552 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.897948 15545 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:45.903185 15559 consensus_queue.cc:260] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:45.937245  7302 leader_election.cc:336] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:45.937958  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.938537  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.927990  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.924844 15429 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:45.940405 15448 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:45.917470 15363 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.941684 15545 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.943311  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:45.945731  7862 leader_election.cc:336] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.929097 15463 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:16:45.947669  7862 leader_election.cc:336] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.950826 15559 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:45.951395  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:45.955520 15518 raft_consensus.cc:3060] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:16:45.959326 15574 log.cc:927] Time spent T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:16:45.962729 15576 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:45.896371 15565 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:45.969547 15192 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:45.968529 15025 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:16:45.971849  7072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 148109us
W20260709 13:16:45.972810  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:45.973297  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.973265  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:45.974135  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.974293  7258 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:45.974455 15562 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:16:45.975054  7228 leader_election.cc:336] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:45.975521  7228 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:45.978783  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:45.979883 15363 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:16:45.980229 15520 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:16:45.980403  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:45.981072  7329 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:45.984549  7861 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:45.988502  7258 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:45.976737 15565 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:45.992205  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:45.993240  7257 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:45.995322  7254 raft_consensus.cc:1275] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:16:45.997810  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.998469 15535 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:16:45.990105 15520 raft_consensus.cc:2804] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:16:45.990965  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 53793us
I20260709 13:16:45.998507  7262 raft_consensus.cc:2468] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:46.015837  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:45.999890 15520 raft_consensus.cc:697] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:46.022668  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06475a21ebc249129fc41345c177538a" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:46.013351 15540 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.868s	user 0.003s	sys 0.000s
W20260709 13:16:46.025287  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50303.8us
W20260709 13:16:46.021292  7302 leader_election.cc:336] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:46.033834  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.027547  7257 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:46.028697  7256 raft_consensus.cc:2393] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 26: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:46.020128 15138 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.032015  7327 raft_consensus.cc:1240] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 25. Current term is 26. Ops: []
I20260709 13:16:46.035030  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.036780  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:46.037918  7333 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:46.041626 15138 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:46.048278  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.050444 15529 raft_consensus.cc:3055] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:16:46.051050 15529 raft_consensus.cc:740] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:46.052191 15529 consensus_queue.cc:260] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:46.053705 15529 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:46.074853  7259 raft_consensus.cc:1275] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:16:46.088568  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 67323.9us
W20260709 13:16:46.093331  7302 leader_election.cc:336] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:46.094337  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:46.094578  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.105319  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:46.106335  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:46.107079  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:46.108603  7896 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 28: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:46.112946  7894 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:16:46.116161  7228 leader_election.cc:336] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:46.103973 15133 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:46.133661  7329 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:46.167821  7896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:46.174132  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.175199  7255 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:46.178376  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:46.179117  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 85680.8us
W20260709 13:16:46.180768  7302 leader_election.cc:336] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:46.181375  7302 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:46.182840  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:46.179620  7888 raft_consensus.cc:2393] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 25: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:46.168741  7896 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 20.
I20260709 13:16:46.190203  7260 raft_consensus.cc:1275] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:16:46.074467 15520 consensus_queue.cc:237] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:46.195101  7893 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 23: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:16:46.199899  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:46.201473  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:46.215178  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:46.200551  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:46.217185  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.207904  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:46.223201  7253 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:16:46.225270  7260 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 22. Current term is 23. Ops: [21.13-22.14]
I20260709 13:16:46.227690  7329 raft_consensus.cc:3060] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:16:46.233728  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:46.234231  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:46.235442  7332 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 28: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:46.207472 15536 log.cc:927] Time spent T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 1.025s	user 0.013s	sys 0.005s
I20260709 13:16:46.237543  7331 raft_consensus.cc:2393] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 23: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:46.240439  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:46.229415  7299 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:46.223256 15584 log.cc:927] Time spent T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 13:16:46.251873  7259 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:16:46.219020 15522 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 13:16:46.262341  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 157326us
I20260709 13:16:46.263350  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.217268 15552 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:46.227909 15544 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.273645 15544 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:46.274803 15376 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:46.275449 15376 raft_consensus.cc:697] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:46.276383 15544 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:46.277859  7150 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:46.276424 15376 consensus_queue.cc:237] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:46.285898  7329 raft_consensus.cc:2468] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:46.207711 15559 consensus_queue.cc:1059] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.044s
I20260709 13:16:46.292191  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:46.296144  7335 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 31.
I20260709 13:16:46.305343  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:46.310029  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.291814 15576 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:16:46.292932 15585 log.cc:927] Time spent T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:16:46.244387 15528 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 27.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.055s
I20260709 13:16:46.322820 14344 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:16:46.334241  7228 leader_election.cc:336] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:46.292701 15025 consensus_queue.cc:1059] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.041s
I20260709 13:16:46.309820 15559 consensus_queue.cc:1243] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer c85cf49c63cc4e66b4747d8c4fa14022 log is divergent from this leader: its last log entry 28.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:16:46.314088 15126 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.312747 15515 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:46.309782 15463 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:46.355712  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:46.364533  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.366474  7891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33224 (request call id 1133) took 1578 ms. Trace:
I20260709 13:16:46.369050  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:46.342890 15576 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:46.370951  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 141700us
I20260709 13:16:46.367120  7891 rpcz_store.cc:276] 0709 13:16:44.787684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.788017 (+   333us) service_pool.cc:224] Handling call
0709 13:16:44.788473 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.788825 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:16:44.788857 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.789374 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.010258 (+220884us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:16:45.010325 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.010427 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.126284 (+1115857us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:46.361830 (+235546us) raft_consensus.cc:1685] finished
0709 13:16:46.361863 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.366379 (+  4516us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66377088,"thread_start_us":207188,"threads_started":1,"wal-append.queue_time_us":278972}
I20260709 13:16:46.381870  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.386439 15576 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:46.378544  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 55726.8us
I20260709 13:16:46.380956  7301 leader_election.cc:304] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:46.391283 15060 consensus_queue.cc:1048] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:46.393555 15059 consensus_queue.cc:1048] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:16:46.360985 15463 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:46.400919 15463 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:46.372321 15138 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:46.407920 15535 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.408538 15535 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:46.415434 15522 consensus_queue.cc:1048] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:16:46.389643  7228 leader_election.cc:336] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:46.420516  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 45430.9us
I20260709 13:16:46.420869  7228 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:46.352916 15521 consensus_queue.cc:1059] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 13:16:46.415928 15591 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:16:46.393462 15544 raft_consensus.cc:2749] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:16:46.427088  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:46.391320 15588 log.cc:927] Time spent T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:16:46.357961 15126 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:46.462862  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 173574us
I20260709 13:16:46.465852  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.466298  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:46.442384 15552 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:46.477881  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 88334.4us
I20260709 13:16:46.470860  7861 leader_election.cc:304] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:46.488148  7084 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 156) took 62615 ms (client timeout 15000 ms). Trace:
I20260709 13:16:46.488832 15551 raft_consensus.cc:2804] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:46.489485 15551 raft_consensus.cc:697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:46.489944 15126 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:46.471969 15463 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:46.436760 15060 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:16:46.489820  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:46.497665  7256 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:16:46.476246 15544 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:16:46.490864 15429 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.495808  7225 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:46.425211 15535 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:46.501276 15544 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:46.504238 15305 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:16:46.526961 15552 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:46.574440  6030 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 7212)
I20260709 13:16:46.490542 15551 consensus_queue.cc:237] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:46.506599 15429 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:46.557168 15518 consensus_meta.cc:287] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.006s
W20260709 13:16:46.605852 15586 log.cc:927] Time spent T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:16:46.521595 15592 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.097s
I20260709 13:16:46.617060  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 4170) took 1540 ms. Trace:
W20260709 13:16:46.611969 15590 log.cc:927] Time spent T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:16:46.623194  7261 rpcz_store.cc:276] 0709 13:16:45.076950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.292411 (+215461us) service_pool.cc:224] Handling call
0709 13:16:45.314250 (+ 21839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.997713 (+683463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.997747 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:45.997791 (+    44us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:16:45.997820 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.616711 (+618891us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54002d3554. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece923ce01 00007fece923b83e 00007fecee200419 00007fece7777bd4 00007fece7777b62 00007fece7777a91 00007fece7777a0c 00007fece7776cc2 00007fece757748c 00007fece75768c6
0709 13:16:46.616784 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.616978 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1571307776}
W20260709 13:16:46.637074  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 130859us
I20260709 13:16:46.551620 15305 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:46.621968 15597 raft_consensus.cc:493] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
W20260709 13:16:46.488689  7084 rpcz_store.cc:269] 0709 13:15:43.808431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.808955 (+   524us) service_pool.cc:224] Handling call
0709 13:16:46.416435 (+62607480us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:42.900928 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:42.902460 (+  1532us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:42.902534 (+    74us) write_op.cc:435] Acquired schema lock
0709 13:16:42.902584 (+    50us) tablet.cc:662] Decoding operations
0709 13:16:42.904120 (+  1536us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:42.904262 (+   142us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:42.904326 (+    64us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:16:42.905332 (+  1006us) tablet.cc:701] Row locks acquired
0709 13:16:42.905398 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:16:42.905742 (+   344us) write_op.cc:270] Start()
0709 13:16:42.905974 (+   232us) write_op.cc:276] Timestamp: P: 1783603002905628 usec, L: 0
0709 13:16:42.906026 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 13:16:42.908282 (+  2256us) log.cc:844] Serialized 2766 byte log entry
0709 13:16:43.834246 (+925964us) op_driver.cc:464] REPLICATION: finished
0709 13:16:44.539310 (+705064us) write_op.cc:301] APPLY: starting
0709 13:16:44.547111 (+  7801us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:44.598555 (+ 51444us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:44.641866 (+ 43311us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:45.480447 (+838581us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:45.527671 (+ 47224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 13:16:45.527767 (+    96us) write_op.cc:312] APPLY: finished
0709 13:16:45.530116 (+  2349us) log.cc:844] Serialized 65 byte log entry
0709 13:16:45.649322 (+119206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:45.649461 (+   139us) write_op.cc:454] Released schema lock
0709 13:16:45.649537 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:45.650082 (+   545us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:45.650111 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27974,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":660972,"apply.run_cpu_time_us":70894,"apply.run_wall_time_us":1120770,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":323473,"prepare.run_cpu_time_us":25296,"prepare.run_wall_time_us":176188,"raft.queue_time_us":420964,"raft.run_cpu_time_us":79684,"raft.run_wall_time_us":423418,"replication_time_us":927983,"thread_start_us":1176636,"threads_started":5,"wal-append.queue_time_us":476125,"wal-append.run_cpu_time_us":34919,"wal-append.run_wall_time_us":1421997}]]}
W20260709 13:16:46.692019 15599 log.cc:927] Time spent T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:16:46.717581  7253 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 30.
I20260709 13:16:46.736207 15429 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:46.741863 15305 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:46.683490 15597 raft_consensus.cc:515] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:46.799197 15603 log.cc:927] Time spent T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:16:46.800917 15600 log.cc:927] Time spent T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:16:46.801141 15559 raft_consensus.cc:3055] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:16:46.801716 15559 raft_consensus.cc:740] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
W20260709 13:16:46.802145  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.802850 15610 log.cc:927] Time spent T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:16:46.802652 15559 consensus_queue.cc:260] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:46.812495  7335 raft_consensus.cc:1217] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Deduplicated request from leader. Original: 25.16->[26.17-29.18]   Dedup: 26.17->[29.18-29.18]
I20260709 13:16:46.813422  7335 raft_consensus.cc:1240] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 29. Current term is 30. Ops: [26.17-29.18]
W20260709 13:16:46.802654  7152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.827519  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.827818 15576 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.828042  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.828330 15576 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:46.830775  7862 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 112 similar messages]
I20260709 13:16:46.831458 15560 raft_consensus.cc:3055] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:16:46.831856 15560 raft_consensus.cc:740] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:46.832640 15560 consensus_queue.cc:260] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:46.833720 15560 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Advancing to term 30
W20260709 13:16:46.837802  7862 leader_election.cc:336] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:46.838953  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 614674us
W20260709 13:16:46.840174  7302 leader_election.cc:336] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:46.841113  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:46.841665  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:46.842166  7302 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:46.843681  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.844914  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.845592  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.850320  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.851255  7262 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 20.
I20260709 13:16:46.852632 15544 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:46.854162  7261 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:16:46.854172 15544 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:46.859524  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:46.866178 14928 raft_consensus.cc:3055] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:16:46.866755 14928 raft_consensus.cc:740] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:46.867664 14928 consensus_queue.cc:260] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:46.869056 15611 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.107s	user 0.001s	sys 0.002s
I20260709 13:16:46.869094 14928 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:46.871055  7256 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:46.830480 15576 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:46.880019  7862 consensus_peers.cc:597] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:46.881217  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:46.882134 15515 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.882907 15515 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:46.885147 15515 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:46.892709  7333 raft_consensus.cc:1240] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 26. Current term is 27. Ops: []
W20260709 13:16:46.888505  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46372.7us
I20260709 13:16:46.898520  7254 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:16:46.898808  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:46.893786  7861 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:46.900394 15552 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:46.902104 15520 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:46.902669 15520 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.903036 15520 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:46.903538 15545 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:16:46.907562  7335 raft_consensus.cc:1240] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 27. Current term is 28. Ops: []
I20260709 13:16:46.908171 15429 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:16:46.915479  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 492184us
W20260709 13:16:46.898646  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:46.923484  7299 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:46.886540 15559 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:46.914587  7301 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:46.886754 15597 leader_election.cc:290] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:46.948344  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 306331us
I20260709 13:16:46.948841  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:46.954859  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:46.957713 14928 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.959324 14928 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:46.961751 14928 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:46.946026 15380 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:16:46.949865  7225 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:46.949901 15305 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:16:46.968600 15305 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.969133 15305 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:46.985304  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:46.957957 15597 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:46.989184  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:46.990528  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:46.997738  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:47.005995  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:47.006973  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:46.949081 15613 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:47.008098  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:47.008350  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:46.963479 15226 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:16:46.995795 15380 raft_consensus.cc:697] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:47.025769  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57203.1us
I20260709 13:16:47.025527 15380 consensus_queue.cc:237] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:47.009474  7890 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:47.027029  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4f3c0328924ddaba5d93fe80e78a64" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:47.009629  7329 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 25.
W20260709 13:16:46.995599  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 45877.5us
I20260709 13:16:47.038983  7335 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:16:47.038918  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 48437.7us
I20260709 13:16:47.043363  7328 raft_consensus.cc:1275] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:16:47.044613  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:47.049139  7328 raft_consensus.cc:1275] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:16:47.024153 15618 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:47.061446  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:47.051384  7299 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.052595  7859 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.061362  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:47.065135  7228 leader_election.cc:336] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.065941  7228 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.075026  7327 raft_consensus.cc:1275] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 17. (term mismatch)
I20260709 13:16:47.075642  7327 pending_rounds.cc:85] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 16
I20260709 13:16:47.075919  7327 pending_rounds.cc:107] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260709 13:16:47.076203  7327 raft_consensus.cc:2889] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:47.079909  7299 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.082713  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:47.044605 15138 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 13:16:47.081378 15515 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.089111 15138 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:47.089753 15138 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:16:47.089486 15515 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:47.090458 15614 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:47.091513 15429 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:47.092988 15515 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:47.086364 15591 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:16:47.095757 15616 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:47.096293 15616 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.096696 15616 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:47.103399  7257 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 25.
I20260709 13:16:47.113289 15616 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:47.113720 15520 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:47.114991  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 219980us
W20260709 13:16:47.129053  7302 leader_election.cc:336] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.134478  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:47.136430  7153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.132988  7861 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:47.085628  7152 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:47.176133  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 90656.3us
I20260709 13:16:47.177793  7152 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.179930  7225 leader_election.cc:304] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:47.182416  7894 raft_consensus.cc:2393] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c in current term 21: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:47.026121 15613 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:47.190032  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:47.195832  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 130737us
I20260709 13:16:47.199988 15522 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.221155 15522 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:47.208318  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:47.223390  7228 leader_election.cc:336] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.224385  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.211738 15616 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:47.206336 15520 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:47.184926 14928 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:47.223578 15522 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:47.224781 15138 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:47.177882 15192 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:16:47.229776  7228 leader_election.cc:336] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.230656  7891 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 31. Current term is 32. Ops: []
I20260709 13:16:47.177583 15545 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:16:47.247726  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 57765.5us
I20260709 13:16:47.192891 15552 raft_consensus.cc:2764] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
W20260709 13:16:47.238780  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:47.251507  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:47.252064  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 85437.3us
I20260709 13:16:47.230818 15576 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:47.252923 14928 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:47.233348 15609 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:47.253872  7302 leader_election.cc:336] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.235142 15545 raft_consensus.cc:493] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:47.266052  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.271100  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:47.276324  7332 raft_consensus.cc:1275] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
W20260709 13:16:47.260047  7302 leader_election.cc:336] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.260375 15545 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:16:47.280263  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:47.283427  7335 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:16:47.283625  7152 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:47.282847  7302 leader_election.cc:336] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.286183  7302 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:47.287134  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 234631us
W20260709 13:16:47.288859  7302 leader_election.cc:336] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:47.294064  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.277280  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:47.269655 15515 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:47.292287  7859 leader_election.cc:304] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:47.284693 15611 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.090s	user 0.002s	sys 0.001s
W20260709 13:16:47.297009  7228 leader_election.cc:336] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.326493  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:47.309239  7228 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.292259 15522 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:16:47.335654  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 52177.6us
W20260709 13:16:47.341972  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45793.4us
W20260709 13:16:47.342821  7228 leader_election.cc:336] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.343281  7228 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:47.344491  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:47.345504  7228 leader_election.cc:336] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.322283 15576 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:16:47.306788 15551 raft_consensus.cc:2749] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:47.348584  7152 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.332504 15609 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:47.334478 14928 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.346454  7228 leader_election.cc:336] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.327688 15429 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:16:47.347496 15138 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 32 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:47.330789 15520 consensus_queue.cc:1048] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 13:16:47.354843 15605 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:47.367456  7228 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.353451 15562 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:16:47.370914  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 194114us
I20260709 13:16:47.364205 15025 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:16:47.403293  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 211951us
I20260709 13:16:47.373061 15515 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.367329 14928 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:47.415678  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69231us
W20260709 13:16:47.419695  7133 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:47.420377  7133 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:47.420698  7133 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:47.421576 15627 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:47.401435 15363 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:47.415768 15515 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:47.448817 15626 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 13:16:47.457044  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:47.457537  7253 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:16:47.455904 15025 raft_consensus.cc:493] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.417434 15560 consensus_meta.cc:287] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.583s	user 0.014s	sys 0.000s
W20260709 13:16:47.466555  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 47437.2us
W20260709 13:16:47.464777  7228 leader_election.cc:336] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:47.469585  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 121119us
W20260709 13:16:47.456135 15622 log.cc:927] Time spent T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:16:47.476842  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.481918  7225 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.483314  7152 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.485433  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:47.489327  7152 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.489636  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:47.494194  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:47.492285  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.498085  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.455557 15613 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:47.482748  7302 leader_election.cc:336] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:47.504061  7302 leader_election.cc:336] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.504705  7302 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.506525 15559 raft_consensus.cc:3060] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:47.479350 15605 consensus_queue.cc:1048] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:16:47.508347  7258 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:16:47.509029 15609 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:47.510182 15305 consensus_meta.cc:287] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.006s
W20260709 13:16:47.510450  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52710.9us
W20260709 13:16:47.511294  7228 leader_election.cc:336] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:47.512328  7228 leader_election.cc:336] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.512823  7228 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.518285  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:47.475481 15576 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.517037 15305 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:47.528283  7333 raft_consensus.cc:2393] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 21: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:47.534564  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:47.496325 15560 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:16:47.535512  7302 leader_election.cc:336] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:47.536774  7228 leader_election.cc:336] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.537801  7228 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:47.539525  7302 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.512341 15614 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:16:47.557741  7228 leader_election.cc:336] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.475340 15552 consensus_queue.cc:1048] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:16:47.564185  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:47.480809 15025 raft_consensus.cc:515] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:47.521767 15544 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:47.526574 15515 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:47.567449  7893 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 20.
I20260709 13:16:47.499845 15617 consensus_queue.cc:1048] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
W20260709 13:16:47.569298  7228 leader_election.cc:336] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.589031  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:47.556833 15562 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:47.587525  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 125949us
I20260709 13:16:47.540216  7302 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:47.522718 15630 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.065s
I20260709 13:16:47.594843  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:47.527216 15576 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:47.577517 15305 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:47.587548 15640 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:16:47.587411 15560 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.586982 15512 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:16:47.597482  7228 leader_election.cc:336] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.611266  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:47.600484  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 89515.5us
I20260709 13:16:47.591104 15615 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:47.604249  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 106333us
W20260709 13:16:47.606437  6030 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 7212)
I20260709 13:16:47.601248  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
W20260709 13:16:47.600613  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 197004us
W20260709 13:16:47.616331  7228 leader_election.cc:336] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:47.617326  7228 leader_election.cc:336] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.617738  7228 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.617859  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:47.618573  7259 raft_consensus.cc:3060] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:47.618906  7859 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.621068  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:47.608903  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 69431.3us
I20260709 13:16:47.609243  7894 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260709 13:16:47.621376  7228 leader_election.cc:336] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:47.622745  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:47.623073  7228 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:47.623848  7302 leader_election.cc:336] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.596724 15634 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:16:47.627048  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.626927  7302 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.632302  7225 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.631469  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.635548  7331 raft_consensus.cc:1275] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 13:16:47.636345  7228 leader_election.cc:336] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.637120  7228 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.640858  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.635421 15515 raft_consensus.cc:2804] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:47.647399 15562 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:16:47.648286 15562 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:47.647550 15515 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.651530 15515 raft_consensus.cc:3060] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:16:47.651484 15639 consensus_queue.cc:1059] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:47.652796 15639 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:47.653550 15639 raft_consensus.cc:3055] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:16:47.665248  7302 leader_election.cc:336] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.666059  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:47.673944 15635 log.cc:927] Time spent T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.004s
W20260709 13:16:47.667212 15632 log.cc:927] Time spent T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:47.670145 15615 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:47.670820 15646 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:47.618932 15640 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:47.615911 15633 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:47.676424  7302 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:47.679236  7228 leader_election.cc:336] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.674446  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:47.683743  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.629935 15527 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:16:47.690459  7228 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.632485 15613 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:47.695205  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:47.630941 14928 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:47.630115 15648 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:47.696153  7228 leader_election.cc:336] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:47.697906  7302 leader_election.cc:336] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.643312 15512 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:47.701982  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:47.704792  7895 raft_consensus.cc:1240] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Rejecting Update request from peer c85cf49c63cc4e66b4747d8c4fa14022 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:16:47.615569 15560 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:47.677814 15559 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:47.702270  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.701462  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.734683  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.736676  7152 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.653900 15639 raft_consensus.cc:740] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:47.747066  7259 raft_consensus.cc:2468] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
I20260709 13:16:47.687258 15646 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:47.693388 15305 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:16:47.766619  7256 raft_consensus.cc:1275] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:16:47.697405 15634 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:47.700307 15643 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:47.762521 14928 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:47.782384  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:47.788780  7894 raft_consensus.cc:1275] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:16:47.752179 15617 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:47.745033 15059 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:16:47.724334 15515 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:47.686825 15631 consensus_queue.cc:1048] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.079s
I20260709 13:16:47.743382 15562 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:47.821328 15515 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:47.795539 15025 leader_election.cc:290] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:47.803198  7255 raft_consensus.cc:1275] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 13:16:47.804845 15654 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.766004 15646 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:47.806888 15576 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:47.808064 15639 consensus_queue.cc:260] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:47.816120 14928 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:47.813747 15634 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:47.745932 15644 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:47.789440 15559 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.840270  7862 leader_election.cc:336] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.840633  7301 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:47.843621  7862 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:47.821476 15562 consensus_queue.cc:1059] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 31.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.017s
W20260709 13:16:47.836709 15545 consensus_meta.cc:287] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.005s
I20260709 13:16:47.832937 15654 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:47.848754 15637 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 13:16:47.853814 15639 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:47.880599 15654 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:47.858135 15641 raft_consensus.cc:2804] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:16:47.874766  7302 leader_election.cc:336] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.843845 15559 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:47.806946 15640 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:47.842222 15634 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:47.911725  7151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.873844 15192 consensus_queue.cc:1048] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:16:47.864953 15545 raft_consensus.cc:515] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:47.887504 15641 raft_consensus.cc:697] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
W20260709 13:16:47.918004  7302 leader_election.cc:336] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.922956  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.929239  7893 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 26: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:16:47.932520  7302 leader_election.cc:336] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:47.922093 15659 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.926589 15560 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:47.936373  7302 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:47.939260 15641 consensus_queue.cc:237] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:47.943291 15650 log.cc:927] Time spent T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:16:47.944722 15659 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:47.953297 15646 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:47.955657 15634 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:47.955868 15559 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:47.929980 15592 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:47.957927 15614 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:16:47.978523  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46046.4us
W20260709 13:16:47.997254  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.001329  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 264905us
I20260709 13:16:48.003369  7261 raft_consensus.cc:3060] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:16:48.015256 15659 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:48.017391 15545 leader_election.cc:290] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:48.018378  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.019897  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.020396  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.021174  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.021273  7327 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:16:48.023008  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.003693  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.024327  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.022372  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.025696  7336 raft_consensus.cc:2410] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d for term 28 because replica has last-logged OpId of term: 27 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 14.
W20260709 13:16:48.059633  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:48.060150  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 56574.1us
I20260709 13:16:48.063935  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.062788  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:48.062849 15662 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:48.079288 15646 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:48.082705  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:48.083642 15655 log.cc:927] Time spent T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.157s	user 0.001s	sys 0.001s
I20260709 13:16:48.083928 15659 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:48.086474  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.088470 15659 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:48.090884  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.092024 15559 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:48.094379 15559 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:48.097230  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:48.106132  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:48.109966  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:48.110991  7257 raft_consensus.cc:2468] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 22.
I20260709 13:16:48.114777  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:48.107007  7150 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:48.119168  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:48.121210  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:48.121640  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
W20260709 13:16:48.125906  7228 leader_election.cc:336] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:48.128751  7152 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:48.129927  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb0912958bd849238a8f104a7916c427" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:48.129751  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:48.132587  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:48.141338  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:48.128957 14928 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.118644 15305 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:48.133721 15658 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.153438  7329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:48.136444 15562 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:48.157128  7329 raft_consensus.cc:2368] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21.
I20260709 13:16:48.160643  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:48.152917 15663 raft_consensus.cc:2804] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:16:48.163846  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:48.155256 15576 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:48.167083  7257 raft_consensus.cc:2393] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 26: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:48.150532 15644 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.150404 14928 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:48.163267 15562 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.175448  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:48.162081 15646 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:48.167951 15663 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.164397 15639 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.174746 15643 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:48.193980  7895 raft_consensus.cc:1240] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 31. Current term is 32. Ops: []
I20260709 13:16:48.197372  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.204288 15654 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:48.204799  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.164922 15305 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:48.179369 15562 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:48.206382  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.219780  7152 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.221196  7152 leader_election.cc:304] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.164595 15658 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:48.221948  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.223762 15658 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:48.224521 15640 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:48.225339 15640 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:48.226042 15640 raft_consensus.cc:2749] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:48.227851 14928 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:48.210314  7225 leader_election.cc:400] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21.
I20260709 13:16:48.228753  7225 leader_election.cc:403] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:16:48.174481 15544 consensus_queue.cc:1048] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 13:16:48.208747 15576 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:48.183805 15646 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:48.235759 15646 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:48.191174 15639 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:48.237109 15515 raft_consensus.cc:3055] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 LEADER]: Stepping down as leader of term 31
I20260709 13:16:48.237560 15515 raft_consensus.cc:740] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:48.238854  7334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5626b16aa2aa438290520c1b9b979802" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:48.189693 15591 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:48.239913  7260 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
W20260709 13:16:48.222409  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 93204.5us
W20260709 13:16:48.254468  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.241767  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.255716  7335 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 28.
I20260709 13:16:48.243571  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.244932  7332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.184608 15663 raft_consensus.cc:3060] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:16:48.254870  7228 leader_election.cc:336] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:48.261448  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.259680  7228 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:48.234467 15656 log.cc:927] Time spent T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.330s	user 0.001s	sys 0.003s
W20260709 13:16:48.269090  7228 leader_election.cc:336] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:48.272339  7228 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:48.273568  7228 leader_election.cc:336] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:48.273972  7228 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:48.172966 15644 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:48.287086  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.257781 15639 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:48.272410 15658 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:48.274227 15654 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:48.275198 15605 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:16:48.278497 15661 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:48.278719 15634 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:48.285660 15544 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:48.312949  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.267321 15616 consensus_queue.cc:1048] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 13:16:48.238404 15515 consensus_queue.cc:260] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:48.334017  7077 catalog_manager.cc:5697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 9 to 19, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 19 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:48.361428 14928 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.372454 14928 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:48.377214  7261 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:48.377889 15609 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093) with higher term. Message: Invalid argument: T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate efc9ee9e1d86480790fa83f6ad0c295c for earlier term 20. Current term is 21.
W20260709 13:16:48.370545 15664 log.cc:927] Time spent T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:16:48.380170  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:48.371371 15305 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:48.322750 15544 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:48.384616 15544 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:48.384332  7077 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.385267 15644 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:48.389122  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:48.390369  7258 raft_consensus.cc:2468] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 30.
I20260709 13:16:48.386276  7077 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 16 to 20, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 20 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.392236  7152 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:48.407107 15562 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:48.365128 15515 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:16:48.401537  7077 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.403267 14928 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:48.451006  7077 catalog_manager.cc:5697] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 13 to 14, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 14 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.404297 15658 raft_consensus.cc:2804] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:16:48.456601  7077 catalog_manager.cc:5697] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 15 to 16, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 16 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.458710 15658 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.473301 15658 raft_consensus.cc:3060] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:16:48.476680  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:48.477447  7895 raft_consensus.cc:2468] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 25.
I20260709 13:16:48.463742 15562 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:48.483335 15676 log.cc:927] Time spent T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:48.484753  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:48.485502  7893 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 28.
I20260709 13:16:48.489684  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.490221  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:48.497681 15673 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.098s	user 0.003s	sys 0.000s
W20260709 13:16:48.499461  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 221380us
I20260709 13:16:48.499877  7892 raft_consensus.cc:2468] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:48.481462  7077 catalog_manager.cc:5697] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:48.515686  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:48.516820 15562 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:16:48.517477 15562 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.518049 15562 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:48.519376  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:48.520610  7328 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:48.530036  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:48.531103  7262 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Advancing to term 27
W20260709 13:16:48.554914  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:48.535238  7301 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:48.555862  7257 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:16:48.556433  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:48.573792  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49285.2us
I20260709 13:16:48.518128  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:48.580281  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:48.587107  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.498241 15663 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:48.581342  7256 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 23.
W20260709 13:16:48.599542  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 171894us
W20260709 13:16:48.612104  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:48.613137  7228 leader_election.cc:336] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:48.613906  6030 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 7212)
I20260709 13:16:48.620055  7077 catalog_manager.cc:5697] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 13 to 16, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 16 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:48.613854  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:48.630540  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 112502us
W20260709 13:16:48.631476  7228 leader_election.cc:336] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:48.631170  7077 catalog_manager.cc:5697] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 17 to 21, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 21 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:48.632954  7077 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 16 to 20, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 20 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:48.640321  7261 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 13:16:48.641321  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:48.600391 15672 raft_consensus.cc:2804] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:16:48.654592  7150 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.659369  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:48.626405 15429 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:48.616724 15662 raft_consensus.cc:2804] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:48.699160 15662 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.699807 15662 raft_consensus.cc:3060] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:48.606350 14928 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:48.685225  7262 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 27.
I20260709 13:16:48.648515 15615 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:48.703015 14928 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:48.705682 14928 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:48.712812  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 70834.3us
I20260709 13:16:48.716342 15429 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:48.719462 15672 raft_consensus.cc:697] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:48.720700 15672 consensus_queue.cc:237] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:48.671936 15560 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.724058 15560 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:48.729184  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 69938.9us
I20260709 13:16:48.731235 15512 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:48.738896 15654 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:16:48.740163  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 85686.2us
I20260709 13:16:48.750669 15663 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:48.753867  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:48.740300  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 74809.7us
I20260709 13:16:48.756764  7859 leader_election.cc:304] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.759936  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.760293  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.760903  7331 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 27.
I20260709 13:16:48.711998  7077 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.763280  7329 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:16:48.763825  7329 pending_rounds.cc:85] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting all ops after (but not including) 13
I20260709 13:16:48.764119  7329 pending_rounds.cc:107] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:16:48.764427  7329 raft_consensus.cc:2889] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.775138  7152 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:48.775350  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:48.786731  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 32 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:48.791101  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:48.607218 15644 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:16:48.801216  7890 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 32: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
W20260709 13:16:48.802026  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:48.808383  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:48.808383  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:48.806710  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:48.809427  7893 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 26.
I20260709 13:16:48.817654  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:48.798183 15669 log.cc:927] Time spent T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:16:48.819260  7077 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.819322 15576 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:16:48.835263 15576 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.835748 15576 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:48.837869 15515 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:16:48.816447 15654 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:48.843371 15429 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:48.804327 15560 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:48.852773  7077 catalog_manager.cc:5697] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 15 to 16, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 16 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:48.855861  7077 catalog_manager.cc:5697] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 19, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 19 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:48.858194  7077 catalog_manager.cc:5697] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 19 to 25. New cstate: current_term: 25 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.799970 15545 raft_consensus.cc:2749] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:16:48.843372 15654 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:48.816388 15559 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.859670 14928 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:48.850417 15658 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:48.862927  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:48.903052  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 120926us
W20260709 13:16:48.904196  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 81122.6us
W20260709 13:16:48.880568  7302 leader_election.cc:336] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:48.907917  7302 leader_election.cc:336] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:48.908048  7328 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 27.
I20260709 13:16:48.920054  7299 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
W20260709 13:16:48.919754  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 289266us
I20260709 13:16:48.922554  7077 catalog_manager.cc:5697] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 19 to 23, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 23 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:48.923090  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:48.928131  7328 raft_consensus.cc:2393] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 27: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
I20260709 13:16:48.923074  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:48.940877  7301 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:48.944509  7077 catalog_manager.cc:5697] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:48.922554 15380 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:16:48.911989 15663 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:48.966883  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 145450us
I20260709 13:16:48.903055 15559 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:48.942519 15591 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:48.980696 15662 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:48.982391  7862 leader_election.cc:336] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:48.955905 15133 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:48.988694  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:48.996273  7888 raft_consensus.cc:1275] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:16:48.990499  7077 catalog_manager.cc:5697] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 13 to 19, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 19 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.962821 15602 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.035s
I20260709 13:16:48.989916 15591 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.999475 15630 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:48.947350 15654 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.055151  7077 catalog_manager.cc:5697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 16 to 19, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 19 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:49.044212 15591 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:49.078594  7077 catalog_manager.cc:5697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 21 to 25, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 25 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:49.082950  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:49.082799  7077 catalog_manager.cc:5697] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:16:49.079309 15693 log.cc:927] Time spent T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:16:49.103842 15380 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:16:49.118978 15658 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 31 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:49.139246  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 57995us
W20260709 13:16:49.150619  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 168267us
I20260709 13:16:49.144753 14928 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.166606 14928 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.166457  7077 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: config changed from index 5 to 11, term changed from 17 to 21, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129), VOTER efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130), VOTER c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131), VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 21 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:49.139008 15696 raft_consensus.cc:493] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.181888  7077 catalog_manager.cc:5697] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:49.134089 15576 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.185393 15662 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:49.146488 15559 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:49.194041 14928 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:49.195345 15576 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:49.205200 15562 consensus_meta.cc:287] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.001s
I20260709 13:16:49.205750 15562 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.206602 15591 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.207692 15702 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.208246 15702 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.208992 15591 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:49.230391  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:49.226483  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:49.237697  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:49.225922  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:49.238889  7330 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: [23.14-23.14]
W20260709 13:16:49.241006  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 65844.1us
I20260709 13:16:49.218287 15672 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.224124  7077 catalog_manager.cc:5697] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:49.250221  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:49.252887 15672 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.221994 15522 consensus_queue.cc:1048] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:16:49.255640 15630 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:49.223111 15562 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:49.210572 15702 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:49.273069  7256 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:49.184728 15696 raft_consensus.cc:515] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.301116 15672 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:49.311054  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:49.313370  7888 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:49.314925  7299 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:49.318318  7256 raft_consensus.cc:2468] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
I20260709 13:16:49.337544  7301 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:49.339183 15616 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:16:49.339623 15616 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.339970 15616 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:49.340441 15696 leader_election.cc:290] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:49.347540  7261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:49.348273  7261 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 21.
I20260709 13:16:49.338611 15305 raft_consensus.cc:2804] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:49.380481 15696 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.405354  7262 raft_consensus.cc:1240] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Rejecting Update request from peer 2ecdd7dc4a144f5aa0f2f91c7b94434d for earlier term 23. Current term is 24. Ops: [21.13-23.14]
I20260709 13:16:49.410290 15305 raft_consensus.cc:697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:49.399262 15696 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.411433 15305 consensus_queue.cc:237] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.414058 15696 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:49.420811  7262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:49.447062  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 58755.5us
I20260709 13:16:49.449887  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:49.450987  7333 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:49.458112  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:49.460278  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:49.461166  7895 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 23.
I20260709 13:16:49.462224  7330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:49.463044  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:49.463886  7335 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:49.465010  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:49.465669  7331 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:49.481395  7150 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:49.488096  7258 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:16:49.491357  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:49.490334  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:49.496853  7327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4039a3dd715849edb6b8786f89e1a1b3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:49.497391  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de90ec51ea634c3d8b220c16d71b8cdf" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:49.498520  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:49.464453 15673 log.cc:927] Time spent T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:16:49.498926  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:49.499454  7888 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:49.507766  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:49.446139 15616 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.491547  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:49.495481 15654 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 13:16:49.502571 15706 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:16:49.515862  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:49.506843  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 144445us
I20260709 13:16:49.464855 15696 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.516732  7895 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:49.499797 15644 raft_consensus.cc:493] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.532500  7890 raft_consensus.cc:1275] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:16:49.529825  7150 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:49.538311  7888 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 28.
I20260709 13:16:49.515120 15562 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:16:49.532294 15702 consensus_queue.cc:1059] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:16:49.548808  7331 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 29.
I20260709 13:16:49.560072  7150 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:49.560737 15663 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:49.514190 15691 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:16:49.561285 15562 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.572758 15562 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:49.528676 15696 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.579293  7335 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 28.
I20260709 13:16:49.562094  7895 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 29.
W20260709 13:16:49.583371  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 49625us
I20260709 13:16:49.585599  7150 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:49.591559  7150 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:49.593274  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:49.593704  7150 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:49.599556  7150 leader_election.cc:304] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:49.601487 15690 log.cc:927] Time spent T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.558s	user 0.004s	sys 0.000s
I20260709 13:16:49.601616 14928 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:49.602618  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:49.603462 15559 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:16:49.604111  7253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 4246) took 1055 ms. Trace:
I20260709 13:16:49.604487  7253 rpcz_store.cc:276] 0709 13:16:48.548836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.548985 (+   149us) service_pool.cc:224] Handling call
0709 13:16:48.549462 (+   477us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:48.588575 (+ 39113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.588605 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:48.589246 (+   641us) log.cc:844] Serialized 52 byte log entry
0709 13:16:48.914456 (+325210us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:16:48.914520 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.914648 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.592940 (+678292us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece8dd786e 00007fece8dd6bb6 00007fece8dd67d8 00007fece8de0221 00007fece8de01d9 00007fece8de0169
0709 13:16:49.603780 (+ 10840us) raft_consensus.cc:1685] finished
0709 13:16:49.603803 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.604034 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43091,"raft.queue_time_us":47546,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":11056,"spinlock_wait_cycles":8260864,"thread_start_us":266231,"threads_started":1,"wal-append.queue_time_us":352702}
I20260709 13:16:49.606302 15559 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:49.606979 15559 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.607581 15616 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Requested vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:49.609637 15559 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:49.610532  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:49.612428  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:49.615311  6030 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 7212)
I20260709 13:16:49.615876  7253 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:16:49.615631 15694 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:16:49.532697 15644 raft_consensus.cc:515] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.626600 15644 leader_election.cc:290] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:49.619074  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:49.620061  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:49.591790 15691 consensus_queue.cc:1048] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:16:49.631057 15694 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:49.631609 15654 raft_consensus.cc:3055] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:16:49.600006 15663 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:16:49.632730 15663 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:49.633649 15663 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.587497 15696 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:49.591938 15706 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:49.602545 14928 raft_consensus.cc:2749] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:49.632125 15694 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.626318 15576 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:49.640033  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:49.640450 15658 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.640758  7258 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:16:49.641057 15658 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.632136 15654 raft_consensus.cc:740] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:49.648977 15654 consensus_queue.cc:260] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.650315 15654 raft_consensus.cc:3060] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:49.650827 15683 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:49.653774 15658 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:49.653539 15683 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.657781  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:49.659807 15683 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:16:49.598975  7302 leader_election.cc:336] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:49.663906  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 64946.1us
W20260709 13:16:49.655957  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 117177us
I20260709 13:16:49.655874  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:49.679335  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa9c7bddd6f49acad7c47c33c761358" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:49.682261  7150 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:49.684994  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:49.685083  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:49.616984  7895 raft_consensus.cc:3060] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:16:49.692970  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:49.704036  7150 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:49.709990  7258 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:49.730683  7895 raft_consensus.cc:2468] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 22.
I20260709 13:16:49.715706 15559 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.736476 15559 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.715619 15658 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:49.745782  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:49.738302 15560 raft_consensus.cc:493] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.774221  7301 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:49.729712 15702 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:49.779904  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:49.731302  7150 leader_election.cc:304] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:49.789179  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:49.801425  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 70321.2us
I20260709 13:16:49.801537 15559 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:49.810387 15672 raft_consensus.cc:2804] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:16:49.811350 15672 raft_consensus.cc:697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:49.812412 15672 consensus_queue.cc:237] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.828927 15694 raft_consensus.cc:2749] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:49.848057 15562 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.852279  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:49.862105 15654 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:49.863042  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:49.863812  7335 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:49.866460  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:49.867380  7895 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:16:49.868074  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:49.875510 15702 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.876201 15702 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.796470 15560 raft_consensus.cc:515] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.883809  7895 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:49.892894  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:49.900170  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:49.886548  7335 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 24.
I20260709 13:16:49.858764 15562 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:49.907469  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac161a9db63471dbd87b41a92fe1202" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:49.904969  7150 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429; no voters: 
I20260709 13:16:49.909888  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:49.871516 15654 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.913753  7150 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:49.888084 15694 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.889704 15515 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.878729 15702 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:49.907895 15663 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.911741 15562 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:16:49.916599 15576 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:49.920012 15701 raft_consensus.cc:2749] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:49.924335 15694 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.927632 15515 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.958396  7335 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:16:49.959582  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:49.941808 15551 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.920493 15654 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.969425 15559 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:49.973572 15559 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.944087 15562 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Becoming Leader. State: Replica: 2ecdd7dc4a144f5aa0f2f91c7b94434d, State: Running, Role: LEADER
I20260709 13:16:49.978914 15576 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.932401 15663 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:49.970572 15702 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 13:16:50.008101  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:49.995082 15576 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:50.020530 14928 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.021157 14928 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:49.981097 15551 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:50.026340 15696 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.027526 15654 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.027182 15696 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:50.030267 15696 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:50.033627 15728 log.cc:927] Time spent T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: Append to log took a long time: real 0.077s	user 0.002s	sys 0.002s
I20260709 13:16:50.037567 15663 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.039896 15551 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.022080 15576 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:50.024516 15706 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.044509 15706 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:50.066356 15560 leader_election.cc:290] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:50.083508  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 58184.9us
I20260709 13:16:50.090972  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:50.091192  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.091667  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.091727  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.091950  7331 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 32.
I20260709 13:16:50.093812  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:50.094338  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:50.082530  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 61426.4us
I20260709 13:16:50.102507  7255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.103863  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2486da35b1ff416a9879e8c0588f1db9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.105057  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.105180  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:50.100247  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 177582us
I20260709 13:16:50.107564  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.108264  7333 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 32.
I20260709 13:16:50.109858  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:50.110543  7890 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in term 32.
I20260709 13:16:50.114161  7259 raft_consensus.cc:1275] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:16:50.115420  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:50.117708  7152 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.115902  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:50.120024  7150 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:50.114521  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:50.099536 15694 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:50.105087 15658 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.053723 15562 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:50.113860 15663 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.116255 15702 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.134378  7152 leader_election.cc:304] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.126022 15654 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 13:16:50.125891 15644 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:50.127794 15429 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 13:16:50.133862 15694 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:50.125453 15730 consensus_queue.cc:1048] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:16:50.143671 15663 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:50.136143 15658 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:50.148808 15654 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.152838 15429 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.173735 15515 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.176036 15429 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:16:50.154115 15696 raft_consensus.cc:493] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.146878 15702 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:50.184897 15702 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:50.179435 15515 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.189334 15515 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:50.164085 14928 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:50.192093 15515 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:50.175588 15654 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:16:50.160567 15644 raft_consensus.cc:2749] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:16:50.203217  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 83268.1us
I20260709 13:16:50.204730  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:50.205909 15515 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:16:50.206743  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 71934.4us
W20260709 13:16:50.218005  7862 consensus_peers.cc:597] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:50.229609  7862 leader_election.cc:336] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:50.239952  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.232134 15706 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.267479  7895 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 13:16:50.243615 15658 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.270462  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.197939 15696 raft_consensus.cc:515] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:50.273207  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:50.260519 15559 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:50.278507  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 144223us
I20260709 13:16:50.274187  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:50.284906  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.280670  7895 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:16:50.286944 15696 leader_election.cc:290] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:50.289539  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.291131  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:50.294029  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.299006  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.299356  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.299264  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.300220  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.304334  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.306912 15559 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.307535 15559 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:50.309021  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.310005 15559 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:50.272554 15740 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:50.307538  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.312258 15663 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.315450  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.294586 15654 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:50.325660  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:50.325757 15559 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:16:50.337438 15429 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:50.337409  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.337471  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.345306 15740 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:50.349036  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.351222  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:50.351342  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.351940  7333 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:16:50.355772  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5920bb7e53034c2688b18dfe352590c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.357160  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.359759  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bbf75da7f04c6cb95c0f589775820b" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:50.358587 15562 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:50.368204 15429 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 33 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:50.374495  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 104741us
I20260709 13:16:50.354393 15559 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.023s
I20260709 13:16:50.347996 15663 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.379177 15663 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:50.383455  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:50.384481  7333 raft_consensus.cc:3060] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:16:50.385213 15696 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:16:50.389658 15663 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.395810 15706 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:50.397903  7152 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:50.389220  7302 leader_election.cc:336] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:50.410207  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:50.409016  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:50.413370  7152 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.416471  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.417645  7150 leader_election.cc:304] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:50.425644  7331 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 13:16:50.425711  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.415251 15059 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:50.430685 15663 raft_consensus.cc:2749] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:50.423213 15696 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:50.439356 15559 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.411939 15739 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:50.440044 15559 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:50.443219  7333 raft_consensus.cc:2468] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 33.
I20260709 13:16:50.445050  7859 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:50.456563  7862 leader_election.cc:336] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:50.460100  7152 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.464391 15559 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.464218  7331 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:16:50.468896  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.450919 15736 raft_consensus.cc:2804] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 13:16:50.484011 15736 raft_consensus.cc:697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 33 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:50.484948 15736 consensus_queue.cc:237] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 31.20, Last appended by leader: 20, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:50.488171  7890 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:16:50.489467  7152 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.454804 15658 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:50.448601 15663 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:16:50.491030  7152 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.491772 15706 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:50.492811 15739 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:16:50.498808  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.501684 15663 raft_consensus.cc:2749] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:50.501607 15672 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:16:50.512102  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:50.521416  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:50.522285  7152 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:50.523706  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:50.530570  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:50.534547  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.543272  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:50.544781  7333 raft_consensus.cc:2393] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ecdd7dc4a144f5aa0f2f91c7b94434d in current term 33: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:50.537096 15658 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:50.545595 15559 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:50.560956  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 33 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
W20260709 13:16:50.561705  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:50.563359  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:50.565434 15696 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
W20260709 13:16:50.567636  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:50.568689  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:50.569598  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:50.572507  7257 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:50.576501 15633 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:16:50.578984  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:50.560568 15654 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 33 election: Requested vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:50.588101 15663 raft_consensus.cc:493] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:50.588716 15663 raft_consensus.cc:515] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:50.594748 15745 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
W20260709 13:16:50.596318  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:50.599733  7299 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125): Couldn't send request to peer 9a54ecc9fb4541df915f9f8c01e19429. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d6277156300462b934adab718a32e44. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.604954  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.605571  7260 raft_consensus.cc:1275] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:16:50.606433  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:50.607841  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.612900 15663 leader_election.cc:290] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:50.616631  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788b854112d74649a8e966f1fe824f3f" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:50.617298  6030 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 7212)
I20260709 13:16:50.639537 15663 raft_consensus.cc:493] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.640199 15663 raft_consensus.cc:515] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:50.642510 15663 leader_election.cc:290] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.645761  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.656116 15672 consensus_queue.cc:1048] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:50.662348  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9487fc89de4e68b395c4a70193c3b6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.662616  7152 leader_election.cc:304] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.665035  7150 leader_election.cc:304] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.675642 15739 raft_consensus.cc:2749] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:50.696995  7331 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:16:50.671756 15658 raft_consensus.cc:2749] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:50.712983  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:50.696995 15740 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:50.720603  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:50.741186  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:50.753156  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.709223 15739 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 13:16:50.745023 15740 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:50.856736 15658 raft_consensus.cc:493] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.857604 15658 raft_consensus.cc:515] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:50.862056  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.866425 15658 leader_election.cc:290] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.867831  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "221fa6fca3154a49b5efa9c28f8c4cd8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.870155  7150 leader_election.cc:304] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.871928 15658 raft_consensus.cc:2749] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:50.820981 15663 raft_consensus.cc:493] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:50.874903 15746 log.cc:927] Time spent T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:16:50.875886 15745 log.cc:927] Time spent T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:16:50.906224 15560 raft_consensus.cc:493] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.977229 15740 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:50.978343  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:50.987169  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:50.990748 15592 raft_consensus.cc:2955] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
I20260709 13:16:50.993023  7150 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:50.995400 15559 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:51.006660  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:50.911770 15663 raft_consensus.cc:515] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:50.927863 15560 raft_consensus.cc:515] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:51.009584 15663 leader_election.cc:290] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:51.011502 15560 leader_election.cc:290] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:51.012415  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:51.013451  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:51.067428  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.073002  7254 raft_consensus.cc:2955] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } }
W20260709 13:16:51.084329  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 132548us
W20260709 13:16:50.948002  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 166484us
I20260709 13:16:51.098673  7895 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Refusing update from remote peer 2ecdd7dc4a144f5aa0f2f91c7b94434d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:16:51.099519  7258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8d111efe5ab4e9cad378e4ebfdeb996" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:51.111173  7152 leader_election.cc:304] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:51.111820  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a190f80864482f8c9dfc9a627c1d6d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:51.140823 15739 raft_consensus.cc:493] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.141727 15739 raft_consensus.cc:515] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:51.144845 15739 leader_election.cc:290] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:51.149313  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:51.155613 15559 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:16:51.168354  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:51.170312  7331 raft_consensus.cc:1275] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 33 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 31 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
I20260709 13:16:51.174015 15545 consensus_queue.cc:1048] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 13:16:51.123800 15515 raft_consensus.cc:2749] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:16:51.238456 15750 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:16:51.267053  7152 leader_election.cc:304] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:51.269106 15515 raft_consensus.cc:2749] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:51.301975  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:51.302979  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:51.309116  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:51.309818  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 92453.1us
W20260709 13:16:51.278393  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 124665us
I20260709 13:16:51.328595  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106224ab6d746898c7fb52a0788256d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:51.333588  7152 leader_election.cc:304] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:51.334612  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.369784 15774 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.370419 15774 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:51.345208 15739 raft_consensus.cc:2749] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:16:51.384135 15768 log.cc:927] Time spent T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: Append to log took a long time: real 0.135s	user 0.003s	sys 0.000s
I20260709 13:16:51.399322 15776 ts_tablet_manager.cc:933] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: Initiating tablet copy from peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:51.400008  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.374284 15560 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.416296 15774 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:51.418102  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:51.420235  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.424616  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:51.434809 15560 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:51.456396  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 95498.5us
I20260709 13:16:51.458281  7150 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:51.472484 15559 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:51.527990  7078 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 21 to 22, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 22 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.541595  7078 catalog_manager.cc:5697] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 20 to 21, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 21 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:51.546155  7078 catalog_manager.cc:5697] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 14 to 18, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 18 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:51.548810  7078 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 12 to 18, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 18 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:51.551044  7078 catalog_manager.cc:5697] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 17 to 18, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 18 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.553236  7078 catalog_manager.cc:5697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:51.555227  7078 catalog_manager.cc:5697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 10 to 15, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 15 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:51.557066  7078 catalog_manager.cc:5697] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 11 to 16, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 16 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:51.560914  7078 catalog_manager.cc:5697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 14 to 21, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 21 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:51.563048  7078 catalog_manager.cc:5697] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:51.565501  7078 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 10 to 18, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 18 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:51.566329 15560 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:51.567132  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:51.567318  7078 catalog_manager.cc:5697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 12 to 15, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 15 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.569214  7078 catalog_manager.cc:5697] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.571513  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:51.572225  7078 catalog_manager.cc:5697] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:51.575981  7150 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
W20260709 13:16:51.579944  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 60658.8us
W20260709 13:16:51.583869  7077 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47542 (request call id 238) took 25750 ms (client timeout 15000 ms). Trace:
I20260709 13:16:51.584250 15560 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:51.597318 15776 tablet_copy_client.cc:323] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Beginning tablet copy session from remote peer at address 127.5.227.131:35093
I20260709 13:16:51.604163  7346 tablet_copy_service.cc:140] P c85cf49c63cc4e66b4747d8c4fa14022: Received BeginTabletCopySession request for tablet 1d6277156300462b934adab718a32e44 from peer 9a54ecc9fb4541df915f9f8c01e19429 ({username='slave'} at 127.0.0.1:44980)
W20260709 13:16:51.584293  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.605183  7346 tablet_copy_service.cc:161] P c85cf49c63cc4e66b4747d8c4fa14022: Beginning new tablet copy session on tablet 1d6277156300462b934adab718a32e44 from peer 9a54ecc9fb4541df915f9f8c01e19429 at {username='slave'} at 127.0.0.1:44980: session id = 9a54ecc9fb4541df915f9f8c01e19429-1d6277156300462b934adab718a32e44
W20260709 13:16:51.606521  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:51.617777  6030 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 7212)
W20260709 13:16:51.584372  7077 rpcz_store.cc:269] 0709 13:16:25.866790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.876434 (+  9644us) service_pool.cc:224] Handling call
0709 13:16:51.579738 (+25703304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:49.595953 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:49.596484 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:49.596523 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:16:49.596541 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:49.725632 (+129091us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:49.748565 (+ 22933us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:49.777066 (+ 28501us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:16:49.831841 (+ 54775us) tablet.cc:701] Row locks acquired
0709 13:16:49.831866 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:16:49.832025 (+   159us) write_op.cc:270] Start()
0709 13:16:49.832157 (+   132us) write_op.cc:276] Timestamp: P: 1783603009831971 usec, L: 0
0709 13:16:49.832181 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:16:49.833035 (+   854us) log.cc:844] Serialized 9460 byte log entry
0709 13:16:49.865787 (+ 32752us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece61320ac 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fece8dd620b
0709 13:16:50.244911 (+379124us) op_driver.cc:464] REPLICATION: finished
0709 13:16:50.276882 (+ 31971us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b4400022b4c. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece5fd7db1 00007fece6075c85 00007fece60766a2 00007fece8de81db 00007fece8de3aaf 00007fece61320ac 00007feceef8cab9 00007fece614e69b 00007fece614c93f 00007fece614ec02 00007fececc72ef0
0709 13:16:50.427507 (+150625us) write_op.cc:301] APPLY: starting
0709 13:16:50.427640 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:50.651215 (+223575us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:50.651245 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:51.158412 (+507167us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:51.158778 (+   366us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0709 13:16:51.158833 (+    55us) write_op.cc:312] APPLY: finished
0709 13:16:51.159320 (+   487us) log.cc:844] Serialized 212 byte log entry
0709 13:16:51.162798 (+  3478us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:51.176786 (+ 13988us) write_op.cc:454] Released schema lock
0709 13:16:51.176868 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:51.228886 (+ 52018us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:51.232536 (+  3650us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1412671,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":182255,"apply.run_cpu_time_us":42201,"apply.run_wall_time_us":783027,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104591,"num_ops":24,"prepare.queue_time_us":109965,"prepare.run_cpu_time_us":54880,"prepare.run_wall_time_us":337217,"raft.queue_time_us":196920,"raft.run_cpu_time_us":72342,"raft.run_wall_time_us":213230,"replication_time_us":412548,"spinlock_wait_cycles":11794048,"thread_start_us":476977,"threads_started":4,"wal-append.queue_time_us":113978}]]}
W20260709 13:16:51.640247  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.648849 15779 raft_consensus.cc:493] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.649804 15779 raft_consensus.cc:515] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:51.655750  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:51.658531  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:51.661254  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:51.661849 15560 raft_consensus.cc:493] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.662673  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458ab76409d4427f8ab55d4d71ca5799" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:51.661492 15779 leader_election.cc:290] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:51.662464 15560 raft_consensus.cc:515] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:51.664611  7150 leader_election.cc:304] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:51.665910  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:51.667032 15559 raft_consensus.cc:2749] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:16:51.668432 15560 leader_election.cc:290] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:51.670189  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0eff9774a9c435d955814f903cb2401" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:51.672705  7150 leader_election.cc:304] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:51.674671 15560 raft_consensus.cc:2749] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:16:51.680684  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.719856  7346 tablet_copy_source_session.cc:215] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:51.756398 15776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6277156300462b934adab718a32e44. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:51.809350  7133 auto_rebalancer.cc:629] Failed to schedule move for tablet cb0912958bd849238a8f104a7916c427: Illegal state: Replica efc9ee9e1d86480790fa83f6ad0c295c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:16:51.816689  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:51.822783 15776 tablet_copy_client.cc:806] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:51.823652 15776 tablet_copy_client.cc:670] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Starting download of 1 WAL segments...
W20260709 13:16:51.827329  7133 auto_rebalancer.cc:629] Failed to schedule move for tablet b0eff9774a9c435d955814f903cb2401: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:16:51.832698  7228 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 284 similar messages]
I20260709 13:16:51.833002 15776 tablet_copy_client.cc:538] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:16:51.869124  7133 auto_rebalancer.cc:629] Failed to schedule move for tablet d8d111efe5ab4e9cad378e4ebfdeb996: Illegal state: Replica efc9ee9e1d86480790fa83f6ad0c295c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 27 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:51.906942 15560 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.907914 15560 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:51.911062 15776 tablet_bootstrap.cc:492] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap starting.
I20260709 13:16:51.912384  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:51.914695 15560 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:51.917037  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:51.947204 15560 raft_consensus.cc:493] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:51.947881 15560 raft_consensus.cc:515] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:51.952206  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:51.950417 15560 leader_election.cc:290] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:51.953493  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8023e86d50f847c7a841c09b7692edeb" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:51.955542  7150 leader_election.cc:304] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:51.956908 15560 raft_consensus.cc:2749] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:51.948213  7152 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:51.991653  7152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 43560.4us
I20260709 13:16:51.998975 15779 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:52.044128  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:52.058172 15779 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:52.067153  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:52.058862 15779 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:52.082680 15779 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:52.083568  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:52.086401  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90c9778e4f484bb7ab035094ae2c24c9" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:52.091770  7150 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:52.095700 15560 raft_consensus.cc:2749] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:52.141386 15560 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:52.142148 15560 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:52.146400 15560 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:52.146700  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:52.156901  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:52.158587  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:52.159905 15779 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:52.168757  7079 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 15 to 19, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 19 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.183763  7079 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.186318  7079 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 15 to 27, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 27 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:52.191124  7079 catalog_manager.cc:5697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 15 to 18, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 18 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:52.201346  7078 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47554 (request call id 238) took 53162 ms (client timeout 15000 ms). Trace:
I20260709 13:16:52.206671 15560 raft_consensus.cc:493] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.212013 15560 raft_consensus.cc:515] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:52.214231 15560 leader_election.cc:290] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:52.216238  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:52.217092  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3d8971d9be4ed09286c9b433d050b2" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:52.210716  7079 catalog_manager.cc:5697] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 23 to 26. New cstate: current_term: 26 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:52.219058  7152 leader_election.cc:304] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:52.219929 15560 raft_consensus.cc:2749] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:52.219384  7079 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.222937  7079 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.225052  7079 catalog_manager.cc:5697] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 12 to 21. New cstate: current_term: 21 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:52.236132  7078 rpcz_store.cc:269] 0709 13:15:59.039389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.039735 (+   346us) service_pool.cc:224] Handling call
0709 13:16:52.201268 (+53161533us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:51.651469 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:51.652695 (+  1226us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:51.652742 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:16:51.668276 (+ 15534us) tablet.cc:662] Decoding operations
0709 13:16:51.677141 (+  8865us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:51.677233 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:51.677264 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:16:51.678331 (+  1067us) tablet.cc:701] Row locks acquired
0709 13:16:51.678351 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:16:51.678514 (+   163us) write_op.cc:270] Start()
0709 13:16:51.678670 (+   156us) write_op.cc:276] Timestamp: P: 1783603011678462 usec, L: 0
0709 13:16:51.678686 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:16:51.706786 (+ 28100us) log.cc:844] Serialized 5556 byte log entry
0709 13:16:51.803417 (+ 96631us) op_driver.cc:464] REPLICATION: finished
0709 13:16:51.832172 (+ 28755us) write_op.cc:301] APPLY: starting
0709 13:16:51.832273 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:51.927262 (+ 94989us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:51.927404 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:52.060717 (+133313us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:52.093633 (+ 32916us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 13:16:52.095364 (+  1731us) write_op.cc:312] APPLY: finished
0709 13:16:52.101877 (+  6513us) log.cc:844] Serialized 129 byte log entry
0709 13:16:52.102098 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.102272 (+   174us) write_op.cc:454] Released schema lock
0709 13:16:52.102333 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:52.102817 (+   484us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.102848 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3621,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":28427,"apply.run_cpu_time_us":25179,"apply.run_wall_time_us":270616,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62731,"num_ops":14,"prepare.queue_time_us":62468,"prepare.run_cpu_time_us":5639,"prepare.run_wall_time_us":84900,"replication_time_us":112588,"thread_start_us":32257,"threads_started":2}]]}
I20260709 13:16:52.320158  7077 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 23 to 27. New cstate: current_term: 27 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.329517 15779 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.330247 15779 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:52.322428  7077 catalog_manager.cc:5697] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 14 to 15, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 15 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:52.335954 15779 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:52.337571  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:52.347725  7077 catalog_manager.cc:5697] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:52.357491  7077 catalog_manager.cc:5697] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:16:52.371690  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:52.359357  7077 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.373899  7077 catalog_manager.cc:5697] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 23 to 25, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 25 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.376240  7077 catalog_manager.cc:5697] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 22 to 26, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 26 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.378563  7077 catalog_manager.cc:5697] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:52.383769  7079 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 157) took 42398 ms (client timeout 15000 ms). Trace:
I20260709 13:16:52.383380  7077 catalog_manager.cc:5697] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 21 to 26, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 26 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.385846  7077 catalog_manager.cc:5697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 17 to 24. New cstate: current_term: 24 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:52.388809 15776 log.cc:927] Time spent T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
W20260709 13:16:52.384570  7079 rpcz_store.cc:269] 0709 13:16:09.985043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.986266 (+  1223us) service_pool.cc:224] Handling call
0709 13:16:52.383697 (+42397431us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:52.230326 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:52.230970 (+   644us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:52.231020 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:16:52.231037 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:52.231981 (+   944us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:52.232061 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:52.232094 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:16:52.232850 (+   756us) tablet.cc:701] Row locks acquired
0709 13:16:52.232870 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:16:52.233058 (+   188us) write_op.cc:270] Start()
0709 13:16:52.233180 (+   122us) write_op.cc:276] Timestamp: P: 1783603012232992 usec, L: 0
0709 13:16:52.233199 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:16:52.235545 (+  2346us) log.cc:844] Serialized 3218 byte log entry
0709 13:16:52.238543 (+  2998us) op_driver.cc:464] REPLICATION: finished
0709 13:16:52.239088 (+   545us) write_op.cc:301] APPLY: starting
0709 13:16:52.239184 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:52.241410 (+  2226us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b54000aa354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece9237e28 00007fececc72581 00007fececc71d58 00007fececc769f1 00007fececc769a9 00007fececc76939 00007fececc76901 00007fececc75b2d 000000000038f354 000000000038f199
0709 13:16:52.244087 (+  2677us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:52.244117 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:52.257908 (+ 13791us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:52.258152 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:16:52.258206 (+    54us) write_op.cc:312] APPLY: finished
0709 13:16:52.258501 (+   295us) log.cc:844] Serialized 81 byte log entry
0709 13:16:52.259478 (+   977us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.259622 (+   144us) write_op.cc:454] Released schema lock
0709 13:16:52.259682 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:52.265135 (+  5453us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.265178 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14071,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":283,"apply.run_cpu_time_us":11809,"apply.run_wall_time_us":25970,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33488,"num_ops":8,"prepare.queue_time_us":133,"prepare.run_cpu_time_us":6388,"prepare.run_wall_time_us":11308,"replication_time_us":5181,"spinlock_wait_cycles":3405056}]]}
I20260709 13:16:52.387830  7077 catalog_manager.cc:5697] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 25 to 29, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 29 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.400645  7077 catalog_manager.cc:5697] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 18 to 21, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 21 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.402431  7077 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 27 to 31, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 31 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.404208  7077 catalog_manager.cc:5697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 19 to 26. New cstate: current_term: 26 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.406275  7077 catalog_manager.cc:5697] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:52.407850  7077 catalog_manager.cc:5697] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d reported cstate change: term changed from 18 to 24, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 24 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:52.399283  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 65720.9us
I20260709 13:16:52.411677  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:52.412822 15776 tablet_bootstrap.cc:492] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:16:52.385790  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 51947.3us
I20260709 13:16:52.414376  7150 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:52.414873 15560 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.415722 15560 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:52.417953 15560 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:52.419677  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:52.423499 15560 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:52.425778  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:52.432336  7150 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:52.433295 15560 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:52.433518 15776 tablet_bootstrap.cc:492] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: Bootstrap complete.
I20260709 13:16:52.434664 15776 ts_tablet_manager.cc:1403] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent bootstrapping tablet: real 0.524s	user 0.039s	sys 0.017s
W20260709 13:16:52.458900  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44819.5us
I20260709 13:16:52.491310 15776 raft_consensus.cc:359] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:16:52.496645 15776 raft_consensus.cc:740] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Initialized, Role: LEARNER
I20260709 13:16:52.497524 15776 consensus_queue.cc:260] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } }
I20260709 13:16:52.513533 15776 ts_tablet_manager.cc:1434] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:16:52.515506  7346 tablet_copy_service.cc:342] P c85cf49c63cc4e66b4747d8c4fa14022: Request end of tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-1d6277156300462b934adab718a32e44 received from {username='slave'} at 127.0.0.1:44980
I20260709 13:16:52.516081  7346 tablet_copy_service.cc:434] P c85cf49c63cc4e66b4747d8c4fa14022: ending tablet copy session 9a54ecc9fb4541df915f9f8c01e19429-1d6277156300462b934adab718a32e44 on tablet 1d6277156300462b934adab718a32e44 with peer 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:52.517373 15560 raft_consensus.cc:493] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.517978 15560 raft_consensus.cc:515] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:52.519410  7895 raft_consensus.cc:1217] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:16:52.520282 15560 leader_election.cc:290] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:52.522079  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:52.522728  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:52.525406  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be83b72d4b17414e8521b6707cd8a597" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:52.529210  7152 leader_election.cc:304] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:52.531136 15560 raft_consensus.cc:2749] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:16:52.535926  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:52.546084  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:52.546829  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:52.548316  7077 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47542 (request call id 239) took 6738 ms. Trace:
I20260709 13:16:52.548756  7077 rpcz_store.cc:276] 0709 13:16:45.810284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.655184 (+5844900us) service_pool.cc:224] Handling call
0709 13:16:51.722952 (+ 67768us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b54000aa354. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a6090 00007fece9244f3a 00007feceeffb1cc 00007fecef0f937e 00007feced5ba2a4 00007feced5ba232 00007feced5ba161 00007feced5ba0dc 00007feced5b9392 00007fece757748c 00007fece75768c6
0709 13:16:52.548220 (+825268us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:52.438182 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:52.438810 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:52.438849 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:16:52.438869 (+    20us) tablet.cc:662] Decoding operations
0709 13:16:52.440273 (+  1404us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:52.440340 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:52.440371 (+    31us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:16:52.442108 (+  1737us) tablet.cc:701] Row locks acquired
0709 13:16:52.442131 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:16:52.442554 (+   423us) write_op.cc:270] Start()
0709 13:16:52.442755 (+   201us) write_op.cc:276] Timestamp: P: 1783603012442278 usec, L: 0
0709 13:16:52.442784 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:16:52.443769 (+   985us) log.cc:844] Serialized 6322 byte log entry
0709 13:16:52.449528 (+  5759us) op_driver.cc:464] REPLICATION: finished
0709 13:16:52.451628 (+  2100us) write_op.cc:301] APPLY: starting
0709 13:16:52.451744 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:52.460422 (+  8678us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:52.460528 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:52.471073 (+ 10545us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:52.471411 (+   338us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:16:52.471486 (+    75us) write_op.cc:312] APPLY: finished
0709 13:16:52.471954 (+   468us) log.cc:844] Serialized 148 byte log entry
0709 13:16:52.473023 (+  1069us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.473214 (+   191us) write_op.cc:454] Released schema lock
0709 13:16:52.473276 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:52.488578 (+ 15302us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.488649 (+    71us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7530,"reported_tablets":50,"spinlock_wait_cycles":47052544,"child_traces":[["op",{"apply.queue_time_us":1871,"apply.run_cpu_time_us":21209,"apply.run_wall_time_us":36653,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66976,"num_ops":16,"prepare.queue_time_us":141,"prepare.run_cpu_time_us":5881,"prepare.run_wall_time_us":8320,"replication_time_us":6602}]]}
I20260709 13:16:52.558710  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:52.563951  6030 tablet_replica.cc:333] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.565029 15560 raft_consensus.cc:493] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.565589 15560 raft_consensus.cc:515] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:52.567857 15560 leader_election.cc:290] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:52.570362  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 34 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:52.571157  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61f52d3e2071488c9b6c59c9b028e118" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 34 candidate_status { last_received { term: 31 index: 20 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:52.575552  6030 raft_consensus.cc:2243] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.576490  6030 raft_consensus.cc:2272] T 1d6277156300462b934adab718a32e44 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.579134 15560 raft_consensus.cc:493] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:16:52.579756 15560 raft_consensus.cc:515] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:52.582062 15560 leader_election.cc:290] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:52.581934  6030 tablet_replica.cc:333] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.584827  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:52.587355  6030 raft_consensus.cc:2243] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.588668  6030 pending_rounds.cc:70] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 1 pending ops.
I20260709 13:16:52.590680  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4637971bd855417fac5632325ab8f119" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:52.588953  6030 pending_rounds.cc:77] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 23 index: 17 } timestamp: 7305637870857940992 op_type: NO_OP noop_request { }
I20260709 13:16:52.591706  6030 raft_consensus.cc:2889] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:52.592140  6030 raft_consensus.cc:2272] T 3a4a2f06cbc44402ae7754d23798eaff P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.592206  7150 leader_election.cc:304] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:52.596875  7150 leader_election.cc:304] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:52.597987 15793 raft_consensus.cc:2749] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 13:16:52.601033  6030 tablet_replica.cc:333] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.611377  6030 raft_consensus.cc:2243] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.612282  6030 raft_consensus.cc:2272] T 8df49b022aa74a6481683d10c4fcc035 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:52.615974  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:52.627276 15779 raft_consensus.cc:2749] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:52.639003 15793 raft_consensus.cc:493] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.639634 15793 raft_consensus.cc:515] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:52.641464  7081 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.642717 15793 leader_election.cc:290] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:52.645344  6030 tablet_replica.cc:333] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.644834  7081 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 20 to 21, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 21 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.646831  6030 raft_consensus.cc:2243] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.648025  6030 pending_rounds.cc:70] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 2 pending ops.
I20260709 13:16:52.662832  6030 pending_rounds.cc:77] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 25 index: 13 } timestamp: 7305637848873082880 op_type: NO_OP noop_request { }
I20260709 13:16:52.663478  6030 raft_consensus.cc:2889] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:52.663900  6030 pending_rounds.cc:77] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 22 index: 12 } timestamp: 7305637803859128320 op_type: NO_OP noop_request { }
I20260709 13:16:52.664319  6030 raft_consensus.cc:2889] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:52.664738  6030 raft_consensus.cc:2272] T 75c50740d1144c09a074230835085663 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.668206  6030 tablet_replica.cc:333] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.648805  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:52.670730  7862 consensus_peers.cc:597] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:52.649494  7081 catalog_manager.cc:5697] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 20 to 23, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 23 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:16:52.656463  7080 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47556 (request call id 257) took 70569 ms (client timeout 15000 ms). Trace:
I20260709 13:16:52.677520  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cd4b2ac236480091e1c72b42541e94" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:52.705085  6030 raft_consensus.cc:2243] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:52.701232  7080 rpcz_store.cc:269] 0709 13:15:42.087570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.088701 (+  1131us) service_pool.cc:224] Handling call
0709 13:16:52.656242 (+70567541us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":428623,"reported_tablets":49}
I20260709 13:16:52.715075  6030 raft_consensus.cc:2272] T edb4d64ffd0f4bed80982e942f1033c3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.713826  7081 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 22 to 25, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 25 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.717500 15793 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.720325 15793 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:52.722561 15793 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:52.725445  6030 tablet_replica.cc:333] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
W20260709 13:16:52.725842  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:52.728976  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:52.732251  6030 raft_consensus.cc:2243] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.733228  6030 raft_consensus.cc:2272] T 50bbf75da7f04c6cb95c0f589775820b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.736656  6030 tablet_replica.cc:333] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.744856  6030 raft_consensus.cc:2243] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:52.743491  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:52.750231  6030 raft_consensus.cc:2272] T 4d9487fc89de4e68b395c4a70193c3b6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:52.738291  7150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 50888.3us
I20260709 13:16:52.761176  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:52.761435 15779 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.762132 15779 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:52.764492 15779 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:52.767227  7150 leader_election.cc:304] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:52.769093 15779 raft_consensus.cc:2749] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:52.771438  6030 tablet_replica.cc:333] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.775544  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:52.775228  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:52.780568  6030 raft_consensus.cc:2243] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.783016  6030 raft_consensus.cc:2272] T 90c9778e4f484bb7ab035094ae2c24c9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.791002  6030 tablet_replica.cc:333] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.792256  6030 raft_consensus.cc:2243] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.792271  7150 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:52.793708  6030 raft_consensus.cc:2272] T 39cd4b2ac236480091e1c72b42541e94 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.792886  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5044ec7fc5dd45979aa778b49eba1ead" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:52.795087  7081 catalog_manager.cc:5697] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 25 to 26, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 26 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:52.794821 15779 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:52.796345  7150 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:52.800796 15779 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:52.797695  6030 tablet_replica.cc:333] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.800792  7081 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 18 to 21, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 21 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.808738  6030 raft_consensus.cc:2243] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.810002  6030 raft_consensus.cc:2272] T 4039a3dd715849edb6b8786f89e1a1b3 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.813413  6030 tablet_replica.cc:333] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.813664  7081 catalog_manager.cc:5697] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 14 to 19, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 19 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.823915  7081 catalog_manager.cc:5697] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.815009  6030 raft_consensus.cc:2243] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.829962  6030 pending_rounds.cc:70] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 1 pending ops.
I20260709 13:16:52.830416  6030 pending_rounds.cc:77] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 18 index: 13 } timestamp: 7305637870798372864 op_type: NO_OP noop_request { }
I20260709 13:16:52.830971  6030 raft_consensus.cc:2889] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:52.831367  6030 raft_consensus.cc:2272] T 2486da35b1ff416a9879e8c0588f1db9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.834473  6030 tablet_replica.cc:333] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.827327  7081 catalog_manager.cc:5697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:52.835466  6030 raft_consensus.cc:2243] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.839140  6030 raft_consensus.cc:2272] T 61f52d3e2071488c9b6c59c9b028e118 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.843331  6030 tablet_replica.cc:333] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
W20260709 13:16:52.846684  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:52.839423  7081 catalog_manager.cc:5697] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:52.849113  7081 catalog_manager.cc:5697] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 13 to 25. New cstate: current_term: 25 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.855188  6030 raft_consensus.cc:2243] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.863075  6030 pending_rounds.cc:70] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 1 pending ops.
I20260709 13:16:52.863623  6030 pending_rounds.cc:77] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 26 index: 13 } timestamp: 7305637891435986944 op_type: NO_OP noop_request { }
I20260709 13:16:52.864145  6030 raft_consensus.cc:2889] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:52.864555  6030 raft_consensus.cc:2272] T 8ffda2d3bf0b4684a675dae01ebe1c35 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.867666  6030 tablet_replica.cc:333] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.853601  7081 catalog_manager.cc:5697] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 17 to 20, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 20 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.869482  7081 catalog_manager.cc:5697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 21 to 24, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 24 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:52.871240  7081 catalog_manager.cc:5697] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:52.873293  7081 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 18 to 20, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 20 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.883783  7081 catalog_manager.cc:5697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:52.886062  7081 catalog_manager.cc:5697] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.875242  6030 raft_consensus.cc:2243] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.887668  6030 pending_rounds.cc:70] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 1 pending ops.
I20260709 13:16:52.888029  6030 pending_rounds.cc:77] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 23 index: 13 } timestamp: 7305637829133750272 op_type: NO_OP noop_request { }
I20260709 13:16:52.888473  6030 raft_consensus.cc:2889] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:52.888907  6030 raft_consensus.cc:2272] T cb0912958bd849238a8f104a7916c427 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.892246  6030 tablet_replica.cc:333] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.899415  6030 raft_consensus.cc:2243] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.900327  6030 pending_rounds.cc:70] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 1 pending ops.
I20260709 13:16:52.900667  6030 pending_rounds.cc:77] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 20 index: 9 } timestamp: 7305637804302274560 op_type: NO_OP noop_request { }
I20260709 13:16:52.901105  6030 raft_consensus.cc:2889] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:52.901538  6030 raft_consensus.cc:2272] T 50a190f80864482f8c9dfc9a627c1d6d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.907862  6030 tablet_replica.cc:333] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.914323  6030 raft_consensus.cc:2243] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:52.914877  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:52.939188  6030 raft_consensus.cc:2272] T de90ec51ea634c3d8b220c16d71b8cdf P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:52.940762  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:52.953270 15779 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.953902 15779 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:52.956403 15779 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:52.959302  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:52.959324  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb8aa5713ef402a91f009eb4f97885e" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:52.968191  7152 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:52.970149 15779 raft_consensus.cc:2749] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:16:52.970443 15059 raft_consensus.cc:1064] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: attempting to promote NON_VOTER 9a54ecc9fb4541df915f9f8c01e19429 to VOTER
I20260709 13:16:52.975006  6030 tablet_replica.cc:333] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:52.976146  6030 raft_consensus.cc:2243] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.976863  6030 pending_rounds.cc:70] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 1 pending ops.
I20260709 13:16:52.977149  6030 pending_rounds.cc:77] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 22 index: 15 } timestamp: 7305637898822447104 op_type: NO_OP noop_request { }
I20260709 13:16:52.976539 15059 consensus_queue.cc:237] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:52.977501  6030 raft_consensus.cc:2889] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:52.978061  6030 raft_consensus.cc:2272] T 3cb8aa5713ef402a91f009eb4f97885e P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.000974  7893 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEARNER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:53.003285 15730 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:53.046222  6030 tablet_replica.cc:333] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.050491  6030 raft_consensus.cc:2243] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.052341  6030 raft_consensus.cc:2272] T 5920bb7e53034c2688b18dfe352590c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.060273  6030 tablet_replica.cc:333] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.063107  6030 raft_consensus.cc:2243] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:16:53.067391  6030 raft_consensus.cc:2272] T 296c0d2843ee4e21a7fdc0240b67a7cc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.099306  6030 tablet_replica.cc:333] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.101276  6030 raft_consensus.cc:2243] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.117863  6030 raft_consensus.cc:2272] T 5044ec7fc5dd45979aa778b49eba1ead P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.133906  7260 raft_consensus.cc:1275] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:53.138788  6030 tablet_replica.cc:333] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.174793  6030 raft_consensus.cc:2243] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:53.242311  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 50414.1us
I20260709 13:16:53.259661  6030 raft_consensus.cc:2272] T 5584200aff994405b2de3e35528fb3cd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.230119  7076 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 17 to 21, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 21 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.324085  6030 tablet_replica.cc:333] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.352420  6030 raft_consensus.cc:2243] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:16:53.354211  6030 raft_consensus.cc:2272] T b3393557a6cf4e58b575e336ba525fe9 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.354454 15797 raft_consensus.cc:493] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.355438 15797 raft_consensus.cc:515] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:53.359946 15797 leader_election.cc:290] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:53.361428  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.361937  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:53.372648  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.362512  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddda14494534865a2d45ddae7f3ec93" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:53.373600  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.375159  7150 leader_election.cc:304] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:53.376669 15797 raft_consensus.cc:2749] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:53.387279  6030 tablet_replica.cc:333] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.389215  6030 raft_consensus.cc:2243] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:16:53.395970  7076 catalog_manager.cc:5697] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 9 to 17, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 17 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.397630 15792 consensus_queue.cc:1048] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:16:53.421144  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.423686 15797 raft_consensus.cc:493] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.431049 15797 raft_consensus.cc:515] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:53.433992 15797 leader_election.cc:290] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:16:53.424048  7081 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47554 (request call id 239) took 25880 ms (client timeout 15000 ms). Trace:
I20260709 13:16:53.436503  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:16:53.435213  7081 rpcz_store.cc:269] 0709 13:16:27.543356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.076013 (+5532657us) service_pool.cc:224] Handling call
0709 13:16:53.423794 (+20347781us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:52.915105 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:52.915671 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:52.915715 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:16:52.915727 (+    12us) tablet.cc:662] Decoding operations
0709 13:16:52.917234 (+  1507us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:52.917292 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:52.917323 (+    31us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:16:52.918683 (+  1360us) tablet.cc:701] Row locks acquired
0709 13:16:52.918712 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:16:52.918885 (+   173us) write_op.cc:270] Start()
0709 13:16:52.919026 (+   141us) write_op.cc:276] Timestamp: P: 1783603012918834 usec, L: 0
0709 13:16:52.919046 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:16:52.919897 (+   851us) log.cc:844] Serialized 6705 byte log entry
0709 13:16:52.923172 (+  3275us) op_driver.cc:464] REPLICATION: finished
0709 13:16:52.923732 (+   560us) write_op.cc:301] APPLY: starting
0709 13:16:52.923829 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:52.934070 (+ 10241us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:52.934188 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:52.974501 (+ 40313us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:52.991508 (+ 17007us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:16:52.991578 (+    70us) write_op.cc:312] APPLY: finished
0709 13:16:52.992154 (+   576us) log.cc:844] Serialized 156 byte log entry
0709 13:16:52.992418 (+   264us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.992669 (+   251us) write_op.cc:454] Released schema lock
0709 13:16:52.992763 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:52.993754 (+   991us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.993798 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50996,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":336,"apply.run_cpu_time_us":23121,"apply.run_wall_time_us":69422,"cfile_cache_hit":68,"cfile_cache_hit_bytes":71162,"num_ops":17,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":5156,"prepare.run_wall_time_us":15704,"replication_time_us":3948}]]}
W20260709 13:16:53.446493  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:53.455204  7076 catalog_manager.cc:5697] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.462443  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71d8ccd854bc453397ebc79aefe1c520" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:53.471872  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.494259  7152 leader_election.cc:304] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:53.495222  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.498618 15797 raft_consensus.cc:2749] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:53.500759  7076 catalog_manager.cc:5697] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 18 to 21, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 21 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.490775  6030 raft_consensus.cc:2272] T 88b1df9cb24b4dc88a4735a646ad8575 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:53.510023  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:53.510082  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:53.511198  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:53.513304  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.523818  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.532265  6030 tablet_replica.cc:333] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.533798  6030 raft_consensus.cc:2243] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.534967  6030 raft_consensus.cc:2272] T dd122c1cdfa84f8ea52721a14c58c4e2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.551729 15804 raft_consensus.cc:2955] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:16:53.571528  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.573854  6030 tablet_replica.cc:333] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.578845  6030 raft_consensus.cc:2243] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.579818  6030 pending_rounds.cc:70] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 1 pending ops.
I20260709 13:16:53.580176  6030 pending_rounds.cc:77] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 26 index: 15 } timestamp: 7305637898567135232 op_type: NO_OP noop_request { }
I20260709 13:16:53.580767  6030 raft_consensus.cc:2889] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:53.581282  6030 raft_consensus.cc:2272] T cb3d8971d9be4ed09286c9b433d050b2 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.584947  6030 tablet_replica.cc:333] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.599869  7257 raft_consensus.cc:2955] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.609182  6030 raft_consensus.cc:2243] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:16:53.612044  6030 raft_consensus.cc:2272] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.623775  7893 raft_consensus.cc:2955] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.631222  6030 tablet_replica.cc:333] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.639328  6030 raft_consensus.cc:2243] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.640419  6030 pending_rounds.cc:70] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 1 pending ops.
I20260709 13:16:53.640724  6030 pending_rounds.cc:77] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 29 index: 18 } timestamp: 7305637898838134784 op_type: NO_OP noop_request { }
I20260709 13:16:53.641161  6030 raft_consensus.cc:2889] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:53.641536  6030 raft_consensus.cc:2272] T 458ab76409d4427f8ab55d4d71ca5799 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.645788  6030 tablet_replica.cc:333] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.646809  6030 raft_consensus.cc:2243] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:53.651894  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:53.654397  6030 raft_consensus.cc:2272] T 3106224ab6d746898c7fb52a0788256d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.720904  6030 tablet_replica.cc:333] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.733114 15797 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.733913 15797 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:53.737121  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.737241  7257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:53.740376  6030 raft_consensus.cc:2243] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.749040 15797 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:53.749583  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:53.749997  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:53.751385  7150 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:53.753844 15797 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:16:53.763796  7078 catalog_manager.cc:5697] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 26 to 29, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 29 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.766032  7078 catalog_manager.cc:5697] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 19 to 22, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 22 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.767760  7078 catalog_manager.cc:5697] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:53.775352  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:53.774664  7078 catalog_manager.cc:5697] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 16 to 19, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 19 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.777524  7078 catalog_manager.cc:5697] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 18 to 26, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 26 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:53.773183  7076 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47556 (request call id 258) took 41893 ms (client timeout 15000 ms). Trace:
W20260709 13:16:53.779701  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:53.779981  7076 rpcz_store.cc:269] 0709 13:16:11.879766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.880103 (+   337us) service_pool.cc:224] Handling call
0709 13:16:53.773073 (+41892970us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:53.540253 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:53.540933 (+   680us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:53.540984 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:16:53.541002 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:53.541714 (+   712us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:53.541828 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:53.541854 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:16:53.567063 (+ 25209us) tablet.cc:701] Row locks acquired
0709 13:16:53.567113 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:16:53.567301 (+   188us) write_op.cc:270] Start()
0709 13:16:53.567470 (+   169us) write_op.cc:276] Timestamp: P: 1783603013567240 usec, L: 0
0709 13:16:53.567508 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:16:53.568220 (+   712us) log.cc:844] Serialized 1696 byte log entry
0709 13:16:53.608916 (+ 40696us) op_driver.cc:464] REPLICATION: finished
0709 13:16:53.635630 (+ 26714us) write_op.cc:301] APPLY: starting
0709 13:16:53.635742 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:53.650191 (+ 14449us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:53.655821 (+  5630us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:53.676368 (+ 20547us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:53.676701 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:16:53.676757 (+    56us) write_op.cc:312] APPLY: finished
0709 13:16:53.677104 (+   347us) log.cc:844] Serialized 49 byte log entry
0709 13:16:53.678052 (+   948us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:53.678168 (+   116us) write_op.cc:454] Released schema lock
0709 13:16:53.678233 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:53.678695 (+   462us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:53.678727 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47844,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":26300,"apply.run_cpu_time_us":8814,"apply.run_wall_time_us":43053,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":9284,"prepare.run_cpu_time_us":3950,"prepare.run_wall_time_us":66764,"replication_time_us":41191,"thread_start_us":18182,"threads_started":2}]]}
W20260709 13:16:53.790269  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:53.794485  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.799885  6030 raft_consensus.cc:2272] T 788b854112d74649a8e966f1fe824f3f P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.818595  6030 tablet_replica.cc:333] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.819717  6030 raft_consensus.cc:2243] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.820653  6030 pending_rounds.cc:70] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 1 pending ops.
I20260709 13:16:53.820902  6030 pending_rounds.cc:77] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 18 index: 15 } timestamp: 7305637877687889920 op_type: NO_OP noop_request { }
I20260709 13:16:53.821357  6030 raft_consensus.cc:2889] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:53.821760  6030 raft_consensus.cc:2272] T f7dc72492fc64c638202c7715a2a72ac P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.779372  7078 catalog_manager.cc:5697] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 25 to 28. New cstate: current_term: 28 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.813956 15797 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:16:53.823210 15797 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:53.823740  7078 catalog_manager.cc:5697] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 22 to 23, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 23 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.825556 15797 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:53.827167  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:53.827311  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:53.829746  7152 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:16:53.830144  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.828671  7078 catalog_manager.cc:5697] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 15 to 16, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 16 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.831338 15797 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:53.832643  7078 catalog_manager.cc:5697] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 16 to 19, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 19 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.840165  7078 catalog_manager.cc:5697] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 18 to 26. New cstate: current_term: 26 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.851018  6030 tablet_replica.cc:333] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.853565  6030 raft_consensus.cc:2243] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.862417  6030 raft_consensus.cc:2272] T b0eff9774a9c435d955814f903cb2401 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.847972  7078 catalog_manager.cc:5697] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 19 to 23, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 23 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.863745  7078 catalog_manager.cc:5697] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.866377  7078 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 20 to 24, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 24 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.871796  7078 catalog_manager.cc:5697] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 19 to 22, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 22 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.873467  7078 catalog_manager.cc:5697] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 22 to 24, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 24 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.870719  6030 tablet_replica.cc:333] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.875473  6030 raft_consensus.cc:2243] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.879729  6030 raft_consensus.cc:2272] T 221fa6fca3154a49b5efa9c28f8c4cd8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.876570  7078 catalog_manager.cc:5697] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 21 to 24, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 24 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.883544 15797 raft_consensus.cc:493] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.884294 15797 raft_consensus.cc:515] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:53.884598  7078 catalog_manager.cc:5697] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 26 to 33, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 33 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.890172  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:53.894284  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a893449156a24240bd4ed83fc67f85f6" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:53.889766  7078 catalog_manager.cc:5697] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.896574  7152 leader_election.cc:304] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:53.888392  6030 tablet_replica.cc:333] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.897636 15779 raft_consensus.cc:2749] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:16:53.897940  6030 raft_consensus.cc:2243] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.903319 15797 leader_election.cc:290] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:53.908316  6030 raft_consensus.cc:2272] T 23e0840e609849f8bd379d43569463c8 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.896165  7078 catalog_manager.cc:5697] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 19 to 27, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 27 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:53.912076  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.913465  7078 catalog_manager.cc:5697] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.915155  7078 catalog_manager.cc:5697] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 21 to 22, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 22 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.916796  7078 catalog_manager.cc:5697] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 25 to 27, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 27 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.918915  7078 catalog_manager.cc:5697] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.920926  7078 catalog_manager.cc:5697] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 24 to 26, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 26 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.912109  6030 tablet_replica.cc:333] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.931635  6030 raft_consensus.cc:2243] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.932780 15797 raft_consensus.cc:493] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.933400 15797 raft_consensus.cc:515] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:53.933645  7078 catalog_manager.cc:5697] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 21 to 25, leader changed from c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 25 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.936482  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:53.937347  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2278b8a74ae4c04882dae719a92af7d" candidate_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:53.938354  7078 catalog_manager.cc:5697] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.940368  7150 leader_election.cc:304] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:53.940280  7078 catalog_manager.cc:5697] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.941453 15779 raft_consensus.cc:2749] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:53.942613 15797 leader_election.cc:290] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:53.932796  6030 raft_consensus.cc:2272] T ab82ab5b0c4442cd8a05ee133017c2e0 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.942119  7078 catalog_manager.cc:5697] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.947335  6030 tablet_replica.cc:333] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.945844  7078 catalog_manager.cc:5697] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 20 to 23, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 23 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.949188  7078 catalog_manager.cc:5697] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 21 to 22, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 22 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:53.957369  7078 catalog_manager.cc:5697] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 26 to 27, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 27 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:53.964774  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:53.954367  6030 raft_consensus.cc:2243] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.967236  6030 raft_consensus.cc:2272] T 9ba8ab4b505c46299ab836854622094b P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:53.967031  7078 catalog_manager.cc:5697] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 19 to 25, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 25 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.968871  7078 catalog_manager.cc:5697] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:53.972447  7078 catalog_manager.cc:5697] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 22 to 24, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 24 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:16:53.975984  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:53.981961  6030 tablet_replica.cc:333] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:53.989172  6030 raft_consensus.cc:2243] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:53.989934  6030 raft_consensus.cc:2272] T c89d6774062049379248eca324d137c6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.002816  6030 tablet_replica.cc:333] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.003782  6030 raft_consensus.cc:2243] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.005177  6030 raft_consensus.cc:2272] T adaaa8fc7441471b9727128476437ccc P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.008886  6030 tablet_replica.cc:333] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.009760  6030 raft_consensus.cc:2243] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.026264  6030 raft_consensus.cc:2272] T b2278b8a74ae4c04882dae719a92af7d P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.029762  6030 tablet_replica.cc:333] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.035905  6030 raft_consensus.cc:2243] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.037024  6030 raft_consensus.cc:2272] T 4aa9c7bddd6f49acad7c47c33c761358 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.040566  6030 tablet_replica.cc:333] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.042918  6030 raft_consensus.cc:2243] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.043996  6030 pending_rounds.cc:70] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 1 pending ops.
I20260709 13:16:54.044349  6030 pending_rounds.cc:77] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 20 index: 10 } timestamp: 7305637831768317952 op_type: NO_OP noop_request { }
W20260709 13:16:54.044768  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:54.044875  6030 raft_consensus.cc:2889] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:54.045676  6030 raft_consensus.cc:2272] T be83b72d4b17414e8521b6707cd8a597 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.049736  6030 tablet_replica.cc:333] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.050853  6030 raft_consensus.cc:2243] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.051802  6030 raft_consensus.cc:2272] T d8d111efe5ab4e9cad378e4ebfdeb996 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.055912  6030 tablet_replica.cc:333] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.057122  6030 raft_consensus.cc:2243] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.058180  6030 pending_rounds.cc:70] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Trying to abort 1 pending ops.
I20260709 13:16:54.058454  6030 pending_rounds.cc:77] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: Aborting op as it isn't in flight: id { term: 23 index: 14 } timestamp: 7305637920573222912 op_type: NO_OP noop_request { }
I20260709 13:16:54.058872  6030 raft_consensus.cc:2889] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:54.059227  6030 raft_consensus.cc:2272] T 71d8ccd854bc453397ebc79aefe1c520 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.062340  6030 tablet_replica.cc:333] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.063236  6030 raft_consensus.cc:2243] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.063906  6030 raft_consensus.cc:2272] T 7ddda14494534865a2d45ddae7f3ec93 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.067245  6030 tablet_replica.cc:333] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.068097  6030 raft_consensus.cc:2243] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.069046  6030 raft_consensus.cc:2272] T 4637971bd855417fac5632325ab8f119 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.072206  6030 tablet_replica.cc:333] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.083174  6030 raft_consensus.cc:2243] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.084167  6030 raft_consensus.cc:2272] T a893449156a24240bd4ed83fc67f85f6 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.090940  6030 tablet_replica.cc:333] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.091724  6030 raft_consensus.cc:2243] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.093081  6030 raft_consensus.cc:2272] T e247e49279304bdfa2f0146e714dc287 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.112146  6030 tablet_replica.cc:333] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.112938  6030 raft_consensus.cc:2243] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.113727  6030 raft_consensus.cc:2272] T eac161a9db63471dbd87b41a92fe1202 P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.116997  6030 tablet_replica.cc:333] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.117820  6030 raft_consensus.cc:2243] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:16:54.120191  6030 raft_consensus.cc:2272] T db390910c47342dc848e258ef7dac1bd P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:54.127990  6030 tablet_replica.cc:333] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d: stopping tablet replica
I20260709 13:16:54.128762  6030 raft_consensus.cc:2243] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:54.129544  6030 raft_consensus.cc:2272] T 8023e86d50f847c7a841c09b7692edeb P 2ecdd7dc4a144f5aa0f2f91c7b94434d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:54.208001  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:54.215873 15806 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:54.216760 15806 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:54.220358 15806 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:54.221846  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:16:54.226856  7302 leader_election.cc:336] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:54.227421  7302 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:54.231252 15806 raft_consensus.cc:2749] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:16:54.264025  7079 catalog_manager.cc:5697] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 22 to 25, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 25 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:54.266453  7079 catalog_manager.cc:5697] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:54.268231  7079 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.276103  7079 catalog_manager.cc:5697] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 21 to 24, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 24 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.278602  7079 catalog_manager.cc:5697] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 23 to 26. New cstate: current_term: 26 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.286548  7078 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47554 (request call id 240) took 7090 ms. Trace:
I20260709 13:16:54.304770  7078 rpcz_store.cc:276] 0709 13:16:47.196325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.290857 (+5094532us) service_pool.cc:224] Handling call
0709 13:16:54.009970 (+1719113us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b54000aa1a8. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fececba6161 00007fececc303af 00007fececc31b11 00007fecef1322d1 00007fecef132b2f 00007feceeff1d4b 00007fecef0f9c3e 00007feced5ba2a4 00007feced5ba232 00007feced5ba161 00007feced5ba0dc
0709 13:16:54.286432 (+276462us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:54.011143 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:54.011736 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:54.011801 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:16:54.011819 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:54.014385 (+  2566us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:54.014448 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:54.014479 (+    31us) tablet.cc:685] Acquiring locks for 34 operations
0709 13:16:54.022159 (+  7680us) tablet.cc:701] Row locks acquired
0709 13:16:54.022180 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:16:54.022327 (+   147us) write_op.cc:270] Start()
0709 13:16:54.022449 (+   122us) write_op.cc:276] Timestamp: P: 1783603014022277 usec, L: 0
0709 13:16:54.022473 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:16:54.023346 (+   873us) log.cc:844] Serialized 13272 byte log entry
0709 13:16:54.027376 (+  4030us) op_driver.cc:464] REPLICATION: finished
0709 13:16:54.027920 (+   544us) write_op.cc:301] APPLY: starting
0709 13:16:54.028000 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:54.076638 (+ 48638us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:54.076736 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:54.170669 (+ 93933us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:54.171177 (+   508us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=0,mrs_lookups=0
0709 13:16:54.171241 (+    64us) write_op.cc:312] APPLY: finished
0709 13:16:54.171943 (+   702us) log.cc:844] Serialized 292 byte log entry
0709 13:16:54.173003 (+  1060us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.173274 (+   271us) write_op.cc:454] Released schema lock
0709 13:16:54.173360 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:54.173995 (+   635us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.174027 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7932,"reported_tablets":50,"spinlock_wait_cycles":11253120,"child_traces":[["op",{"apply.queue_time_us":310,"apply.run_cpu_time_us":42917,"apply.run_wall_time_us":146004,"cfile_cache_hit":136,"cfile_cache_hit_bytes":142324,"num_ops":34,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":7496,"prepare.run_wall_time_us":15855,"replication_time_us":4764,"spinlock_wait_cycles":11648}]]}
W20260709 13:16:54.363077  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:54.379208 15801 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:54.380185 15801 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:54.395469 15801 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:54.398532  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:54.399468  7331 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 27.
I20260709 13:16:54.403383  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
W20260709 13:16:54.406363  7228 connection.cc:573] client connection to 127.5.227.129:44171 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:16:54.411556 15775 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:16:54.412150 15775 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:54.412524 15775 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:16:54.425788 15775 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:54.430159  7079 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 159) took 5618 ms. Trace:
I20260709 13:16:54.451933 15775 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:54.453366  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296c0d2843ee4e21a7fdc0240b67a7cc" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:54.454072  7331 raft_consensus.cc:3060] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:16:54.454830  7228 leader_election.cc:336] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:54.431816  7079 rpcz_store.cc:276] 0709 13:16:48.811959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.428600 (+3616641us) service_pool.cc:224] Handling call
0709 13:16:54.430060 (+2001460us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:54.302775 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:54.303324 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:54.303359 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:16:54.303377 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:54.304052 (+   675us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:54.304111 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:54.304140 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:16:54.304710 (+   570us) tablet.cc:701] Row locks acquired
0709 13:16:54.304732 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:16:54.304888 (+   156us) write_op.cc:270] Start()
0709 13:16:54.305007 (+   119us) write_op.cc:276] Timestamp: P: 1783603014304841 usec, L: 0
0709 13:16:54.305029 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:54.305668 (+   639us) log.cc:844] Serialized 2132 byte log entry
0709 13:16:54.308329 (+  2661us) op_driver.cc:464] REPLICATION: finished
0709 13:16:54.308817 (+   488us) write_op.cc:301] APPLY: starting
0709 13:16:54.308896 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:54.312487 (+  3591us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:54.312601 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:54.315883 (+  3282us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:54.316101 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:16:54.316156 (+    55us) write_op.cc:312] APPLY: finished
0709 13:16:54.316480 (+   324us) log.cc:844] Serialized 57 byte log entry
0709 13:16:54.326799 (+ 10319us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.326911 (+   112us) write_op.cc:454] Released schema lock
0709 13:16:54.326955 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:54.327350 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.327385 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":48655,"reported_tablets":31,"spinlock_wait_cycles":9088,"child_traces":[["op",{"apply.queue_time_us":289,"apply.run_cpu_time_us":7865,"apply.run_wall_time_us":18466,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20930,"num_ops":5,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":3219,"prepare.run_wall_time_us":5144,"replication_time_us":3160}]]}
I20260709 13:16:54.464881  7331 raft_consensus.cc:2468] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 28.
I20260709 13:16:54.443373  7084 catalog_manager.cc:5697] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 20 to 21, leader changed from efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 21 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:54.466792  7225 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:54.469062 15775 raft_consensus.cc:2804] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:16:54.471493 15775 raft_consensus.cc:697] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 28 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:54.472992 15775 consensus_queue.cc:237] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:54.483975  7228 leader_election.cc:336] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:16:54.583246  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 80632.7us
I20260709 13:16:54.598435  7893 consensus_queue.cc:237] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:54.652357  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:54.656673  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:54.657514  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:54.672706  7331 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:16:54.676494 15429 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:54.688257  7260 raft_consensus.cc:1275] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:16:54.692817 15643 consensus_queue.cc:1048] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:16:54.721925 15735 raft_consensus.cc:2955] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index 11 to 16, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:54.731202 15643 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:54.731927 15643 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:54.734558 15643 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:54.739261 15643 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:54.740190 15643 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:54.739883  7335 raft_consensus.cc:2955] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 11 to 16, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:54.759531  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:54.779309 15643 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:54.780798  7084 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47556 (request call id 259) took 11119 ms. Trace:
I20260709 13:16:54.784101  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:54.781129  7069 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c89d6774062049379248eca324d137c6 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:54.797276 15817 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:54.798075 15817 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:54.801095 15817 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:54.801133  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:54.806893  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:54.808501  7862 leader_election.cc:336] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:54.809103  7862 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:54.810134 15826 raft_consensus.cc:2749] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:16:54.813892  7862 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:54.819427  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:54.821444  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:54.822150 15826 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:16:54.822216  7893 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 28.
I20260709 13:16:54.825766  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
W20260709 13:16:54.827051  7302 leader_election.cc:336] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:54.828739 15806 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:54.829360 15806 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:54.830091 15730 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:16:54.830591 15730 raft_consensus.cc:493] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:54.830977 15730 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:16:54.831974 15806 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:54.781237  7084 rpcz_store.cc:276] 0709 13:16:43.662032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.778796 (+3116764us) service_pool.cc:224] Handling call
0709 13:16:54.780716 (+8001920us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:54.544731 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:54.547268 (+  2537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:54.547315 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:16:54.547332 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:54.547692 (+   360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:54.547760 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:54.547792 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:54.548003 (+   211us) tablet.cc:701] Row locks acquired
0709 13:16:54.548019 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:16:54.548203 (+   184us) write_op.cc:270] Start()
0709 13:16:54.548331 (+   128us) write_op.cc:276] Timestamp: P: 1783603014548148 usec, L: 0
0709 13:16:54.548357 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:16:54.549160 (+   803us) log.cc:844] Serialized 541 byte log entry
0709 13:16:54.551307 (+  2147us) op_driver.cc:464] REPLICATION: finished
0709 13:16:54.551794 (+   487us) write_op.cc:301] APPLY: starting
0709 13:16:54.551884 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:54.552924 (+  1040us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:54.553029 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:54.553847 (+   818us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:54.554025 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:16:54.554097 (+    72us) write_op.cc:312] APPLY: finished
0709 13:16:54.554330 (+   233us) log.cc:844] Serialized 25 byte log entry
0709 13:16:54.554536 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.568127 (+ 13591us) write_op.cc:454] Released schema lock
0709 13:16:54.568198 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:54.568580 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.568615 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85942,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":272,"apply.run_cpu_time_us":3312,"apply.run_wall_time_us":16743,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":11407,"prepare.run_cpu_time_us":3104,"prepare.run_wall_time_us":9388,"replication_time_us":2792,"spinlock_wait_cycles":1920}]]}
I20260709 13:16:54.842798  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:54.843618  7893 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
W20260709 13:16:54.853048  7085 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 155) took 95497 ms (client timeout 15000 ms). Trace:
W20260709 13:16:54.853552  7085 rpcz_store.cc:269] 0709 13:15:19.355821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.356247 (+   426us) service_pool.cc:224] Handling call
0709 13:16:54.852835 (+95496588us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":348360,"reported_tablets":31}
I20260709 13:16:54.855006  7260 raft_consensus.cc:2955] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 11 to 16, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:54.862545  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:54.866238 15817 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:54.866765 15817 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:54.870952 15817 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:54.890749 15817 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:54.893337 15817 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:54.904718  7082 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 21 to 22, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 22 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.923697  7331 raft_consensus.cc:1275] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:16:54.924801  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:54.925565  7893 raft_consensus.cc:3060] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:54.915724 15730 raft_consensus.cc:515] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:54.936937 15821 consensus_queue.cc:1048] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:16:54.948002  7302 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:54.968889  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3393557a6cf4e58b575e336ba525fe9" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:54.969707  7890 raft_consensus.cc:3060] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:16:54.961555  7083 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47554 (request call id 237) took 82348 ms (client timeout 15000 ms). Trace:
I20260709 13:16:54.962865 15730 leader_election.cc:290] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:54.965188  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.973672  7893 raft_consensus.cc:2468] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
W20260709 13:16:54.974035  7083 rpcz_store.cc:269] 0709 13:15:32.613241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.613559 (+   318us) service_pool.cc:224] Handling call
0709 13:16:54.961295 (+82347736us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40175,"reported_tablets":50}
W20260709 13:16:54.986253  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:54.986287  7890 raft_consensus.cc:2468] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 29.
I20260709 13:16:54.990820  7299 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:54.991405  7079 catalog_manager.cc:5697] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 29 to 30, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 30 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:54.995162  7079 catalog_manager.cc:5697] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 26 to 27, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 27 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:54.998965  7299 leader_election.cc:304] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:55.000103 15806 raft_consensus.cc:2804] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:55.000676 15806 raft_consensus.cc:697] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:55.000744 15059 raft_consensus.cc:2804] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:16:55.001392 15059 raft_consensus.cc:697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:55.001770 15806 consensus_queue.cc:237] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:54.999748  7079 catalog_manager.cc:5697] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 21 to 22, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 22 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:55.011219  7079 catalog_manager.cc:5697] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:55.002293 15059 consensus_queue.cc:237] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:55.013211  7079 catalog_manager.cc:5697] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 20 to 26. New cstate: current_term: 26 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:55.015609  7079 catalog_manager.cc:5697] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 24 to 25, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 25 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:55.019280 15817 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.020345 15817 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:55.020519  7079 catalog_manager.cc:5697] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index -1 to 12, VOTER 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) added. New cstate: current_term: 18 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:16:55.019265  7082 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 158) took 25210 ms (client timeout 15000 ms). Trace:
I20260709 13:16:55.032542  7079 catalog_manager.cc:5697] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 21 to 24, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 24 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:16:55.028990  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:55.034947  7079 catalog_manager.cc:5697] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
I20260709 13:16:55.078715  7079 catalog_manager.cc:5697] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:55.080050  7079 catalog_manager.cc:5697] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } }
W20260709 13:16:55.084039  7302 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:55.082132  7079 catalog_manager.cc:5697] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 19 to 21, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 21 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
W20260709 13:16:55.022358  7082 rpcz_store.cc:269] 0709 13:16:29.808859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.748279 (+11939420us) service_pool.cc:224] Handling call
0709 13:16:54.937809 (+13189530us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.937839 (+    30us) write_op.cc:454] Released schema lock
0709 13:16:55.019127 (+ 81288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:54.925887 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:54.926427 (+   540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:54.926483 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:16:54.926501 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:54.926881 (+   380us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:54.926932 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:54.926969 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:54.927174 (+   205us) tablet.cc:701] Row locks acquired
0709 13:16:54.927195 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:16:54.927337 (+   142us) write_op.cc:270] Start()
0709 13:16:54.927459 (+   122us) write_op.cc:276] Timestamp: P: 1783603014927295 usec, L: 0
0709 13:16:54.927483 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:16:54.928168 (+   685us) log.cc:844] Serialized 532 byte log entry
0709 13:16:54.930520 (+  2352us) op_driver.cc:464] REPLICATION: finished
0709 13:16:54.931145 (+   625us) write_op.cc:301] APPLY: starting
0709 13:16:54.931243 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:54.932127 (+   884us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:54.932253 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:54.933273 (+  1020us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:54.933458 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:16:54.933517 (+    59us) write_op.cc:312] APPLY: finished
0709 13:16:54.933731 (+   214us) log.cc:844] Serialized 25 byte log entry
0709 13:16:54.933928 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.934015 (+    87us) write_op.cc:454] Released schema lock
0709 13:16:54.934073 (+    58us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":33681,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":412,"apply.run_cpu_time_us":3249,"apply.run_wall_time_us":3249,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":899,"prepare.run_cpu_time_us":2597,"prepare.run_wall_time_us":2595,"replication_time_us":2895}]]}
I20260709 13:16:55.098186 15825 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.137399 15429 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.138504 15429 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:55.141152 15429 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:55.122177 15825 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:55.153887 15825 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:55.170853 15819 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.179174 15819 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:55.181550 15819 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:55.212994 15817 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:55.243040  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:55.243836  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:55.244632  7335 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 29.
I20260709 13:16:55.243832  7328 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 24.
I20260709 13:16:55.244024  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:55.249007  7895 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 24.
W20260709 13:16:55.251384  7862 leader_election.cc:336] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:16:55.253027  7862 leader_election.cc:336] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:55.254360  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:55.247946 15730 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.268144  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:55.274246  7078 catalog_manager.cc:5697] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 31 to 33, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 33 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:55.286553  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:55.291090  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:55.287062 15832 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.269555  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:55.296119 15838 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:16:55.296669 15838 raft_consensus.cc:493] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.297106 15838 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:16:55.287281 15730 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:55.299083 15730 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:55.300658 15832 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:55.303368 15832 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:55.303599 15429 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:55.304251 15429 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.304719 15429 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:55.306145  7074 maintenance_manager.cc:419] P 50ff9c56d8414bdb8f05f31957b53075: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033381
I20260709 13:16:55.321472 15838 raft_consensus.cc:515] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:55.325713  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 56258us
I20260709 13:16:55.329623 15819 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:55.330114 15819 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.330535 15819 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:55.333448  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:55.336552  7078 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:55.344241  7078 catalog_manager.cc:5697] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 19 to 24, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129). New cstate: current_term: 24 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:55.345422  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:16:55.352161  7302 leader_election.cc:336] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:55.345992  7078 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:55.356606  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:55.357579  7890 raft_consensus.cc:2393] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 30: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:55.357836  7078 catalog_manager.cc:5697] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 22 to 25, leader changed from 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 25 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:55.373418 15838 leader_election.cc:290] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:55.369871 15429 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:55.375372 15643 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.375747  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adaaa8fc7441471b9727128476437ccc" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:55.375954 15643 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:55.376416 15429 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:55.376483  7331 raft_consensus.cc:3060] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Advancing to term 30
W20260709 13:16:55.385576  7862 leader_election.cc:336] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:55.379851  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:55.386950 15643 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:55.387974  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:16:55.389762  7260 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 26.
I20260709 13:16:55.404277 15819 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:55.405753  7335 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a54ecc9fb4541df915f9f8c01e19429 in current term 25: Already voted for candidate c85cf49c63cc4e66b4747d8c4fa14022 in this term.
W20260709 13:16:55.406571  7228 leader_election.cc:336] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:16:55.394588  7862 leader_election.cc:336] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:16:55.407771  7862 leader_election.cc:336] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:55.411121  7331 raft_consensus.cc:2468] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 30.
I20260709 13:16:55.418880  7861 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
W20260709 13:16:55.422850  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:55.424934 15819 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:16:55.426546  7302 leader_election.cc:336] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:16:55.428102  6030 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7208)
I20260709 13:16:55.439462 15838 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:16:55.440037 15838 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.440429 15838 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:16:55.450242  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:55.455446  7225 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:55.456348 15801 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:16:55.466257 15801 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.467012 15801 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:55.470502 15801 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:55.477993  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:55.478968  7895 raft_consensus.cc:2393] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate c85cf49c63cc4e66b4747d8c4fa14022 in current term 25: Already voted for candidate 9a54ecc9fb4541df915f9f8c01e19429 in this term.
I20260709 13:16:55.479907  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:16:55.480768 15429 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:55.480765 15838 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:55.481505  7859 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:55.482337 15643 raft_consensus.cc:2804] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:16:55.482894 15643 raft_consensus.cc:697] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
I20260709 13:16:55.483771 15643 consensus_queue.cc:237] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:55.491997  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 79239.2us
W20260709 13:16:55.499173  7302 leader_election.cc:336] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:55.499821  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:16:55.506839 15059 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:16:55.508399  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:55.509123  7302 leader_election.cc:336] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:55.509558  7302 leader_election.cc:304] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:55.510689  7079 catalog_manager.cc:5697] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: config changed from index 11 to 16, VOTER 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) evicted. New cstate: current_term: 25 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } } }
I20260709 13:16:55.513257  7079 catalog_manager.cc:5697] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 27 to 28, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 28 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.518083 15806 raft_consensus.cc:2749] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:16:55.524135  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:16:55.524179  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c"
I20260709 13:16:55.525048  7331 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 24.
I20260709 13:16:55.525141  7254 raft_consensus.cc:3060] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:16:55.524852  7073 maintenance_manager.cc:643] P 50ff9c56d8414bdb8f05f31957b53075: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.217s	user 0.041s	sys 0.003s Metrics: {"bytes_written":6852,"delete_count":0,"lbm_write_time_us":3931,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":5,"reinsert_count":0,"update_count":289}
W20260709 13:16:55.526201  7069 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet c89d6774062049379248eca324d137c6 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER failed with leader 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 11 but the committed config has opid_index of 16
I20260709 13:16:55.527451  7074 maintenance_manager.cc:419] P 50ff9c56d8414bdb8f05f31957b53075: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.298888
W20260709 13:16:55.531075  7228 leader_election.cc:336] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:16:55.531708  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:55.533242  7254 raft_consensus.cc:2468] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a54ecc9fb4541df915f9f8c01e19429 in term 27.
I20260709 13:16:55.535187  7861 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 
I20260709 13:16:55.536355 15643 raft_consensus.cc:2804] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:16:55.537184  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:55.538473 15643 raft_consensus.cc:697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 LEADER]: Becoming Leader. State: Replica: 9a54ecc9fb4541df915f9f8c01e19429, State: Running, Role: LEADER
W20260709 13:16:55.517326  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:55.541870 15643 consensus_queue.cc:237] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:55.542748 15838 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:16:55.552551 15841 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:16:55.553150 15841 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2ecdd7dc4a144f5aa0f2f91c7b94434d)
I20260709 13:16:55.553612 15841 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:16:55.555826  7895 raft_consensus.cc:1275] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
W20260709 13:16:55.571427  7302 leader_election.cc:336] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:55.571959  7302 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:16:55.574865 15840 consensus_queue.cc:1048] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 13:16:55.579106  7862 leader_election.cc:336] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:55.586905  7082 catalog_manager.cc:5697] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 28 to 29, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 29 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.570021 15841 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:16:55.591156 15059 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:16:55.601663 15841 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:16:55.601794  7890 raft_consensus.cc:1275] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:16:55.603943 15818 consensus_queue.cc:1048] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:16:55.627229  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022"
I20260709 13:16:55.627882  7331 raft_consensus.cc:3060] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:16:55.645959  7228 leader_election.cc:336] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:55.662465  7331 raft_consensus.cc:2468] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc9ee9e1d86480790fa83f6ad0c295c in term 25.
I20260709 13:16:55.666085  7225 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d
I20260709 13:16:55.675956 15832 raft_consensus.cc:2804] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:16:55.683744 15832 raft_consensus.cc:697] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Becoming Leader. State: Replica: efc9ee9e1d86480790fa83f6ad0c295c, State: Running, Role: LEADER
I20260709 13:16:55.684719 15832 consensus_queue.cc:237] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
W20260709 13:16:55.741940  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:55.742643  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:55.732146  7079 catalog_manager.cc:5697] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 29 to 30, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 30 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.752779  7079 catalog_manager.cc:5697] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 reported cstate change: term changed from 26 to 27, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132). New cstate: current_term: 27 leader_uuid: "9a54ecc9fb4541df915f9f8c01e19429" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:55.814033  7072 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 106601us
W20260709 13:16:55.816289  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.817001  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:55.857177  7078 catalog_manager.cc:5697] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c reported cstate change: term changed from 24 to 25, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130). New cstate: current_term: 25 leader_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:55.860054  7072 catalog_manager.cc:4755] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c89d6774062049379248eca324d137c6: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:16:55.862339  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:55.842407  7082 catalog_manager.cc:5697] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 24 to 25, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 25 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.898773  7331 raft_consensus.cc:1275] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 13:16:55.900597 15838 consensus_queue.cc:1048] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:16:55.978302  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.979013  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:55.980191  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:55.980686  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:55.984262  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:55.986610  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:56.005215  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:56.019107  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.023885  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:56.085788  7256 raft_consensus.cc:1275] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Refusing update from remote peer 9a54ecc9fb4541df915f9f8c01e19429: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:16:56.087536 15643 consensus_queue.cc:1048] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 13:16:56.099370  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:56.115067  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:56.163193  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:56.212746  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:56.324398  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:56.420610  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.423105  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45187.3us
W20260709 13:16:56.428583  6030 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 7208)
I20260709 13:16:56.453883  7331 raft_consensus.cc:1275] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Refusing update from remote peer efc9ee9e1d86480790fa83f6ad0c295c: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:16:56.476598  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:56.496217  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:16:56.485244 15841 consensus_queue.cc:1048] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
W20260709 13:16:56.500092  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:56.505693  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:56.538585  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 62472.6us
W20260709 13:16:56.539052  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:56.550136  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:56.559980  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:56.572227  7073 maintenance_manager.cc:643] P 50ff9c56d8414bdb8f05f31957b53075: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 1.044s	user 0.088s	sys 0.053s Metrics: {"cfile_cache_miss":7,"cfile_cache_miss_bytes":27219,"cfile_init":3,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":78533,"dirs.run_cpu_time_us":985,"dirs.run_wall_time_us":7849,"lbm_read_time_us":1963,"lbm_reads_lt_1ms":19,"lbm_write_time_us":10589,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":10,"peak_mem_usage":303342,"reinsert_count":0,"thread_start_us":87636,"threads_started":2,"update_count":289}
W20260709 13:16:56.575647  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 96204.4us
W20260709 13:16:56.621574  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:56.663352  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:56.826426  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:56.850224  7302 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111) [suppressed 446 similar messages]
W20260709 13:16:56.966975  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:57.027642  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:57.096330  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:57.164026  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:57.217528  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.255776  7072 catalog_manager.cc:4755] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c89d6774062049379248eca324d137c6: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:16:57.256982  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:16:57.267263 15840 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.267949 15840 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:57.270262 15840 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:57.278211  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:16:57.278992  7890 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 25.
I20260709 13:16:57.280857  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:57.281734 15840 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:16:57.282140 15840 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.282491 15840 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:57.293175 15840 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:16:57.296757  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429"
I20260709 13:16:57.297401  7895 raft_consensus.cc:3060] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:16:57.309540  7895 raft_consensus.cc:2468] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c85cf49c63cc4e66b4747d8c4fa14022 in term 26.
I20260709 13:16:57.310998  7299 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022; no voters: 
I20260709 13:16:57.313746 15862 raft_consensus.cc:2804] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:16:57.314337 15862 raft_consensus.cc:697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Becoming Leader. State: Replica: c85cf49c63cc4e66b4747d8c4fa14022, State: Running, Role: LEADER
I20260709 13:16:57.316339 15840 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: Requested vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:16:57.315271 15862 consensus_queue.cc:237] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:16:57.311489  7302 leader_election.cc:336] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:16:57.417543  7079 catalog_manager.cc:5697] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 reported cstate change: term changed from 24 to 26, leader changed from 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129) to c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131). New cstate: current_term: 26 leader_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:57.429298  6030 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 7208)
W20260709 13:16:57.457770  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:57.467074  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:57.469026  7302 leader_election.cc:336] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:16:57.545833  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:57.548204  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:57.625240  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:57.638018  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:57.765017  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:16:57.873078  7890 raft_consensus.cc:1275] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Refusing update from remote peer c85cf49c63cc4e66b4747d8c4fa14022: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:16:57.874807 15862 consensus_queue.cc:1048] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:16:57.891404  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:57.905308  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.047260  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.130857  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.149629  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.170442  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.196708  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:58.214007  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.287266  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.312003  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.339973  7072 catalog_manager.cc:4755] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c89d6774062049379248eca324d137c6: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:16:58.357081  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 97757.7us
W20260709 13:16:58.390683  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.429842  6030 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 7208)
W20260709 13:16:58.425091  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.435834  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.456473  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.504668  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.533921  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.544458  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.548533  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.557976  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.584323  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.603987  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:58.678958  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.710983  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.816326  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:58.839105  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.876296  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.908811  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.914695  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.963378  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:58.978065  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:58.998689  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:59.096321  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:59.138293  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:59.154700  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:16:59.370694  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 45366.6us
W20260709 13:16:59.401273  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:59.434306  6030 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 7208)
W20260709 13:16:59.590776  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63947.7us
W20260709 13:16:59.618175  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:59.636490  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:59.703555  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:59.739614  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:16:59.805889  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:16:59.816814  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.019532  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:00.210841  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 85372.2us
W20260709 13:17:00.393857  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.426354  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:00.426906  7301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.006s	sys 0.012s
W20260709 13:17:00.442061  6030 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:00.445873  7301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.006s	sys 0.013s
W20260709 13:17:00.470597  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 44307.9us
W20260709 13:17:00.474059  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:00.499850  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.532183  7072 catalog_manager.cc:4755] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c89d6774062049379248eca324d137c6: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:00.667537  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:00.681777  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:00.717252  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:00.727322  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:00.865846  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:00.870682  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.023834  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:01.055356  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.068575  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.078411  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.119938  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.154084  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.193382  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.249262  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:01.311723  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.312388  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.362787  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.368414  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.373193  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:01.444280  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:01.446382  6030 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:01.465356  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.477342  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.509202  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:01.545037  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:01.553234  7357 debug-util.cc:398] Leaking SignalData structure 0x7b08001a1180 after lost signal to thread 6033
W20260709 13:17:01.555317  7357 debug-util.cc:398] Leaking SignalData structure 0x7b0800334320 after lost signal to thread 7119
W20260709 13:17:01.557168  7357 debug-util.cc:398] Leaking SignalData structure 0x7b08001ed0a0 after lost signal to thread 7286
W20260709 13:17:01.568198  7357 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2100 after lost signal to thread 7360
W20260709 13:17:01.584187  7357 debug-util.cc:398] Leaking SignalData structure 0x7b080026e840 after lost signal to thread 7920
W20260709 13:17:01.617132  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.737277  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:01.867074  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:01.879076  7302 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111) [suppressed 430 similar messages]
W20260709 13:17:01.903824  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:01.906903  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:02.108265  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:02.154872  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46678.7us
W20260709 13:17:02.169747  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.222455  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46238.1us
W20260709 13:17:02.363263  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.393900  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.446013  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.446949  6030 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:02.661365  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 60425.4us
W20260709 13:17:02.680984  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 62419.3us
W20260709 13:17:02.814478  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 83221us
W20260709 13:17:02.821988  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:02.853261  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.859755  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.883195  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:02.891161  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:02.895308  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.914258  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.916352  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.944128  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:02.968604  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.091259  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.133498  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.155169  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:03.174952  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:03.340472  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.341549  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:03.474058  6030 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:03.514058  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.535168  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:03.566207  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:03.591449  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:03.599709  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:03.632591  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:03.663843  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:03.799822  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.841389  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:03.896267  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:04.033432  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:04.065922  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:04.085572  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:04.119283  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:04.119982  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:04.160127  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:04.164745  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:04.199355  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:04.220688  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:04.287854  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:04.300799  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:04.387637  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:04.460150  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.474705  6030 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:04.488095  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:04.505445  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:04.542445  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:04.548250  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:04.631210  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:04.687335  7072 catalog_manager.cc:4755] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c89d6774062049379248eca324d137c6: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:04.772910  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:04.789907  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:04.890692  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:04.912182  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.114744  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.255302  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.262809  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.402772  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.408455  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.480010  6030 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:05.480861  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:05.488775  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:05.505613  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.554975  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:05.568794  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.574033  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.582360  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:05.617901  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.751821  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.797857  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:05.864765  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:05.887241  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:05.917685  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:05.999727  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.028622  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.033746  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.145903  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.262871  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.390358  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.401963  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:06.442931  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.460001  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.480532  6030 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:06.523752  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.592679  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:06.621822  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:06.626917  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.691821  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.718544  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.732499  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.769743  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:06.777591  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.812637  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:06.833840  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:06.882423  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:06.883232  7228 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111) [suppressed 465 similar messages]
W20260709 13:17:06.937371  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:06.982517  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:07.181787  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:07.245771  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:07.247088  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:07.285506  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:07.481140  6030 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:07.501559  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:07.688163  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:07.713549  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:07.726975  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:07.782331  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:07.835973  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:07.957430  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:08.144845  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:08.185739  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:08.367244  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:08.423710  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:08.481745  6030 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:08.704999  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:08.796972  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:08.801898  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:08.836984  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 107641us
W20260709 13:17:08.839836  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.854547  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.859958  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.867921  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.876444  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.879123  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.881453  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.884845  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.902614  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:08.949101  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:08.980978  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:09.033102  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:09.034845  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:09.035036  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:09.054991  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:09.097329  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:09.178025  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:09.266327  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.270753  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:09.356287  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:09.408301  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:09.422180  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:09.423048  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 83524.5us
W20260709 13:17:09.455947  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:09.480573  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:09.482367  6030 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:09.513006  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:09.545430  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:09.575645  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:09.635121  7357 debug-util.cc:398] Leaking SignalData structure 0x7b0800251b40 after lost signal to thread 6033
W20260709 13:17:09.637034  7357 debug-util.cc:398] Leaking SignalData structure 0x7b080031c7e0 after lost signal to thread 7119
W20260709 13:17:09.639091  7357 debug-util.cc:398] Leaking SignalData structure 0x7b08002befa0 after lost signal to thread 7286
W20260709 13:17:09.640763  7357 debug-util.cc:398] Leaking SignalData structure 0x7b08001e64e0 after lost signal to thread 7360
W20260709 13:17:09.642501  7357 debug-util.cc:398] Leaking SignalData structure 0x7b080010a920 after lost signal to thread 7920
W20260709 13:17:09.663673  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:09.882575  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:10.083820  7299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 71206.7us
W20260709 13:17:10.216867  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:10.240001  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:10.304436  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:10.305332  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:10.392482  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:10.394670  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 60077.3us
W20260709 13:17:10.490878  6030 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:10.569728  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:10.584298  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.649081  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.726275  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:10.726904  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:10.727447  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:10.781584  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:10.939484  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 68052us
W20260709 13:17:11.038144  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:11.047631  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:11.124159  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:11.137950  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 67735.6us
W20260709 13:17:11.218803  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:11.219656  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:11.243619  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.246649  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.260144  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.261098  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.262079  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.262709  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.287030  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.338042  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.380906  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:11.386134  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:11.457050  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:11.481997  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:11.491499  6030 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:11.497722  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.537382  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:11.552397  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:11.635283  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:11.639870  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:11.763578  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:11.804348  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:11.814541  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:11.851133  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:11.884127  7862 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111) [suppressed 437 similar messages]
W20260709 13:17:11.938097  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:12.034343  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:12.044397  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:12.119553  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:12.147265  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:12.199188  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:12.247076  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:12.273200  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.272500  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:12.492619  6030 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:12.528518  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:12.718858  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 63258.6us
W20260709 13:17:12.757263  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:12.759743  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:12.766949  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:12.786594  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:12.865746  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:12.943970  7072 catalog_manager.cc:4755] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c89d6774062049379248eca324d137c6: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:12.994010  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:13.123809  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:13.177687  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:13.229267  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:13.246534  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:13.247299  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:13.345283  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:13.354231  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:13.367295  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:13.493472  6030 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:13.604601  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:13.716095  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:13.746770  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:13.764613  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:13.846122  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:13.900801  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:13.907744  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:13.911080  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:13.918401  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.060676  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:14.070783  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:14.257742  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.264145  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.276593  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:14.302181  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:14.316550  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:14.361382  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:14.362531  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:14.363561  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.364130  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:14.368515  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.399760  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:14.418895  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.494547  6030 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:14.506304  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:14.565896  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.661540  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:14.685086  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:39125, user_credentials={real_user=slave}} blocked reactor thread for 56857.1us
W20260709 13:17:14.728569  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 67108.6us
W20260709 13:17:14.735744  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:14.770792  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:14.809886  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:14.843346  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:14.844309  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:14.864993  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:15.495208  6030 thread.cc:527] Waited for 21000ms trying to join with diag-logger (tid 7208)
I20260709 13:17:15.987453 16001 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:15.988902 16001 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:15.993685 16001 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:15.996637  7261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55506 (request call id 5488) took 1044 ms. Trace:
I20260709 13:17:15.997323  7261 rpcz_store.cc:276] 0709 13:17:14.952093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.994934 (+1042841us) service_pool.cc:224] Handling call
0709 13:17:15.995343 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.995530 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:15.995583 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:15.995626 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:15.995673 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.995735 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:15.995878 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:16.000577 16001 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:16.001540 16001 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:16.004140 16001 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:16.006337 16002 raft_consensus.cc:493] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:16.007171 16002 raft_consensus.cc:515] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:16.014384  7260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c50740d1144c09a074230835085663" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:17:16.013537 16002 leader_election.cc:290] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:16.021344  7259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e247e49279304bdfa2f0146e714dc287" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:17:16.023540  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e0840e609849f8bd379d43569463c8" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:17:16.042246 16003 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:16.042920 16003 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:16.045092 16003 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:16.056521 16000 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:16.056708  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffda2d3bf0b4684a675dae01ebe1c35" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:17:16.057274 16000 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:16.061188 16000 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:16.069657  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5584200aff994405b2de3e35528fb3cd" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:17:16.071727 15999 raft_consensus.cc:493] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:17:16.073726 15999 raft_consensus.cc:515] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.082053 16001 raft_consensus.cc:493] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:17:16.082929 16001 raft_consensus.cc:515] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.089751  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:17:16.090385  7256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:17:16.097719 16008 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:16.094497 16001 leader_election.cc:290] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:17:16.098443 16008 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.121480 16008 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:16.127558 16006 raft_consensus.cc:493] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:16.134003 16006 raft_consensus.cc:515] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.143256 16005 raft_consensus.cc:493] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:16.143893 16005 raft_consensus.cc:515] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.146355 16005 leader_election.cc:290] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:16.139783 16006 leader_election.cc:290] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:16.160738 16006 raft_consensus.cc:493] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:16.172297 16006 raft_consensus.cc:515] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.174598 16006 leader_election.cc:290] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:16.175629  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:17:16.176761 15999 leader_election.cc:290] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:17:16.185405 16011 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:16.186213 16011 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.198227 16011 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:16.198537 15999 raft_consensus.cc:493] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:17:16.199272 15999 raft_consensus.cc:515] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.201702 15999 leader_election.cc:290] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:17:16.208588  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 103211us
I20260709 13:17:16.209647  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:17:16.224856  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 76850us
I20260709 13:17:16.231364 16009 raft_consensus.cc:493] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:16.232131 16009 raft_consensus.cc:515] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.271502 16009 leader_election.cc:290] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
W20260709 13:17:16.275949  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 114188us
I20260709 13:17:16.282166  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242a63190870450082200759c7f513ab" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:17:16.282495  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984a0b52728d43fb97379422fa55491d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:17:16.283830 16009 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:16.284586  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d6774062049379248eca324d137c6" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:17:16.284513 16009 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.285514  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4278a1ff7e0c4ce4a86d4e7b748f9557" candidate_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:17:16.274729 16008 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:16.295771 16008 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.299121 16009 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:16.299151 16017 raft_consensus.cc:493] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:16.301491 16015 raft_consensus.cc:493] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:16.298471 16008 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:16.300442 16017 raft_consensus.cc:515] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.302286 16015 raft_consensus.cc:515] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:16.304745 16017 leader_election.cc:290] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:17:16.307425 16015 leader_election.cc:290] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:16.310743  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba8ab4b505c46299ab836854622094b" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:17:16.311643  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:17:16.312481  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:17:16.320482  7333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b1df9cb24b4dc88a4735a646ad8575" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:17:16.321548  7328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:17:16.321955  7335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:17:16.323331  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:17:16.324753  7336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7edd6d1f1343c1868f27ecb9a9ae9d" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
W20260709 13:17:16.326783  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 107318us
I20260709 13:17:16.336840  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fac6ca4a1b42d1b629b7a5b1e5e6ee" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:17:16.339519  7862 leader_election.cc:336] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:16.345525  7862 leader_election.cc:336] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:16.346103  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:17:16.346266  7299 leader_election.cc:304] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:17:16.346891  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:17:16.347787  7299 leader_election.cc:304] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:16.350435 15998 raft_consensus.cc:2749] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:17:16.350579  7299 leader_election.cc:304] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 9a54ecc9fb4541df915f9f8c01e19429, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:16.348834 16000 raft_consensus.cc:2749] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:17:16.351763 16000 raft_consensus.cc:2749] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:16.365903  7859 leader_election.cc:304] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:17:16.369861  7859 leader_election.cc:304] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:17:16.378827 16017 raft_consensus.cc:493] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:16.379284 16008 raft_consensus.cc:2749] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:17:16.379575 16017 raft_consensus.cc:515] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:16.381587  7861 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:16.382097 16017 leader_election.cc:290] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:16.368253 16018 raft_consensus.cc:2749] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:17:16.382354  7225 leader_election.cc:304] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 9a54ecc9fb4541df915f9f8c01e19429, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:17:16.384148 15997 raft_consensus.cc:2749] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:17:16.386339  7862 leader_election.cc:336] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.386929  7862 leader_election.cc:304] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:17:16.387925  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab82ab5b0c4442cd8a05ee133017c2e0" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:17:16.403618 16009 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:17:16.404840  7862 leader_election.cc:336] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:16.405452  7862 leader_election.cc:336] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.408313 16008 raft_consensus.cc:2749] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:16.417882  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f19c97414f4b0c9f9e2ed509ee22d1" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
W20260709 13:17:16.419849  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:17:16.420481  7254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c394fe784e4244b68716ee824f271f" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:17:16.420912  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6277156300462b934adab718a32e44" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:17:16.423353  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7dc72492fc64c638202c7715a2a72ac" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:17:16.425503  7253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd122c1cdfa84f8ea52721a14c58c4e2" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" is_pre_election: true
I20260709 13:17:16.425776  7861 leader_election.cc:304] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:17:16.424806  7302 leader_election.cc:336] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.426817  7302 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:16.427850 15999 raft_consensus.cc:2749] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:17:16.428498  7302 leader_election.cc:336] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.428967  7302 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:16.429579 16018 raft_consensus.cc:2749] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:17:16.429925 16004 raft_consensus.cc:2749] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:17:16.430126  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:16.430738  7302 leader_election.cc:336] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.431120  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:16.431137  7302 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:16.433359 16004 raft_consensus.cc:2749] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:17:16.434612  7302 leader_election.cc:336] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.435155  7302 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:16.436151 16004 raft_consensus.cc:2749] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:17:16.438876 16018 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:17:16.441119  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:16.442037 16018 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:16.444504 16016 raft_consensus.cc:493] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:17:16.449697 16016 raft_consensus.cc:515] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.442499  7861 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:16.443500 16017 raft_consensus.cc:493] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:17:16.454097  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4d64ffd0f4bed80982e942f1033c3" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 30 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:17:16.454610 16017 raft_consensus.cc:515] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.457329 16017 leader_election.cc:290] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
W20260709 13:17:16.453040  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 55507.9us
I20260709 13:17:16.453811 16016 leader_election.cc:290] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:17:16.460050  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db390910c47342dc848e258ef7dac1bd" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
I20260709 13:17:16.446527 15997 raft_consensus.cc:493] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9a54ecc9fb4541df915f9f8c01e19429)
I20260709 13:17:16.461524 15997 raft_consensus.cc:515] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.464262 15997 leader_election.cc:290] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), 9a54ecc9fb4541df915f9f8c01e19429 (127.5.227.132:39125)
I20260709 13:17:16.464818 16018 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:16.466351  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8df49b022aa74a6481683d10c4fcc035" candidate_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9a54ecc9fb4541df915f9f8c01e19429" is_pre_election: true
W20260709 13:17:16.473635  7228 leader_election.cc:336] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.474149  7228 leader_election.cc:304] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:17:16.478083 16018 raft_consensus.cc:493] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:16.478844 16018 raft_consensus.cc:515] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:16.481333 16018 leader_election.cc:290] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:16.482422  7331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4a2f06cbc44402ae7754d23798eaff" candidate_uuid: "9a54ecc9fb4541df915f9f8c01e19429" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" is_pre_election: true
I20260709 13:17:16.482913 15997 raft_consensus.cc:2749] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:17:16.489884  7228 leader_election.cc:336] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:16.491725  7862 leader_election.cc:336] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.492259  7862 leader_election.cc:304] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:17:16.493569 16018 raft_consensus.cc:2749] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:17:16.495899  6030 thread.cc:527] Waited for 22000ms trying to join with diag-logger (tid 7208)
I20260709 13:17:16.490469  7228 leader_election.cc:304] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:17:16.502883 15997 raft_consensus.cc:2749] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:17:16.506044  7228 leader_election.cc:336] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.506682  7228 leader_election.cc:304] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:17:16.510569 16017 raft_consensus.cc:2749] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:17:16.511094  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.513499  7228 leader_election.cc:336] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.513985  7228 leader_election.cc:304] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:17:16.514927 16017 raft_consensus.cc:2749] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:17:16.515185  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:16.520684  7228 leader_election.cc:336] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.521358  7228 leader_election.cc:304] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:17:16.522315 16017 raft_consensus.cc:2749] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:17:16.535732  7228 leader_election.cc:336] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:16.536417  7228 leader_election.cc:304] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efc9ee9e1d86480790fa83f6ad0c295c; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, 9a54ecc9fb4541df915f9f8c01e19429
I20260709 13:17:16.537302 16017 raft_consensus.cc:2749] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:17:16.552629  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.562315  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:16.597836  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.693905  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:16.733702  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:16.835358  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:16.889463  7302 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111) [suppressed 384 similar messages]
W20260709 13:17:16.961115  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08003c02a0 after lost signal to thread 6033
W20260709 13:17:16.962538  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0100 after lost signal to thread 7119
W20260709 13:17:16.964139  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3b20 after lost signal to thread 7286
W20260709 13:17:16.965395  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5560 after lost signal to thread 7360
W20260709 13:17:16.992540  7917 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5a20 after lost signal to thread 7920
W20260709 13:17:17.057133  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:17.152627  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.155020  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.165887  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:17.167127  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.204433  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:17.226338  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:17.283680  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:17.312734  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.396986  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.497954  6030 thread.cc:527] Waited for 23000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:17.510654  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:17.587625  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:17.588812  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:17.728085  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:17.738296  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.775906  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.778908  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:17.780941  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.801193  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:17.863430  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:17.906222  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.914788  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:17.950699  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.990190  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:18.010191  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:18.015095  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:18.047180  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:18.123499  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 76384us
W20260709 13:17:18.179864  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:18.217485  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:18.232110  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:18.263732  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:18.276930  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:18.507156  6030 thread.cc:527] Waited for 24000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:18.579859  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:18.594115  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:18.652786  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:18.653424  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:18.797722  7301 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 50450.1us
W20260709 13:17:18.843566  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 225106us
W20260709 13:17:18.855232  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:18.871165  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:18.875707  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:18.887863  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:18.887804  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:18.952461  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:18.998329  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:19.009544  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:19.081872  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:19.146056  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:19.187008  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:19.233297  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:19.294836  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:19.508190  6030 thread.cc:527] Waited for 25000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:19.617856  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:19.654875  7283 debug-util.cc:398] Leaking SignalData structure 0x7b0800312900 after lost signal to thread 6033
W20260709 13:17:19.664197  7283 debug-util.cc:398] Leaking SignalData structure 0x7b08003411e0 after lost signal to thread 7119
W20260709 13:17:19.666427  7283 debug-util.cc:398] Leaking SignalData structure 0x7b080009d220 after lost signal to thread 7286
W20260709 13:17:19.675002  7283 debug-util.cc:398] Leaking SignalData structure 0x7b08001a53e0 after lost signal to thread 7360
W20260709 13:17:19.718879  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:19.720027  7283 debug-util.cc:398] Leaking SignalData structure 0x7b08002659c0 after lost signal to thread 7920
W20260709 13:17:19.743513  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 49371.6us
W20260709 13:17:19.748589  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:19.754575  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:19.867673  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:19.887172  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:19.925266  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:19.953177  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:19.993777  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:20.160192  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:20.236207  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:20.256798  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:20.379317  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:20.380239  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:20.403539  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:20.466977  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:20.483762  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:20.495601  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:20.496057  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:20.509176  6030 thread.cc:527] Waited for 26000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:20.532121  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:20.560732  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:20.561326  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:20.568782  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:20.576180  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:20.592599  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:20.623747  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:20.648890  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:20.668087  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:20.721743  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:20.854537  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:21.433732  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:21.434751  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:21.449826  7862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 432244us
W20260709 13:17:21.509785  6030 thread.cc:527] Waited for 27000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:21.588016  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:40351, user_credentials={real_user=slave}} blocked reactor thread for 123868us
W20260709 13:17:21.607652  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 107272us
W20260709 13:17:21.631152  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:21.632675  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:21.633304  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:21.706007  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:21.733209  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:21.752760  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:21.758535  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:21.761344  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:21.762753  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:21.792606  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:21.893748  7228 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111) [suppressed 444 similar messages]
W20260709 13:17:21.974134  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:22.054525  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:22.194867  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:22.220507  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:22.221135  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:22.228392  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:22.229017  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:22.242897  7116 debug-util.cc:398] Leaking SignalData structure 0x7b080000b6c0 after lost signal to thread 6033
W20260709 13:17:22.244163  7116 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3740 after lost signal to thread 7119
W20260709 13:17:22.245656  7116 debug-util.cc:398] Leaking SignalData structure 0x7b080033a0a0 after lost signal to thread 7286
W20260709 13:17:22.246981  7116 debug-util.cc:398] Leaking SignalData structure 0x7b0800109ee0 after lost signal to thread 7360
W20260709 13:17:22.248355  7116 debug-util.cc:398] Leaking SignalData structure 0x7b08003150c0 after lost signal to thread 7920
W20260709 13:17:22.376259  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:22.376976  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:22.451517  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:22.480814  7225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:35093, user_credentials={real_user=slave}} blocked reactor thread for 72295.1us
W20260709 13:17:22.520145  6030 thread.cc:527] Waited for 28000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:22.549649  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:22.640216  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:22.826725  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:22.835426  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:22.866457  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:22.921712  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:22.940865  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:23.037854  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:23.054955  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:23.070990  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:23.125638  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:23.167348  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:23.188268  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:23.197427  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:23.225831  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:23.275643  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:23.363601  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:23.455513  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:23.513041  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:23.531646  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:23.545703  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:23.559055  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:23.588393  6030 thread.cc:527] Waited for 29000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:23.692368  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:23.767109  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:23.768059  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:23.784025  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:23.785948  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:23.799270  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:23.813989  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:24.009739  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:24.035351  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:24.139804  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:24.198127  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:24.212455  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:24.246346  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:24.296803  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:24.402060  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:24.445516  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:24.452857  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:24.493547  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:24.506871  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:24.512993  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:24.589421  6030 thread.cc:527] Waited for 30000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:24.664490  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:24.716969  7302 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 52498.4us
W20260709 13:17:24.720022  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:24.763677  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:24.822201  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:25.161893  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:25.167074  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:25.189453  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:25.197661  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:25.253558  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:25.331378  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:25.466982  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:25.467665  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:25.479826  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:25.480544  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:25.495635  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:25.590020  6030 thread.cc:527] Waited for 31000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:25.658934  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:25.672487  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:25.740171  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:25.832212  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:25.869091  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:25.869506  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:25.884922  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:25.897486  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:25.938489  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:25.991462  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:26.017138  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:26.017911  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260709 13:17:26.114880  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260709 13:17:26.123317  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:26.127179  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:26.286441  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:26.329473  7228 consensus_peers.cc:597] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:26.403177  7228 consensus_peers.cc:597] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:26.567574  7228 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:44171, user_credentials={real_user=slave}} blocked reactor thread for 46537.3us
W20260709 13:17:26.590535  6030 thread.cc:527] Waited for 32000ms trying to join with diag-logger (tid 7208)
W20260709 13:17:26.613245  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:26.633005  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260709 13:17:26.639796  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260709 13:17:26.712347  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:26.765750  7228 consensus_peers.cc:597] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:26.800143  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:26.881067  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:26.900298  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:26.901171  7302 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111) [suppressed 466 similar messages]
W20260709 13:17:26.905004  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:26.944928  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260709 13:17:27.053787  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:27.072657  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:27.073439  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:27.120703  7228 consensus_peers.cc:597] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:27.202416  7228 consensus_peers.cc:597] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:27.334565  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:27.357771  7228 consensus_peers.cc:597] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:27.398901  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:27.411006  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:27.568197  7302 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:27.572978  7302 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:27.587240  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:27.934264  7228 consensus_peers.cc:597] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:27.969924  7228 consensus_peers.cc:597] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:27.977914  7302 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:27.988269  7302 consensus_peers.cc:597] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:17:28.062704  6030 tablet_server.cc:196] TabletServer@127.5.227.129:0 shutdown complete.
W20260709 13:17:28.100999  7228 consensus_peers.cc:597] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:28.244380  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:28.281580  7302 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:28.300897  7302 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:28.299206  7228 consensus_peers.cc:597] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:28.307847  7228 consensus_peers.cc:597] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:17:28.292088  6030 tablet_server.cc:179] TabletServer@127.5.227.130:0 shutting down...
W20260709 13:17:28.322160  7302 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:28.332521  7301 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.363170  7302 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:28.370728  7301 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.371315  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260709 13:17:28.372824  7301 consensus_peers.cc:597] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.379761  7302 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:17:28.380753  7302 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:28.384454  7228 consensus_peers.cc:597] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:28.388073  7861 consensus_peers.cc:597] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.391117  7301 consensus_peers.cc:597] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.395113  7301 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.397523  7861 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.400180  7301 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.406047  7861 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.425038  7301 consensus_peers.cc:597] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.433001  7301 consensus_peers.cc:597] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.439543  7861 consensus_peers.cc:597] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.440634  7861 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.441403  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260709 13:17:28.456820  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:17:28.462492  7861 consensus_peers.cc:597] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.458786  7301 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.465140  7861 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.465924  6030 tablet_replica.cc:333] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.467650  6030 raft_consensus.cc:2243] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.469657  6030 raft_consensus.cc:2272] T 1d6277156300462b934adab718a32e44 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.473244  6030 tablet_replica.cc:333] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
W20260709 13:17:28.475490  7301 consensus_peers.cc:597] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.476368  7301 consensus_peers.cc:597] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.476922  6030 raft_consensus.cc:2243] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.478417  6030 raft_consensus.cc:2272] T d6f19c97414f4b0c9f9e2ed509ee22d1 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.480208  7861 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.482410  7301 consensus_peers.cc:597] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.483278  7301 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.483522  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
I20260709 13:17:28.485864  6030 tablet_replica.cc:333] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.487048  6030 raft_consensus.cc:2243] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.488008  6030 raft_consensus.cc:2272] T 984a0b52728d43fb97379422fa55491d P efc9ee9e1d86480790fa83f6ad0c295c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.491605  6030 tablet_replica.cc:333] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.493971  6030 raft_consensus.cc:2243] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.498986  6030 raft_consensus.cc:2272] T 75c50740d1144c09a074230835085663 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.503705  6030 tablet_replica.cc:333] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.505409  6030 raft_consensus.cc:2243] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.506426  6030 raft_consensus.cc:2272] T 39cd4b2ac236480091e1c72b42541e94 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.509750  6030 tablet_replica.cc:333] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.511271  6030 raft_consensus.cc:2243] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.513732  6030 raft_consensus.cc:2272] T edb4d64ffd0f4bed80982e942f1033c3 P efc9ee9e1d86480790fa83f6ad0c295c [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.518148  6030 tablet_replica.cc:333] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.519256  6030 raft_consensus.cc:2243] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.520175  6030 raft_consensus.cc:2272] T 50a190f80864482f8c9dfc9a627c1d6d P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.521181  7302 consensus_peers.cc:597] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:17:28.524533  6030 tablet_replica.cc:333] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.525640  6030 raft_consensus.cc:2243] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.526583  6030 raft_consensus.cc:2272] T 4039a3dd715849edb6b8786f89e1a1b3 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.527851  7301 consensus_peers.cc:597] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.530134  6030 tablet_replica.cc:333] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.531211  6030 raft_consensus.cc:2243] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.531961  6030 raft_consensus.cc:2272] T 2486da35b1ff416a9879e8c0588f1db9 P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.534807  7302 consensus_peers.cc:597] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:17:28.535432  6030 tablet_replica.cc:333] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
W20260709 13:17:28.537747  7301 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.538838  6030 raft_consensus.cc:2243] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.539870  6030 raft_consensus.cc:2272] T 3106224ab6d746898c7fb52a0788256d P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.542165  7301 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.542900  6030 tablet_replica.cc:333] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.543701  6030 raft_consensus.cc:2243] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.544418  6030 raft_consensus.cc:2272] T cb0912958bd849238a8f104a7916c427 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.548862  6030 tablet_replica.cc:333] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.549821  6030 raft_consensus.cc:2243] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 LEADER]: Raft consensus shutting down.
W20260709 13:17:28.551218  7861 consensus_peers.cc:597] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.552814  6030 raft_consensus.cc:2272] T 8ffda2d3bf0b4684a675dae01ebe1c35 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.556509  6030 tablet_replica.cc:333] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.557526  6030 raft_consensus.cc:2243] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.558396  6030 raft_consensus.cc:2272] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.561956  6030 tablet_replica.cc:333] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.563007  6030 raft_consensus.cc:2243] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:28.564551  7861 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.564877  6030 raft_consensus.cc:2272] T ad4f3c0328924ddaba5d93fe80e78a64 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.567905  6030 tablet_replica.cc:333] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.569051  6030 raft_consensus.cc:2243] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.570242  6030 raft_consensus.cc:2272] T 4d9487fc89de4e68b395c4a70193c3b6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.574859  6030 tablet_replica.cc:333] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.575603  6030 raft_consensus.cc:2243] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.576289  6030 raft_consensus.cc:2272] T 242a63190870450082200759c7f513ab P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.578943  6030 tablet_replica.cc:333] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.579665  6030 raft_consensus.cc:2243] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.581053  6030 raft_consensus.cc:2272] T 5626b16aa2aa438290520c1b9b979802 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.584221  6030 tablet_replica.cc:333] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.585253  6030 raft_consensus.cc:2243] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.586037  6030 raft_consensus.cc:2272] T 4aa9c7bddd6f49acad7c47c33c761358 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.590065  6030 tablet_replica.cc:333] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.591084  6030 raft_consensus.cc:2243] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.592636  6030 raft_consensus.cc:2272] T dd122c1cdfa84f8ea52721a14c58c4e2 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.596035  6030 tablet_replica.cc:333] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.597060  6030 raft_consensus.cc:2243] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.598721  6030 raft_consensus.cc:2272] T 90c9778e4f484bb7ab035094ae2c24c9 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.601701  6030 tablet_replica.cc:333] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.602581  6030 raft_consensus.cc:2243] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.603255  6030 raft_consensus.cc:2272] T 06475a21ebc249129fc41345c177538a P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.606107  6030 tablet_replica.cc:333] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.607059  6030 raft_consensus.cc:2243] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.608493  6030 raft_consensus.cc:2272] T de90ec51ea634c3d8b220c16d71b8cdf P efc9ee9e1d86480790fa83f6ad0c295c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.611650  6030 tablet_replica.cc:333] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.612484  6030 raft_consensus.cc:2243] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.613897  6030 raft_consensus.cc:2272] T 3cb8aa5713ef402a91f009eb4f97885e P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.616694  6030 tablet_replica.cc:333] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.617483  6030 raft_consensus.cc:2243] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.618096  6030 raft_consensus.cc:2272] T cb3d8971d9be4ed09286c9b433d050b2 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.620826  6030 tablet_replica.cc:333] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.621567  6030 raft_consensus.cc:2243] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.622263  6030 raft_consensus.cc:2272] T 458ab76409d4427f8ab55d4d71ca5799 P efc9ee9e1d86480790fa83f6ad0c295c [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.625526  6030 tablet_replica.cc:333] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.626487  6030 raft_consensus.cc:2243] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.627754  6030 raft_consensus.cc:2272] T 5584200aff994405b2de3e35528fb3cd P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.629559  7301 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.630956  6030 tablet_replica.cc:333] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.631898  6030 raft_consensus.cc:2243] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.632684  6030 raft_consensus.cc:2272] T d735c64b62484486814db631ca028bdb P efc9ee9e1d86480790fa83f6ad0c295c [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.635731  6030 tablet_replica.cc:333] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.636385  6030 raft_consensus.cc:2243] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.637579  6030 raft_consensus.cc:2272] T a4c394fe784e4244b68716ee824f271f P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.638654  7302 consensus_peers.cc:597] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:28.639869  7301 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.640614  6030 tablet_replica.cc:333] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.641294  6030 raft_consensus.cc:2243] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.641837  6030 raft_consensus.cc:2272] T 788b854112d74649a8e966f1fe824f3f P efc9ee9e1d86480790fa83f6ad0c295c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.644269  6030 tablet_replica.cc:333] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.644873  6030 raft_consensus.cc:2243] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.646178  6030 raft_consensus.cc:2272] T f7dc72492fc64c638202c7715a2a72ac P efc9ee9e1d86480790fa83f6ad0c295c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.649349  6030 tablet_replica.cc:333] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.650004  6030 raft_consensus.cc:2243] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.650575  6030 raft_consensus.cc:2272] T 4637971bd855417fac5632325ab8f119 P efc9ee9e1d86480790fa83f6ad0c295c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.654078  6030 tablet_replica.cc:333] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.655400  6030 raft_consensus.cc:2243] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.656325  6030 raft_consensus.cc:2272] T 7ddda14494534865a2d45ddae7f3ec93 P efc9ee9e1d86480790fa83f6ad0c295c [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.657989  7301 consensus_peers.cc:597] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.659693  7861 consensus_peers.cc:597] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.659984  6030 tablet_replica.cc:333] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.660749  6030 raft_consensus.cc:2243] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.661885  6030 raft_consensus.cc:2272] T 5920bb7e53034c2688b18dfe352590c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.664387  6030 tablet_replica.cc:333] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.665004  6030 raft_consensus.cc:2243] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.666074  6030 raft_consensus.cc:2272] T 296c0d2843ee4e21a7fdc0240b67a7cc P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.669351  6030 tablet_replica.cc:333] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.670161  6030 raft_consensus.cc:2243] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.670828  6030 raft_consensus.cc:2272] T b2278b8a74ae4c04882dae719a92af7d P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.670851  7301 consensus_peers.cc:597] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.673290  6030 tablet_replica.cc:333] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.673923  6030 raft_consensus.cc:2243] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.674605  6030 raft_consensus.cc:2272] T ab82ab5b0c4442cd8a05ee133017c2e0 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.677062  6030 tablet_replica.cc:333] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.677739  6030 raft_consensus.cc:2243] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.678996  6030 raft_consensus.cc:2272] T eac161a9db63471dbd87b41a92fe1202 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.680389  7301 consensus_peers.cc:597] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.681928  6030 tablet_replica.cc:333] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.682651  6030 raft_consensus.cc:2243] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.683471  6030 raft_consensus.cc:2272] T db390910c47342dc848e258ef7dac1bd P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.685981  6030 tablet_replica.cc:333] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.686965  6030 raft_consensus.cc:2243] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.687733  6030 raft_consensus.cc:2272] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.690946  6030 tablet_replica.cc:333] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.691772  6030 raft_consensus.cc:2243] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.692688  6030 raft_consensus.cc:2272] T c89d6774062049379248eca324d137c6 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.695775  6030 tablet_replica.cc:333] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.696683  6030 raft_consensus.cc:2243] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.697425  6030 raft_consensus.cc:2272] T 221fa6fca3154a49b5efa9c28f8c4cd8 P efc9ee9e1d86480790fa83f6ad0c295c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.700592  6030 tablet_replica.cc:333] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
W20260709 13:17:28.701179  7861 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:28.701438  6030 raft_consensus.cc:2243] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.702107  6030 raft_consensus.cc:2272] T b0eff9774a9c435d955814f903cb2401 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.705394  6030 tablet_replica.cc:333] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.706384  6030 raft_consensus.cc:2243] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.709192  6030 raft_consensus.cc:2272] T be83b72d4b17414e8521b6707cd8a597 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.710501  7302 consensus_peers.cc:597] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:17:28.712886  6030 tablet_replica.cc:333] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.713948  6030 raft_consensus.cc:2243] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.714768  6030 raft_consensus.cc:2272] T d8d111efe5ab4e9cad378e4ebfdeb996 P efc9ee9e1d86480790fa83f6ad0c295c [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.716351  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260709 13:17:28.718456  6030 tablet_replica.cc:333] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.719393  6030 raft_consensus.cc:2243] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.720117  6030 raft_consensus.cc:2272] T 71d8ccd854bc453397ebc79aefe1c520 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.723098  6030 tablet_replica.cc:333] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.723928  6030 raft_consensus.cc:2243] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.724568  6030 raft_consensus.cc:2272] T a893449156a24240bd4ed83fc67f85f6 P efc9ee9e1d86480790fa83f6ad0c295c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.727667  6030 tablet_replica.cc:333] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.728444  6030 raft_consensus.cc:2243] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:17:28.729784  6030 raft_consensus.cc:2272] T e247e49279304bdfa2f0146e714dc287 P efc9ee9e1d86480790fa83f6ad0c295c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.733227  6030 tablet_replica.cc:333] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.733948  6030 raft_consensus.cc:2243] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.734797  6030 raft_consensus.cc:2272] T 23e0840e609849f8bd379d43569463c8 P efc9ee9e1d86480790fa83f6ad0c295c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.737852  6030 tablet_replica.cc:333] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.738588  6030 raft_consensus.cc:2243] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.739729  6030 raft_consensus.cc:2272] T 9ba8ab4b505c46299ab836854622094b P efc9ee9e1d86480790fa83f6ad0c295c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:28.742897  6030 tablet_replica.cc:333] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c: stopping tablet replica
I20260709 13:17:28.743573  6030 raft_consensus.cc:2243] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:28.744747  6030 raft_consensus.cc:2272] T 8df49b022aa74a6481683d10c4fcc035 P efc9ee9e1d86480790fa83f6ad0c295c [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:28.754014  7301 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.800423  7301 consensus_peers.cc:597] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.816918  7301 consensus_peers.cc:597] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.884124  7301 connection.cc:769] client connection to 127.5.227.130:40351 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260709 13:17:28.930555  7301 consensus_peers.cc:597] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:28.991191  7302 consensus_peers.cc:597] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:29.065420  7862 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260709 13:17:29.098938  7302 consensus_peers.cc:597] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:29.109134  7302 consensus_peers.cc:597] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:29.257057  7302 consensus_peers.cc:597] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:29.277886  7862 consensus_peers.cc:597] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260709 13:17:29.293422  7862 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20260709 13:17:29.294872  7862 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:29.305688  7302 consensus_peers.cc:597] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:29.377090  7302 consensus_peers.cc:597] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:29.389369  7072 catalog_manager.cc:4755] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c89d6774062049379248eca324d137c6: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:29.412173  7302 consensus_peers.cc:597] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:17:29.605026  7302 consensus_peers.cc:597] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:29.628809  7302 consensus_peers.cc:597] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:17:29.634322  7302 consensus_peers.cc:597] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:17:29.637449 16086 raft_consensus.cc:493] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:29.638108 16086 raft_consensus.cc:515] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:29.640782 16086 leader_election.cc:290] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:29.643544 16086 raft_consensus.cc:493] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:29.644076 16086 raft_consensus.cc:515] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:29.645777 16086 leader_election.cc:290] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:17:29.646742  7302 leader_election.cc:336] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:29.653904  7302 leader_election.cc:336] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:29.680138  7302 consensus_peers.cc:597] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:17:29.705101  6030 tablet_server.cc:196] TabletServer@127.5.227.130:0 shutdown complete.
I20260709 13:17:29.713763 16083 raft_consensus.cc:493] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:29.714438 16083 raft_consensus.cc:515] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:29.718075 16083 leader_election.cc:290] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:17:29.721827  7302 leader_election.cc:336] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:29.738034  7302 consensus_peers.cc:597] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:17:29.763597 16079 raft_consensus.cc:493] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:29.764977 16079 raft_consensus.cc:515] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:17:29.774138  7861 leader_election.cc:336] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111)
I20260709 13:17:29.775132 16079 leader_election.cc:290] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:17:29.777365  7862 leader_election.cc:336] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:29.777966  7862 leader_election.cc:304] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:29.779150 16076 raft_consensus.cc:2749] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:29.815444 16083 raft_consensus.cc:493] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:29.816144 16083 raft_consensus.cc:515] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:29.819871 16079 raft_consensus.cc:493] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:29.820669 16083 leader_election.cc:290] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:29.820487 16079 raft_consensus.cc:515] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:17:29.825006  7302 leader_election.cc:336] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:29.825232 16079 leader_election.cc:290] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:17:29.827947  7862 leader_election.cc:336] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:29.829499  7861 leader_election.cc:336] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111)
I20260709 13:17:29.830037  7861 leader_election.cc:304] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:29.831050 16079 raft_consensus.cc:2749] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:29.882066  6030 tablet_server.cc:179] TabletServer@127.5.227.131:0 shutting down...
I20260709 13:17:29.910059 16079 raft_consensus.cc:493] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:29.910835 16079 raft_consensus.cc:515] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:29.913522 16079 leader_election.cc:290] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
W20260709 13:17:29.922432  7862 leader_election.cc:336] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:29.924926  7861 leader_election.cc:336] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111)
I20260709 13:17:29.926712  7861 leader_election.cc:304] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:29.927560 16079 raft_consensus.cc:2749] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:29.956488  7862 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:17:29.961514 16079 raft_consensus.cc:493] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:29.962121 16079 raft_consensus.cc:515] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
W20260709 13:17:29.969089  7859 leader_election.cc:336] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:29.969756 16079 leader_election.cc:290] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:29.976991 16083 raft_consensus.cc:493] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:29.977582 16083 raft_consensus.cc:515] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:29.979023  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:29.980147 16083 leader_election.cc:290] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:29.980887  6030 tablet_replica.cc:333] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
W20260709 13:17:29.981004  7861 leader_election.cc:336] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111)
I20260709 13:17:29.981562  7861 leader_election.cc:304] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:29.981839  6030 raft_consensus.cc:2243] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:17:29.982396 16079 raft_consensus.cc:2749] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:17:29.983186  6030 raft_consensus.cc:2272] T 3a4a2f06cbc44402ae7754d23798eaff P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:29.986363  6030 tablet_replica.cc:333] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:29.987519  6030 raft_consensus.cc:2243] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:17:29.988045  7302 leader_election.cc:336] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:29.989576  6030 raft_consensus.cc:2272] T 1d6277156300462b934adab718a32e44 P c85cf49c63cc4e66b4747d8c4fa14022 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:29.992717  6030 tablet_replica.cc:333] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:29.994051  6030 raft_consensus.cc:2243] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:17:29.995077  6030 raft_consensus.cc:2272] T d6f19c97414f4b0c9f9e2ed509ee22d1 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:29.997409  6030 tablet_replica.cc:333] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:29.998144  6030 raft_consensus.cc:2243] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:29.998800  6030 raft_consensus.cc:2272] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.001487  6030 tablet_replica.cc:333] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.002383  6030 raft_consensus.cc:2243] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.003429  6030 raft_consensus.cc:2272] T 984a0b52728d43fb97379422fa55491d P c85cf49c63cc4e66b4747d8c4fa14022 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.006862  6030 tablet_replica.cc:333] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.007886  6030 raft_consensus.cc:2243] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.007998 16086 raft_consensus.cc:493] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:30.008716 16086 raft_consensus.cc:515] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:30.009095  6030 raft_consensus.cc:2272] T d8d111efe5ab4e9cad378e4ebfdeb996 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.011478 16086 leader_election.cc:290] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:30.014936  6030 tablet_replica.cc:333] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.016000  6030 raft_consensus.cc:2243] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.017092  6030 raft_consensus.cc:2272] T 71d8ccd854bc453397ebc79aefe1c520 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.021023  6030 tablet_replica.cc:333] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.022224  6030 raft_consensus.cc:2243] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.024163  6030 raft_consensus.cc:2272] T 39cd4b2ac236480091e1c72b42541e94 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:30.026265  7302 leader_election.cc:336] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:30.027134  6030 tablet_replica.cc:333] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.028019  6030 raft_consensus.cc:2243] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.030264  6030 raft_consensus.cc:2272] T 3106224ab6d746898c7fb52a0788256d P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.034487  6030 tablet_replica.cc:333] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.035571  6030 raft_consensus.cc:2243] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.036597  6030 raft_consensus.cc:2272] T 50a190f80864482f8c9dfc9a627c1d6d P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.038565 16086 raft_consensus.cc:493] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:30.039153 16086 raft_consensus.cc:515] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:30.039539  6030 tablet_replica.cc:333] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.040509  6030 raft_consensus.cc:2243] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.042238 16086 leader_election.cc:290] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:30.042315  6030 raft_consensus.cc:2272] T adaaa8fc7441471b9727128476437ccc P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.047032  6030 tablet_replica.cc:333] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.047941  6030 raft_consensus.cc:2243] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.048661  6030 raft_consensus.cc:2272] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.051631  6030 tablet_replica.cc:333] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.052459  6030 raft_consensus.cc:2243] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.053198  6030 raft_consensus.cc:2272] T 06475a21ebc249129fc41345c177538a P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:30.056519  7302 leader_election.cc:336] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:30.056979  6030 tablet_replica.cc:333] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
W20260709 13:17:30.057432  7859 consensus_peers.cc:597] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.057858  6030 raft_consensus.cc:2243] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.058857  6030 raft_consensus.cc:2272] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.061619  6030 tablet_replica.cc:333] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.062565  6030 raft_consensus.cc:2243] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.062754 16083 raft_consensus.cc:493] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:30.063482 16083 raft_consensus.cc:515] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:30.063872  6030 raft_consensus.cc:2272] T 4039a3dd715849edb6b8786f89e1a1b3 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.067129 16083 leader_election.cc:290] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:30.067870  6030 tablet_replica.cc:333] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.069314  6030 raft_consensus.cc:2243] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.070590  6030 raft_consensus.cc:2272] T 2486da35b1ff416a9879e8c0588f1db9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.074035  6030 tablet_replica.cc:333] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
W20260709 13:17:30.074539  7302 leader_election.cc:336] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:30.075106  6030 raft_consensus.cc:2243] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.076812  6030 raft_consensus.cc:2272] T 5044ec7fc5dd45979aa778b49eba1ead P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.080144  6030 tablet_replica.cc:333] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.081254  6030 raft_consensus.cc:2243] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.082132  6030 raft_consensus.cc:2272] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.084312 16083 raft_consensus.cc:493] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader efc9ee9e1d86480790fa83f6ad0c295c)
I20260709 13:17:30.084854 16083 raft_consensus.cc:515] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } }
I20260709 13:17:30.085532  6030 tablet_replica.cc:333] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.086486  6030 raft_consensus.cc:2243] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.087206 16083 leader_election.cc:290] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351)
I20260709 13:17:30.087957  6030 raft_consensus.cc:2272] T b3393557a6cf4e58b575e336ba525fe9 P c85cf49c63cc4e66b4747d8c4fa14022 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.091116  6030 tablet_replica.cc:333] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.092065  6030 raft_consensus.cc:2243] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.092898  6030 raft_consensus.cc:2272] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:30.093361  7302 leader_election.cc:336] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
W20260709 13:17:30.096570 16083 raft_consensus.cc:670] T a4c394fe784e4244b68716ee824f271f P c85cf49c63cc4e66b4747d8c4fa14022: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:17:30.099715  6030 tablet_replica.cc:333] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.100421  6030 raft_consensus.cc:2243] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.101616  6030 raft_consensus.cc:2272] T 88b1df9cb24b4dc88a4735a646ad8575 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.104086  6030 tablet_replica.cc:333] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.104797  6030 raft_consensus.cc:2243] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.105315  6030 raft_consensus.cc:2272] T d735c64b62484486814db631ca028bdb P c85cf49c63cc4e66b4747d8c4fa14022 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.107491  6030 tablet_replica.cc:333] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.108103  6030 raft_consensus.cc:2243] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.108620  6030 raft_consensus.cc:2272] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.111265  6030 tablet_replica.cc:333] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
W20260709 13:17:30.111982  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.112198  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.112036  6030 raft_consensus.cc:2243] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.113292  6030 raft_consensus.cc:2272] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.116484  6030 tablet_replica.cc:333] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.118696  6030 raft_consensus.cc:2243] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.119802  6030 raft_consensus.cc:2272] T b2278b8a74ae4c04882dae719a92af7d P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.122498  6030 tablet_replica.cc:333] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.123118  6030 raft_consensus.cc:2243] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.123720  6030 raft_consensus.cc:2272] T 61f52d3e2071488c9b6c59c9b028e118 P c85cf49c63cc4e66b4747d8c4fa14022 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.125860  6030 tablet_replica.cc:333] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.126659  6030 raft_consensus.cc:2243] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.127627  6030 raft_consensus.cc:2272] T b0eff9774a9c435d955814f903cb2401 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:30.129736  7859 consensus_peers.cc:597] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.130839  6030 tablet_replica.cc:333] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.131726  6030 raft_consensus.cc:2243] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.132520  6030 raft_consensus.cc:2272] T 221fa6fca3154a49b5efa9c28f8c4cd8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.137121  6030 tablet_replica.cc:333] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.138072  6030 raft_consensus.cc:2243] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.139045  6030 raft_consensus.cc:2272] T 23e0840e609849f8bd379d43569463c8 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.141938  6030 tablet_replica.cc:333] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.143061  6030 raft_consensus.cc:2243] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.143926  6030 raft_consensus.cc:2272] T cb3d8971d9be4ed09286c9b433d050b2 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.146142  6030 tablet_replica.cc:333] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.146873  6030 raft_consensus.cc:2243] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.148361  6030 raft_consensus.cc:2272] T cb7edd6d1f1343c1868f27ecb9a9ae9d P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.150593  6030 tablet_replica.cc:333] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.151304  6030 raft_consensus.cc:2243] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.152146  6030 raft_consensus.cc:2272] T 458ab76409d4427f8ab55d4d71ca5799 P c85cf49c63cc4e66b4747d8c4fa14022 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.155367  6030 tablet_replica.cc:333] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.156183  6030 raft_consensus.cc:2243] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:17:30.157117  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.157388  6030 raft_consensus.cc:2272] T 4d9487fc89de4e68b395c4a70193c3b6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.159874  6030 tablet_replica.cc:333] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.160660  6030 raft_consensus.cc:2243] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.161315  6030 raft_consensus.cc:2272] T 242a63190870450082200759c7f513ab P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.163579  6030 tablet_replica.cc:333] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.164183  6030 raft_consensus.cc:2243] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.166138  6030 raft_consensus.cc:2272] T 5626b16aa2aa438290520c1b9b979802 P c85cf49c63cc4e66b4747d8c4fa14022 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.168438  6030 tablet_replica.cc:333] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.169111  6030 raft_consensus.cc:2243] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.170035  6030 raft_consensus.cc:2272] T 4aa9c7bddd6f49acad7c47c33c761358 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.173502  6030 tablet_replica.cc:333] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.174504  6030 raft_consensus.cc:2243] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.175148  6030 raft_consensus.cc:2272] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:30.177387  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.177719  6030 tablet_replica.cc:333] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.178448  6030 raft_consensus.cc:2243] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.179502  6030 raft_consensus.cc:2272] T be83b72d4b17414e8521b6707cd8a597 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.182390  6030 tablet_replica.cc:333] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.183213  6030 raft_consensus.cc:2243] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.184418  6030 raft_consensus.cc:2272] T 8023e86d50f847c7a841c09b7692edeb P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:30.185580  7859 consensus_peers.cc:597] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.187635  6030 tablet_replica.cc:333] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.188390  6030 raft_consensus.cc:2243] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:17:30.189071  7859 consensus_peers.cc:597] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.189453  6030 raft_consensus.cc:2272] T 50bbf75da7f04c6cb95c0f589775820b P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.192543  6030 tablet_replica.cc:333] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.193480  6030 raft_consensus.cc:2243] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.194749  6030 raft_consensus.cc:2272] T c89d6774062049379248eca324d137c6 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.197511  6030 tablet_replica.cc:333] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.198374  6030 raft_consensus.cc:2243] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.199100  6030 raft_consensus.cc:2272] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:30.201728  7859 consensus_peers.cc:597] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.202044  6030 tablet_replica.cc:333] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.202977  6030 raft_consensus.cc:2243] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:30.203696  6030 raft_consensus.cc:2272] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.206404  6030 tablet_replica.cc:333] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.207080  6030 raft_consensus.cc:2243] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.208033  6030 raft_consensus.cc:2272] T cb0912958bd849238a8f104a7916c427 P c85cf49c63cc4e66b4747d8c4fa14022 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.211041  6030 tablet_replica.cc:333] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.211720  6030 raft_consensus.cc:2243] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:30.212368  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.212383  6030 raft_consensus.cc:2272] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.215919  6030 tablet_replica.cc:333] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.216903  6030 raft_consensus.cc:2243] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.217793  6030 raft_consensus.cc:2272] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.220121  6030 tablet_replica.cc:333] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.220711  6030 raft_consensus.cc:2243] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.221493  6030 raft_consensus.cc:2272] T ad4f3c0328924ddaba5d93fe80e78a64 P c85cf49c63cc4e66b4747d8c4fa14022 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:30.223932  6030 tablet_replica.cc:333] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
I20260709 13:17:30.224665  6030 raft_consensus.cc:2243] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.226042  6030 raft_consensus.cc:2272] T 9ba8ab4b505c46299ab836854622094b P c85cf49c63cc4e66b4747d8c4fa14022 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:30.227730  7859 consensus_peers.cc:597] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:30.228792  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.229508  6030 tablet_replica.cc:333] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022: stopping tablet replica
W20260709 13:17:30.230693  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.231473  6030 raft_consensus.cc:2243] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:17:30.232543  6030 raft_consensus.cc:2272] T ab82ab5b0c4442cd8a05ee133017c2e0 P c85cf49c63cc4e66b4747d8c4fa14022 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:30.236430  7862 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:17:30.270921  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.307446  7299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.312552  7302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.313647  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.322570  7859 consensus_peers.cc:597] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:30.351924  7301 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.354895  7300 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.364738  7301 leader_election.cc:336] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Service unavailable: Unable to start connection negotiation thread: The pool has been shut down.
I20260709 13:17:30.365622  7301 leader_election.cc:304] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:17:30.366757  7301 raft_consensus.cc:2686] T eac161a9db63471dbd87b41a92fe1202 P c85cf49c63cc4e66b4747d8c4fa14022: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:17:30.368136 16061 leader_election.cc:336] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Service unavailable: reactor is shutting down (error 108)
I20260709 13:17:30.368739 16061 leader_election.cc:304] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:17:30.369565 16061 raft_consensus.cc:2686] T 8ffda2d3bf0b4684a675dae01ebe1c35 P c85cf49c63cc4e66b4747d8c4fa14022: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:17:30.370479  7301 leader_election.cc:336] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Service unavailable: Unable to start connection negotiation thread: The pool has been shut down.
I20260709 13:17:30.371013  7301 leader_election.cc:304] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:17:30.371678  7301 raft_consensus.cc:2686] T e247e49279304bdfa2f0146e714dc287 P c85cf49c63cc4e66b4747d8c4fa14022: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:17:30.374119  7301 leader_election.cc:336] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Service unavailable: Unable to start connection negotiation thread: The pool has been shut down.
I20260709 13:17:30.374576  7301 leader_election.cc:304] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:17:30.375247  7301 raft_consensus.cc:2686] T 5920bb7e53034c2688b18dfe352590c8 P c85cf49c63cc4e66b4747d8c4fa14022: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:17:30.377565  7301 leader_election.cc:336] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Service unavailable: Unable to start connection negotiation thread: The pool has been shut down.
I20260709 13:17:30.377942  7301 leader_election.cc:304] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:17:30.378423  7301 raft_consensus.cc:2686] T 3cb8aa5713ef402a91f009eb4f97885e P c85cf49c63cc4e66b4747d8c4fa14022: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:17:30.380259  7301 leader_election.cc:336] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Service unavailable: Unable to start connection negotiation thread: The pool has been shut down.
I20260709 13:17:30.380635  7301 leader_election.cc:304] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:17:30.381173  7301 raft_consensus.cc:2686] T 296c0d2843ee4e21a7fdc0240b67a7cc P c85cf49c63cc4e66b4747d8c4fa14022: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:17:30.384573  7301 leader_election.cc:336] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Service unavailable: Unable to start connection negotiation thread: The pool has been shut down.
I20260709 13:17:30.384909  7301 leader_election.cc:304] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:17:30.385388  7301 raft_consensus.cc:2686] T 75c50740d1144c09a074230835085663 P c85cf49c63cc4e66b4747d8c4fa14022: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:17:30.389469  6030 leader_election.cc:336] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Aborted: reactor is shutting down (error 108)
I20260709 13:17:30.389969  6030 leader_election.cc:304] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:17:30.390611  6030 raft_consensus.cc:2686] T 90c9778e4f484bb7ab035094ae2c24c9 P c85cf49c63cc4e66b4747d8c4fa14022: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:17:30.393184  6030 leader_election.cc:336] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Aborted: reactor is shutting down (error 108)
I20260709 13:17:30.393586  6030 leader_election.cc:304] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c85cf49c63cc4e66b4747d8c4fa14022; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, efc9ee9e1d86480790fa83f6ad0c295c
W20260709 13:17:30.394171  6030 raft_consensus.cc:2686] T 5584200aff994405b2de3e35528fb3cd P c85cf49c63cc4e66b4747d8c4fa14022: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:17:30.435339  7859 consensus_peers.cc:597] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Couldn't send request to peer c85cf49c63cc4e66b4747d8c4fa14022. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.131:35093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:30.743031  7861 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:30.757630  7861 consensus_peers.cc:597] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:30.834511  7861 consensus_peers.cc:597] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:30.856410  7861 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:30.879043  7862 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260709 13:17:30.943296  7862 consensus_peers.cc:597] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260709 13:17:30.953560  6030 tablet_server.cc:196] TabletServer@127.5.227.131:0 shutdown complete.
W20260709 13:17:30.960326  7862 consensus_peers.cc:597] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20260709 13:17:30.972395  7861 consensus_peers.cc:597] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:30.988786  7861 consensus_peers.cc:597] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:31.037770  7861 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:31.074916  6030 tablet_server.cc:179] TabletServer@127.5.227.132:0 shutting down...
W20260709 13:17:31.122885  7861 consensus_peers.cc:597] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:31.134245  7861 consensus_peers.cc:597] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:31.134804  7861 consensus_peers.cc:597] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Couldn't send request to peer efc9ee9e1d86480790fa83f6ad0c295c. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:31.140059  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:31.141297  6030 tablet_replica.cc:333] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.142581  6030 raft_consensus.cc:2243] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.143476  6030 raft_consensus.cc:2272] T 1d6277156300462b934adab718a32e44 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.146944  6030 tablet_replica.cc:333] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.147845  6030 raft_consensus.cc:2243] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.148811  6030 raft_consensus.cc:2272] T 242a63190870450082200759c7f513ab P 9a54ecc9fb4541df915f9f8c01e19429 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.151335  6030 tablet_replica.cc:333] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.151305 16095 raft_consensus.cc:493] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:31.152138 16095 raft_consensus.cc:515] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:31.152720  6030 raft_consensus.cc:2243] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEARNER]: Raft consensus shutting down.
I20260709 13:17:31.153286  6030 pending_rounds.cc:70] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Trying to abort 1 pending ops.
I20260709 13:17:31.153590  6030 pending_rounds.cc:77] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7305637093926477824 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "b2278b8a74ae4c04882dae719a92af7d" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } } new_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2ecdd7dc4a144f5aa0f2f91c7b94434d" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 44171 } } peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } attrs { replace: true } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: NON_VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: true } } } }
I20260709 13:17:31.154946 16095 leader_election.cc:290] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:31.155197  6030 raft_consensus.cc:2917] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted
I20260709 13:17:31.155654  6030 raft_consensus.cc:2889] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:17:31.156059  6030 raft_consensus.cc:2272] T b2278b8a74ae4c04882dae719a92af7d P 9a54ecc9fb4541df915f9f8c01e19429 [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:17:31.159314  6030 tablet_replica.cc:333] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.160322  6030 raft_consensus.cc:2243] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:17:31.161343  7862 leader_election.cc:336] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:17:31.161547  6030 raft_consensus.cc:2272] T a893449156a24240bd4ed83fc67f85f6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:31.163419  7859 leader_election.cc:336] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Network error: Client connection negotiation failed: client connection to 127.5.227.131:35093: connect: Connection refused (error 111)
I20260709 13:17:31.163885  7859 leader_election.cc:304] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: 2ecdd7dc4a144f5aa0f2f91c7b94434d, c85cf49c63cc4e66b4747d8c4fa14022
I20260709 13:17:31.164651 16095 raft_consensus.cc:2749] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:17:31.164781  6030 tablet_replica.cc:333] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.165966  6030 raft_consensus.cc:2243] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.167570  6030 raft_consensus.cc:2272] T 4637971bd855417fac5632325ab8f119 P 9a54ecc9fb4541df915f9f8c01e19429 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.170445  6030 tablet_replica.cc:333] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.171141  6030 raft_consensus.cc:2243] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 33 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.172143  6030 raft_consensus.cc:2272] T 61f52d3e2071488c9b6c59c9b028e118 P 9a54ecc9fb4541df915f9f8c01e19429 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.174798  6030 tablet_replica.cc:333] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.175413  6030 raft_consensus.cc:2243] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.176370  6030 raft_consensus.cc:2272] T edb4d64ffd0f4bed80982e942f1033c3 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.178561  6030 tablet_replica.cc:333] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.179250  6030 raft_consensus.cc:2243] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.180150  6030 raft_consensus.cc:2272] T 06475a21ebc249129fc41345c177538a P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.182564  6030 tablet_replica.cc:333] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.183254  6030 raft_consensus.cc:2243] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.183831  6030 raft_consensus.cc:2272] T b3393557a6cf4e58b575e336ba525fe9 P 9a54ecc9fb4541df915f9f8c01e19429 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.186165  6030 tablet_replica.cc:333] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.186863  6030 raft_consensus.cc:2243] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.187493  6030 raft_consensus.cc:2272] T 5044ec7fc5dd45979aa778b49eba1ead P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.190945  6030 tablet_replica.cc:333] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.191807  6030 raft_consensus.cc:2243] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.192538  6030 raft_consensus.cc:2272] T 88b1df9cb24b4dc88a4735a646ad8575 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.195587  6030 tablet_replica.cc:333] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.196489  6030 raft_consensus.cc:2243] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 33 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.197775  6030 raft_consensus.cc:2272] T d735c64b62484486814db631ca028bdb P 9a54ecc9fb4541df915f9f8c01e19429 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.201797  6030 tablet_replica.cc:333] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.202831  6030 raft_consensus.cc:2243] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.202888 16095 raft_consensus.cc:493] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c85cf49c63cc4e66b4747d8c4fa14022)
I20260709 13:17:31.203649 16095 raft_consensus.cc:515] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "efc9ee9e1d86480790fa83f6ad0c295c" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 40351 } } peers { permanent_uuid: "c85cf49c63cc4e66b4747d8c4fa14022" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 35093 } } peers { permanent_uuid: "9a54ecc9fb4541df915f9f8c01e19429" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 39125 } attrs { promote: false } }
I20260709 13:17:31.204160  6030 raft_consensus.cc:2272] T 7ddda14494534865a2d45ddae7f3ec93 P 9a54ecc9fb4541df915f9f8c01e19429 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:31.204306  7862 consensus_peers.cc:597] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 -> Peer 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): Couldn't send request to peer 2ecdd7dc4a144f5aa0f2f91c7b94434d. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
I20260709 13:17:31.207571  6030 tablet_replica.cc:333] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.208580  6030 raft_consensus.cc:2243] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.208537 16095 leader_election.cc:290] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351), c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093)
I20260709 13:17:31.210170  6030 raft_consensus.cc:2272] T 8023e86d50f847c7a841c09b7692edeb P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:31.211588  7861 leader_election.cc:336] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer efc9ee9e1d86480790fa83f6ad0c295c (127.5.227.130:40351): Network error: Client connection negotiation failed: client connection to 127.5.227.130:40351: connect: Connection refused (error 111)
W20260709 13:17:31.214342  7859 leader_election.cc:336] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c85cf49c63cc4e66b4747d8c4fa14022 (127.5.227.131:35093): Network error: Client connection negotiation failed: client connection to 127.5.227.131:35093: connect: Connection refused (error 111)
I20260709 13:17:31.214496  6030 tablet_replica.cc:333] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.214804  7859 leader_election.cc:304] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a54ecc9fb4541df915f9f8c01e19429; no voters: c85cf49c63cc4e66b4747d8c4fa14022, efc9ee9e1d86480790fa83f6ad0c295c
I20260709 13:17:31.215519 16095 raft_consensus.cc:2749] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:31.216205  6030 raft_consensus.cc:2243] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.217088  6030 raft_consensus.cc:2272] T 984a0b52728d43fb97379422fa55491d P 9a54ecc9fb4541df915f9f8c01e19429 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.220196  6030 tablet_replica.cc:333] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.221068  6030 raft_consensus.cc:2243] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.221698  6030 raft_consensus.cc:2272] T f7dc72492fc64c638202c7715a2a72ac P 9a54ecc9fb4541df915f9f8c01e19429 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.224625  6030 tablet_replica.cc:333] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.225419  6030 raft_consensus.cc:2243] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.226919  6030 raft_consensus.cc:2272] T 788b854112d74649a8e966f1fe824f3f P 9a54ecc9fb4541df915f9f8c01e19429 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.229740  6030 tablet_replica.cc:333] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.230553  6030 raft_consensus.cc:2243] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.231272  6030 raft_consensus.cc:2272] T ad4f3c0328924ddaba5d93fe80e78a64 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.234073  6030 tablet_replica.cc:333] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.235016  6030 raft_consensus.cc:2243] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.236359  6030 raft_consensus.cc:2272] T 8df49b022aa74a6481683d10c4fcc035 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.239509  6030 tablet_replica.cc:333] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.240356  6030 raft_consensus.cc:2243] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.241094  6030 raft_consensus.cc:2272] T cb7edd6d1f1343c1868f27ecb9a9ae9d P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.244060  6030 tablet_replica.cc:333] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.244886  6030 raft_consensus.cc:2243] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.245558  6030 raft_consensus.cc:2272] T 3a4a2f06cbc44402ae7754d23798eaff P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.248533  6030 tablet_replica.cc:333] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.249394  6030 raft_consensus.cc:2243] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.250777  6030 raft_consensus.cc:2272] T db390910c47342dc848e258ef7dac1bd P 9a54ecc9fb4541df915f9f8c01e19429 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.253614  6030 tablet_replica.cc:333] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.254385  6030 raft_consensus.cc:2243] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.255525  6030 raft_consensus.cc:2272] T 4278a1ff7e0c4ce4a86d4e7b748f9557 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.258296  6030 tablet_replica.cc:333] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.259105  6030 raft_consensus.cc:2243] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.259692  6030 raft_consensus.cc:2272] T d6f19c97414f4b0c9f9e2ed509ee22d1 P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.262475  6030 tablet_replica.cc:333] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.263304  6030 raft_consensus.cc:2243] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.263976  6030 raft_consensus.cc:2272] T 79fac6ca4a1b42d1b629b7a5b1e5e6ee P 9a54ecc9fb4541df915f9f8c01e19429 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.267127  6030 tablet_replica.cc:333] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.267910  6030 raft_consensus.cc:2243] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.269064  6030 raft_consensus.cc:2272] T c89d6774062049379248eca324d137c6 P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.272193  6030 tablet_replica.cc:333] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.272949  6030 raft_consensus.cc:2243] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.273535  6030 raft_consensus.cc:2272] T 50bbf75da7f04c6cb95c0f589775820b P 9a54ecc9fb4541df915f9f8c01e19429 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.276517  6030 tablet_replica.cc:333] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.277275  6030 raft_consensus.cc:2243] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.277848  6030 raft_consensus.cc:2272] T dd122c1cdfa84f8ea52721a14c58c4e2 P 9a54ecc9fb4541df915f9f8c01e19429 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.280866  6030 tablet_replica.cc:333] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.281651  6030 raft_consensus.cc:2243] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:17:31.283016  6030 raft_consensus.cc:2272] T adaaa8fc7441471b9727128476437ccc P 9a54ecc9fb4541df915f9f8c01e19429 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.286103  6030 tablet_replica.cc:333] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.286821  6030 raft_consensus.cc:2243] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.287470  6030 raft_consensus.cc:2272] T a4c394fe784e4244b68716ee824f271f P 9a54ecc9fb4541df915f9f8c01e19429 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.289637  6030 tablet_replica.cc:333] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.290350  6030 raft_consensus.cc:2243] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.290987  6030 raft_consensus.cc:2272] T de90ec51ea634c3d8b220c16d71b8cdf P 9a54ecc9fb4541df915f9f8c01e19429 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.293257  6030 tablet_replica.cc:333] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429: stopping tablet replica
I20260709 13:17:31.293771  6030 raft_consensus.cc:2243] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.294318  6030 raft_consensus.cc:2272] T 5626b16aa2aa438290520c1b9b979802 P 9a54ecc9fb4541df915f9f8c01e19429 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.678853  6030 tablet_server.cc:196] TabletServer@127.5.227.132:0 shutdown complete.
I20260709 13:17:31.759047  6030 master.cc:562] Master@127.5.227.190:45419 shutting down...
W20260709 13:17:31.820087  7133 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:17:31.820365  7133 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:17:31.820600  7133 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:17:52.933303  7116 debug-util.cc:398] Leaking SignalData structure 0x7b0800138e40 after lost signal to thread 6033
W20260709 13:17:52.933990  7116 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6500 after lost signal to thread 7119
W20260709 13:18:02.189294  7072 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111) [suppressed 492 similar messages]
W20260709 13:18:02.193701  7072 catalog_manager.cc:4755] TS 2ecdd7dc4a144f5aa0f2f91c7b94434d (127.5.227.129:44171): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c89d6774062049379248eca324d137c6: Network error: Client connection negotiation failed: client connection to 127.5.227.129:44171: connect: Connection refused (error 111)
I20260709 13:18:05.045315  6030 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.046877  6030 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.047345  6030 tablet_replica.cc:333] T 00000000000000000000000000000000 P 50ff9c56d8414bdb8f05f31957b53075: stopping tablet replica
I20260709 13:18:05.270994  6030 master.cc:584] Master@127.5.227.190:45419 shutdown complete.
I20260709 13:18:05.335389  6030 test_util.cc:182] -----------------------------------------------
I20260709 13:18:05.335708  6030 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602741015013-6030-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (317971 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:18:05.340174  6030 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.227.190:42867
I20260709 13:18:05.341573  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:05.348881 16104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:05.348997 16103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:05.349720 16106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:05.351881  6030 server_base.cc:1061] running on GCE node
I20260709 13:18:05.356432  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:05.356750  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:05.356925  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603085356904 us; error 0 us; skew 500 ppm
I20260709 13:18:05.357826  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:05.361465  6030 webserver.cc:533] Webserver started at http://127.5.227.190:44255/ using document root <none> and password file <none>
I20260709 13:18:05.362133  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:05.362365  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:05.363099  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:05.364830  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/master-0-root/instance:
uuid: "9ab76ab2e13548cd9aa4ff9d5112da32"
format_stamp: "Formatted at 2026-07-09 13:18:05 on dist-test-slave-tbwl"
I20260709 13:18:05.370757  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:18:05.374855 16111 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:05.375934  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:18:05.376318  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/master-0-root
uuid: "9ab76ab2e13548cd9aa4ff9d5112da32"
format_stamp: "Formatted at 2026-07-09 13:18:05 on dist-test-slave-tbwl"
I20260709 13:18:05.376974  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:05.399245  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:05.401299  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:05.453480  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.190:42867
I20260709 13:18:05.453593 16162 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.190:42867 every 8 connection(s)
I20260709 13:18:05.458503 16163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.474378 16163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32: Bootstrap starting.
I20260709 13:18:05.481379 16163 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.487775 16163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32: No bootstrap required, opened a new log
I20260709 13:18:05.490234 16163 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab76ab2e13548cd9aa4ff9d5112da32" member_type: VOTER }
I20260709 13:18:05.490851 16163 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.491087 16163 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab76ab2e13548cd9aa4ff9d5112da32, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.491740 16163 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab76ab2e13548cd9aa4ff9d5112da32" member_type: VOTER }
I20260709 13:18:05.492244 16163 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:05.492493 16163 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:05.492810 16163 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.498402 16163 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab76ab2e13548cd9aa4ff9d5112da32" member_type: VOTER }
I20260709 13:18:05.500691 16163 leader_election.cc:304] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ab76ab2e13548cd9aa4ff9d5112da32; no voters: 
I20260709 13:18:05.502372 16163 leader_election.cc:290] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:05.503015 16166 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.505184 16166 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab76ab2e13548cd9aa4ff9d5112da32, State: Running, Role: LEADER
I20260709 13:18:05.506368 16166 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab76ab2e13548cd9aa4ff9d5112da32" member_type: VOTER }
I20260709 13:18:05.507287 16163 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:05.516937 16168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ab76ab2e13548cd9aa4ff9d5112da32. Latest consensus state: current_term: 1 leader_uuid: "9ab76ab2e13548cd9aa4ff9d5112da32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab76ab2e13548cd9aa4ff9d5112da32" member_type: VOTER } }
I20260709 13:18:05.517134 16167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ab76ab2e13548cd9aa4ff9d5112da32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab76ab2e13548cd9aa4ff9d5112da32" member_type: VOTER } }
I20260709 13:18:05.517894 16167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:05.518814 16168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:05.520617 16176 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:05.531004 16176 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:05.532272  6030 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:05.543569 16176 catalog_manager.cc:1383] Generated new cluster ID: 322f22a5b1d34ff38b4bb5a2d4a27b83
I20260709 13:18:05.543959 16176 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:05.572952 16176 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:05.574412 16176 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:05.599470 16176 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32: Generated new TSK 0
I20260709 13:18:05.600296 16176 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:05.665004  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:05.672562 16184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:05.673631 16185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:05.676038 16187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:05.676944  6030 server_base.cc:1061] running on GCE node
I20260709 13:18:05.680599  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:05.680945  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:05.681130  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603085681105 us; error 0 us; skew 500 ppm
I20260709 13:18:05.681766  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:05.685415  6030 webserver.cc:533] Webserver started at http://127.5.227.129:44797/ using document root <none> and password file <none>
I20260709 13:18:05.686056  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:05.686285  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:05.686618  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:05.688462  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/instance:
uuid: "fe046a372b6a4df982eebe83cf3ee184"
format_stamp: "Formatted at 2026-07-09 13:18:05 on dist-test-slave-tbwl"
I20260709 13:18:05.693810  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:18:05.698180 16192 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:05.699429  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:18:05.699923  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-0-root
uuid: "fe046a372b6a4df982eebe83cf3ee184"
format_stamp: "Formatted at 2026-07-09 13:18:05 on dist-test-slave-tbwl"
I20260709 13:18:05.700350  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:05.725016  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:05.726490  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:05.728240  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:05.731011  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:05.731307  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:05.731597  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:05.731802  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:05.786890  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.129:36859
I20260709 13:18:05.787004 16254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.129:36859 every 8 connection(s)
I20260709 13:18:05.793423  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:05.805202 16259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:05.808495 16260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:05.810423 16262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:05.811671 16255 heartbeater.cc:344] Connected to a master server at 127.5.227.190:42867
I20260709 13:18:05.812134 16255 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:05.812641  6030 server_base.cc:1061] running on GCE node
I20260709 13:18:05.813293 16255 heartbeater.cc:507] Master 127.5.227.190:42867 requested a full tablet report, sending...
I20260709 13:18:05.816084  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:05.816466  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:05.816556 16128 ts_manager.cc:194] Registered new tserver with Master: fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:05.816747  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603085816721 us; error 0 us; skew 500 ppm
I20260709 13:18:05.817662  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:05.819865 16128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41682
I20260709 13:18:05.821933  6030 webserver.cc:533] Webserver started at http://127.5.227.130:33333/ using document root <none> and password file <none>
I20260709 13:18:05.822731  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:05.822973  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:05.823269  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:05.824956  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/instance:
uuid: "35e0de78970041afb173662b1c34598e"
format_stamp: "Formatted at 2026-07-09 13:18:05 on dist-test-slave-tbwl"
I20260709 13:18:05.830801  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:18:05.834957 16267 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:05.835924  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:18:05.836257  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-1-root
uuid: "35e0de78970041afb173662b1c34598e"
format_stamp: "Formatted at 2026-07-09 13:18:05 on dist-test-slave-tbwl"
I20260709 13:18:05.836593  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:05.862214  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:05.863950  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:05.865698  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:05.869166  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:05.869477  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:05.869786  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:05.869978  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:05.924356  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.130:42747
I20260709 13:18:05.924695 16329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.130:42747 every 8 connection(s)
I20260709 13:18:05.930687  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:05.940339 16333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:05.944005 16334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:05.948596  6030 server_base.cc:1061] running on GCE node
W20260709 13:18:05.948638 16336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:05.950239 16330 heartbeater.cc:344] Connected to a master server at 127.5.227.190:42867
I20260709 13:18:05.950529  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:18:05.950764 16330 heartbeater.cc:461] Registering TS with master...
W20260709 13:18:05.951062  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:05.951370  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603085951349 us; error 0 us; skew 500 ppm
I20260709 13:18:05.951944 16330 heartbeater.cc:507] Master 127.5.227.190:42867 requested a full tablet report, sending...
I20260709 13:18:05.952067  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:05.954489 16128 ts_manager.cc:194] Registered new tserver with Master: 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:05.956097 16128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41690
I20260709 13:18:05.957851  6030 webserver.cc:533] Webserver started at http://127.5.227.131:46611/ using document root <none> and password file <none>
I20260709 13:18:05.958539  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:05.958841  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:05.959146  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:05.960439  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/instance:
uuid: "0c736bf768804f2e86a875366c12a71c"
format_stamp: "Formatted at 2026-07-09 13:18:05 on dist-test-slave-tbwl"
I20260709 13:18:05.965854  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:18:05.970238 16341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:05.971494  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:18:05.971920  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-2-root
uuid: "0c736bf768804f2e86a875366c12a71c"
format_stamp: "Formatted at 2026-07-09 13:18:05 on dist-test-slave-tbwl"
I20260709 13:18:05.972260  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:05.985632  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:05.987561  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:05.989094  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:05.991919  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:05.992197  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:05.992472  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:05.992666  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:06.044643  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.131:34771
I20260709 13:18:06.044857 16403 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.131:34771 every 8 connection(s)
I20260709 13:18:06.051189  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:06.060824 16407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:06.062704 16408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:06.066303 16410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:06.067734  6030 server_base.cc:1061] running on GCE node
I20260709 13:18:06.068068 16404 heartbeater.cc:344] Connected to a master server at 127.5.227.190:42867
I20260709 13:18:06.068578 16404 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:06.069097  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:06.069411  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:06.069651  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603086069632 us; error 0 us; skew 500 ppm
I20260709 13:18:06.069737 16404 heartbeater.cc:507] Master 127.5.227.190:42867 requested a full tablet report, sending...
I20260709 13:18:06.070565  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:06.072592 16128 ts_manager.cc:194] Registered new tserver with Master: 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:06.074316  6030 webserver.cc:533] Webserver started at http://127.5.227.132:46575/ using document root <none> and password file <none>
I20260709 13:18:06.074918 16128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41696
I20260709 13:18:06.075259  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:06.075595  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:06.075953  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:06.077766  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-3-root/instance:
uuid: "0763e17c84d248738dade73ded2c5f71"
format_stamp: "Formatted at 2026-07-09 13:18:06 on dist-test-slave-tbwl"
I20260709 13:18:06.083666  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:18:06.087963 16415 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:06.088937  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:18:06.089321  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-3-root
uuid: "0763e17c84d248738dade73ded2c5f71"
format_stamp: "Formatted at 2026-07-09 13:18:06 on dist-test-slave-tbwl"
I20260709 13:18:06.089679  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:06.109688  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:06.111218  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:06.112722  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:06.115159  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:06.115368  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:06.115703  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:06.115860  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:06.169593  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.132:42671
I20260709 13:18:06.169721 16477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.132:42671 every 8 connection(s)
I20260709 13:18:06.188577 16478 heartbeater.cc:344] Connected to a master server at 127.5.227.190:42867
I20260709 13:18:06.189091 16478 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:06.189994 16478 heartbeater.cc:507] Master 127.5.227.190:42867 requested a full tablet report, sending...
I20260709 13:18:06.192407 16128 ts_manager.cc:194] Registered new tserver with Master: 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:06.192569  6030 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.019066548s
I20260709 13:18:06.194376 16128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41702
I20260709 13:18:06.231894 16128 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41716:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:06.524129 16175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:06.531710 16220 tablet_service.cc:1511] Processing CreateTablet for tablet d0408e10512d4613a6250d70072ab152 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:06.533561 16220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0408e10512d4613a6250d70072ab152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.533155 16218 tablet_service.cc:1511] Processing CreateTablet for tablet 738b09b19983412bbbf2fccd7c5687b5 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:06.534776 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738b09b19983412bbbf2fccd7c5687b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.536515 16219 tablet_service.cc:1511] Processing CreateTablet for tablet 6c139e8f552d449faa03901839fb43b1 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:06.538369 16219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c139e8f552d449faa03901839fb43b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.544524 16443 tablet_service.cc:1511] Processing CreateTablet for tablet d0408e10512d4613a6250d70072ab152 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:06.548307 16442 tablet_service.cc:1511] Processing CreateTablet for tablet 738b09b19983412bbbf2fccd7c5687b5 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:06.550945 16294 tablet_service.cc:1511] Processing CreateTablet for tablet 738b09b19983412bbbf2fccd7c5687b5 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:06.548686 16295 tablet_service.cc:1511] Processing CreateTablet for tablet 6c139e8f552d449faa03901839fb43b1 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:06.554972 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0408e10512d4613a6250d70072ab152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.559190 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738b09b19983412bbbf2fccd7c5687b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.558871 16369 tablet_service.cc:1511] Processing CreateTablet for tablet d0408e10512d4613a6250d70072ab152 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:06.561306 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0408e10512d4613a6250d70072ab152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.554502 16293 tablet_service.cc:1511] Processing CreateTablet for tablet 28e25b852f6d47959be47bdd036d45a2 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:06.552771 16294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738b09b19983412bbbf2fccd7c5687b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.567858 16292 tablet_service.cc:1511] Processing CreateTablet for tablet 48b93db33f164564bbded82c6ca74a3a (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:06.569105 16441 tablet_service.cc:1511] Processing CreateTablet for tablet 28e25b852f6d47959be47bdd036d45a2 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:06.565707 16217 tablet_service.cc:1511] Processing CreateTablet for tablet 48b93db33f164564bbded82c6ca74a3a (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:06.569674 16292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b93db33f164564bbded82c6ca74a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.570984 16217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b93db33f164564bbded82c6ca74a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.564329 16367 tablet_service.cc:1511] Processing CreateTablet for tablet 28e25b852f6d47959be47bdd036d45a2 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:06.564317 16368 tablet_service.cc:1511] Processing CreateTablet for tablet 6c139e8f552d449faa03901839fb43b1 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:06.573486 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e25b852f6d47959be47bdd036d45a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.574852 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c139e8f552d449faa03901839fb43b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.577417 16366 tablet_service.cc:1511] Processing CreateTablet for tablet 48b93db33f164564bbded82c6ca74a3a (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:06.579236 16293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e25b852f6d47959be47bdd036d45a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.580034 16440 tablet_service.cc:1511] Processing CreateTablet for tablet 506096b267e14e6f8e28c082062c6481 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:06.582079 16366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48b93db33f164564bbded82c6ca74a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.587029 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e25b852f6d47959be47bdd036d45a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.594615 16216 tablet_service.cc:1511] Processing CreateTablet for tablet 506096b267e14e6f8e28c082062c6481 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:06.604086 16216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506096b267e14e6f8e28c082062c6481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.607300 16440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506096b267e14e6f8e28c082062c6481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.615720 16291 tablet_service.cc:1511] Processing CreateTablet for tablet 506096b267e14e6f8e28c082062c6481 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:06.617399 16291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506096b267e14e6f8e28c082062c6481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.619221 16439 tablet_service.cc:1511] Processing CreateTablet for tablet 128dfcd70ea847fbae9691a10e6db1a5 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:06.621263 16439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128dfcd70ea847fbae9691a10e6db1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.620837 16365 tablet_service.cc:1511] Processing CreateTablet for tablet 128dfcd70ea847fbae9691a10e6db1a5 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:06.627458 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c139e8f552d449faa03901839fb43b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.632238 16365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128dfcd70ea847fbae9691a10e6db1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.638401 16217 tablet_service.cc:1511] Processing CreateTablet for tablet 128dfcd70ea847fbae9691a10e6db1a5 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:06.640002 16217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128dfcd70ea847fbae9691a10e6db1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.644100 16498 tablet_bootstrap.cc:492] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:06.652025 16499 tablet_bootstrap.cc:492] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:06.652717 16290 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5c65063a9241f6a62a7867005e3e57 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:06.654496 16290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5c65063a9241f6a62a7867005e3e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.669941 16364 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5c65063a9241f6a62a7867005e3e57 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:06.672329 16500 tablet_bootstrap.cc:492] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:06.671939 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5c65063a9241f6a62a7867005e3e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.686743 16498 tablet_bootstrap.cc:654] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.700940 16499 tablet_bootstrap.cc:654] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.697414 16500 tablet_bootstrap.cc:654] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.722887 16218 tablet_service.cc:1511] Processing CreateTablet for tablet e1767e0ec9e442fd80d03d4f83e02ddb (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:06.724742 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1767e0ec9e442fd80d03d4f83e02ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.727317 16441 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5c65063a9241f6a62a7867005e3e57 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:06.729039 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5c65063a9241f6a62a7867005e3e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.729991 16295 tablet_service.cc:1511] Processing CreateTablet for tablet e1767e0ec9e442fd80d03d4f83e02ddb (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:06.731518 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1767e0ec9e442fd80d03d4f83e02ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.739216 16364 tablet_service.cc:1511] Processing CreateTablet for tablet e1767e0ec9e442fd80d03d4f83e02ddb (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:06.747051 16498 tablet_bootstrap.cc:492] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:06.747483 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1767e0ec9e442fd80d03d4f83e02ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.747743 16498 ts_tablet_manager.cc:1403] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.104s	user 0.025s	sys 0.000s
I20260709 13:18:06.752592 16502 tablet_bootstrap.cc:492] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:06.754187 16439 tablet_service.cc:1511] Processing CreateTablet for tablet 403c864cda0f4da0b0547c0a3f1cb3ea (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:06.755970 16439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 403c864cda0f4da0b0547c0a3f1cb3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.760802 16498 raft_consensus.cc:359] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:06.767486 16500 tablet_bootstrap.cc:492] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:06.768175 16500 ts_tablet_manager.cc:1403] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.017s
I20260709 13:18:06.771529 16500 raft_consensus.cc:359] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:06.772312 16500 raft_consensus.cc:385] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.772614 16500 raft_consensus.cc:740] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.762419 16498 raft_consensus.cc:385] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.774199 16498 raft_consensus.cc:740] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.775964 16499 tablet_bootstrap.cc:492] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:06.776600 16499 ts_tablet_manager.cc:1403] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.125s	user 0.027s	sys 0.001s
I20260709 13:18:06.780684 16499 raft_consensus.cc:359] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:06.780987 16217 tablet_service.cc:1511] Processing CreateTablet for tablet 403c864cda0f4da0b0547c0a3f1cb3ea (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:06.782497 16500 consensus_queue.cc:260] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:06.783113 16217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 403c864cda0f4da0b0547c0a3f1cb3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.787281 16292 tablet_service.cc:1511] Processing CreateTablet for tablet 403c864cda0f4da0b0547c0a3f1cb3ea (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:06.788599 16502 tablet_bootstrap.cc:654] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.788839 16292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 403c864cda0f4da0b0547c0a3f1cb3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.781716 16499 raft_consensus.cc:385] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.791359 16499 raft_consensus.cc:740] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.785277 16498 consensus_queue.cc:260] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:06.792464 16499 consensus_queue.cc:260] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:06.793061 16367 tablet_service.cc:1511] Processing CreateTablet for tablet c883f64d971d4eeeb73836cdb95e1071 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:06.794541 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c883f64d971d4eeeb73836cdb95e1071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.818444 16440 tablet_service.cc:1511] Processing CreateTablet for tablet c883f64d971d4eeeb73836cdb95e1071 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:06.821554 16440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c883f64d971d4eeeb73836cdb95e1071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.823215 16478 heartbeater.cc:499] Master 127.5.227.190:42867 was elected leader, sending a full tablet report...
I20260709 13:18:06.827912 16498 ts_tablet_manager.cc:1434] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.080s	user 0.011s	sys 0.000s
I20260709 13:18:06.827747 16295 tablet_service.cc:1511] Processing CreateTablet for tablet 780cc3fe16024ae9837ab737de1d769c (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:06.827966 16255 heartbeater.cc:499] Master 127.5.227.190:42867 was elected leader, sending a full tablet report...
I20260709 13:18:06.829289 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780cc3fe16024ae9837ab737de1d769c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.829253 16498 tablet_bootstrap.cc:492] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:06.835952 16500 ts_tablet_manager.cc:1434] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.067s	user 0.017s	sys 0.014s
I20260709 13:18:06.835501 16216 tablet_service.cc:1511] Processing CreateTablet for tablet c883f64d971d4eeeb73836cdb95e1071 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:06.836977 16330 heartbeater.cc:499] Master 127.5.227.190:42867 was elected leader, sending a full tablet report...
I20260709 13:18:06.837302 16216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c883f64d971d4eeeb73836cdb95e1071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.838454 16499 ts_tablet_manager.cc:1434] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.015s
I20260709 13:18:06.839938 16499 tablet_bootstrap.cc:492] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:06.841583 16500 tablet_bootstrap.cc:492] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:06.861315 16508 raft_consensus.cc:493] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.862087 16508 raft_consensus.cc:515] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:06.863384 16500 tablet_bootstrap.cc:654] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.869231 16498 tablet_bootstrap.cc:654] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.872957 16508 leader_election.cc:290] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:06.875051 16367 tablet_service.cc:1511] Processing CreateTablet for tablet 780cc3fe16024ae9837ab737de1d769c (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:06.876579 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780cc3fe16024ae9837ab737de1d769c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.878202 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 780cc3fe16024ae9837ab737de1d769c (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:06.879848 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780cc3fe16024ae9837ab737de1d769c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.880934 16502 tablet_bootstrap.cc:492] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:06.881647 16502 ts_tablet_manager.cc:1403] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.129s	user 0.000s	sys 0.021s
I20260709 13:18:06.881407 16218 tablet_service.cc:1511] Processing CreateTablet for tablet 0a15949e759d40be9560228008490390 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:06.884351 16291 tablet_service.cc:1511] Processing CreateTablet for tablet 0a15949e759d40be9560228008490390 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:06.892004 16291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a15949e759d40be9560228008490390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.901564 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a15949e759d40be9560228008490390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.912454 16441 tablet_service.cc:1511] Processing CreateTablet for tablet 84888dc6b86747d6b08b125a8df5394c (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:06.913935 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84888dc6b86747d6b08b125a8df5394c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.915128 16502 raft_consensus.cc:359] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:06.892004 16364 tablet_service.cc:1511] Processing CreateTablet for tablet 0a15949e759d40be9560228008490390 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
W20260709 13:18:06.926432 16479 tablet.cc:2406] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:18:06.925880 16217 tablet_service.cc:1511] Processing CreateTablet for tablet 84888dc6b86747d6b08b125a8df5394c (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:06.936259 16217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84888dc6b86747d6b08b125a8df5394c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.928457 16502 raft_consensus.cc:385] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.944337 16502 raft_consensus.cc:740] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.943769 16292 tablet_service.cc:1511] Processing CreateTablet for tablet 84888dc6b86747d6b08b125a8df5394c (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:06.945374 16502 consensus_queue.cc:260] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:06.950089 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a15949e759d40be9560228008490390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.945878 16292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84888dc6b86747d6b08b125a8df5394c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.936203 16499 tablet_bootstrap.cc:654] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.965157 16367 tablet_service.cc:1511] Processing CreateTablet for tablet dc75ff85212648e2accfc8fa2e73685e (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:06.975610 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc75ff85212648e2accfc8fa2e73685e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.975666 16498 tablet_bootstrap.cc:492] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:06.976611 16498 ts_tablet_manager.cc:1403] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.148s	user 0.014s	sys 0.021s
I20260709 13:18:06.996589 16500 tablet_bootstrap.cc:492] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:06.997591 16500 ts_tablet_manager.cc:1403] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.156s	user 0.026s	sys 0.018s
I20260709 13:18:07.043154 16404 heartbeater.cc:499] Master 127.5.227.190:42867 was elected leader, sending a full tablet report...
I20260709 13:18:07.026932 16498 raft_consensus.cc:359] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:07.046223 16502 ts_tablet_manager.cc:1434] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.164s	user 0.020s	sys 0.034s
I20260709 13:18:07.051146 16502 tablet_bootstrap.cc:492] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:07.051461 16295 tablet_service.cc:1511] Processing CreateTablet for tablet 08e2d2c479b141a9be75ed9b938e974b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:07.050747 16216 tablet_service.cc:1511] Processing CreateTablet for tablet dc75ff85212648e2accfc8fa2e73685e (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:07.052969 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e2d2c479b141a9be75ed9b938e974b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.053272 16216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc75ff85212648e2accfc8fa2e73685e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.055387 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:07.060117 16513 raft_consensus.cc:493] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.060978 16502 tablet_bootstrap.cc:654] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.060897 16513 raft_consensus.cc:515] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.063328 16440 tablet_service.cc:1511] Processing CreateTablet for tablet dc75ff85212648e2accfc8fa2e73685e (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:07.065042 16440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc75ff85212648e2accfc8fa2e73685e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.067425 16513 leader_election.cc:290] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:07.045410 16498 raft_consensus.cc:385] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.071969 16498 raft_consensus.cc:740] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.073058 16498 consensus_queue.cc:260] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:07.076092 16498 ts_tablet_manager.cc:1434] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.099s	user 0.011s	sys 0.000s
I20260709 13:18:07.077320 16498 tablet_bootstrap.cc:492] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:07.079383 16220 tablet_service.cc:1511] Processing CreateTablet for tablet 1f28345dd0f24a26b496904242ab1d87 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:07.080547 16290 tablet_service.cc:1511] Processing CreateTablet for tablet 1f28345dd0f24a26b496904242ab1d87 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:07.042315 16500 raft_consensus.cc:359] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.087334 16500 raft_consensus.cc:385] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.087827 16500 raft_consensus.cc:740] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.088749 16500 consensus_queue.cc:260] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.089336 16220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f28345dd0f24a26b496904242ab1d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.089977 16305 raft_consensus.cc:2468] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:07.093658 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 08e2d2c479b141a9be75ed9b938e974b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:07.094537 16499 tablet_bootstrap.cc:492] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:07.095229 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e2d2c479b141a9be75ed9b938e974b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.095295 16499 ts_tablet_manager.cc:1403] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.256s	user 0.012s	sys 0.013s
I20260709 13:18:07.099866 16499 raft_consensus.cc:359] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.100755 16499 raft_consensus.cc:385] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.101068 16499 raft_consensus.cc:740] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.102188 16290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f28345dd0f24a26b496904242ab1d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.102396 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
W20260709 13:18:07.104808 16194 leader_election.cc:343] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.105166 16505 raft_consensus.cc:493] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.105804 16505 raft_consensus.cc:515] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.106024 16499 consensus_queue.cc:260] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.108856 16499 ts_tablet_manager.cc:1434] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:18:07.116905 16505 leader_election.cc:290] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:07.129343 16439 tablet_service.cc:1511] Processing CreateTablet for tablet ae815525899842d7983214ddeeec135f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:07.131690 16439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae815525899842d7983214ddeeec135f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.140336 16365 tablet_service.cc:1511] Processing CreateTablet for tablet 08e2d2c479b141a9be75ed9b938e974b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:07.140513 16368 tablet_service.cc:1511] Processing CreateTablet for tablet 1f28345dd0f24a26b496904242ab1d87 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:07.143479 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f28345dd0f24a26b496904242ab1d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.147197 16365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e2d2c479b141a9be75ed9b938e974b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.147763 16500 ts_tablet_manager.cc:1434] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.150s	user 0.004s	sys 0.006s
I20260709 13:18:07.148962 16500 tablet_bootstrap.cc:492] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:07.147331 16498 tablet_bootstrap.cc:654] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.158574 16502 tablet_bootstrap.cc:492] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:07.159970 16502 ts_tablet_manager.cc:1403] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.008s
I20260709 13:18:07.160792 16217 tablet_service.cc:1511] Processing CreateTablet for tablet ae815525899842d7983214ddeeec135f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:07.162555 16217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae815525899842d7983214ddeeec135f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.195055 16507 raft_consensus.cc:493] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.195751 16507 raft_consensus.cc:515] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.178936 16499 tablet_bootstrap.cc:492] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:07.202683 16507 leader_election.cc:290] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:07.170246 16502 raft_consensus.cc:359] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.214226 16502 raft_consensus.cc:385] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.214700 16502 raft_consensus.cc:740] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.215646 16502 consensus_queue.cc:260] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.218052 16502 ts_tablet_manager.cc:1434] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:18:07.219354 16502 tablet_bootstrap.cc:492] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:07.199064 16509 raft_consensus.cc:493] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.232076 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 4702fc1d81a24e6683bf2a12ebd8d108 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:07.238986 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4702fc1d81a24e6683bf2a12ebd8d108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.240167 16291 tablet_service.cc:1511] Processing CreateTablet for tablet ae815525899842d7983214ddeeec135f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:07.243973 16509 raft_consensus.cc:515] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.242478 16291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae815525899842d7983214ddeeec135f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.236370 16194 leader_election.cc:304] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:07.271164 16500 tablet_bootstrap.cc:654] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.271849 16218 tablet_service.cc:1511] Processing CreateTablet for tablet 4702fc1d81a24e6683bf2a12ebd8d108 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:07.273556 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4702fc1d81a24e6683bf2a12ebd8d108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.277172 16508 raft_consensus.cc:2804] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.277880 16508 raft_consensus.cc:493] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.278561 16508 raft_consensus.cc:3060] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.278633 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 4702fc1d81a24e6683bf2a12ebd8d108 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:07.280741 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4702fc1d81a24e6683bf2a12ebd8d108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.286211 16509 leader_election.cc:290] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:07.286531 16294 tablet_service.cc:1511] Processing CreateTablet for tablet eab0948ebbcd4a558567e5fbab88a4b1 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:07.288046 16294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab0948ebbcd4a558567e5fbab88a4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.289580 16367 tablet_service.cc:1511] Processing CreateTablet for tablet eab0948ebbcd4a558567e5fbab88a4b1 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:07.291011 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab0948ebbcd4a558567e5fbab88a4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.296542 16441 tablet_service.cc:1511] Processing CreateTablet for tablet eab0948ebbcd4a558567e5fbab88a4b1 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:07.297385 16498 tablet_bootstrap.cc:492] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:07.298177 16498 ts_tablet_manager.cc:1403] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.221s	user 0.010s	sys 0.016s
I20260709 13:18:07.298249 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab0948ebbcd4a558567e5fbab88a4b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:07.302815 16194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 80742.9us
I20260709 13:18:07.305361 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b93db33f164564bbded82c6ca74a3a" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:07.305626 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b93db33f164564bbded82c6ca74a3a" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:07.306221 16379 raft_consensus.cc:2468] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:07.315037 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e25b852f6d47959be47bdd036d45a2" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:07.316022 16305 raft_consensus.cc:2468] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:07.317288 16343 leader_election.cc:304] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:07.318290 16513 raft_consensus.cc:2804] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.318699 16513 raft_consensus.cc:493] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.319041 16513 raft_consensus.cc:3060] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.322970 16194 leader_election.cc:304] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 
W20260709 13:18:07.324040 16194 leader_election.cc:343] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.324978 16509 raft_consensus.cc:2804] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.325456 16509 raft_consensus.cc:493] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.325822 16509 raft_consensus.cc:3060] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.336807 16513 raft_consensus.cc:515] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.341502 16502 tablet_bootstrap.cc:654] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.342186 16498 raft_consensus.cc:359] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.343214 16498 raft_consensus.cc:385] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.343165 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e25b852f6d47959be47bdd036d45a2" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:07.343794 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e25b852f6d47959be47bdd036d45a2" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:07.346855 16379 raft_consensus.cc:2393] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e0de78970041afb173662b1c34598e in current term 1: Already voted for candidate 0c736bf768804f2e86a875366c12a71c in this term.
I20260709 13:18:07.348385 16220 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0799b6996943f9b0b9093d073d6dbd (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:07.349917 16220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0799b6996943f9b0b9093d073d6dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.345649 16305 raft_consensus.cc:3060] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.354291 16499 tablet_bootstrap.cc:654] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.343768 16498 raft_consensus.cc:740] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.354967 16295 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0799b6996943f9b0b9093d073d6dbd (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:07.355590 16498 consensus_queue.cc:260] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.356621 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0799b6996943f9b0b9093d073d6dbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.356791 16508 raft_consensus.cc:515] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.366081 16508 leader_election.cc:290] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:07.366358 16507 raft_consensus.cc:493] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.366523 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:07.367300 16304 raft_consensus.cc:3060] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.366989 16507 raft_consensus.cc:515] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:07.368196 16498 ts_tablet_manager.cc:1434] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:18:07.369438 16498 tablet_bootstrap.cc:492] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:07.369593 16507 leader_election.cc:290] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:07.380398 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:07.380596 16364 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0799b6996943f9b0b9093d073d6dbd (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:07.382339 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0799b6996943f9b0b9093d073d6dbd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:07.382741 16194 leader_election.cc:343] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.391232 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e25b852f6d47959be47bdd036d45a2" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:07.391362 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e25b852f6d47959be47bdd036d45a2" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:07.392125 16452 raft_consensus.cc:3060] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.390506 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e25b852f6d47959be47bdd036d45a2" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:07.398514 16509 raft_consensus.cc:515] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.400918 16509 leader_election.cc:290] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:07.402266 16452 raft_consensus.cc:2468] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:07.364270 16513 leader_election.cc:290] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:07.402508 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b93db33f164564bbded82c6ca74a3a" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:07.406989 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b93db33f164564bbded82c6ca74a3a" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:07.407661 16379 raft_consensus.cc:3060] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.408265 16268 leader_election.cc:304] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:07.403055 16304 raft_consensus.cc:2468] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
W20260709 13:18:07.415834 16194 leader_election.cc:343] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.416218 16217 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc2538e6830475791d9f70a5adcee9b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:07.417788 16217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc2538e6830475791d9f70a5adcee9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.417538 16194 leader_election.cc:304] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:07.420432 16509 raft_consensus.cc:2804] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.420692 16292 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc2538e6830475791d9f70a5adcee9b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:07.421119 16509 raft_consensus.cc:697] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:07.422202 16509 consensus_queue.cc:237] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.422204 16292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc2538e6830475791d9f70a5adcee9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.424337 16342 leader_election.cc:304] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:07.425371 16513 raft_consensus.cc:2804] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.435351 16500 tablet_bootstrap.cc:492] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:07.436230 16500 ts_tablet_manager.cc:1403] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.288s	user 0.013s	sys 0.003s
I20260709 13:18:07.440220 16305 raft_consensus.cc:2468] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:07.441054 16505 raft_consensus.cc:2749] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.445609 16498 tablet_bootstrap.cc:654] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.456971 16500 raft_consensus.cc:359] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:07.457861 16500 raft_consensus.cc:385] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.458163 16500 raft_consensus.cc:740] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.468111 16500 consensus_queue.cc:260] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:07.476982 16439 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc2538e6830475791d9f70a5adcee9b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:07.478147 16500 ts_tablet_manager.cc:1434] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.004s
I20260709 13:18:07.478611 16439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc2538e6830475791d9f70a5adcee9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.484820 16500 tablet_bootstrap.cc:492] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:07.467659 16513 raft_consensus.cc:697] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:07.488581 16513 consensus_queue.cc:237] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.482587 16379 raft_consensus.cc:2468] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:07.492841 16194 leader_election.cc:304] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:07.494211 16508 raft_consensus.cc:2804] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.468781 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5ed6ba8f644df7bcec53f34c63a569 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:07.500326 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5ed6ba8f644df7bcec53f34c63a569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.506394 16508 raft_consensus.cc:697] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:07.516108 16508 consensus_queue.cc:237] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.512302 16218 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5ed6ba8f644df7bcec53f34c63a569 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:07.513383 16291 tablet_service.cc:1511] Processing CreateTablet for tablet afba79efe5d1481e8a1a31d1da74dd55 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:07.518471 16367 tablet_service.cc:1511] Processing CreateTablet for tablet afba79efe5d1481e8a1a31d1da74dd55 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:07.519312 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5ed6ba8f644df7bcec53f34c63a569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.519443 16291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afba79efe5d1481e8a1a31d1da74dd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.520659 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afba79efe5d1481e8a1a31d1da74dd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.505975 16499 tablet_bootstrap.cc:492] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:07.523057 16499 ts_tablet_manager.cc:1403] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.394s	user 0.017s	sys 0.025s
I20260709 13:18:07.525290 16500 tablet_bootstrap.cc:654] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.521428 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0408e10512d4613a6250d70072ab152" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
W20260709 13:18:07.527777 16175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:18:07.528103 16417 leader_election.cc:343] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.499219 16441 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5ed6ba8f644df7bcec53f34c63a569 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:07.533054 16502 tablet_bootstrap.cc:492] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:07.541093 16502 ts_tablet_manager.cc:1403] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.322s	user 0.014s	sys 0.008s
I20260709 13:18:07.541245 16216 tablet_service.cc:1511] Processing CreateTablet for tablet 6196aafd32f448a7964c50df2be2a4b3 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:07.541992 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0408e10512d4613a6250d70072ab152" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:07.542939 16216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6196aafd32f448a7964c50df2be2a4b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:07.543911 16419 leader_election.cc:343] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.544462 16419 leader_election.cc:304] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:07.544644 16502 raft_consensus.cc:359] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.545473 16502 raft_consensus.cc:385] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.545778 16502 raft_consensus.cc:740] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.546043 16528 raft_consensus.cc:2749] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.541460 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738b09b19983412bbbf2fccd7c5687b5" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:07.549870 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5ed6ba8f644df7bcec53f34c63a569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.550128 16443 tablet_service.cc:1511] Processing CreateTablet for tablet afba79efe5d1481e8a1a31d1da74dd55 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
W20260709 13:18:07.554279 16419 leader_election.cc:343] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.555905 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afba79efe5d1481e8a1a31d1da74dd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.555799 16127 catalog_manager.cc:5697] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.562114 16498 tablet_bootstrap.cc:492] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:07.546566 16502 consensus_queue.cc:260] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.564616 16502 ts_tablet_manager.cc:1434] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:18:07.565826 16502 tablet_bootstrap.cc:492] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:07.566843 16498 ts_tablet_manager.cc:1403] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.198s	user 0.010s	sys 0.008s
I20260709 13:18:07.584071 16440 tablet_service.cc:1511] Processing CreateTablet for tablet 295c483df4e74d1a8314d5219167cc16 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:07.586282 16440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295c483df4e74d1a8314d5219167cc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.588932 16498 raft_consensus.cc:359] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:07.589383 16220 tablet_service.cc:1511] Processing CreateTablet for tablet 295c483df4e74d1a8314d5219167cc16 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:07.590862 16220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295c483df4e74d1a8314d5219167cc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.589815 16498 raft_consensus.cc:385] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.594493 16498 raft_consensus.cc:740] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.597600 16498 consensus_queue.cc:260] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:07.600940 16498 ts_tablet_manager.cc:1434] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.005s
I20260709 13:18:07.602111 16498 tablet_bootstrap.cc:492] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:07.606397 16292 tablet_service.cc:1511] Processing CreateTablet for tablet 6196aafd32f448a7964c50df2be2a4b3 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:07.607959 16292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6196aafd32f448a7964c50df2be2a4b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.548417 16499 raft_consensus.cc:359] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.618106 16499 raft_consensus.cc:385] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.618575 16499 raft_consensus.cc:740] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.623700 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738b09b19983412bbbf2fccd7c5687b5" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:07.626943 16305 raft_consensus.cc:2468] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:07.631316 16417 leader_election.cc:304] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:07.631918 16498 tablet_bootstrap.cc:654] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.632745 16528 raft_consensus.cc:2804] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.633188 16528 raft_consensus.cc:493] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.633549 16528 raft_consensus.cc:3060] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.635955 16295 tablet_service.cc:1511] Processing CreateTablet for tablet 295c483df4e74d1a8314d5219167cc16 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:07.637421 16502 tablet_bootstrap.cc:654] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.637686 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295c483df4e74d1a8314d5219167cc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.635943 16364 tablet_service.cc:1511] Processing CreateTablet for tablet 6196aafd32f448a7964c50df2be2a4b3 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:07.640151 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6196aafd32f448a7964c50df2be2a4b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.640585 16499 consensus_queue.cc:260] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.644824 16499 ts_tablet_manager.cc:1434] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.000s
I20260709 13:18:07.654835 16365 tablet_service.cc:1511] Processing CreateTablet for tablet 8997dd86a5ac421ba825e30c817e3ceb (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:07.657286 16365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8997dd86a5ac421ba825e30c817e3ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.661863 16499 tablet_bootstrap.cc:492] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:07.672226 16124 catalog_manager.cc:5697] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.682927 16500 tablet_bootstrap.cc:492] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:07.689793 16500 ts_tablet_manager.cc:1403] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.205s	user 0.017s	sys 0.042s
I20260709 13:18:07.691798 16528 raft_consensus.cc:515] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:07.693856 16499 tablet_bootstrap.cc:654] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.695474 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738b09b19983412bbbf2fccd7c5687b5" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:07.698418 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738b09b19983412bbbf2fccd7c5687b5" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
W20260709 13:18:07.698990 16419 leader_election.cc:343] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.699120 16305 raft_consensus.cc:3060] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.696825 16500 raft_consensus.cc:359] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.701865 16500 raft_consensus.cc:385] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.702760 16500 raft_consensus.cc:740] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.701798 16439 tablet_service.cc:1511] Processing CreateTablet for tablet 8997dd86a5ac421ba825e30c817e3ceb (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:07.704365 16500 consensus_queue.cc:260] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.694346 16528 leader_election.cc:290] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:07.707647 16439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8997dd86a5ac421ba825e30c817e3ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.715302 16500 ts_tablet_manager.cc:1434] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:18:07.718425 16218 tablet_service.cc:1511] Processing CreateTablet for tablet 8997dd86a5ac421ba825e30c817e3ceb (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:07.720574 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8997dd86a5ac421ba825e30c817e3ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.730341 16291 tablet_service.cc:1511] Processing CreateTablet for tablet 1e67f760e0414db092683b5e5ce3ef8f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:07.731907 16291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e67f760e0414db092683b5e5ce3ef8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.735777 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 1e67f760e0414db092683b5e5ce3ef8f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:07.736327 16441 tablet_service.cc:1511] Processing CreateTablet for tablet 1e67f760e0414db092683b5e5ce3ef8f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:07.737051 16502 tablet_bootstrap.cc:492] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:07.737223 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e67f760e0414db092683b5e5ce3ef8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.737777 16502 ts_tablet_manager.cc:1403] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.172s	user 0.016s	sys 0.013s
I20260709 13:18:07.737829 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e67f760e0414db092683b5e5ce3ef8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.741163 16305 raft_consensus.cc:2468] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:07.742841 16417 leader_election.cc:304] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:07.743072 16502 raft_consensus.cc:359] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.743860 16502 raft_consensus.cc:385] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.744190 16502 raft_consensus.cc:740] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.746408 16500 tablet_bootstrap.cc:492] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:07.746583 16508 raft_consensus.cc:493] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.747172 16508 raft_consensus.cc:515] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.752256 16508 leader_election.cc:290] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:07.752612 16295 tablet_service.cc:1511] Processing CreateTablet for tablet 029ee74f09f8428c81f8feae77fd8e84 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:07.754108 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029ee74f09f8428c81f8feae77fd8e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.758862 16528 raft_consensus.cc:2804] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.760113 16220 tablet_service.cc:1511] Processing CreateTablet for tablet 029ee74f09f8428c81f8feae77fd8e84 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:07.761682 16220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029ee74f09f8428c81f8feae77fd8e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.771009 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0408e10512d4613a6250d70072ab152" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:07.776166 16379 raft_consensus.cc:2468] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:07.778229 16194 leader_election.cc:304] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:07.782963 16508 raft_consensus.cc:2804] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.783624 16508 raft_consensus.cc:493] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.784116 16508 raft_consensus.cc:3060] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.762939 16528 raft_consensus.cc:697] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:07.786837 16528 consensus_queue.cc:237] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:07.778264 16500 tablet_bootstrap.cc:654] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.792912 16498 tablet_bootstrap.cc:492] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:07.793586 16498 ts_tablet_manager.cc:1403] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.192s	user 0.016s	sys 0.004s
I20260709 13:18:07.797559 16498 raft_consensus.cc:359] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:07.798764 16498 raft_consensus.cc:385] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.799134 16498 raft_consensus.cc:740] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.800338 16498 consensus_queue.cc:260] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:07.805291 16498 ts_tablet_manager.cc:1434] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:18:07.768378 16502 consensus_queue.cc:260] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.819350 16498 tablet_bootstrap.cc:492] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:07.830119 16440 tablet_service.cc:1511] Processing CreateTablet for tablet 58607755710543c9809dbf53631f4738 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:07.832217 16217 tablet_service.cc:1511] Processing CreateTablet for tablet 58607755710543c9809dbf53631f4738 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:07.832901 16440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58607755710543c9809dbf53631f4738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.833981 16217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58607755710543c9809dbf53631f4738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.830030 16367 tablet_service.cc:1511] Processing CreateTablet for tablet 029ee74f09f8428c81f8feae77fd8e84 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:07.836424 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029ee74f09f8428c81f8feae77fd8e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.841114 16505 raft_consensus.cc:493] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.841738 16505 raft_consensus.cc:515] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:07.843748 16502 ts_tablet_manager.cc:1434] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.000s
I20260709 13:18:07.844391 16505 leader_election.cc:290] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:07.845005 16502 tablet_bootstrap.cc:492] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:07.845731 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b93db33f164564bbded82c6ca74a3a" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:07.850518 16379 raft_consensus.cc:2393] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e0de78970041afb173662b1c34598e in current term 1: Already voted for candidate fe046a372b6a4df982eebe83cf3ee184 in this term.
I20260709 13:18:07.854310 16295 tablet_service.cc:1511] Processing CreateTablet for tablet 58607755710543c9809dbf53631f4738 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:07.864291 16499 tablet_bootstrap.cc:492] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:07.864936 16499 ts_tablet_manager.cc:1403] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.203s	user 0.008s	sys 0.029s
I20260709 13:18:07.865664 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58607755710543c9809dbf53631f4738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.877612 16508 raft_consensus.cc:515] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.885643 16499 raft_consensus.cc:359] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:07.890962 16499 raft_consensus.cc:385] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.896567 16369 tablet_service.cc:1511] Processing CreateTablet for tablet b86655b05b814b00bcf81c0da904bdaf (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:07.901024 16500 tablet_bootstrap.cc:492] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:07.903298 16443 tablet_service.cc:1511] Processing CreateTablet for tablet b86655b05b814b00bcf81c0da904bdaf (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:07.906850 16498 tablet_bootstrap.cc:654] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.910802 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86655b05b814b00bcf81c0da904bdaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.911723 16502 tablet_bootstrap.cc:654] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.917742 16218 tablet_service.cc:1511] Processing CreateTablet for tablet b86655b05b814b00bcf81c0da904bdaf (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:07.919200 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86655b05b814b00bcf81c0da904bdaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.908008 16499 raft_consensus.cc:740] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.921485 16128 catalog_manager.cc:5697] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.919246 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b86655b05b814b00bcf81c0da904bdaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.922757 16499 consensus_queue.cc:260] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:07.925300 16499 ts_tablet_manager.cc:1434] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:18:07.922365 16305 raft_consensus.cc:3060] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.927959 16508 leader_election.cc:290] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:07.928370 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0408e10512d4613a6250d70072ab152" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:07.929100 16452 raft_consensus.cc:2468] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:07.929322 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0408e10512d4613a6250d70072ab152" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:07.929991 16453 raft_consensus.cc:3060] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.931236 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0408e10512d4613a6250d70072ab152" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:07.931918 16379 raft_consensus.cc:3060] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.934044 16127 catalog_manager.cc:5697] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.926466 16499 tablet_bootstrap.cc:492] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:07.937618 16513 raft_consensus.cc:493] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.943852 16531 consensus_queue.cc:1048] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.944540 16513 raft_consensus.cc:515] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.948611 16365 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab0b93ad21849139b174c34a46ce646 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:07.948598 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c65063a9241f6a62a7867005e3e57" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:07.941424 16453 raft_consensus.cc:2468] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:07.955802 16193 leader_election.cc:304] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
W20260709 13:18:07.956698 16343 leader_election.cc:343] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.957100 16509 raft_consensus.cc:2804] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.957726 16509 raft_consensus.cc:697] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:07.958463 16365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab0b93ad21849139b174c34a46ce646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.958688 16509 consensus_queue.cc:237] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.963277 16513 leader_election.cc:290] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:07.940240 16500 ts_tablet_manager.cc:1403] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.224s	user 0.022s	sys 0.002s
I20260709 13:18:07.968057 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c65063a9241f6a62a7867005e3e57" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:07.969048 16439 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab0b93ad21849139b174c34a46ce646 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:07.970710 16439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab0b93ad21849139b174c34a46ce646. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:07.970930 16342 leader_election.cc:343] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.971685 16342 leader_election.cc:304] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:07.973717 16513 raft_consensus.cc:2749] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.944208 16295 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab0b93ad21849139b174c34a46ce646 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:07.976925 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab0b93ad21849139b174c34a46ce646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:07.988816 16500 raft_consensus.cc:359] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:07.997581 16220 tablet_service.cc:1511] Processing CreateTablet for tablet 2485b97ef87a4855b8cc1c0f6e0ba2c7 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:08.000741 16533 consensus_queue.cc:1048] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.005059 16513 consensus_queue.cc:1048] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.992753 16500 raft_consensus.cc:385] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.031798 16379 raft_consensus.cc:2468] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:08.024907 16500 raft_consensus.cc:740] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.045343 16507 raft_consensus.cc:493] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.040928 16220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2485b97ef87a4855b8cc1c0f6e0ba2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.046145 16507 raft_consensus.cc:515] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:08.047118 16364 tablet_service.cc:1511] Processing CreateTablet for tablet 2485b97ef87a4855b8cc1c0f6e0ba2c7 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:08.048682 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2485b97ef87a4855b8cc1c0f6e0ba2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.049206 16499 tablet_bootstrap.cc:654] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.061074 16441 tablet_service.cc:1511] Processing CreateTablet for tablet c96fff68e07b4c3f82332cd44d0dd3d2 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:08.063392 16507 leader_election.cc:290] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:08.066543 16502 tablet_bootstrap.cc:492] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:08.067085 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96fff68e07b4c3f82332cd44d0dd3d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.067521 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128dfcd70ea847fbae9691a10e6db1a5" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:08.068877 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128dfcd70ea847fbae9691a10e6db1a5" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
W20260709 13:18:08.070503 16419 leader_election.cc:343] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.067201 16502 ts_tablet_manager.cc:1403] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.222s	user 0.033s	sys 0.046s
I20260709 13:18:08.071245 16498 tablet_bootstrap.cc:492] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:08.080314 16498 ts_tablet_manager.cc:1403] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.268s	user 0.015s	sys 0.020s
I20260709 13:18:08.080749 16500 consensus_queue.cc:260] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:08.082957 16502 raft_consensus.cc:359] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:08.083947 16502 raft_consensus.cc:385] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.084312 16502 raft_consensus.cc:740] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
W20260709 13:18:08.073712 16417 leader_election.cc:343] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.085186 16502 consensus_queue.cc:260] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:08.085635 16417 leader_election.cc:304] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:08.066175 16128 catalog_manager.cc:5697] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.077474 16295 tablet_service.cc:1511] Processing CreateTablet for tablet 2485b97ef87a4855b8cc1c0f6e0ba2c7 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:08.092308 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2485b97ef87a4855b8cc1c0f6e0ba2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.091308 16507 raft_consensus.cc:2749] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.105301 16500 ts_tablet_manager.cc:1434] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.141s	user 0.006s	sys 0.002s
I20260709 13:18:08.109794 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b93db33f164564bbded82c6ca74a3a" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:08.111723 16498 raft_consensus.cc:359] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:08.112732 16498 raft_consensus.cc:385] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.112871 16271 leader_election.cc:304] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:08.113633 16218 tablet_service.cc:1511] Processing CreateTablet for tablet c96fff68e07b4c3f82332cd44d0dd3d2 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:08.114593 16505 raft_consensus.cc:2749] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.115127 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96fff68e07b4c3f82332cd44d0dd3d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.087692 16508 consensus_queue.cc:1048] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:18:08.113135 16498 raft_consensus.cc:740] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.091149 16509 consensus_queue.cc:1048] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:18:08.133314 16291 tablet_service.cc:1511] Processing CreateTablet for tablet c96fff68e07b4c3f82332cd44d0dd3d2 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:08.128717 16500 tablet_bootstrap.cc:492] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:08.144608 16369 tablet_service.cc:1511] Processing CreateTablet for tablet a13fb80f9cf64345a2b3e9f4009281b6 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:08.145833 16379 raft_consensus.cc:3060] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.152833 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a13fb80f9cf64345a2b3e9f4009281b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.152558 16498 consensus_queue.cc:260] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:08.137109 16291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96fff68e07b4c3f82332cd44d0dd3d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.181156 16502 ts_tablet_manager.cc:1434] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.002s
I20260709 13:18:08.189702 16292 tablet_service.cc:1511] Processing CreateTablet for tablet 751bec01e5d145adac78c28b7b581d73 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:08.221444 16502 tablet_bootstrap.cc:492] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:08.221885 16292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 751bec01e5d145adac78c28b7b581d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.195319 16440 tablet_service.cc:1511] Processing CreateTablet for tablet a13fb80f9cf64345a2b3e9f4009281b6 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:08.228113 16440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a13fb80f9cf64345a2b3e9f4009281b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.228598 16502 tablet_bootstrap.cc:654] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.197723 16442 tablet_service.cc:1511] Processing CreateTablet for tablet 751bec01e5d145adac78c28b7b581d73 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:08.231814 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 751bec01e5d145adac78c28b7b581d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.205159 16367 tablet_service.cc:1511] Processing CreateTablet for tablet 751bec01e5d145adac78c28b7b581d73 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:08.205374 16368 tablet_service.cc:1511] Processing CreateTablet for tablet dbce7ea12f554f25812e7ef8fdcc892e (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:08.237463 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 751bec01e5d145adac78c28b7b581d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.216747 16499 tablet_bootstrap.cc:492] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:08.200165 16498 ts_tablet_manager.cc:1434] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.002s
I20260709 13:18:08.232757 16295 tablet_service.cc:1511] Processing CreateTablet for tablet dbce7ea12f554f25812e7ef8fdcc892e (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:08.246238 16499 ts_tablet_manager.cc:1403] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.320s	user 0.033s	sys 0.013s
I20260709 13:18:08.246902 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbce7ea12f554f25812e7ef8fdcc892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.247159 16498 tablet_bootstrap.cc:492] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:08.233341 16218 tablet_service.cc:1511] Processing CreateTablet for tablet a13fb80f9cf64345a2b3e9f4009281b6 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:08.235738 16217 tablet_service.cc:1511] Processing CreateTablet for tablet dbce7ea12f554f25812e7ef8fdcc892e (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:08.250752 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbce7ea12f554f25812e7ef8fdcc892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.251649 16217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbce7ea12f554f25812e7ef8fdcc892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.208859 16507 raft_consensus.cc:493] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.254700 16507 raft_consensus.cc:515] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:08.242460 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 145398d14cf9402e819285d9fc5253b9 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:08.256740 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a13fb80f9cf64345a2b3e9f4009281b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.258303 16533 raft_consensus.cc:493] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.263352 16533 raft_consensus.cc:515] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:08.266474 16533 leader_election.cc:290] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:08.269073 16528 consensus_queue.cc:1048] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.270015 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145398d14cf9402e819285d9fc5253b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.269891 16220 tablet_service.cc:1511] Processing CreateTablet for tablet 145398d14cf9402e819285d9fc5253b9 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:08.271365 16220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145398d14cf9402e819285d9fc5253b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.271883 16499 raft_consensus.cc:359] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:08.272739 16499 raft_consensus.cc:385] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.273026 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:08.282763 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:08.284106 16560 raft_consensus.cc:493] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.284678 16560 raft_consensus.cc:515] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:08.289119 16528 raft_consensus.cc:493] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.289757 16528 raft_consensus.cc:515] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:08.295183 16560 leader_election.cc:290] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:08.295506 16528 leader_election.cc:290] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:08.273044 16499 raft_consensus.cc:740] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.305744 16505 raft_consensus.cc:493] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.311102 16505 raft_consensus.cc:515] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:08.311869 16507 leader_election.cc:290] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:08.313148 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:08.292088 16452 raft_consensus.cc:2468] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:08.313421 16505 leader_election.cc:290] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:08.319761 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c65063a9241f6a62a7867005e3e57" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:08.320637 16379 raft_consensus.cc:2468] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:08.330889 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:08.315341 16229 raft_consensus.cc:2468] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:08.333811 16365 tablet_service.cc:1511] Processing CreateTablet for tablet ccf1f8703ff64c89afb0d1dbe0eab26f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:08.335376 16419 leader_election.cc:304] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:08.335510 16295 tablet_service.cc:1511] Processing CreateTablet for tablet 145398d14cf9402e819285d9fc5253b9 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:08.336615 16507 raft_consensus.cc:2804] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.336910 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145398d14cf9402e819285d9fc5253b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.337018 16507 raft_consensus.cc:493] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.337438 16507 raft_consensus.cc:3060] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.340027 16365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf1f8703ff64c89afb0d1dbe0eab26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.340655 16366 tablet_service.cc:1511] Processing CreateTablet for tablet 20206667639a48e8a81abb2b99441995 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:08.342092 16366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20206667639a48e8a81abb2b99441995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.342995 16417 leader_election.cc:304] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:08.343124 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c65063a9241f6a62a7867005e3e57" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:08.315017 16533 consensus_queue.cc:1048] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:18:08.344053 16453 raft_consensus.cc:2468] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:08.344679 16528 raft_consensus.cc:2804] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.345090 16528 raft_consensus.cc:493] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.345461 16528 raft_consensus.cc:3060] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.345352 16193 leader_election.cc:304] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:08.345965 16291 tablet_service.cc:1511] Processing CreateTablet for tablet 20206667639a48e8a81abb2b99441995 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:08.346980 16268 leader_election.cc:304] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:08.347465 16291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20206667639a48e8a81abb2b99441995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.348233 16505 raft_consensus.cc:2804] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.348747 16505 raft_consensus.cc:493] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.349161 16505 raft_consensus.cc:3060] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.349659 16499 consensus_queue.cc:260] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:08.343458 16500 tablet_bootstrap.cc:654] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.361661 16216 tablet_service.cc:1511] Processing CreateTablet for tablet ccf1f8703ff64c89afb0d1dbe0eab26f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:08.363343 16216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf1f8703ff64c89afb0d1dbe0eab26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.370886 16439 tablet_service.cc:1511] Processing CreateTablet for tablet 20206667639a48e8a81abb2b99441995 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:08.378685 16439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20206667639a48e8a81abb2b99441995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.383062 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c65063a9241f6a62a7867005e3e57" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:08.383220 16441 tablet_service.cc:1511] Processing CreateTablet for tablet ccf1f8703ff64c89afb0d1dbe0eab26f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:08.384042 16379 raft_consensus.cc:2468] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:08.384790 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf1f8703ff64c89afb0d1dbe0eab26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.384922 16498 tablet_bootstrap.cc:654] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.343233 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:08.385241 16509 raft_consensus.cc:2804] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.389231 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c65063a9241f6a62a7867005e3e57" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:08.388515 16194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 92405.9us
I20260709 13:18:08.398864 16509 raft_consensus.cc:493] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:08.419081 16417 leader_election.cc:343] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.432121 16295 tablet_service.cc:1511] Processing CreateTablet for tablet b562a19c9d1947508c77a1a946dc873b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:08.433507 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b562a19c9d1947508c77a1a946dc873b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.420902 16502 tablet_bootstrap.cc:492] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:08.437856 16502 ts_tablet_manager.cc:1403] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.217s	user 0.011s	sys 0.016s
W20260709 13:18:08.431999 16194 leader_election.cc:343] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.441584 16502 raft_consensus.cc:359] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:08.447081 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:08.449076 16345 leader_election.cc:304] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:08.446226 16364 tablet_service.cc:1511] Processing CreateTablet for tablet b562a19c9d1947508c77a1a946dc873b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:08.457027 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b562a19c9d1947508c77a1a946dc873b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.464473 16566 consensus_queue.cc:1048] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.465363 16438 tablet_service.cc:1511] Processing CreateTablet for tablet e6acf3d9f73d4f38817c4ea25ba9139b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:08.467478 16438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6acf3d9f73d4f38817c4ea25ba9139b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.431877 16509 raft_consensus.cc:3060] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.469343 16217 tablet_service.cc:1511] Processing CreateTablet for tablet b562a19c9d1947508c77a1a946dc873b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:08.479205 16217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b562a19c9d1947508c77a1a946dc873b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.442474 16502 raft_consensus.cc:385] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.483059 16502 raft_consensus.cc:740] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.497536 16500 tablet_bootstrap.cc:492] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:08.500447 16505 raft_consensus.cc:515] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:08.503295 16305 raft_consensus.cc:2393] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0763e17c84d248738dade73ded2c5f71 in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:08.507016 16507 raft_consensus.cc:515] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:08.509930 16218 tablet_service.cc:1511] Processing CreateTablet for tablet e6acf3d9f73d4f38817c4ea25ba9139b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:08.510565 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:08.511301 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c65063a9241f6a62a7867005e3e57" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:08.511850 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6acf3d9f73d4f38817c4ea25ba9139b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.511948 16378 raft_consensus.cc:3060] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.525755 16509 raft_consensus.cc:515] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:08.526753 16502 consensus_queue.cc:260] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:08.532196 16505 leader_election.cc:290] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:08.533165 16229 raft_consensus.cc:2393] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0763e17c84d248738dade73ded2c5f71 in current term 1: Already voted for candidate fe046a372b6a4df982eebe83cf3ee184 in this term.
I20260709 13:18:08.532858 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 99394f0dfd1046148485eae1db42c1fb (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:08.533908 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c65063a9241f6a62a7867005e3e57" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:08.534487 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99394f0dfd1046148485eae1db42c1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.535934 16570 consensus_queue.cc:1048] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:08.536620 16175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:08.530450 16502 ts_tablet_manager.cc:1434] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 13:18:08.519675 16528 raft_consensus.cc:515] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:08.548667 16507 leader_election.cc:290] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:08.540351 16500 ts_tablet_manager.cc:1403] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.418s	user 0.006s	sys 0.017s
I20260709 13:18:08.555325 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:08.556334 16452 raft_consensus.cc:2393] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35e0de78970041afb173662b1c34598e in current term 1: Already voted for candidate 0763e17c84d248738dade73ded2c5f71 in this term.
I20260709 13:18:08.557837 16502 tablet_bootstrap.cc:492] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:08.558254 16498 tablet_bootstrap.cc:492] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:08.558822 16498 ts_tablet_manager.cc:1403] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.312s	user 0.017s	sys 0.007s
I20260709 13:18:08.559300 16528 leader_election.cc:290] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:08.564325 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c65063a9241f6a62a7867005e3e57" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:08.564551 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c65063a9241f6a62a7867005e3e57" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:08.565474 16304 raft_consensus.cc:2393] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0763e17c84d248738dade73ded2c5f71 in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:08.556421 16219 tablet_service.cc:1511] Processing CreateTablet for tablet 99394f0dfd1046148485eae1db42c1fb (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:08.568778 16219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99394f0dfd1046148485eae1db42c1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.573503 16295 tablet_service.cc:1511] Processing CreateTablet for tablet e6acf3d9f73d4f38817c4ea25ba9139b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 13:18:08.579298 16417 leader_election.cc:343] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.580050 16417 leader_election.cc:304] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:08.581420 16229 raft_consensus.cc:3060] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.583878 16498 raft_consensus.cc:359] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:08.584730 16498 raft_consensus.cc:385] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.585053 16498 raft_consensus.cc:740] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.585799 16498 consensus_queue.cc:260] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:08.586848 16560 raft_consensus.cc:2749] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:08.591558 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 99394f0dfd1046148485eae1db42c1fb (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:08.591675 16509 leader_election.cc:290] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:08.593252 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99394f0dfd1046148485eae1db42c1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.594017 16507 raft_consensus.cc:2749] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.581342 16417 leader_election.cc:304] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:08.596822 16507 raft_consensus.cc:2749] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.597046 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:08.597962 16452 raft_consensus.cc:2393] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0763e17c84d248738dade73ded2c5f71 in this term.
I20260709 13:18:08.606192 16367 tablet_service.cc:1511] Processing CreateTablet for tablet a2559ecae96646189c0bc8afbe49ce16 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:08.606971 16500 raft_consensus.cc:359] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:08.607595 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2559ecae96646189c0bc8afbe49ce16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.607859 16500 raft_consensus.cc:385] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.608229 16500 raft_consensus.cc:740] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.608481 16498 ts_tablet_manager.cc:1434] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.003s
I20260709 13:18:08.609061 16500 consensus_queue.cc:260] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:08.610122 16498 tablet_bootstrap.cc:492] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:08.616113 16499 ts_tablet_manager.cc:1434] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.369s	user 0.010s	sys 0.010s
I20260709 13:18:08.621309 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6acf3d9f73d4f38817c4ea25ba9139b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.620494 16499 tablet_bootstrap.cc:492] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:08.594168 16292 tablet_service.cc:1511] Processing CreateTablet for tablet a2559ecae96646189c0bc8afbe49ce16 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:08.647094 16378 raft_consensus.cc:2468] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:08.648988 16269 leader_election.cc:304] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 0763e17c84d248738dade73ded2c5f71
I20260709 13:18:08.649863 16502 tablet_bootstrap.cc:654] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.650146 16505 raft_consensus.cc:2804] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.650749 16505 raft_consensus.cc:697] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:08.651728 16505 consensus_queue.cc:237] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:08.652213 16441 tablet_service.cc:1511] Processing CreateTablet for tablet a2559ecae96646189c0bc8afbe49ce16 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:08.653605 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2559ecae96646189c0bc8afbe49ce16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.660400 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:08.662523 16292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2559ecae96646189c0bc8afbe49ce16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.668830 16218 tablet_service.cc:1511] Processing CreateTablet for tablet e1d2386a536042dcb0271fdc91474697 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:08.670184 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d2386a536042dcb0271fdc91474697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.673349 16498 tablet_bootstrap.cc:654] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.676926 16294 tablet_service.cc:1511] Processing CreateTablet for tablet e1d2386a536042dcb0271fdc91474697 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:08.678184 16500 ts_tablet_manager.cc:1434] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.107s	user 0.002s	sys 0.006s
I20260709 13:18:08.679472 16500 tablet_bootstrap.cc:492] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:08.679716 16442 tablet_service.cc:1511] Processing CreateTablet for tablet 2d99e00427c045ab9f5b3c444ecf06a0 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:08.678493 16294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d2386a536042dcb0271fdc91474697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.681147 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d99e00427c045ab9f5b3c444ecf06a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.693405 16570 raft_consensus.cc:493] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.694120 16570 raft_consensus.cc:515] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:08.697136 16500 tablet_bootstrap.cc:654] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.697754 16570 leader_election.cc:290] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:08.699517 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738b09b19983412bbbf2fccd7c5687b5" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:08.700788 16305 raft_consensus.cc:3060] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.704514 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738b09b19983412bbbf2fccd7c5687b5" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:08.706233 16194 leader_election.cc:304] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:08.707969 16570 raft_consensus.cc:2749] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:08.714850 16499 tablet_bootstrap.cc:654] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.715461 16365 tablet_service.cc:1511] Processing CreateTablet for tablet e1d2386a536042dcb0271fdc91474697 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:08.720707 16577 consensus_queue.cc:1048] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.735488 16216 tablet_service.cc:1511] Processing CreateTablet for tablet 2d99e00427c045ab9f5b3c444ecf06a0 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:08.735567 16291 tablet_service.cc:1511] Processing CreateTablet for tablet 2d99e00427c045ab9f5b3c444ecf06a0 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:08.737748 16291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d99e00427c045ab9f5b3c444ecf06a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.738550 16217 tablet_service.cc:1511] Processing CreateTablet for tablet 3943f59d05384cb0b44c356da96441c8 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:08.739547 16365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d2386a536042dcb0271fdc91474697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.739413 16367 tablet_service.cc:1511] Processing CreateTablet for tablet 3943f59d05384cb0b44c356da96441c8 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:08.741062 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3943f59d05384cb0b44c356da96441c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.745014 16295 tablet_service.cc:1511] Processing CreateTablet for tablet 78eb3c242fc743cf98a4f1d7cffd975b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:08.752417 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78eb3c242fc743cf98a4f1d7cffd975b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.756983 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 3943f59d05384cb0b44c356da96441c8 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:08.758432 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3943f59d05384cb0b44c356da96441c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.761153 16364 tablet_service.cc:1511] Processing CreateTablet for tablet 78eb3c242fc743cf98a4f1d7cffd975b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:08.779703 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78eb3c242fc743cf98a4f1d7cffd975b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.783623 16216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d99e00427c045ab9f5b3c444ecf06a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.785101 16217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3943f59d05384cb0b44c356da96441c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.803153 16502 tablet_bootstrap.cc:492] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:08.803620 16305 raft_consensus.cc:2468] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:08.803870 16502 ts_tablet_manager.cc:1403] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.246s	user 0.009s	sys 0.018s
I20260709 13:18:08.805528 16194 leader_election.cc:304] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71
I20260709 13:18:08.806536 16570 raft_consensus.cc:2804] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.807219 16570 raft_consensus.cc:697] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:08.808043 16570 consensus_queue.cc:237] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:08.810101 16502 raft_consensus.cc:359] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:08.811321 16502 raft_consensus.cc:385] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.811650 16502 raft_consensus.cc:740] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.811856 16441 tablet_service.cc:1511] Processing CreateTablet for tablet 78eb3c242fc743cf98a4f1d7cffd975b (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:08.812568 16502 consensus_queue.cc:260] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:08.813416 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78eb3c242fc743cf98a4f1d7cffd975b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.814944 16366 tablet_service.cc:1511] Processing CreateTablet for tablet 246e5a50c75e4f0fa58538237d61e585 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:08.815384 16502 ts_tablet_manager.cc:1434] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:18:08.815899 16290 tablet_service.cc:1511] Processing CreateTablet for tablet 246e5a50c75e4f0fa58538237d61e585 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:08.816603 16366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246e5a50c75e4f0fa58538237d61e585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.817178 16502 tablet_bootstrap.cc:492] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:08.817533 16290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246e5a50c75e4f0fa58538237d61e585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.825444 16218 tablet_service.cc:1511] Processing CreateTablet for tablet 246e5a50c75e4f0fa58538237d61e585 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:08.827484 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246e5a50c75e4f0fa58538237d61e585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.834216 16502 tablet_bootstrap.cc:654] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.801740 16124 catalog_manager.cc:5697] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.878305 16498 tablet_bootstrap.cc:492] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:08.878886 16498 ts_tablet_manager.cc:1403] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.269s	user 0.025s	sys 0.020s
I20260709 13:18:08.883301 16499 tablet_bootstrap.cc:492] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:08.883977 16499 ts_tablet_manager.cc:1403] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.266s	user 0.014s	sys 0.021s
I20260709 13:18:08.887848 16499 raft_consensus.cc:359] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:08.888734 16499 raft_consensus.cc:385] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.888823 16498 raft_consensus.cc:359] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:08.889756 16498 raft_consensus.cc:385] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.890072 16498 raft_consensus.cc:740] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.891004 16498 consensus_queue.cc:260] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:08.891842 16500 tablet_bootstrap.cc:492] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:08.892467 16500 ts_tablet_manager.cc:1403] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.213s	user 0.009s	sys 0.012s
I20260709 13:18:08.893795 16498 ts_tablet_manager.cc:1434] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:18:08.889112 16499 raft_consensus.cc:740] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.895972 16500 raft_consensus.cc:359] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:08.896813 16500 raft_consensus.cc:385] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.897136 16500 raft_consensus.cc:740] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.897395 16295 tablet_service.cc:1511] Processing CreateTablet for tablet d360c4d961f74b5e95455c5f84d85ad0 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:08.898126 16500 consensus_queue.cc:260] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:08.898855 16295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d360c4d961f74b5e95455c5f84d85ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.900586 16218 tablet_service.cc:1511] Processing CreateTablet for tablet d360c4d961f74b5e95455c5f84d85ad0 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:08.901937 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d360c4d961f74b5e95455c5f84d85ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.906771 16500 ts_tablet_manager.cc:1434] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:18:08.907903 16498 tablet_bootstrap.cc:492] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:08.909027 16364 tablet_service.cc:1511] Processing CreateTablet for tablet cf2962c590b5497da58a885103a32aef (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:08.911077 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2962c590b5497da58a885103a32aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.894914 16499 consensus_queue.cc:260] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:08.909086 16442 tablet_service.cc:1511] Processing CreateTablet for tablet cf2962c590b5497da58a885103a32aef (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:08.917512 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2962c590b5497da58a885103a32aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.932911 16498 tablet_bootstrap.cc:654] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.934810 16443 tablet_service.cc:1511] Processing CreateTablet for tablet d360c4d961f74b5e95455c5f84d85ad0 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:08.936112 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d360c4d961f74b5e95455c5f84d85ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.934041 16500 tablet_bootstrap.cc:492] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:08.951998 16499 ts_tablet_manager.cc:1434] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 13:18:08.953348 16502 tablet_bootstrap.cc:492] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:08.954653 16502 ts_tablet_manager.cc:1403] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.138s	user 0.007s	sys 0.009s
I20260709 13:18:08.953356 16499 tablet_bootstrap.cc:492] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:08.954964 16291 tablet_service.cc:1511] Processing CreateTablet for tablet 1f63940625724ed3a4294375705e345d (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:08.960227 16291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f63940625724ed3a4294375705e345d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.962278 16502 raft_consensus.cc:359] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:08.963163 16502 raft_consensus.cc:385] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.963476 16502 raft_consensus.cc:740] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.964375 16502 consensus_queue.cc:260] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:08.968665 16441 tablet_service.cc:1511] Processing CreateTablet for tablet 1f63940625724ed3a4294375705e345d (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:08.970140 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f63940625724ed3a4294375705e345d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.975044 16364 tablet_service.cc:1511] Processing CreateTablet for tablet 1f63940625724ed3a4294375705e345d (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:08.976459 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f63940625724ed3a4294375705e345d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.979305 16218 tablet_service.cc:1511] Processing CreateTablet for tablet cf2962c590b5497da58a885103a32aef (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:08.981941 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2962c590b5497da58a885103a32aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.980700 16502 ts_tablet_manager.cc:1434] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:18:08.984338 16502 tablet_bootstrap.cc:492] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:08.984831 16500 tablet_bootstrap.cc:654] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.994804 16560 raft_consensus.cc:493] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.995482 16560 raft_consensus.cc:515] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:08.996042 16216 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8b6cdc63734f54b3ebb138b4e0b94c (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:08.997736 16216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8b6cdc63734f54b3ebb138b4e0b94c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.000170 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:09.000401 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:09.003386 16305 raft_consensus.cc:2468] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
W20260709 13:18:09.006172 16345 leader_election.cc:343] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.007993 16343 leader_election.cc:304] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:09.010404 16531 raft_consensus.cc:493] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.011289 16531 raft_consensus.cc:515] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.012593 16292 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8b6cdc63734f54b3ebb138b4e0b94c (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:09.014186 16292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8b6cdc63734f54b3ebb138b4e0b94c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.018415 16593 raft_consensus.cc:2804] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.016222 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c883f64d971d4eeeb73836cdb95e1071" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:09.016728 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c883f64d971d4eeeb73836cdb95e1071" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:09.021032 16342 leader_election.cc:343] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.021919 16593 raft_consensus.cc:493] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.022985 16593 raft_consensus.cc:3060] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.025534 16366 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8b6cdc63734f54b3ebb138b4e0b94c (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:09.027135 16366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8b6cdc63734f54b3ebb138b4e0b94c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:09.029109 16345 leader_election.cc:343] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.029737 16345 leader_election.cc:304] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:08.998368 16560 leader_election.cc:290] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:09.032742 16560 raft_consensus.cc:2749] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.014581 16531 leader_election.cc:290] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:09.011299 16499 tablet_bootstrap.cc:654] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.039249 16593 raft_consensus.cc:515] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.040786 16577 raft_consensus.cc:493] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.042513 16577 raft_consensus.cc:515] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.043833 16500 tablet_bootstrap.cc:492] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:09.044623 16500 ts_tablet_manager.cc:1403] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.001s
I20260709 13:18:09.053220 16577 leader_election.cc:290] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:09.055060 16502 tablet_bootstrap.cc:654] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.055234 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403c864cda0f4da0b0547c0a3f1cb3ea" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:09.059397 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403c864cda0f4da0b0547c0a3f1cb3ea" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:09.062026 16419 leader_election.cc:343] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.067698 16593 leader_election.cc:290] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:09.071691 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:09.073273 16500 raft_consensus.cc:359] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.073711 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:09.074095 16500 raft_consensus.cc:385] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.074338 16304 raft_consensus.cc:3060] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.074421 16500 raft_consensus.cc:740] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.075322 16500 consensus_queue.cc:260] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.076560 16441 tablet_service.cc:1511] Processing CreateTablet for tablet b38373beeca944c692d0895d25f56ad8 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:09.078001 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38373beeca944c692d0895d25f56ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.080885 16500 ts_tablet_manager.cc:1434] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.000s
W20260709 13:18:09.079262 16345 leader_election.cc:343] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:09.092032 16417 leader_election.cc:343] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.087419 16593 raft_consensus.cc:493] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.092703 16417 leader_election.cc:304] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:09.093937 16577 raft_consensus.cc:2749] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.097088 16218 tablet_service.cc:1511] Processing CreateTablet for tablet b38373beeca944c692d0895d25f56ad8 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:09.099313 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38373beeca944c692d0895d25f56ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.110548 16505 consensus_queue.cc:1048] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.094548 16127 catalog_manager.cc:5697] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.128021 16304 raft_consensus.cc:2468] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:09.093191 16593 raft_consensus.cc:515] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.134007 16343 leader_election.cc:304] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:09.135380 16594 raft_consensus.cc:2804] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.136010 16594 raft_consensus.cc:697] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:09.137089 16442 tablet_service.cc:1511] Processing CreateTablet for tablet d0d21ba5abb841f1bd1d8564ddbb78c2 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:09.139612 16593 leader_election.cc:290] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:09.140849 16498 tablet_bootstrap.cc:492] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:09.140666 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128dfcd70ea847fbae9691a10e6db1a5" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:09.141470 16453 raft_consensus.cc:2468] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:09.143760 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128dfcd70ea847fbae9691a10e6db1a5" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:09.134377 16570 raft_consensus.cc:493] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.147125 16570 raft_consensus.cc:515] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.150025 16570 leader_election.cc:290] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:09.150856 16500 tablet_bootstrap.cc:492] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:09.152143 16364 tablet_service.cc:1511] Processing CreateTablet for tablet d0d21ba5abb841f1bd1d8564ddbb78c2 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:09.153618 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128dfcd70ea847fbae9691a10e6db1a5" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:09.154704 16452 raft_consensus.cc:2468] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:09.155207 16505 raft_consensus.cc:493] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.155767 16291 tablet_service.cc:1511] Processing CreateTablet for tablet b38373beeca944c692d0895d25f56ad8 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:09.156589 16193 leader_election.cc:304] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:09.157608 16291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38373beeca944c692d0895d25f56ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.157902 16229 raft_consensus.cc:2468] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:09.159626 16572 consensus_queue.cc:1048] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:09.160133 16342 leader_election.cc:304] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:09.161526 16290 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7586df8cdd4eff8a7fffe7fde7997d (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:09.162309 16531 raft_consensus.cc:2804] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.162770 16531 raft_consensus.cc:493] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.162992 16290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7586df8cdd4eff8a7fffe7fde7997d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.163146 16531 raft_consensus.cc:3060] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.163851 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d21ba5abb841f1bd1d8564ddbb78c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.164533 16499 tablet_bootstrap.cc:492] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:09.137034 16594 consensus_queue.cc:237] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.155804 16505 raft_consensus.cc:515] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.165150 16499 ts_tablet_manager.cc:1403] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.212s	user 0.027s	sys 0.044s
I20260709 13:18:09.166857 16570 raft_consensus.cc:2804] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.167321 16570 raft_consensus.cc:493] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.167675 16570 raft_consensus.cc:3060] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.175769 16499 raft_consensus.cc:359] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.176837 16499 raft_consensus.cc:385] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.177202 16499 raft_consensus.cc:740] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.181623 16499 consensus_queue.cc:260] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.184633 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403c864cda0f4da0b0547c0a3f1cb3ea" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:09.185635 16453 raft_consensus.cc:2468] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:09.185860 16505 leader_election.cc:290] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:09.187266 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403c864cda0f4da0b0547c0a3f1cb3ea" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:09.187347 16268 leader_election.cc:304] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:09.184710 16499 ts_tablet_manager.cc:1434] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.009s
W20260709 13:18:09.189014 16271 leader_election.cc:343] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.190258 16499 tablet_bootstrap.cc:492] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:09.190835 16505 raft_consensus.cc:2804] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.191304 16505 raft_consensus.cc:493] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.191736 16505 raft_consensus.cc:3060] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.193280 16218 tablet_service.cc:1511] Processing CreateTablet for tablet d0d21ba5abb841f1bd1d8564ddbb78c2 (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:09.211758 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d21ba5abb841f1bd1d8564ddbb78c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.222669 16502 tablet_bootstrap.cc:492] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:09.223356 16502 ts_tablet_manager.cc:1403] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.239s	user 0.037s	sys 0.026s
I20260709 13:18:09.228878 16508 consensus_queue.cc:1048] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.231003 16531 raft_consensus.cc:515] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.233497 16531 leader_election.cc:290] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:09.234352 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128dfcd70ea847fbae9691a10e6db1a5" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:09.247325 16452 raft_consensus.cc:3060] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.234766 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128dfcd70ea847fbae9691a10e6db1a5" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:09.252774 16505 raft_consensus.cc:515] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.147174 16498 ts_tablet_manager.cc:1403] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.240s	user 0.023s	sys 0.036s
I20260709 13:18:09.256053 16505 leader_election.cc:290] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:09.256184 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7586df8cdd4eff8a7fffe7fde7997d (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:09.257568 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7586df8cdd4eff8a7fffe7fde7997d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.257256 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403c864cda0f4da0b0547c0a3f1cb3ea" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
W20260709 13:18:09.259315 16271 leader_election.cc:343] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.261986 16452 raft_consensus.cc:2468] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:09.263506 16342 leader_election.cc:304] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:09.238891 16602 raft_consensus.cc:493] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.241856 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128dfcd70ea847fbae9691a10e6db1a5" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:09.265007 16378 raft_consensus.cc:2393] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0c736bf768804f2e86a875366c12a71c in this term.
I20260709 13:18:09.268419 16531 raft_consensus.cc:2804] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.268998 16531 raft_consensus.cc:697] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:09.264658 16602 raft_consensus.cc:515] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.270381 16531 consensus_queue.cc:237] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.271165 16498 raft_consensus.cc:359] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.273244 16498 raft_consensus.cc:385] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.273030 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780cc3fe16024ae9837ab737de1d769c" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:09.274827 16499 tablet_bootstrap.cc:654] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:09.275017 16417 leader_election.cc:343] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.275943 16498 raft_consensus.cc:740] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.277688 16498 consensus_queue.cc:260] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.285116 16216 tablet_service.cc:1511] Processing CreateTablet for tablet de0abdbd9a6846b5a7aef90fef35d03f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:09.281754 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780cc3fe16024ae9837ab737de1d769c" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:09.293663 16498 ts_tablet_manager.cc:1434] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.003s
I20260709 13:18:09.300979 16498 tablet_bootstrap.cc:492] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:09.301657 16502 raft_consensus.cc:359] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.302963 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d21ba5abb841f1bd1d8564ddbb78c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.294116 16602 leader_election.cc:290] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:09.310963 16365 tablet_service.cc:1511] Processing CreateTablet for tablet de0abdbd9a6846b5a7aef90fef35d03f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:09.312954 16365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0abdbd9a6846b5a7aef90fef35d03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.312763 16566 consensus_queue.cc:1048] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.302537 16502 raft_consensus.cc:385] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.314651 16502 raft_consensus.cc:740] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.317699 16502 consensus_queue.cc:260] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
W20260709 13:18:09.320082 16417 leader_election.cc:343] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.320817 16417 leader_election.cc:304] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:09.309949 16498 tablet_bootstrap.cc:654] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.323247 16502 ts_tablet_manager.cc:1434] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.100s	user 0.009s	sys 0.000s
I20260709 13:18:09.324771 16502 tablet_bootstrap.cc:492] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:09.332360 16218 tablet_service.cc:1511] Processing CreateTablet for tablet a53592287efd4b3ba8208b91130d38cd (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:09.334374 16218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53592287efd4b3ba8208b91130d38cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.341725 16502 tablet_bootstrap.cc:654] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.343989 16442 tablet_service.cc:1511] Processing CreateTablet for tablet a53592287efd4b3ba8208b91130d38cd (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:09.345953 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53592287efd4b3ba8208b91130d38cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.351706 16602 raft_consensus.cc:2749] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.353395 16216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0abdbd9a6846b5a7aef90fef35d03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.364113 16367 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec87a6842274eeeb8d174967fd4cead (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:09.364625 16291 tablet_service.cc:1511] Processing CreateTablet for tablet a53592287efd4b3ba8208b91130d38cd (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:09.365600 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec87a6842274eeeb8d174967fd4cead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.366072 16291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53592287efd4b3ba8208b91130d38cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.367050 16124 catalog_manager.cc:5697] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.369786 16531 raft_consensus.cc:493] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.370368 16531 raft_consensus.cc:515] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.373287 16531 leader_election.cc:290] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:09.374979 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780cc3fe16024ae9837ab737de1d769c" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:09.376042 16453 raft_consensus.cc:2468] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:09.377511 16342 leader_election.cc:304] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:09.378759 16531 raft_consensus.cc:2804] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.379675 16531 raft_consensus.cc:493] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.380155 16531 raft_consensus.cc:3060] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.369194 16124 catalog_manager.cc:5697] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.390069 16498 tablet_bootstrap.cc:492] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:09.390867 16498 ts_tablet_manager.cc:1403] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.023s
I20260709 13:18:09.392185 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec87a6842274eeeb8d174967fd4cead (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:09.393883 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec87a6842274eeeb8d174967fd4cead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.394374 16498 raft_consensus.cc:359] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.395380 16498 raft_consensus.cc:385] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.266213 16500 tablet_bootstrap.cc:654] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.395700 16498 raft_consensus.cc:740] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.298008 16290 tablet_service.cc:1511] Processing CreateTablet for tablet de0abdbd9a6846b5a7aef90fef35d03f (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:09.397221 16290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0abdbd9a6846b5a7aef90fef35d03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.397053 16498 consensus_queue.cc:260] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.287178 16570 raft_consensus.cc:515] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.400420 16229 raft_consensus.cc:2393] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c736bf768804f2e86a875366c12a71c in current term 1: Already voted for candidate fe046a372b6a4df982eebe83cf3ee184 in this term.
I20260709 13:18:09.400743 16570 leader_election.cc:290] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:09.403184 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128dfcd70ea847fbae9691a10e6db1a5" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:09.405392 16498 ts_tablet_manager.cc:1434] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:18:09.407275 16217 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec87a6842274eeeb8d174967fd4cead (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:09.408650 16217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec87a6842274eeeb8d174967fd4cead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.411407 16502 tablet_bootstrap.cc:492] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:09.412051 16502 ts_tablet_manager.cc:1403] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.003s
I20260709 13:18:09.415151 16502 raft_consensus.cc:359] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.419461 16502 raft_consensus.cc:385] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.419843 16502 raft_consensus.cc:740] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.420864 16502 consensus_queue.cc:260] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.431710 16502 ts_tablet_manager.cc:1434] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:18:09.432596 16502 tablet_bootstrap.cc:492] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:09.437963 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128dfcd70ea847fbae9691a10e6db1a5" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:09.438603 16502 tablet_bootstrap.cc:654] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.438942 16453 raft_consensus.cc:2393] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0c736bf768804f2e86a875366c12a71c in this term.
I20260709 13:18:09.264433 16366 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7586df8cdd4eff8a7fffe7fde7997d (DEFAULT_TABLE table=test-workload [id=2048c15707204676bcd65fd167055ac6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:09.296291 16499 tablet_bootstrap.cc:492] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:09.459367 16499 ts_tablet_manager.cc:1403] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.269s	user 0.018s	sys 0.000s
I20260709 13:18:09.459935 16366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7586df8cdd4eff8a7fffe7fde7997d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.452064 16193 leader_election.cc:304] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:09.454593 16498 tablet_bootstrap.cc:492] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:09.463500 16570 raft_consensus.cc:2749] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.470957 16499 raft_consensus.cc:359] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.472066 16499 raft_consensus.cc:385] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.472385 16499 raft_consensus.cc:740] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.473486 16499 consensus_queue.cc:260] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.476325 16499 ts_tablet_manager.cc:1434] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:18:09.478382 16499 tablet_bootstrap.cc:492] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:09.481112 16498 tablet_bootstrap.cc:654] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.489014 16502 tablet_bootstrap.cc:492] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:09.489638 16502 ts_tablet_manager.cc:1403] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.000s
I20260709 13:18:09.493620 16570 raft_consensus.cc:493] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.494279 16570 raft_consensus.cc:515] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.496707 16570 leader_election.cc:290] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
W20260709 13:18:09.482029 16268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 234982us
I20260709 13:18:09.497501 16499 tablet_bootstrap.cc:654] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.498519 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:09.499536 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:09.503973 16304 raft_consensus.cc:2393] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0c736bf768804f2e86a875366c12a71c in this term.
I20260709 13:18:09.504099 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403c864cda0f4da0b0547c0a3f1cb3ea" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:09.499317 16502 raft_consensus.cc:359] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.504833 16453 raft_consensus.cc:3060] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.505121 16502 raft_consensus.cc:385] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.505467 16502 raft_consensus.cc:740] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.506187 16502 consensus_queue.cc:260] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.507659 16194 leader_election.cc:304] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:09.509049 16570 raft_consensus.cc:3060] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.509876 16531 raft_consensus.cc:515] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.511195 16502 ts_tablet_manager.cc:1434] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:18:09.512317 16502 tablet_bootstrap.cc:492] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:09.513237 16453 raft_consensus.cc:2468] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:09.513870 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780cc3fe16024ae9837ab737de1d769c" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:09.514559 16452 raft_consensus.cc:3060] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.521029 16499 tablet_bootstrap.cc:492] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:09.521648 16499 ts_tablet_manager.cc:1403] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.000s
I20260709 13:18:09.523761 16502 tablet_bootstrap.cc:654] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.524768 16499 raft_consensus.cc:359] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.525583 16499 raft_consensus.cc:385] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.525892 16499 raft_consensus.cc:740] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.526659 16499 consensus_queue.cc:260] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.528944 16499 ts_tablet_manager.cc:1434] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:09.522082 16452 raft_consensus.cc:2468] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:09.529961 16499 tablet_bootstrap.cc:492] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:09.530279 16342 leader_election.cc:304] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:09.531265 16594 raft_consensus.cc:2804] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.531765 16594 raft_consensus.cc:697] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:09.532320 16500 tablet_bootstrap.cc:492] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:09.532909 16500 ts_tablet_manager.cc:1403] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.382s	user 0.017s	sys 0.006s
I20260709 13:18:09.532665 16594 consensus_queue.cc:237] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.536116 16500 raft_consensus.cc:359] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.536885 16500 raft_consensus.cc:385] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.537020 16499 tablet_bootstrap.cc:654] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.537254 16500 raft_consensus.cc:740] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.538038 16500 consensus_queue.cc:260] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.543165 16570 raft_consensus.cc:2749] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.543558 16500 ts_tablet_manager.cc:1434] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:18:09.543658 16602 raft_consensus.cc:493] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.544663 16500 tablet_bootstrap.cc:492] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:09.544464 16602 raft_consensus.cc:515] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.553260 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c883f64d971d4eeeb73836cdb95e1071" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:09.553881 16502 tablet_bootstrap.cc:492] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:09.554463 16502 ts_tablet_manager.cc:1403] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 13:18:09.554298 16377 raft_consensus.cc:2468] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:09.557410 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c883f64d971d4eeeb73836cdb95e1071" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:09.557823 16502 raft_consensus.cc:359] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.558585 16502 raft_consensus.cc:385] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.558440 16229 raft_consensus.cc:2468] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:09.559129 16502 raft_consensus.cc:740] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.560159 16502 consensus_queue.cc:260] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.560698 16419 leader_election.cc:304] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:09.561430 16500 tablet_bootstrap.cc:654] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.561650 16498 tablet_bootstrap.cc:492] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:09.566294 16498 ts_tablet_manager.cc:1403] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.006s
I20260709 13:18:09.564070 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780cc3fe16024ae9837ab737de1d769c" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:09.569973 16304 raft_consensus.cc:2468] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:09.577564 16560 raft_consensus.cc:493] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.578193 16560 raft_consensus.cc:515] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.573622 16531 leader_election.cc:290] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:09.583904 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a15949e759d40be9560228008490390" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:09.588428 16125 catalog_manager.cc:5697] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:09.589639 16345 leader_election.cc:343] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.564561 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780cc3fe16024ae9837ab737de1d769c" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:09.592067 16305 raft_consensus.cc:3060] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.553246 16602 leader_election.cc:290] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:09.562304 16603 raft_consensus.cc:2804] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.597023 16603 raft_consensus.cc:493] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.597508 16603 raft_consensus.cc:3060] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.601781 16502 ts_tablet_manager.cc:1434] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:18:09.603250 16502 tablet_bootstrap.cc:492] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:09.589672 16560 leader_election.cc:290] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:09.612821 16498 raft_consensus.cc:359] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.626240 16498 raft_consensus.cc:385] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.626957 16498 raft_consensus.cc:740] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.629451 16500 tablet_bootstrap.cc:492] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:09.564469 16268 leader_election.cc:304] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:09.630070 16500 ts_tablet_manager.cc:1403] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.003s
I20260709 13:18:09.630712 16604 raft_consensus.cc:2804] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.631349 16604 raft_consensus.cc:697] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:09.632274 16604 consensus_queue.cc:237] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.634500 16500 raft_consensus.cc:359] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.635506 16500 raft_consensus.cc:385] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:09.636969 16620 log.cc:927] Time spent T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:09.638746 16603 raft_consensus.cc:515] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
W20260709 13:18:09.639739 16268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 75364us
I20260709 13:18:09.635787 16500 raft_consensus.cc:740] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.642437 16500 consensus_queue.cc:260] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
W20260709 13:18:09.645686 16175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:09.628023 16498 consensus_queue.cc:260] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.647281 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a15949e759d40be9560228008490390" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:09.649094 16304 raft_consensus.cc:2468] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:09.647154 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c883f64d971d4eeeb73836cdb95e1071" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:09.650107 16377 raft_consensus.cc:3060] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.648185 16305 raft_consensus.cc:2468] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:09.659207 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c883f64d971d4eeeb73836cdb95e1071" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:09.660013 16229 raft_consensus.cc:3060] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.662380 16502 tablet_bootstrap.cc:654] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.659523 16498 ts_tablet_manager.cc:1434] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.002s
I20260709 13:18:09.664740 16498 tablet_bootstrap.cc:492] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:09.662807 16603 leader_election.cc:290] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:09.662513 16343 leader_election.cc:304] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:09.669024 16500 ts_tablet_manager.cc:1434] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.001s
I20260709 13:18:09.671173 16500 tablet_bootstrap.cc:492] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:09.671654 16531 raft_consensus.cc:2804] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.672245 16531 raft_consensus.cc:493] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.672641 16531 raft_consensus.cc:3060] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.677729 16560 consensus_queue.cc:1048] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:09.677520 16500 tablet_bootstrap.cc:654] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.683696 16125 catalog_manager.cc:5697] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.692320 16603 raft_consensus.cc:493] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.692997 16603 raft_consensus.cc:515] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.686133 16531 raft_consensus.cc:515] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.695688 16603 leader_election.cc:290] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:09.698199 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a15949e759d40be9560228008490390" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:09.701453 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84888dc6b86747d6b08b125a8df5394c" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:09.692345 16498 tablet_bootstrap.cc:654] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:09.701468 16345 leader_election.cc:343] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.709633 16560 consensus_queue.cc:1048] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:09.713065 16531 leader_election.cc:290] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:09.713709 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84888dc6b86747d6b08b125a8df5394c" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:09.714315 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a15949e759d40be9560228008490390" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:09.714965 16304 raft_consensus.cc:3060] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:09.722414 16419 leader_election.cc:343] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:09.724936 16417 leader_election.cc:343] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.725521 16417 leader_election.cc:304] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:09.727135 16603 raft_consensus.cc:2749] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.728650 16499 tablet_bootstrap.cc:492] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:09.729246 16499 ts_tablet_manager.cc:1403] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.200s	user 0.057s	sys 0.077s
I20260709 13:18:09.732223 16304 raft_consensus.cc:2468] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:09.733764 16343 leader_election.cc:304] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:09.734879 16560 raft_consensus.cc:2804] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.735587 16560 raft_consensus.cc:697] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:09.736678 16560 consensus_queue.cc:237] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.738240 16594 consensus_queue.cc:1048] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.739352 16377 raft_consensus.cc:2468] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:09.745297 16417 leader_election.cc:304] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:09.748925 16603 raft_consensus.cc:2804] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.751248 16603 raft_consensus.cc:697] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:09.752331 16531 consensus_queue.cc:1048] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.752267 16603 consensus_queue.cc:237] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.756395 16499 raft_consensus.cc:359] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.757416 16499 raft_consensus.cc:385] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.757863 16499 raft_consensus.cc:740] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.759202 16499 consensus_queue.cc:260] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.762336 16502 tablet_bootstrap.cc:492] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:09.763314 16502 ts_tablet_manager.cc:1403] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.160s	user 0.014s	sys 0.027s
I20260709 13:18:09.747056 16229 raft_consensus.cc:2468] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:09.768373 16502 raft_consensus.cc:359] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.769505 16502 raft_consensus.cc:385] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.769933 16502 raft_consensus.cc:740] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.770924 16502 consensus_queue.cc:260] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.774742 16499 ts_tablet_manager.cc:1434] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:18:09.775910 16499 tablet_bootstrap.cc:492] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:09.776190 16502 ts_tablet_manager.cc:1434] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:18:09.776935 16500 tablet_bootstrap.cc:492] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:09.777539 16500 ts_tablet_manager.cc:1403] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.107s	user 0.024s	sys 0.013s
I20260709 13:18:09.777585 16502 tablet_bootstrap.cc:492] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:09.786553 16498 tablet_bootstrap.cc:492] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:09.787246 16498 ts_tablet_manager.cc:1403] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.123s	user 0.010s	sys 0.007s
I20260709 13:18:09.787854 16500 raft_consensus.cc:359] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.788668 16500 raft_consensus.cc:385] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.788956 16500 raft_consensus.cc:740] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.790091 16500 consensus_queue.cc:260] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.783183 16499 tablet_bootstrap.cc:654] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.802879 16566 raft_consensus.cc:493] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.812554 16498 raft_consensus.cc:359] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.820518 16566 raft_consensus.cc:515] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:09.821187 16498 raft_consensus.cc:385] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.821617 16498 raft_consensus.cc:740] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.805893 16502 tablet_bootstrap.cc:654] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.822992 16566 leader_election.cc:290] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:09.824932 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403c864cda0f4da0b0547c0a3f1cb3ea" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:09.825907 16453 raft_consensus.cc:2393] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:09.828908 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "403c864cda0f4da0b0547c0a3f1cb3ea" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:09.815696 16128 catalog_manager.cc:5697] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.831013 16194 leader_election.cc:304] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:09.832305 16566 raft_consensus.cc:3060] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.835666 16594 raft_consensus.cc:493] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.836297 16594 raft_consensus.cc:515] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.840201 16594 leader_election.cc:290] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:09.841409 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc75ff85212648e2accfc8fa2e73685e" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:09.841418 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc75ff85212648e2accfc8fa2e73685e" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
W20260709 13:18:09.843868 16345 leader_election.cc:343] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.843751 16127 catalog_manager.cc:5697] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.850332 16499 tablet_bootstrap.cc:492] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:09.850972 16499 ts_tablet_manager.cc:1403] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.008s
I20260709 13:18:09.851912 16498 consensus_queue.cc:260] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.852994 16453 raft_consensus.cc:2468] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:09.802778 16500 ts_tablet_manager.cc:1434] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:18:09.855306 16498 ts_tablet_manager.cc:1434] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 13:18:09.856655 16342 leader_election.cc:304] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:09.861315 16594 raft_consensus.cc:2804] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.861723 16594 raft_consensus.cc:493] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.862078 16594 raft_consensus.cc:3060] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.864650 16498 tablet_bootstrap.cc:492] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:09.864820 16500 tablet_bootstrap.cc:492] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:09.859429 16566 raft_consensus.cc:2749] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.859277 16499 raft_consensus.cc:359] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.859035 16502 tablet_bootstrap.cc:492] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:09.866109 16502 ts_tablet_manager.cc:1403] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.008s
I20260709 13:18:09.866667 16499 raft_consensus.cc:385] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.866988 16499 raft_consensus.cc:740] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.867717 16499 consensus_queue.cc:260] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.869900 16499 ts_tablet_manager.cc:1434] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:18:09.871341 16499 tablet_bootstrap.cc:492] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:09.873317 16594 raft_consensus.cc:515] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.877072 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc75ff85212648e2accfc8fa2e73685e" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:09.877741 16453 raft_consensus.cc:3060] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.879511 16499 tablet_bootstrap.cc:654] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.885370 16502 raft_consensus.cc:359] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.886691 16502 raft_consensus.cc:385] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.888545 16502 raft_consensus.cc:740] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.889896 16502 consensus_queue.cc:260] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.891440 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc75ff85212648e2accfc8fa2e73685e" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:09.894135 16502 ts_tablet_manager.cc:1434] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 13:18:09.894687 16498 tablet_bootstrap.cc:654] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.895344 16502 tablet_bootstrap.cc:492] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:09.889709 16594 leader_election.cc:290] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:09.897464 16566 raft_consensus.cc:493] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.898238 16453 raft_consensus.cc:2468] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:09.900293 16342 leader_election.cc:304] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:09.901391 16531 raft_consensus.cc:2804] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.902190 16531 raft_consensus.cc:697] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:09.907065 16635 raft_consensus.cc:493] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.907613 16635 raft_consensus.cc:515] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
W20260709 13:18:09.908182 16345 leader_election.cc:343] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.905045 16500 tablet_bootstrap.cc:654] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.904359 16502 tablet_bootstrap.cc:654] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.907928 16531 consensus_queue.cc:237] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.906912 16499 tablet_bootstrap.cc:492] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:09.898066 16566 raft_consensus.cc:515] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.912025 16635 leader_election.cc:290] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:09.913637 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:09.915776 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:09.918644 16499 ts_tablet_manager.cc:1403] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:18:09.921862 16566 leader_election.cc:290] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:09.924459 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a15949e759d40be9560228008490390" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
W20260709 13:18:09.925388 16345 leader_election.cc:343] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.927045 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a15949e759d40be9560228008490390" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:09.938901 16342 leader_election.cc:343] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.939918 16345 leader_election.cc:304] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:09.941335 16304 raft_consensus.cc:2393] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0c736bf768804f2e86a875366c12a71c in this term.
I20260709 13:18:09.941941 16635 raft_consensus.cc:2749] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.946785 16194 leader_election.cc:304] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:09.948437 16566 raft_consensus.cc:3060] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.956938 16566 raft_consensus.cc:2749] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.962409 16499 raft_consensus.cc:359] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.970752 16499 raft_consensus.cc:385] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.971079 16499 raft_consensus.cc:740] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.971813 16499 consensus_queue.cc:260] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:09.972414 16635 consensus_queue.cc:1048] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:09.974023 16499 ts_tablet_manager.cc:1434] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 13:18:09.974969 16502 tablet_bootstrap.cc:492] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:09.975190 16499 tablet_bootstrap.cc:492] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:09.975876 16502 ts_tablet_manager.cc:1403] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.081s	user 0.038s	sys 0.018s
I20260709 13:18:09.979322 16502 raft_consensus.cc:359] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.980159 16502 raft_consensus.cc:385] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.980644 16502 raft_consensus.cc:740] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.981856 16499 tablet_bootstrap.cc:654] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.981455 16502 consensus_queue.cc:260] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:09.985695 16502 ts_tablet_manager.cc:1434] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:09.988198 16502 tablet_bootstrap.cc:492] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:09.988025 16500 tablet_bootstrap.cc:492] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:09.987933 16498 tablet_bootstrap.cc:492] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:09.989351 16498 ts_tablet_manager.cc:1403] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.125s	user 0.020s	sys 0.016s
I20260709 13:18:09.989544 16500 ts_tablet_manager.cc:1403] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.008s
I20260709 13:18:09.995745 16635 raft_consensus.cc:493] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.996457 16635 raft_consensus.cc:515] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:09.999619 16128 catalog_manager.cc:5697] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.001024 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28345dd0f24a26b496904242ab1d87" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:10.004635 16345 leader_election.cc:343] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.005195 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28345dd0f24a26b496904242ab1d87" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:10.006243 16305 raft_consensus.cc:2468] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:10.008688 16343 leader_election.cc:304] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:10.009863 16634 raft_consensus.cc:2804] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:10.010285 16634 raft_consensus.cc:493] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.011655 16634 raft_consensus.cc:3060] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.011936 16498 raft_consensus.cc:359] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.012732 16498 raft_consensus.cc:385] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.013044 16498 raft_consensus.cc:740] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.013952 16498 consensus_queue.cc:260] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.016244 16502 tablet_bootstrap.cc:654] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.016750 16498 ts_tablet_manager.cc:1434] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:18:10.017856 16498 tablet_bootstrap.cc:492] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:10.010041 16635 leader_election.cc:290] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:10.026832 16498 tablet_bootstrap.cc:654] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.030016 16634 raft_consensus.cc:515] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.032866 16604 consensus_queue.cc:1048] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:10.033280 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28345dd0f24a26b496904242ab1d87" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
W20260709 13:18:10.035275 16345 leader_election.cc:343] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.011651 16500 raft_consensus.cc:359] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.036700 16500 raft_consensus.cc:385] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.037007 16500 raft_consensus.cc:740] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.037163 16594 consensus_queue.cc:1048] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:10.042928 16500 consensus_queue.cc:260] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.045792 16500 ts_tablet_manager.cc:1434] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:18:10.048447 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28345dd0f24a26b496904242ab1d87" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:10.048235 16634 leader_election.cc:290] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:10.049265 16305 raft_consensus.cc:3060] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.049300 16499 tablet_bootstrap.cc:492] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:10.050410 16499 ts_tablet_manager.cc:1403] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.009s
I20260709 13:18:10.050480 16500 tablet_bootstrap.cc:492] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:10.074414 16499 raft_consensus.cc:359] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.075315 16499 raft_consensus.cc:385] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.075698 16499 raft_consensus.cc:740] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.076488 16499 consensus_queue.cc:260] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.079519 16500 tablet_bootstrap.cc:654] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.083595 16604 consensus_queue.cc:1048] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:10.086149 16603 raft_consensus.cc:493] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.087070 16603 raft_consensus.cc:515] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.093497 16603 leader_election.cc:290] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:10.095383 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2d2c479b141a9be75ed9b938e974b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:10.095863 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2d2c479b141a9be75ed9b938e974b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:10.096421 16377 raft_consensus.cc:2468] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:10.096630 16303 raft_consensus.cc:2468] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:10.098397 16417 leader_election.cc:304] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:10.099931 16499 ts_tablet_manager.cc:1434] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.002s
I20260709 13:18:10.104225 16499 tablet_bootstrap.cc:492] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:10.115000 16499 tablet_bootstrap.cc:654] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.121052 16603 raft_consensus.cc:2804] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:10.121650 16603 raft_consensus.cc:493] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.122033 16603 raft_consensus.cc:3060] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.135744 16499 tablet_bootstrap.cc:492] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:10.136538 16499 ts_tablet_manager.cc:1403] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.004s
I20260709 13:18:10.140950 16499 raft_consensus.cc:359] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.142138 16499 raft_consensus.cc:385] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.142508 16499 raft_consensus.cc:740] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.143842 16499 consensus_queue.cc:260] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.147632 16499 ts_tablet_manager.cc:1434] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:18:10.149122 16499 tablet_bootstrap.cc:492] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:10.155129 16566 raft_consensus.cc:493] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.156025 16566 raft_consensus.cc:515] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.159929 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc75ff85212648e2accfc8fa2e73685e" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:10.162539 16566 leader_election.cc:290] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:10.165004 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc75ff85212648e2accfc8fa2e73685e" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:10.166350 16453 raft_consensus.cc:2393] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0c736bf768804f2e86a875366c12a71c in this term.
I20260709 13:18:10.168350 16193 leader_election.cc:304] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:10.169654 16573 raft_consensus.cc:493] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.170348 16573 raft_consensus.cc:515] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.175707 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84888dc6b86747d6b08b125a8df5394c" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:10.178484 16194 leader_election.cc:343] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.179533 16573 leader_election.cc:290] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:10.180339 16573 raft_consensus.cc:3060] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.192075 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84888dc6b86747d6b08b125a8df5394c" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:10.198901 16502 tablet_bootstrap.cc:492] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:10.198762 16452 raft_consensus.cc:2468] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:10.199733 16502 ts_tablet_manager.cc:1403] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.213s	user 0.019s	sys 0.001s
I20260709 13:18:10.200721 16193 leader_election.cc:304] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:10.202700 16570 raft_consensus.cc:2804] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:10.203166 16570 raft_consensus.cc:493] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.203612 16570 raft_consensus.cc:3060] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.206805 16566 raft_consensus.cc:493] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.207412 16566 raft_consensus.cc:515] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.212438 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:10.215011 16194 leader_election.cc:343] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.217253 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:10.218370 16453 raft_consensus.cc:2468] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:10.223172 16566 leader_election.cc:290] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:10.223927 16193 leader_election.cc:304] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:10.224952 16654 raft_consensus.cc:2804] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:10.225390 16654 raft_consensus.cc:493] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.225793 16654 raft_consensus.cc:3060] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.195643 16305 raft_consensus.cc:2468] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:10.236725 16500 tablet_bootstrap.cc:492] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:10.237656 16343 leader_election.cc:304] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:10.238221 16500 ts_tablet_manager.cc:1403] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.188s	user 0.044s	sys 0.086s
I20260709 13:18:10.238781 16634 raft_consensus.cc:2804] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:10.203225 16502 raft_consensus.cc:359] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.239445 16634 raft_consensus.cc:697] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:10.229027 16603 raft_consensus.cc:515] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.239497 16502 raft_consensus.cc:385] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.241133 16498 tablet_bootstrap.cc:492] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:10.241714 16498 ts_tablet_manager.cc:1403] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.224s	user 0.057s	sys 0.097s
I20260709 13:18:10.243074 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2d2c479b141a9be75ed9b938e974b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:10.243819 16305 raft_consensus.cc:3060] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.240512 16634 consensus_queue.cc:237] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.244798 16498 raft_consensus.cc:359] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.245543 16498 raft_consensus.cc:385] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.245854 16498 raft_consensus.cc:740] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.246758 16498 consensus_queue.cc:260] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.248952 16498 ts_tablet_manager.cc:1434] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:10.251381 16603 leader_election.cc:290] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:10.252089 16502 raft_consensus.cc:740] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.252849 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2d2c479b141a9be75ed9b938e974b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:10.253016 16502 consensus_queue.cc:260] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.253613 16377 raft_consensus.cc:3060] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.255677 16502 ts_tablet_manager.cc:1434] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 13:18:10.256722 16502 tablet_bootstrap.cc:492] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:10.263912 16305 raft_consensus.cc:2468] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:10.265338 16417 leader_election.cc:304] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:10.266310 16603 raft_consensus.cc:2804] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:10.266865 16603 raft_consensus.cc:697] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:10.267393 16498 tablet_bootstrap.cc:492] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:10.267722 16603 consensus_queue.cc:237] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.270236 16570 raft_consensus.cc:515] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.270731 16500 raft_consensus.cc:359] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.271575 16500 raft_consensus.cc:385] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.271917 16500 raft_consensus.cc:740] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.272719 16500 consensus_queue.cc:260] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.274264 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84888dc6b86747d6b08b125a8df5394c" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:10.274976 16453 raft_consensus.cc:3060] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.276932 16500 ts_tablet_manager.cc:1434] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:18:10.278195 16500 tablet_bootstrap.cc:492] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:10.280458 16635 raft_consensus.cc:493] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.281109 16635 raft_consensus.cc:515] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.284768 16500 tablet_bootstrap.cc:654] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.286203 16635 leader_election.cc:290] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:10.288630 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab0948ebbcd4a558567e5fbab88a4b1" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:10.288765 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab0948ebbcd4a558567e5fbab88a4b1" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:10.289845 16451 raft_consensus.cc:2468] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:10.291565 16342 leader_election.cc:304] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
W20260709 13:18:10.292548 16343 leader_election.cc:343] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.197630 16499 tablet_bootstrap.cc:654] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.295258 16502 tablet_bootstrap.cc:654] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.196784 16573 raft_consensus.cc:2749] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:10.342679 16634 consensus_queue.cc:1048] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:18:10.303417 16602 consensus_queue.cc:1048] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:10.330960 16659 raft_consensus.cc:493] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.355530 16127 catalog_manager.cc:5697] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.295894 16635 raft_consensus.cc:2804] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:10.308588 16377 raft_consensus.cc:2468] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:10.234458 16654 raft_consensus.cc:515] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.318061 16128 catalog_manager.cc:5697] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.363518 16498 tablet_bootstrap.cc:654] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.272656 16570 leader_election.cc:290] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:10.370266 16635 raft_consensus.cc:493] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.366603 16603 consensus_queue.cc:1048] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260709 13:18:10.372581 16194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 135122us
I20260709 13:18:10.377774 16659 raft_consensus.cc:515] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.396409 16635 raft_consensus.cc:3060] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:10.399901 16419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 68023.9us
I20260709 13:18:10.412550 16498 tablet_bootstrap.cc:492] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:10.413110 16498 ts_tablet_manager.cc:1403] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.146s	user 0.012s	sys 0.003s
I20260709 13:18:10.418884 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84888dc6b86747d6b08b125a8df5394c" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:10.419711 16305 raft_consensus.cc:3060] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.420989 16453 raft_consensus.cc:2468] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:10.422688 16193 leader_election.cc:304] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:10.423672 16657 raft_consensus.cc:2804] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:10.424566 16657 raft_consensus.cc:697] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:10.425734 16654 leader_election.cc:290] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:10.425915 16657 consensus_queue.cc:237] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.439258 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:10.440114 16453 raft_consensus.cc:3060] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.441437 16305 raft_consensus.cc:2468] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:10.449545 16531 raft_consensus.cc:493] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.450721 16594 consensus_queue.cc:1048] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:10.456085 16498 raft_consensus.cc:359] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.457118 16498 raft_consensus.cc:385] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.457533 16498 raft_consensus.cc:740] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.457935 16453 raft_consensus.cc:2468] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:10.449433 16502 tablet_bootstrap.cc:492] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:10.459056 16502 ts_tablet_manager.cc:1403] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.203s	user 0.011s	sys 0.004s
I20260709 13:18:10.463289 16502 raft_consensus.cc:359] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.464654 16502 raft_consensus.cc:385] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.464991 16502 raft_consensus.cc:740] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.450433 16531 raft_consensus.cc:515] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.475852 16502 consensus_queue.cc:260] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.479133 16193 leader_election.cc:304] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:10.480499 16654 raft_consensus.cc:2804] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:10.482138 16654 raft_consensus.cc:697] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:10.483120 16654 consensus_queue.cc:237] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.484627 16531 leader_election.cc:290] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:10.485913 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0799b6996943f9b0b9093d073d6dbd" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:10.487648 16343 leader_election.cc:343] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.491546 16502 ts_tablet_manager.cc:1434] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.002s
I20260709 13:18:10.485922 16500 tablet_bootstrap.cc:492] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:10.493690 16500 ts_tablet_manager.cc:1403] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.216s	user 0.034s	sys 0.064s
I20260709 13:18:10.499343 16500 raft_consensus.cc:359] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.499620 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0799b6996943f9b0b9093d073d6dbd" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:10.500195 16500 raft_consensus.cc:385] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.500607 16500 raft_consensus.cc:740] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.493096 16502 tablet_bootstrap.cc:492] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:10.471434 16498 consensus_queue.cc:260] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.512161 16498 ts_tablet_manager.cc:1434] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.099s	user 0.010s	sys 0.001s
I20260709 13:18:10.513237 16500 consensus_queue.cc:260] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.513882 16498 tablet_bootstrap.cc:492] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:10.525609 16499 tablet_bootstrap.cc:492] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:10.526216 16500 ts_tablet_manager.cc:1434] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:18:10.526403 16499 ts_tablet_manager.cc:1403] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.378s	user 0.033s	sys 0.018s
I20260709 13:18:10.527444 16500 tablet_bootstrap.cc:492] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:10.535837 16499 raft_consensus.cc:359] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.537531 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:10.538975 16499 raft_consensus.cc:385] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.540416 16499 raft_consensus.cc:740] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.544203 16499 consensus_queue.cc:260] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.556372 16531 raft_consensus.cc:493] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.557104 16531 raft_consensus.cc:515] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.560611 16531 leader_election.cc:290] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:10.561641 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ed6ba8f644df7bcec53f34c63a569" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:10.562902 16594 consensus_queue.cc:1048] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:10.563649 16531 consensus_queue.cc:1048] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:10.564507 16659 leader_election.cc:290] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
W20260709 13:18:10.565091 16342 leader_election.cc:343] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.584424 16502 tablet_bootstrap.cc:654] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:10.590569 16345 leader_election.cc:343] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.591225 16345 leader_election.cc:304] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:10.517742 16635 raft_consensus.cc:515] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.593051 16499 ts_tablet_manager.cc:1434] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.001s
I20260709 13:18:10.596263 16499 tablet_bootstrap.cc:492] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:10.594920 16634 raft_consensus.cc:2749] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:10.603263 16127 catalog_manager.cc:5697] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.605245 16603 raft_consensus.cc:493] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.605849 16603 raft_consensus.cc:515] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.607451 16500 tablet_bootstrap.cc:654] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.609958 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:10.610221 16603 leader_election.cc:290] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:10.612128 16229 raft_consensus.cc:2468] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:10.614022 16419 leader_election.cc:304] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:10.615360 16664 raft_consensus.cc:2804] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:10.615824 16664 raft_consensus.cc:493] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.616182 16664 raft_consensus.cc:3060] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.616331 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:10.617102 16377 raft_consensus.cc:2468] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
W20260709 13:18:10.617816 16194 leader_election.cc:343] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.620265 16635 leader_election.cc:290] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:10.629165 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28345dd0f24a26b496904242ab1d87" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:10.629374 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28345dd0f24a26b496904242ab1d87" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:10.630752 16303 raft_consensus.cc:2393] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0c736bf768804f2e86a875366c12a71c in this term.
I20260709 13:18:10.631031 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab0948ebbcd4a558567e5fbab88a4b1" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:10.631827 16453 raft_consensus.cc:3060] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.633384 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab0948ebbcd4a558567e5fbab88a4b1" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:10.635030 16305 raft_consensus.cc:3060] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.637042 16664 raft_consensus.cc:515] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.641803 16453 raft_consensus.cc:2468] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:10.632397 16498 tablet_bootstrap.cc:654] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.651996 16342 leader_election.cc:304] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:10.655843 16634 raft_consensus.cc:2804] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:10.656519 16634 raft_consensus.cc:697] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:10.656836 16633 consensus_queue.cc:1048] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:10.657438 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:10.657517 16634 consensus_queue.cc:237] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.658387 16377 raft_consensus.cc:3060] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.662993 16127 catalog_manager.cc:5697] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.670925 16502 tablet_bootstrap.cc:492] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:10.670944 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ed6ba8f644df7bcec53f34c63a569" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:10.671550 16502 ts_tablet_manager.cc:1403] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.179s	user 0.008s	sys 0.011s
I20260709 13:18:10.680505 16664 leader_election.cc:290] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:10.682082 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:10.682914 16230 raft_consensus.cc:3060] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.683249 16499 tablet_bootstrap.cc:654] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.698040 16664 consensus_queue.cc:1048] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:10.700133 16194 leader_election.cc:304] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:10.701499 16654 raft_consensus.cc:3060] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.712559 16377 raft_consensus.cc:2468] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
W20260709 13:18:10.708817 16345 leader_election.cc:343] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.703624 16305 raft_consensus.cc:2468] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:10.725268 16345 leader_election.cc:304] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:10.733026 16500 tablet_bootstrap.cc:492] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:10.733707 16502 raft_consensus.cc:359] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.735889 16500 ts_tablet_manager.cc:1403] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.209s	user 0.014s	sys 0.014s
I20260709 13:18:10.736153 16502 raft_consensus.cc:385] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.737182 16502 raft_consensus.cc:740] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.739719 16502 consensus_queue.cc:260] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.744333 16417 leader_election.cc:304] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:10.745668 16664 raft_consensus.cc:2804] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:10.746246 16664 raft_consensus.cc:697] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:10.747097 16230 raft_consensus.cc:2468] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:10.743429 16635 raft_consensus.cc:2749] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:10.755267 16502 ts_tablet_manager.cc:1434] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 13:18:10.756893 16502 tablet_bootstrap.cc:492] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:10.747197 16664 consensus_queue.cc:237] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.761353 16498 tablet_bootstrap.cc:492] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:10.761936 16498 ts_tablet_manager.cc:1403] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.248s	user 0.016s	sys 0.003s
I20260709 13:18:10.762372 16500 raft_consensus.cc:359] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.763160 16500 raft_consensus.cc:385] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.763427 16500 raft_consensus.cc:740] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.764147 16500 consensus_queue.cc:260] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.764892 16498 raft_consensus.cc:359] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.766319 16498 raft_consensus.cc:385] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.766598 16498 raft_consensus.cc:740] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.767416 16498 consensus_queue.cc:260] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.769713 16498 ts_tablet_manager.cc:1434] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 13:18:10.774158 16498 tablet_bootstrap.cc:492] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:10.774668 16500 ts_tablet_manager.cc:1434] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 13:18:10.780874 16654 raft_consensus.cc:2749] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:10.787662 16500 tablet_bootstrap.cc:492] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
W20260709 13:18:10.800031 16175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:10.803630 16498 tablet_bootstrap.cc:654] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.807793 16502 tablet_bootstrap.cc:654] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.805658 16686 consensus_queue.cc:1048] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:10.815526 16531 consensus_queue.cc:1048] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:10.828773 16500 tablet_bootstrap.cc:654] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.834790 16499 tablet_bootstrap.cc:492] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:10.835502 16499 ts_tablet_manager.cc:1403] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.239s	user 0.015s	sys 0.000s
I20260709 13:18:10.854055 16634 raft_consensus.cc:493] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.856925 16634 raft_consensus.cc:515] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.864238 16228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6196aafd32f448a7964c50df2be2a4b3" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:10.870944 16127 catalog_manager.cc:5697] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.847163 16499 raft_consensus.cc:359] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.872705 16499 raft_consensus.cc:385] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.873047 16499 raft_consensus.cc:740] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.873924 16499 consensus_queue.cc:260] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:10.876237 16499 ts_tablet_manager.cc:1434] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:18:10.876951 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6196aafd32f448a7964c50df2be2a4b3" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:10.879284 16634 leader_election.cc:290] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
W20260709 13:18:10.879483 16343 leader_election.cc:343] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:10.883432 16345 leader_election.cc:343] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.889338 16345 leader_election.cc:304] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:10.898010 16634 raft_consensus.cc:2749] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:10.885573 16123 catalog_manager.cc:5697] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.886392 16502 tablet_bootstrap.cc:492] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:10.901962 16502 ts_tablet_manager.cc:1403] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.145s	user 0.009s	sys 0.019s
I20260709 13:18:10.892110 16499 tablet_bootstrap.cc:492] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:10.905010 16502 raft_consensus.cc:359] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.905792 16502 raft_consensus.cc:385] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.906069 16502 raft_consensus.cc:740] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.906884 16502 consensus_queue.cc:260] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.896349 16498 tablet_bootstrap.cc:492] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:10.908387 16498 ts_tablet_manager.cc:1403] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.016s
I20260709 13:18:10.909175 16502 ts_tablet_manager.cc:1434] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:18:10.910434 16502 tablet_bootstrap.cc:492] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:10.915784 16654 consensus_queue.cc:1048] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:10.917038 16502 tablet_bootstrap.cc:654] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.925825 16498 raft_consensus.cc:359] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.927105 16498 raft_consensus.cc:385] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.927512 16498 raft_consensus.cc:740] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.928031 16499 tablet_bootstrap.cc:654] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.935696 16498 consensus_queue.cc:260] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.941057 16654 consensus_queue.cc:1048] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:10.945925 16531 raft_consensus.cc:493] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.946820 16531 raft_consensus.cc:515] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:10.952020 16498 ts_tablet_manager.cc:1434] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:18:10.952625 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:10.954509 16343 leader_election.cc:343] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.957140 16531 leader_election.cc:290] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:10.953239 16498 tablet_bootstrap.cc:492] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:10.962080 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
W20260709 13:18:10.968115 16342 leader_election.cc:343] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.969288 16342 leader_election.cc:304] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:10.970764 16531 raft_consensus.cc:2749] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:10.971328 16498 tablet_bootstrap.cc:654] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.976382 16502 tablet_bootstrap.cc:492] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:10.980022 16500 tablet_bootstrap.cc:492] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:10.980368 16502 ts_tablet_manager.cc:1403] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.070s	user 0.027s	sys 0.016s
I20260709 13:18:10.980605 16500 ts_tablet_manager.cc:1403] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.204s	user 0.022s	sys 0.011s
I20260709 13:18:10.977594 16499 tablet_bootstrap.cc:492] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:10.982089 16499 ts_tablet_manager.cc:1403] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.014s
I20260709 13:18:10.987179 16502 raft_consensus.cc:359] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.987692 16664 raft_consensus.cc:493] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.988080 16502 raft_consensus.cc:385] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.988435 16502 raft_consensus.cc:740] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.988231 16664 raft_consensus.cc:515] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:10.989162 16502 consensus_queue.cc:260] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.991453 16502 ts_tablet_manager.cc:1434] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:18:10.992523 16502 tablet_bootstrap.cc:492] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:10.992774 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc2538e6830475791d9f70a5adcee9b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:10.993243 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc2538e6830475791d9f70a5adcee9b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:10.994918 16419 leader_election.cc:343] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.998208 16686 raft_consensus.cc:493] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.998831 16686 raft_consensus.cc:515] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:10.999199 16657 raft_consensus.cc:493] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.999451 16502 tablet_bootstrap.cc:654] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.999750 16657 raft_consensus.cc:515] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.001108 16686 leader_election.cc:290] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:11.001698 16664 leader_election.cc:290] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:11.003724 16500 raft_consensus.cc:359] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.004478 16500 raft_consensus.cc:385] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.004758 16500 raft_consensus.cc:740] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.009651 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ed6ba8f644df7bcec53f34c63a569" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:11.010545 16498 tablet_bootstrap.cc:492] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:11.010730 16379 raft_consensus.cc:2468] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:11.011175 16498 ts_tablet_manager.cc:1403] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.005s
I20260709 13:18:11.012319 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ed6ba8f644df7bcec53f34c63a569" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:11.014112 16498 raft_consensus.cc:359] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.014909 16498 raft_consensus.cc:385] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.015237 16498 raft_consensus.cc:740] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.016043 16498 consensus_queue.cc:260] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.017649 16498 ts_tablet_manager.cc:1434] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:18:11.018519 16500 consensus_queue.cc:260] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
W20260709 13:18:11.015019 16419 leader_election.cc:343] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.023142 16498 tablet_bootstrap.cc:492] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:11.023511 16303 raft_consensus.cc:2468] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:11.029562 16303 raft_consensus.cc:3060] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.034919 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0799b6996943f9b0b9093d073d6dbd" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:11.030169 16498 tablet_bootstrap.cc:654] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.035146 16500 ts_tablet_manager.cc:1434] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.054s	user 0.013s	sys 0.000s
I20260709 13:18:11.035889 16499 raft_consensus.cc:359] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.036640 16499 raft_consensus.cc:385] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.036955 16499 raft_consensus.cc:740] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
W20260709 13:18:11.037431 16194 leader_election.cc:343] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.039050 16500 tablet_bootstrap.cc:492] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:11.030169 16417 leader_election.cc:304] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:11.040915 16502 tablet_bootstrap.cc:492] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:11.041501 16502 ts_tablet_manager.cc:1403] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.007s
I20260709 13:18:11.041484 16417 leader_election.cc:304] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:11.042433 16686 raft_consensus.cc:2804] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.042826 16686 raft_consensus.cc:493] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.043159 16686 raft_consensus.cc:3060] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.044943 16502 raft_consensus.cc:359] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.045779 16502 raft_consensus.cc:385] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.046393 16502 raft_consensus.cc:740] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.047223 16499 consensus_queue.cc:260] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.047242 16502 consensus_queue.cc:260] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.049522 16499 ts_tablet_manager.cc:1434] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.000s
I20260709 13:18:11.045755 16500 tablet_bootstrap.cc:654] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.049849 16502 ts_tablet_manager.cc:1434] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:11.051525 16603 raft_consensus.cc:2804] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.051970 16603 raft_consensus.cc:493] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.052302 16603 raft_consensus.cc:3060] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.055516 16657 leader_election.cc:290] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:11.055779 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0799b6996943f9b0b9093d073d6dbd" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:11.056841 16379 raft_consensus.cc:2468] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:11.058763 16688 raft_consensus.cc:493] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.059500 16688 raft_consensus.cc:515] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.062908 16194 leader_election.cc:304] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:11.064751 16499 tablet_bootstrap.cc:492] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:11.065547 16573 raft_consensus.cc:2804] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.066159 16573 raft_consensus.cc:493] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.066722 16573 raft_consensus.cc:3060] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.063943 16686 raft_consensus.cc:515] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.071313 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ed6ba8f644df7bcec53f34c63a569" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:11.072131 16379 raft_consensus.cc:3060] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.078465 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:11.063396 16603 raft_consensus.cc:515] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.079102 16688 leader_election.cc:290] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:11.079350 16451 raft_consensus.cc:2468] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:11.080470 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:11.080775 16603 leader_election.cc:290] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:11.066532 16654 consensus_queue.cc:1048] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:11.084558 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc2538e6830475791d9f70a5adcee9b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:11.085247 16304 raft_consensus.cc:3060] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.086869 16379 raft_consensus.cc:2468] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:11.087387 16502 tablet_bootstrap.cc:492] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:11.088152 16499 tablet_bootstrap.cc:654] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.088528 16417 leader_election.cc:304] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:11.089650 16686 leader_election.cc:290] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:11.090246 16686 raft_consensus.cc:2804] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:11.091418 16686 raft_consensus.cc:697] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:11.092218 16268 leader_election.cc:304] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:11.092600 16686 consensus_queue.cc:237] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.093502 16633 raft_consensus.cc:493] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.094070 16633 raft_consensus.cc:515] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.096278 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ed6ba8f644df7bcec53f34c63a569" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:11.097648 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc2538e6830475791d9f70a5adcee9b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:11.098394 16229 raft_consensus.cc:3060] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:11.100075 16419 leader_election.cc:343] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.117035 16654 consensus_queue.cc:1048] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:11.117758 16304 raft_consensus.cc:2468] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:11.117964 16531 consensus_queue.cc:1048] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:11.118902 16573 raft_consensus.cc:515] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.120157 16688 raft_consensus.cc:2804] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:11.121227 16573 leader_election.cc:290] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:11.124701 16688 raft_consensus.cc:493] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:11.126355 16502 tablet_bootstrap.cc:654] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.131088 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0799b6996943f9b0b9093d073d6dbd" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:11.131836 16379 raft_consensus.cc:3060] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.132066 16417 leader_election.cc:304] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:11.126670 16688 raft_consensus.cc:3060] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.136665 16603 raft_consensus.cc:2804] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:11.137537 16603 raft_consensus.cc:697] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:11.138399 16603 consensus_queue.cc:237] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.139990 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0799b6996943f9b0b9093d073d6dbd" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
W20260709 13:18:11.141665 16194 leader_election.cc:343] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.136631 16498 tablet_bootstrap.cc:492] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:11.143044 16498 ts_tablet_manager.cc:1403] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.006s
I20260709 13:18:11.147943 16125 catalog_manager.cc:5697] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:11.152738 16229 raft_consensus.cc:2468] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:11.153820 16499 tablet_bootstrap.cc:492] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:11.154400 16499 ts_tablet_manager.cc:1403] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.000s
I20260709 13:18:11.157612 16499 raft_consensus.cc:359] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.158363 16499 raft_consensus.cc:385] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.160629 16499 raft_consensus.cc:740] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.165462 16498 raft_consensus.cc:359] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.166347 16498 raft_consensus.cc:385] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.161851 16499 consensus_queue.cc:260] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.168412 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e67f760e0414db092683b5e5ce3ef8f" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:11.168694 16499 ts_tablet_manager.cc:1434] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:18:11.177080 16499 tablet_bootstrap.cc:492] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:11.176970 16498 raft_consensus.cc:740] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.178028 16498 consensus_queue.cc:260] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.171550 16633 leader_election.cc:290] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:11.188421 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e67f760e0414db092683b5e5ce3ef8f" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:11.191568 16500 tablet_bootstrap.cc:492] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:11.200696 16500 ts_tablet_manager.cc:1403] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.162s	user 0.018s	sys 0.024s
W20260709 13:18:11.183640 16342 leader_election.cc:343] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:11.202737 16343 leader_election.cc:343] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.203795 16343 leader_election.cc:304] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:11.205665 16634 raft_consensus.cc:2749] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.197199 16502 tablet_bootstrap.cc:492] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:11.210029 16688 raft_consensus.cc:515] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.210664 16502 ts_tablet_manager.cc:1403] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.123s	user 0.021s	sys 0.024s
I20260709 13:18:11.211303 16303 raft_consensus.cc:1240] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Rejecting Update request from peer fe046a372b6a4df982eebe83cf3ee184 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.213861 16573 consensus_queue.cc:1059] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:11.214856 16634 consensus_queue.cc:1048] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:11.215049 16573 raft_consensus.cc:3055] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:11.198697 16498 ts_tablet_manager.cc:1434] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:18:11.205669 16500 raft_consensus.cc:359] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.216825 16500 raft_consensus.cc:385] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.217098 16498 tablet_bootstrap.cc:492] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:11.217123 16500 raft_consensus.cc:740] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.215706 16573 raft_consensus.cc:740] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:11.221343 16573 consensus_queue.cc:260] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.222553 16573 raft_consensus.cc:3060] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.230464 16499 tablet_bootstrap.cc:654] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.235721 16379 raft_consensus.cc:2468] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:11.243691 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:11.246819 16194 leader_election.cc:304] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:11.219408 16500 consensus_queue.cc:260] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.251019 16688 leader_election.cc:290] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:11.265229 16498 tablet_bootstrap.cc:654] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.265841 16500 ts_tablet_manager.cc:1434] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.004s
I20260709 13:18:11.267385 16500 tablet_bootstrap.cc:492] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:11.264848 16502 raft_consensus.cc:359] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.268441 16502 raft_consensus.cc:385] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.268743 16502 raft_consensus.cc:740] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.256206 16573 raft_consensus.cc:2804] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:11.259160 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:11.273532 16686 raft_consensus.cc:493] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.285841 16686 raft_consensus.cc:515] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.288285 16686 leader_election.cc:290] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:11.278098 16603 raft_consensus.cc:493] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.289366 16603 raft_consensus.cc:515] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.291913 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:11.292426 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:11.293139 16378 raft_consensus.cc:2468] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
W20260709 13:18:11.294132 16417 leader_election.cc:343] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.295150 16603 leader_election.cc:290] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:11.295068 16417 leader_election.cc:304] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:11.297223 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:11.298292 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:11.272040 16502 consensus_queue.cc:260] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.299646 16603 raft_consensus.cc:2804] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.300294 16603 raft_consensus.cc:493] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.300760 16603 raft_consensus.cc:3060] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.302217 16502 ts_tablet_manager.cc:1434] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.091s	user 0.010s	sys 0.000s
I20260709 13:18:11.302610 16633 raft_consensus.cc:493] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.304824 16633 raft_consensus.cc:515] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.305446 16502 tablet_bootstrap.cc:492] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:11.307309 16633 leader_election.cc:290] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:11.308398 16603 raft_consensus.cc:515] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
W20260709 13:18:11.298666 16419 leader_election.cc:343] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.277240 16128 catalog_manager.cc:5697] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:11.310551 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86655b05b814b00bcf81c0da904bdaf" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:11.312000 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86655b05b814b00bcf81c0da904bdaf" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:11.313306 16342 leader_election.cc:343] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:11.314947 16708 log.cc:927] Time spent T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:18:11.315173 16345 leader_election.cc:343] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:11.315702 16417 leader_election.cc:343] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.315743 16345 leader_election.cc:304] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:11.316891 16417 leader_election.cc:304] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:11.318017 16633 raft_consensus.cc:2749] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.318575 16686 raft_consensus.cc:2749] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.321357 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:11.322186 16379 raft_consensus.cc:3060] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.319636 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
W20260709 13:18:11.327731 16417 leader_election.cc:343] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.329245 16379 raft_consensus.cc:2468] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:11.310582 16603 leader_election.cc:290] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:11.333603 16573 raft_consensus.cc:697] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:11.334702 16573 consensus_queue.cc:237] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.338338 16417 leader_election.cc:304] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:11.339558 16499 tablet_bootstrap.cc:492] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:11.340112 16499 ts_tablet_manager.cc:1403] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.170s	user 0.033s	sys 0.028s
I20260709 13:18:11.340629 16686 raft_consensus.cc:2804] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:11.344928 16686 raft_consensus.cc:697] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:11.346026 16686 consensus_queue.cc:237] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.356516 16603 consensus_queue.cc:1048] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:11.345106 16502 tablet_bootstrap.cc:654] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.360920 16498 tablet_bootstrap.cc:492] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:11.361560 16498 ts_tablet_manager.cc:1403] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.145s	user 0.014s	sys 0.017s
I20260709 13:18:11.364974 16500 tablet_bootstrap.cc:654] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.366310 16603 consensus_queue.cc:1048] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:11.357132 16499 raft_consensus.cc:359] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.373466 16498 raft_consensus.cc:359] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.380024 16498 raft_consensus.cc:385] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.380424 16498 raft_consensus.cc:740] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.381244 16498 consensus_queue.cc:260] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.386579 16498 ts_tablet_manager.cc:1434] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:18:11.386785 16229 raft_consensus.cc:2468] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 2.
I20260709 13:18:11.387827 16498 tablet_bootstrap.cc:492] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:11.388259 16128 catalog_manager.cc:5697] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:11.392498 16271 leader_election.cc:304] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71
I20260709 13:18:11.394164 16656 raft_consensus.cc:2804] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:11.394977 16656 raft_consensus.cc:697] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:11.395541 16502 tablet_bootstrap.cc:492] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:11.396117 16502 ts_tablet_manager.cc:1403] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.000s
I20260709 13:18:11.395915 16656 consensus_queue.cc:237] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.367636 16499 raft_consensus.cc:385] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.398031 16499 raft_consensus.cc:740] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.403730 16633 raft_consensus.cc:493] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.404356 16633 raft_consensus.cc:515] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.408527 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8997dd86a5ac421ba825e30c817e3ceb" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:11.411440 16499 consensus_queue.cc:260] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.414575 16633 leader_election.cc:290] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
W20260709 13:18:11.414371 16342 leader_election.cc:343] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.419495 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8997dd86a5ac421ba825e30c817e3ceb" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:11.423147 16499 ts_tablet_manager.cc:1434] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.004s
I20260709 13:18:11.424281 16499 tablet_bootstrap.cc:492] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
W20260709 13:18:11.425060 16345 leader_election.cc:343] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.425599 16345 leader_election.cc:304] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:11.414179 16127 catalog_manager.cc:5697] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:11.426793 16633 raft_consensus.cc:2749] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.426592 16123 catalog_manager.cc:5697] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 2 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:11.431345 16498 tablet_bootstrap.cc:654] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.439422 16499 tablet_bootstrap.cc:654] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.431233 16502 raft_consensus.cc:359] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.443948 16502 raft_consensus.cc:385] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.444252 16502 raft_consensus.cc:740] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.445058 16502 consensus_queue.cc:260] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.448514 16502 ts_tablet_manager.cc:1434] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.000s
I20260709 13:18:11.449793 16502 tablet_bootstrap.cc:492] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:11.458547 16654 raft_consensus.cc:493] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.459447 16654 raft_consensus.cc:515] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.462090 16654 leader_election.cc:290] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:11.464299 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ed6ba8f644df7bcec53f34c63a569" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:11.464851 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5ed6ba8f644df7bcec53f34c63a569" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:11.465349 16379 raft_consensus.cc:2393] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0763e17c84d248738dade73ded2c5f71 in this term.
I20260709 13:18:11.468212 16194 leader_election.cc:304] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:11.443514 16500 tablet_bootstrap.cc:492] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:11.469477 16500 ts_tablet_manager.cc:1403] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.202s	user 0.028s	sys 0.027s
I20260709 13:18:11.469753 16657 raft_consensus.cc:3060] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.473781 16500 raft_consensus.cc:359] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.481272 16500 raft_consensus.cc:385] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.483273 16498 tablet_bootstrap.cc:492] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:11.483807 16500 raft_consensus.cc:740] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.484083 16498 ts_tablet_manager.cc:1403] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.007s
I20260709 13:18:11.484825 16500 consensus_queue.cc:260] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.482987 16499 tablet_bootstrap.cc:492] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:11.486009 16499 ts_tablet_manager.cc:1403] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.028s
I20260709 13:18:11.487285 16657 raft_consensus.cc:2749] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.487767 16502 tablet_bootstrap.cc:654] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.489118 16499 raft_consensus.cc:359] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.490010 16499 raft_consensus.cc:385] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.490098 16500 ts_tablet_manager.cc:1434] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:18:11.490429 16499 raft_consensus.cc:740] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.487280 16498 raft_consensus.cc:359] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.491391 16498 raft_consensus.cc:385] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.491706 16498 raft_consensus.cc:740] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.491537 16499 consensus_queue.cc:260] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.492527 16498 consensus_queue.cc:260] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.493270 16500 tablet_bootstrap.cc:492] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:11.495198 16498 ts_tablet_manager.cc:1434] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:18:11.496337 16498 tablet_bootstrap.cc:492] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:11.500288 16499 ts_tablet_manager.cc:1434] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:18:11.501039 16500 tablet_bootstrap.cc:654] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.501812 16499 tablet_bootstrap.cc:492] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:11.503865 16498 tablet_bootstrap.cc:654] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.508325 16502 tablet_bootstrap.cc:492] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:11.509042 16502 ts_tablet_manager.cc:1403] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.000s
I20260709 13:18:11.508325 16499 tablet_bootstrap.cc:654] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.511902 16500 tablet_bootstrap.cc:492] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:11.512452 16500 ts_tablet_manager.cc:1403] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:18:11.520200 16602 consensus_queue.cc:1048] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:11.520702 16502 raft_consensus.cc:359] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.515534 16500 raft_consensus.cc:359] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.521767 16500 raft_consensus.cc:385] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.522143 16500 raft_consensus.cc:740] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.522899 16500 consensus_queue.cc:260] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.521438 16502 raft_consensus.cc:385] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.525115 16502 raft_consensus.cc:740] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.526760 16498 tablet_bootstrap.cc:492] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:11.526401 16502 consensus_queue.cc:260] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.529307 16500 ts_tablet_manager.cc:1434] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:18:11.530443 16500 tablet_bootstrap.cc:492] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:11.530516 16502 ts_tablet_manager.cc:1434] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:18:11.532756 16502 tablet_bootstrap.cc:492] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:11.527371 16498 ts_tablet_manager.cc:1403] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 13:18:11.539717 16498 raft_consensus.cc:359] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.540489 16498 raft_consensus.cc:385] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.540757 16498 raft_consensus.cc:740] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.541471 16498 consensus_queue.cc:260] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.543748 16498 ts_tablet_manager.cc:1434] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:11.547825 16500 tablet_bootstrap.cc:654] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.548857 16664 consensus_queue.cc:1048] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:11.550928 16498 tablet_bootstrap.cc:492] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:11.557958 16498 tablet_bootstrap.cc:654] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.563462 16502 tablet_bootstrap.cc:654] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.567780 16500 tablet_bootstrap.cc:492] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:11.568390 16500 ts_tablet_manager.cc:1403] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.005s
I20260709 13:18:11.571525 16500 raft_consensus.cc:359] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.572271 16500 raft_consensus.cc:385] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.572562 16500 raft_consensus.cc:740] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.573287 16500 consensus_queue.cc:260] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.576885 16500 ts_tablet_manager.cc:1434] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:18:11.579821 16500 tablet_bootstrap.cc:492] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:11.584204 16502 tablet_bootstrap.cc:492] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:11.585022 16502 ts_tablet_manager.cc:1403] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.001s
I20260709 13:18:11.588932 16502 raft_consensus.cc:359] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.589918 16502 raft_consensus.cc:385] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.590261 16500 tablet_bootstrap.cc:654] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.590276 16502 raft_consensus.cc:740] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.594269 16502 consensus_queue.cc:260] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.596808 16502 ts_tablet_manager.cc:1434] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:18:11.600577 16500 tablet_bootstrap.cc:492] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:11.601205 16500 ts_tablet_manager.cc:1403] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.007s
I20260709 13:18:11.604554 16656 raft_consensus.cc:493] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.605185 16656 raft_consensus.cc:515] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.609850 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:11.612172 16656 leader_election.cc:290] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:11.612993 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:11.613730 16502 tablet_bootstrap.cc:492] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:11.613965 16379 raft_consensus.cc:2393] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e0de78970041afb173662b1c34598e in current term 1: Already voted for candidate 0763e17c84d248738dade73ded2c5f71 in this term.
I20260709 13:18:11.615525 16269 leader_election.cc:304] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:11.616750 16656 raft_consensus.cc:3060] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.618175 16500 raft_consensus.cc:359] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.618933 16500 raft_consensus.cc:385] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.619189 16500 raft_consensus.cc:740] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.623829 16502 tablet_bootstrap.cc:654] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.626994 16688 raft_consensus.cc:493] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.627584 16688 raft_consensus.cc:515] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.629969 16688 leader_election.cc:290] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:11.633137 16602 consensus_queue.cc:1048] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:11.626994 16500 consensus_queue.cc:260] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.639498 16656 raft_consensus.cc:2749] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.643208 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0799b6996943f9b0b9093d073d6dbd" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:11.646760 16500 ts_tablet_manager.cc:1434] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.002s
I20260709 13:18:11.647360 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0799b6996943f9b0b9093d073d6dbd" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:11.648069 16500 tablet_bootstrap.cc:492] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:11.648533 16379 raft_consensus.cc:2393] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e0de78970041afb173662b1c34598e in current term 1: Already voted for candidate fe046a372b6a4df982eebe83cf3ee184 in this term.
I20260709 13:18:11.650180 16269 leader_election.cc:304] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:11.651566 16687 raft_consensus.cc:3060] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.666818 16602 raft_consensus.cc:493] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.667510 16602 raft_consensus.cc:515] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.671824 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8997dd86a5ac421ba825e30c817e3ceb" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:11.672816 16379 raft_consensus.cc:2468] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:11.674980 16417 leader_election.cc:304] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:11.676035 16686 raft_consensus.cc:2804] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.678156 16686 raft_consensus.cc:493] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.678666 16686 raft_consensus.cc:3060] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.684949 16500 tablet_bootstrap.cc:654] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.686054 16602 leader_election.cc:290] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:11.688601 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8997dd86a5ac421ba825e30c817e3ceb" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:11.699214 16499 tablet_bootstrap.cc:492] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:11.699752 16499 ts_tablet_manager.cc:1403] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.198s	user 0.046s	sys 0.050s
I20260709 13:18:11.700793 16502 tablet_bootstrap.cc:492] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:11.701292 16502 ts_tablet_manager.cc:1403] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.002s
W20260709 13:18:11.702057 16419 leader_election.cc:343] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.705265 16498 tablet_bootstrap.cc:492] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:11.705819 16498 ts_tablet_manager.cc:1403] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.161s	user 0.023s	sys 0.026s
I20260709 13:18:11.706794 16502 raft_consensus.cc:359] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.707557 16502 raft_consensus.cc:385] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.707839 16502 raft_consensus.cc:740] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.708640 16502 consensus_queue.cc:260] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.710531 16502 ts_tablet_manager.cc:1434] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:11.711666 16502 tablet_bootstrap.cc:492] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:11.717435 16686 raft_consensus.cc:515] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.718384 16502 tablet_bootstrap.cc:654] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.725900 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8997dd86a5ac421ba825e30c817e3ceb" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:11.726684 16379 raft_consensus.cc:3060] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.718595 16498 raft_consensus.cc:359] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.720708 16687 raft_consensus.cc:2749] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.727792 16498 raft_consensus.cc:385] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.732190 16498 raft_consensus.cc:740] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.734055 16498 consensus_queue.cc:260] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.742208 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8997dd86a5ac421ba825e30c817e3ceb" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:11.736351 16686 leader_election.cc:290] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:11.759411 16664 raft_consensus.cc:493] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.760098 16664 raft_consensus.cc:515] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.765265 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58607755710543c9809dbf53631f4738" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:11.765475 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58607755710543c9809dbf53631f4738" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:11.767542 16419 leader_election.cc:343] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:11.768364 16417 leader_election.cc:343] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.769001 16417 leader_election.cc:304] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:11.775794 16498 ts_tablet_manager.cc:1434] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.000s
I20260709 13:18:11.777307 16498 tablet_bootstrap.cc:492] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:11.732844 16602 consensus_queue.cc:1048] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:18:11.780414 16602 raft_consensus.cc:2749] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.784008 16664 leader_election.cc:290] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:11.787392 16500 tablet_bootstrap.cc:492] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:11.787993 16500 ts_tablet_manager.cc:1403] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.140s	user 0.024s	sys 0.020s
I20260709 13:18:11.791083 16500 raft_consensus.cc:359] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.791874 16500 raft_consensus.cc:385] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.792131 16500 raft_consensus.cc:740] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.795925 16499 raft_consensus.cc:359] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.796633 16379 raft_consensus.cc:2468] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:11.796944 16499 raft_consensus.cc:385] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.797454 16499 raft_consensus.cc:740] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.801821 16499 consensus_queue.cc:260] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.802711 16657 raft_consensus.cc:493] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.805708 16500 consensus_queue.cc:260] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.809101 16499 ts_tablet_manager.cc:1434] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
I20260709 13:18:11.810565 16499 tablet_bootstrap.cc:492] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
W20260709 13:18:11.803488 16419 leader_election.cc:343] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.815169 16633 raft_consensus.cc:493] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.816206 16633 raft_consensus.cc:515] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.817320 16499 tablet_bootstrap.cc:654] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.821548 16531 raft_consensus.cc:493] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.803364 16657 raft_consensus.cc:515] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.822402 16531 raft_consensus.cc:515] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.826453 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab0b93ad21849139b174c34a46ce646" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:11.827584 16531 leader_election.cc:290] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:11.827914 16657 leader_election.cc:290] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:11.832193 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6196aafd32f448a7964c50df2be2a4b3" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:11.831341 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6196aafd32f448a7964c50df2be2a4b3" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:11.833228 16378 raft_consensus.cc:2468] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:11.833616 16303 raft_consensus.cc:2468] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:11.832223 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "751bec01e5d145adac78c28b7b581d73" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
W20260709 13:18:11.828981 16343 leader_election.cc:343] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.839141 16194 leader_election.cc:304] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
W20260709 13:18:11.840106 16342 leader_election.cc:343] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.840871 16654 raft_consensus.cc:2804] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.841347 16654 raft_consensus.cc:493] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.841738 16654 raft_consensus.cc:3060] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.829824 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab0b93ad21849139b174c34a46ce646" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:11.843256 16453 raft_consensus.cc:2468] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:11.844949 16342 leader_election.cc:304] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:11.845842 16531 raft_consensus.cc:2804] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.846226 16531 raft_consensus.cc:493] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.846560 16531 raft_consensus.cc:3060] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.851917 16687 raft_consensus.cc:493] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.852072 16654 raft_consensus.cc:515] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.852651 16687 raft_consensus.cc:515] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.854982 16687 leader_election.cc:290] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:11.856079 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e67f760e0414db092683b5e5ce3ef8f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:11.856781 16378 raft_consensus.cc:2468] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:11.857023 16654 leader_election.cc:290] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:11.854059 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "751bec01e5d145adac78c28b7b581d73" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:11.866844 16500 ts_tablet_manager.cc:1434] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 13:18:11.868692 16500 tablet_bootstrap.cc:492] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:11.859957 16633 leader_election.cc:290] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:11.879273 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e67f760e0414db092683b5e5ce3ef8f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:11.883637 16502 tablet_bootstrap.cc:492] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:11.884207 16502 ts_tablet_manager.cc:1403] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.173s	user 0.025s	sys 0.015s
I20260709 13:18:11.880527 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6196aafd32f448a7964c50df2be2a4b3" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:11.880579 16453 raft_consensus.cc:2468] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:11.859150 16417 leader_election.cc:304] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:11.861608 16269 leader_election.cc:304] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
W20260709 13:18:11.887931 16343 leader_election.cc:343] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.892011 16343 leader_election.cc:304] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:11.892148 16603 raft_consensus.cc:2804] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:11.886898 16378 raft_consensus.cc:3060] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.894284 16498 tablet_bootstrap.cc:654] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.894831 16633 raft_consensus.cc:2749] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:11.892048 16417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 84151.4us
I20260709 13:18:11.898671 16603 raft_consensus.cc:697] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:11.899621 16635 raft_consensus.cc:493] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.904626 16687 raft_consensus.cc:2804] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.912117 16635 raft_consensus.cc:515] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.915828 16635 leader_election.cc:290] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:11.907109 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6196aafd32f448a7964c50df2be2a4b3" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:11.916890 16303 raft_consensus.cc:3060] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.912488 16687 raft_consensus.cc:493] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.919669 16687 raft_consensus.cc:3060] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.919766 16732 consensus_queue.cc:1048] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:11.923738 16502 raft_consensus.cc:359] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.924646 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029ee74f09f8428c81f8feae77fd8e84" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:11.925390 16304 raft_consensus.cc:2468] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:11.924643 16502 raft_consensus.cc:385] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.926764 16502 raft_consensus.cc:740] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.927769 16502 consensus_queue.cc:260] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:11.929627 16735 consensus_queue.cc:1048] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:11.912442 16603 consensus_queue.cc:237] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:11.930413 16654 raft_consensus.cc:493] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.932157 16654 raft_consensus.cc:515] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.934418 16654 leader_election.cc:290] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:11.935482 16656 raft_consensus.cc:493] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.936431 16656 raft_consensus.cc:515] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:11.936878 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:11.937729 16453 raft_consensus.cc:2468] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:11.929234 16227 raft_consensus.cc:1275] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Refusing update from remote peer 35e0de78970041afb173662b1c34598e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:11.940754 16656 leader_election.cc:290] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:11.941347 16193 leader_election.cc:304] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:11.942893 16657 raft_consensus.cc:2804] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.943326 16657 raft_consensus.cc:493] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.943693 16657 raft_consensus.cc:3060] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.944414 16502 ts_tablet_manager.cc:1434] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.005s
I20260709 13:18:11.945123 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029ee74f09f8428c81f8feae77fd8e84" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:11.945482 16502 tablet_bootstrap.cc:492] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:11.946820 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:11.946972 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:11.947520 16451 raft_consensus.cc:2468] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:11.948827 16378 raft_consensus.cc:2468] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:11.958442 16499 tablet_bootstrap.cc:492] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:11.953580 16343 leader_election.cc:304] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:11.955569 16656 consensus_queue.cc:1048] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:11.959318 16500 tablet_bootstrap.cc:654] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.908419 16531 raft_consensus.cc:515] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:11.964430 16499 ts_tablet_manager.cc:1403] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.154s	user 0.024s	sys 0.046s
I20260709 13:18:11.971563 16635 raft_consensus.cc:2804] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.974927 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:11.975293 16635 raft_consensus.cc:493] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.975829 16302 raft_consensus.cc:2468] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:11.976742 16654 consensus_queue.cc:1048] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:11.966351 16345 leader_election.cc:343] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.975855 16635 raft_consensus.cc:3060] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.972226 16268 leader_election.cc:304] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:11.985116 16657 raft_consensus.cc:515] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.014484 16656 raft_consensus.cc:2804] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:18:12.011242 16268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 44320.6us
I20260709 13:18:11.998557 16687 raft_consensus.cc:515] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.027791 16227 raft_consensus.cc:2393] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e0de78970041afb173662b1c34598e in current term 1: Already voted for candidate fe046a372b6a4df982eebe83cf3ee184 in this term.
I20260709 13:18:12.022600 16656 raft_consensus.cc:493] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.047597 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:12.048372 16451 raft_consensus.cc:3060] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.034878 16194 leader_election.cc:304] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:12.056491 16451 raft_consensus.cc:2468] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
W20260709 13:18:12.057097 16736 log.cc:927] Time spent T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:18:12.058593 16498 tablet_bootstrap.cc:492] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:12.065279 16498 ts_tablet_manager.cc:1403] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.288s	user 0.020s	sys 0.000s
I20260709 13:18:12.052335 16744 raft_consensus.cc:2804] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.051199 16499 raft_consensus.cc:359] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:12.067531 16499 raft_consensus.cc:385] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.050561 16657 leader_election.cc:290] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
W20260709 13:18:12.028332 16345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 67608.2us
I20260709 13:18:12.036027 16656 raft_consensus.cc:3060] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.101634 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab0b93ad21849139b174c34a46ce646" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:12.102115 16531 leader_election.cc:290] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:12.102306 16453 raft_consensus.cc:3060] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.072722 16744 raft_consensus.cc:697] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:12.076512 16451 raft_consensus.cc:3060] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.103077 16502 tablet_bootstrap.cc:654] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.103542 16744 consensus_queue.cc:237] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:12.079177 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab0b93ad21849139b174c34a46ce646" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:12.079730 16635 raft_consensus.cc:515] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:12.108407 16635 leader_election.cc:290] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:12.065704 16633 raft_consensus.cc:493] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.109136 16633 raft_consensus.cc:515] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:12.111459 16633 leader_election.cc:290] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:12.085453 16498 raft_consensus.cc:359] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.112171 16498 raft_consensus.cc:385] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.112468 16498 raft_consensus.cc:740] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.113047 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e67f760e0414db092683b5e5ce3ef8f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:12.113147 16498 consensus_queue.cc:260] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.113821 16452 raft_consensus.cc:3060] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.087891 16126 catalog_manager.cc:5697] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.090396 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:12.093557 16634 raft_consensus.cc:493] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.114941 16634 raft_consensus.cc:515] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:12.095067 16193 leader_election.cc:304] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:12.095199 16743 consensus_queue.cc:1048] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.068101 16499 raft_consensus.cc:740] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.052449 16303 raft_consensus.cc:2468] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:12.132582 16499 consensus_queue.cc:260] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:12.136159 16498 ts_tablet_manager.cc:1434] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:18:12.139817 16743 raft_consensus.cc:2804] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.140630 16743 raft_consensus.cc:697] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:12.119223 16687 leader_election.cc:290] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:12.150341 16498 tablet_bootstrap.cc:492] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:12.156216 16499 ts_tablet_manager.cc:1434] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.182s	user 0.014s	sys 0.003s
I20260709 13:18:12.158118 16499 tablet_bootstrap.cc:492] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:12.141795 16743 consensus_queue.cc:237] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.164491 16634 leader_election.cc:290] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:12.167156 16500 tablet_bootstrap.cc:492] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:12.167790 16500 ts_tablet_manager.cc:1403] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.299s	user 0.029s	sys 0.024s
I20260709 13:18:12.176455 16452 raft_consensus.cc:2468] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:12.180389 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e67f760e0414db092683b5e5ce3ef8f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:12.181131 16379 raft_consensus.cc:3060] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.176512 16451 raft_consensus.cc:1275] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer 35e0de78970041afb173662b1c34598e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:12.183302 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029ee74f09f8428c81f8feae77fd8e84" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:12.184091 16302 raft_consensus.cc:3060] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.185248 16500 raft_consensus.cc:359] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.186292 16500 raft_consensus.cc:385] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.186669 16500 raft_consensus.cc:740] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.187654 16500 consensus_queue.cc:260] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.189765 16502 tablet_bootstrap.cc:492] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:12.192561 16502 ts_tablet_manager.cc:1403] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.247s	user 0.013s	sys 0.006s
I20260709 13:18:12.190018 16500 ts_tablet_manager.cc:1434] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
W20260709 13:18:12.197402 16343 leader_election.cc:343] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.201889 16268 leader_election.cc:304] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:12.203274 16745 raft_consensus.cc:2804] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.203830 16745 raft_consensus.cc:697] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:12.204715 16745 consensus_queue.cc:237] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.205806 16656 raft_consensus.cc:515] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.226953 16305 raft_consensus.cc:2393] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:12.234225 16499 tablet_bootstrap.cc:654] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:12.242489 16193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 148577us
I20260709 13:18:12.234440 16453 raft_consensus.cc:2468] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:12.253909 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:12.254698 16342 leader_election.cc:304] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:12.252290 16657 raft_consensus.cc:493] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.256395 16657 raft_consensus.cc:515] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.257078 16302 raft_consensus.cc:2468] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:12.257416 16634 raft_consensus.cc:2804] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.261114 16634 raft_consensus.cc:697] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:12.261648 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8997dd86a5ac421ba825e30c817e3ceb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:12.258728 16657 leader_election.cc:290] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:12.248325 16500 tablet_bootstrap.cc:492] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:12.267874 16498 tablet_bootstrap.cc:654] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.270882 16379 raft_consensus.cc:2468] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:12.272527 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbce7ea12f554f25812e7ef8fdcc892e" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:12.272704 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029ee74f09f8428c81f8feae77fd8e84" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:12.273867 16229 raft_consensus.cc:3060] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.274391 16502 raft_consensus.cc:359] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.275563 16502 raft_consensus.cc:385] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.276073 16502 raft_consensus.cc:740] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.281776 16502 consensus_queue.cc:260] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.244284 16656 leader_election.cc:290] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:12.284368 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2485b97ef87a4855b8cc1c0f6e0ba2c7" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:12.286234 16502 ts_tablet_manager.cc:1434] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 13:18:12.295305 16502 tablet_bootstrap.cc:492] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:12.290545 16500 tablet_bootstrap.cc:654] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:12.305662 16268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 103890us
I20260709 13:18:12.314612 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2485b97ef87a4855b8cc1c0f6e0ba2c7" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:12.277078 16634 consensus_queue.cc:237] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.326493 16656 raft_consensus.cc:493] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.327337 16656 raft_consensus.cc:515] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.326539 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8997dd86a5ac421ba825e30c817e3ceb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
W20260709 13:18:12.333000 16345 leader_election.cc:343] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.333650 16376 raft_consensus.cc:2393] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0763e17c84d248738dade73ded2c5f71 in this term.
W20260709 13:18:12.334537 16345 leader_election.cc:343] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.334920 16656 leader_election.cc:290] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:12.336828 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58607755710543c9809dbf53631f4738" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:12.338878 16745 consensus_queue.cc:1048] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:12.341567 16271 leader_election.cc:343] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.342387 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbce7ea12f554f25812e7ef8fdcc892e" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:12.344748 16343 leader_election.cc:304] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:12.348383 16749 raft_consensus.cc:2804] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:12.348928 16343 leader_election.cc:343] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.349716 16343 leader_election.cc:304] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:12.350881 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:12.350746 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58607755710543c9809dbf53631f4738" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:12.367899 16194 leader_election.cc:304] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:12.369975 16744 raft_consensus.cc:3060] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.355273 16594 raft_consensus.cc:2749] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.348966 16749 raft_consensus.cc:697] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:12.360306 16451 raft_consensus.cc:2393] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35e0de78970041afb173662b1c34598e in current term 1: Already voted for candidate fe046a372b6a4df982eebe83cf3ee184 in this term.
I20260709 13:18:12.353544 16450 raft_consensus.cc:2468] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:12.395962 16502 tablet_bootstrap.cc:654] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.398756 16749 consensus_queue.cc:237] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
W20260709 13:18:12.383800 16343 leader_election.cc:343] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.413030 16268 leader_election.cc:304] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:12.414378 16343 leader_election.cc:304] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:12.417286 16744 raft_consensus.cc:2749] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.417446 16633 raft_consensus.cc:2749] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.421100 16499 tablet_bootstrap.cc:492] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:12.420989 16229 raft_consensus.cc:2468] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:12.421871 16499 ts_tablet_manager.cc:1403] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.264s	user 0.017s	sys 0.000s
I20260709 13:18:12.424072 16656 raft_consensus.cc:2749] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.430549 16499 raft_consensus.cc:359] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.433840 16499 raft_consensus.cc:385] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.434195 16499 raft_consensus.cc:740] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.443693 16664 consensus_queue.cc:1048] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.444134 16268 leader_election.cc:304] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:12.435007 16499 consensus_queue.cc:260] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.445765 16754 raft_consensus.cc:2804] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.446256 16754 raft_consensus.cc:493] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.446652 16754 raft_consensus.cc:3060] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.447587 16499 ts_tablet_manager.cc:1434] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.003s
I20260709 13:18:12.448640 16499 tablet_bootstrap.cc:492] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:12.455668 16754 raft_consensus.cc:515] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.463973 16603 consensus_queue.cc:1048] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.470266 16500 tablet_bootstrap.cc:492] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:12.470232 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58607755710543c9809dbf53631f4738" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:12.471308 16500 ts_tablet_manager.cc:1403] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.223s	user 0.009s	sys 0.018s
I20260709 13:18:12.471405 16450 raft_consensus.cc:3060] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.474803 16500 raft_consensus.cc:359] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.475694 16500 raft_consensus.cc:385] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.475987 16500 raft_consensus.cc:740] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.470371 16499 tablet_bootstrap.cc:654] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.476812 16500 consensus_queue.cc:260] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.484933 16498 tablet_bootstrap.cc:492] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:12.485467 16498 ts_tablet_manager.cc:1403] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.335s	user 0.019s	sys 0.003s
I20260709 13:18:12.494990 16498 raft_consensus.cc:359] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.495739 16498 raft_consensus.cc:385] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.496004 16498 raft_consensus.cc:740] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.496867 16743 consensus_queue.cc:1048] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.499359 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58607755710543c9809dbf53631f4738" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:12.500388 16229 raft_consensus.cc:3060] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.502027 16450 raft_consensus.cc:2468] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:12.503762 16498 consensus_queue.cc:260] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.509690 16268 leader_election.cc:304] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:12.510970 16656 raft_consensus.cc:2804] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.511541 16656 raft_consensus.cc:697] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:12.512472 16656 consensus_queue.cc:237] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.514690 16502 tablet_bootstrap.cc:492] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:12.515231 16502 ts_tablet_manager.cc:1403] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.220s	user 0.018s	sys 0.010s
I20260709 13:18:12.515477 16498 ts_tablet_manager.cc:1434] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 13:18:12.516870 16500 ts_tablet_manager.cc:1434] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.001s
I20260709 13:18:12.518230 16500 tablet_bootstrap.cc:492] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:12.506404 16664 raft_consensus.cc:493] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.521111 16664 raft_consensus.cc:515] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.521422 16229 raft_consensus.cc:2468] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:12.494468 16754 leader_election.cc:290] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:12.525144 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86655b05b814b00bcf81c0da904bdaf" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:12.527920 16498 tablet_bootstrap.cc:492] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:12.536139 16376 raft_consensus.cc:2468] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:12.538247 16417 leader_election.cc:304] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:12.542559 16603 raft_consensus.cc:2804] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.545207 16603 raft_consensus.cc:493] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.545405 16499 tablet_bootstrap.cc:492] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:12.545771 16603 raft_consensus.cc:3060] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.546042 16499 ts_tablet_manager.cc:1403] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.098s	user 0.022s	sys 0.010s
I20260709 13:18:12.546178 16123 catalog_manager.cc:5697] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.541738 16125 catalog_manager.cc:5697] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:12.543236 16175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:12.549382 16499 raft_consensus.cc:359] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.552423 16499 raft_consensus.cc:385] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.553299 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86655b05b814b00bcf81c0da904bdaf" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:12.549813 16664 leader_election.cc:290] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:12.552881 16499 raft_consensus.cc:740] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.558094 16502 raft_consensus.cc:359] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.559005 16502 raft_consensus.cc:385] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.559326 16502 raft_consensus.cc:740] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.560060 16502 consensus_queue.cc:260] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.562358 16502 ts_tablet_manager.cc:1434] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.000s
I20260709 13:18:12.560060 16499 consensus_queue.cc:260] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.563287 16125 catalog_manager.cc:5697] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.568187 16502 tablet_bootstrap.cc:492] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:12.575534 16502 tablet_bootstrap.cc:654] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.576843 16229 raft_consensus.cc:2468] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:12.580982 16499 ts_tablet_manager.cc:1434] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:18:12.583992 16499 tablet_bootstrap.cc:492] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:12.589527 16498 tablet_bootstrap.cc:654] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.593820 16499 tablet_bootstrap.cc:654] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.605180 16657 consensus_queue.cc:1048] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.597209 16500 tablet_bootstrap.cc:654] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.600441 16603 raft_consensus.cc:515] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.611377 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86655b05b814b00bcf81c0da904bdaf" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:12.612210 16377 raft_consensus.cc:3060] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.617134 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86655b05b814b00bcf81c0da904bdaf" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:12.618151 16229 raft_consensus.cc:3060] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.622277 16656 raft_consensus.cc:493] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.622944 16656 raft_consensus.cc:515] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.625356 16656 leader_election.cc:290] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:12.626278 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab0b93ad21849139b174c34a46ce646" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:12.626494 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab0b93ad21849139b174c34a46ce646" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:12.627487 16450 raft_consensus.cc:2393] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e0de78970041afb173662b1c34598e in current term 1: Already voted for candidate 0c736bf768804f2e86a875366c12a71c in this term.
I20260709 13:18:12.627817 16603 leader_election.cc:290] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:12.628933 16268 leader_election.cc:304] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:12.636269 16656 raft_consensus.cc:3060] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.630507 16229 raft_consensus.cc:2468] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:12.639715 16502 tablet_bootstrap.cc:492] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:12.639703 16498 tablet_bootstrap.cc:492] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:12.641216 16498 ts_tablet_manager.cc:1403] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.004s
I20260709 13:18:12.641477 16419 leader_election.cc:304] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:12.642933 16664 raft_consensus.cc:2804] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.643488 16664 raft_consensus.cc:697] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:12.644374 16664 consensus_queue.cc:237] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.644614 16498 raft_consensus.cc:359] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.645292 16656 raft_consensus.cc:2749] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.645437 16498 raft_consensus.cc:385] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.646405 16498 raft_consensus.cc:740] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.647452 16498 consensus_queue.cc:260] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.648067 16124 catalog_manager.cc:5697] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.650033 16498 ts_tablet_manager.cc:1434] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:12.650370 16633 raft_consensus.cc:493] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.651257 16498 tablet_bootstrap.cc:492] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:12.650935 16633 raft_consensus.cc:515] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.640372 16502 ts_tablet_manager.cc:1403] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.021s
I20260709 13:18:12.660724 16502 raft_consensus.cc:359] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.661518 16502 raft_consensus.cc:385] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.661826 16502 raft_consensus.cc:740] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.662549 16502 consensus_queue.cc:260] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.665438 16502 ts_tablet_manager.cc:1434] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:18:12.666497 16502 tablet_bootstrap.cc:492] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:12.672845 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13fb80f9cf64345a2b3e9f4009281b6" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:12.676427 16633 leader_election.cc:290] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:12.676687 16498 tablet_bootstrap.cc:654] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.677829 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13fb80f9cf64345a2b3e9f4009281b6" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:12.678917 16342 leader_election.cc:343] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:12.679556 16345 leader_election.cc:343] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.680112 16345 leader_election.cc:304] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:12.681183 16633 raft_consensus.cc:2749] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.684670 16377 raft_consensus.cc:2468] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:12.685279 16499 tablet_bootstrap.cc:492] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:12.689319 16499 ts_tablet_manager.cc:1403] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.003s
I20260709 13:18:12.692703 16499 raft_consensus.cc:359] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.688201 16498 tablet_bootstrap.cc:492] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:12.672834 16502 tablet_bootstrap.cc:654] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.693513 16500 tablet_bootstrap.cc:492] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:12.693970 16498 ts_tablet_manager.cc:1403] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.000s
I20260709 13:18:12.694229 16500 ts_tablet_manager.cc:1403] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.007s
I20260709 13:18:12.696116 16499 raft_consensus.cc:385] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.696473 16499 raft_consensus.cc:740] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.690928 16126 catalog_manager.cc:5697] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.696996 16498 raft_consensus.cc:359] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.697216 16499 consensus_queue.cc:260] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.697821 16498 raft_consensus.cc:385] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.698309 16498 raft_consensus.cc:740] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.699350 16500 raft_consensus.cc:359] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:12.700410 16500 raft_consensus.cc:385] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.700687 16500 raft_consensus.cc:740] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.700798 16499 ts_tablet_manager.cc:1434] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:18:12.699360 16498 consensus_queue.cc:260] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.702361 16500 consensus_queue.cc:260] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:12.701897 16499 tablet_bootstrap.cc:492] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:12.703990 16498 ts_tablet_manager.cc:1434] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:18:12.705120 16498 tablet_bootstrap.cc:492] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:12.710053 16500 ts_tablet_manager.cc:1434] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:18:12.713526 16500 tablet_bootstrap.cc:492] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:12.714529 16499 tablet_bootstrap.cc:654] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.720619 16500 tablet_bootstrap.cc:654] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.712234 16498 tablet_bootstrap.cc:654] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.728128 16743 consensus_queue.cc:1048] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.729333 16634 consensus_queue.cc:1048] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.741802 16743 consensus_queue.cc:1048] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.747345 16664 raft_consensus.cc:493] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.748114 16664 raft_consensus.cc:515] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.751919 16664 leader_election.cc:290] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:12.755074 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13fb80f9cf64345a2b3e9f4009281b6" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:12.755964 16377 raft_consensus.cc:2468] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:12.757577 16417 leader_election.cc:304] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:12.758373 16656 raft_consensus.cc:493] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.758966 16656 raft_consensus.cc:515] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:12.759266 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13fb80f9cf64345a2b3e9f4009281b6" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:12.759552 16664 raft_consensus.cc:2804] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.761991 16656 leader_election.cc:290] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:12.763479 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2485b97ef87a4855b8cc1c0f6e0ba2c7" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:12.780117 16377 raft_consensus.cc:2468] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
W20260709 13:18:12.761876 16419 leader_election.cc:343] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.783006 16269 leader_election.cc:304] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:12.784598 16531 raft_consensus.cc:493] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.785399 16531 raft_consensus.cc:515] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.787488 16656 raft_consensus.cc:2804] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.788060 16656 raft_consensus.cc:493] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.788491 16531 leader_election.cc:290] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:12.796203 16747 consensus_queue.cc:1048] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.799229 16749 consensus_queue.cc:1048] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.803068 16531 raft_consensus.cc:493] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.803895 16531 raft_consensus.cc:515] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.762704 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2485b97ef87a4855b8cc1c0f6e0ba2c7" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:12.811054 16664 raft_consensus.cc:493] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:12.811470 16271 leader_election.cc:343] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.811800 16664 raft_consensus.cc:3060] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.816838 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2559ecae96646189c0bc8afbe49ce16" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:12.819700 16531 leader_election.cc:290] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:12.788511 16656 raft_consensus.cc:3060] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.822583 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2559ecae96646189c0bc8afbe49ce16" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:12.826974 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20206667639a48e8a81abb2b99441995" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:12.835191 16343 leader_election.cc:343] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:12.836369 16343 leader_election.cc:343] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.836671 16747 consensus_queue.cc:1048] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:12.879557 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20206667639a48e8a81abb2b99441995" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:12.874923 16732 raft_consensus.cc:493] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.871623 16743 raft_consensus.cc:493] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.895601 16125 catalog_manager.cc:5697] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.837060 16633 consensus_queue.cc:1048] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
I20260709 13:18:12.905304 16499 tablet_bootstrap.cc:492] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:12.907089 16499 ts_tablet_manager.cc:1403] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.205s	user 0.011s	sys 0.012s
I20260709 13:18:12.911424 16502 tablet_bootstrap.cc:492] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:12.912155 16502 ts_tablet_manager.cc:1403] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.246s	user 0.050s	sys 0.098s
I20260709 13:18:12.910955 16732 raft_consensus.cc:515] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:12.907021 16634 consensus_queue.cc:1048] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:18:12.908928 16743 raft_consensus.cc:515] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
W20260709 13:18:12.926493 16342 leader_election.cc:343] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.947680 16498 tablet_bootstrap.cc:492] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:12.946833 16502 raft_consensus.cc:359] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:12.948501 16498 ts_tablet_manager.cc:1403] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.244s	user 0.028s	sys 0.050s
I20260709 13:18:12.952183 16498 raft_consensus.cc:359] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.953032 16498 raft_consensus.cc:385] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.953316 16498 raft_consensus.cc:740] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.943143 16342 leader_election.cc:304] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:12.954043 16498 consensus_queue.cc:260] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:12.956017 16594 raft_consensus.cc:2749] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.956475 16498 ts_tablet_manager.cc:1434] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:12.948859 16502 raft_consensus.cc:385] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.958735 16502 raft_consensus.cc:740] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.963351 16498 tablet_bootstrap.cc:492] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:12.964505 16500 tablet_bootstrap.cc:492] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:12.965593 16500 ts_tablet_manager.cc:1403] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.252s	user 0.033s	sys 0.018s
I20260709 13:18:12.966979 16656 raft_consensus.cc:515] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:12.969009 16732 leader_election.cc:290] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:12.969892 16656 leader_election.cc:290] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:12.985296 16502 consensus_queue.cc:260] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
W20260709 13:18:12.964298 16342 leader_election.cc:343] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.998378 16502 ts_tablet_manager.cc:1434] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:18:13.003970 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:12.996259 16342 leader_election.cc:304] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:12.997627 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2485b97ef87a4855b8cc1c0f6e0ba2c7" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
W20260709 13:18:13.023691 16342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 65546.6us
I20260709 13:18:13.035243 16531 raft_consensus.cc:2749] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.053531 16502 tablet_bootstrap.cc:492] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:13.091200 16732 raft_consensus.cc:493] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.091872 16732 raft_consensus.cc:515] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.104516 16743 leader_election.cc:290] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:13.113858 16732 leader_election.cc:290] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
W20260709 13:18:13.118754 16788 log.cc:927] Time spent T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:18:13.119181 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:13.120234 16453 raft_consensus.cc:2468] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:13.121503 16500 raft_consensus.cc:359] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.122068 16499 raft_consensus.cc:359] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:13.123060 16499 raft_consensus.cc:385] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.123358 16499 raft_consensus.cc:740] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.124069 16499 consensus_queue.cc:260] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:13.126359 16499 ts_tablet_manager.cc:1434] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.218s	user 0.005s	sys 0.000s
I20260709 13:18:13.127588 16634 raft_consensus.cc:493] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.128383 16634 raft_consensus.cc:515] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.131652 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2485b97ef87a4855b8cc1c0f6e0ba2c7" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:13.132360 16377 raft_consensus.cc:3060] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.136256 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145398d14cf9402e819285d9fc5253b9" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:13.122517 16500 raft_consensus.cc:385] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.141535 16449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf1f8703ff64c89afb0d1dbe0eab26f" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:13.143142 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:13.136152 16634 leader_election.cc:290] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
W20260709 13:18:13.146945 16417 leader_election.cc:343] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.141835 16500 raft_consensus.cc:740] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.147953 16664 raft_consensus.cc:515] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.151961 16664 leader_election.cc:290] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:13.155515 16502 tablet_bootstrap.cc:654] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.156617 16498 tablet_bootstrap.cc:654] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.163563 16500 consensus_queue.cc:260] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.165537 16499 tablet_bootstrap.cc:492] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:13.173046 16500 ts_tablet_manager.cc:1434] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.207s	user 0.007s	sys 0.004s
I20260709 13:18:13.174258 16500 tablet_bootstrap.cc:492] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
W20260709 13:18:13.174459 16417 leader_election.cc:343] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:13.177127 16342 leader_election.cc:343] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.183755 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:13.166285 16304 raft_consensus.cc:2468] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:13.184571 16227 raft_consensus.cc:2468] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:13.180183 16795 consensus_queue.cc:1048] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:18:13.189335 16500 tablet_bootstrap.cc:654] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.188607 16128 catalog_manager.cc:5697] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.193300 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145398d14cf9402e819285d9fc5253b9" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:13.192960 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13fb80f9cf64345a2b3e9f4009281b6" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:13.195034 16379 raft_consensus.cc:3060] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.195719 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13fb80f9cf64345a2b3e9f4009281b6" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
W20260709 13:18:13.197511 16271 leader_election.cc:343] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.199725 16193 leader_election.cc:304] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:13.207072 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf1f8703ff64c89afb0d1dbe0eab26f" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:13.212126 16345 leader_election.cc:343] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.212692 16345 leader_election.cc:304] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:13.214109 16794 consensus_queue.cc:1048] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:13.214722 16634 raft_consensus.cc:2749] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.220224 16419 leader_election.cc:304] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:13.221395 16794 raft_consensus.cc:2804] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:18:13.221786 16419 leader_election.cc:343] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.222661 16499 tablet_bootstrap.cc:654] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.221829 16794 raft_consensus.cc:493] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.230409 16377 raft_consensus.cc:2468] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:13.238013 16798 raft_consensus.cc:2804] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:13.238425 16794 raft_consensus.cc:3060] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.258715 16269 leader_election.cc:304] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:13.260432 16795 raft_consensus.cc:2804] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:13.260985 16795 raft_consensus.cc:697] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:13.251294 16798 raft_consensus.cc:493] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.261775 16798 raft_consensus.cc:3060] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.261875 16795 consensus_queue.cc:237] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:13.235826 16419 leader_election.cc:304] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:13.272388 16664 raft_consensus.cc:2749] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:13.273834 16419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 52152.9us
I20260709 13:18:13.289067 16745 consensus_queue.cc:1048] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:13.309135 16502 tablet_bootstrap.cc:492] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:13.309774 16502 ts_tablet_manager.cc:1403] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.257s	user 0.027s	sys 0.016s
I20260709 13:18:13.313644 16502 raft_consensus.cc:359] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:13.319132 16502 raft_consensus.cc:385] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.319732 16502 raft_consensus.cc:740] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.323791 16502 consensus_queue.cc:260] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
W20260709 13:18:13.305419 16419 leader_election.cc:343] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:13.330430 16419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 51769.9us
I20260709 13:18:13.334553 16796 raft_consensus.cc:493] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.335544 16796 raft_consensus.cc:515] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:13.337906 16502 ts_tablet_manager.cc:1434] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.004s
I20260709 13:18:13.338716 16796 leader_election.cc:290] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:13.339227 16502 tablet_bootstrap.cc:492] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:13.343125 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2485b97ef87a4855b8cc1c0f6e0ba2c7" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:13.339368 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2485b97ef87a4855b8cc1c0f6e0ba2c7" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:13.347314 16377 raft_consensus.cc:2393] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:13.350049 16194 leader_election.cc:304] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:13.353396 16502 tablet_bootstrap.cc:654] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.359934 16500 tablet_bootstrap.cc:492] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:13.369304 16500 ts_tablet_manager.cc:1403] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.195s	user 0.021s	sys 0.004s
I20260709 13:18:13.351732 16799 raft_consensus.cc:3060] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.367877 16499 tablet_bootstrap.cc:492] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:13.374318 16499 ts_tablet_manager.cc:1403] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.211s	user 0.014s	sys 0.000s
I20260709 13:18:13.367013 16379 raft_consensus.cc:2468] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:13.376618 16417 leader_election.cc:304] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:13.334112 16794 raft_consensus.cc:515] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.380998 16498 tablet_bootstrap.cc:492] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:13.381575 16498 ts_tablet_manager.cc:1403] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.424s	user 0.029s	sys 0.044s
I20260709 13:18:13.379642 16664 raft_consensus.cc:2804] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:13.385377 16664 raft_consensus.cc:697] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:13.390390 16499 raft_consensus.cc:359] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.391393 16499 raft_consensus.cc:385] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.391726 16499 raft_consensus.cc:740] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.386312 16664 consensus_queue.cc:237] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.358453 16798 raft_consensus.cc:515] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.393401 16499 consensus_queue.cc:260] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.402936 16602 raft_consensus.cc:493] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.403575 16602 raft_consensus.cc:515] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:13.405730 16602 leader_election.cc:290] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:13.409477 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "751bec01e5d145adac78c28b7b581d73" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:13.409672 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "751bec01e5d145adac78c28b7b581d73" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:13.410432 16379 raft_consensus.cc:2468] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
W20260709 13:18:13.411365 16417 leader_election.cc:343] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.412158 16417 leader_election.cc:304] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:13.413268 16602 raft_consensus.cc:2804] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:13.413727 16602 raft_consensus.cc:493] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.415297 16602 raft_consensus.cc:3060] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.414063 16799 raft_consensus.cc:2749] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.415010 16499 ts_tablet_manager.cc:1434] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:18:13.423336 16498 raft_consensus.cc:359] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.424501 16498 raft_consensus.cc:385] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.424798 16498 raft_consensus.cc:740] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.427435 16498 consensus_queue.cc:260] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.431334 16798 leader_election.cc:290] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:13.430065 16128 catalog_manager.cc:5697] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.432698 16499 tablet_bootstrap.cc:492] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:13.442241 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:13.443059 16304 raft_consensus.cc:3060] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.446817 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:13.447871 16452 raft_consensus.cc:2393] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0763e17c84d248738dade73ded2c5f71 in this term.
I20260709 13:18:13.448459 16498 ts_tablet_manager.cc:1434] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:18:13.449657 16498 tablet_bootstrap.cc:492] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:13.452454 16602 raft_consensus.cc:515] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:13.432367 16732 consensus_queue.cc:1048] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:18:13.466741 16531 raft_consensus.cc:493] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.467316 16531 raft_consensus.cc:515] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:13.468695 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "751bec01e5d145adac78c28b7b581d73" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:13.468962 16602 leader_election.cc:290] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
W20260709 13:18:13.470595 16417 leader_election.cc:343] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.472519 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:13.473701 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:13.474202 16343 leader_election.cc:343] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:13.475322 16345 leader_election.cc:343] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.475844 16345 leader_election.cc:304] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:13.475545 16531 leader_election.cc:290] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:13.476644 16531 raft_consensus.cc:2749] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.477365 16499 tablet_bootstrap.cc:654] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.477623 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "751bec01e5d145adac78c28b7b581d73" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:13.478353 16378 raft_consensus.cc:3060] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.481616 16502 tablet_bootstrap.cc:492] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:13.482148 16502 ts_tablet_manager.cc:1403] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.017s
W20260709 13:18:13.483177 16808 log.cc:927] Time spent T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:13.489251 16794 leader_election.cc:290] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:13.491034 16500 raft_consensus.cc:359] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:13.491937 16500 raft_consensus.cc:385] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.492223 16500 raft_consensus.cc:740] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.492321 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:13.493197 16500 consensus_queue.cc:260] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:13.496552 16500 ts_tablet_manager.cc:1434] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.123s	user 0.003s	sys 0.003s
I20260709 13:18:13.497990 16500 tablet_bootstrap.cc:492] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:13.497480 16228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:13.499472 16228 raft_consensus.cc:2393] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0763e17c84d248738dade73ded2c5f71 in current term 1: Already voted for candidate fe046a372b6a4df982eebe83cf3ee184 in this term.
I20260709 13:18:13.505692 16502 raft_consensus.cc:359] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.511333 16502 raft_consensus.cc:385] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.511643 16502 raft_consensus.cc:740] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.510679 16126 catalog_manager.cc:5697] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.516933 16498 tablet_bootstrap.cc:654] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.512377 16502 consensus_queue.cc:260] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.527348 16502 ts_tablet_manager.cc:1434] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.004s
I20260709 13:18:13.528344 16502 tablet_bootstrap.cc:492] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:13.538305 16502 tablet_bootstrap.cc:654] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.525702 16419 leader_election.cc:304] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:13.541015 16794 raft_consensus.cc:2749] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.544315 16304 raft_consensus.cc:2468] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:13.589138 16194 leader_election.cc:304] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71
I20260709 13:18:13.590481 16799 raft_consensus.cc:2804] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:13.591125 16799 raft_consensus.cc:697] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:13.592087 16799 consensus_queue.cc:237] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.637996 16499 tablet_bootstrap.cc:492] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:13.640936 16499 ts_tablet_manager.cc:1403] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.219s	user 0.027s	sys 0.032s
I20260709 13:18:13.654485 16500 tablet_bootstrap.cc:654] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.649250 16126 catalog_manager.cc:5697] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.657879 16749 raft_consensus.cc:493] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.658475 16749 raft_consensus.cc:515] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.650290 16378 raft_consensus.cc:2468] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:13.660892 16749 leader_election.cc:290] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:13.663309 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:13.664498 16499 raft_consensus.cc:359] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:13.665256 16499 raft_consensus.cc:385] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.665325 16228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:13.663770 16417 leader_election.cc:304] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e
W20260709 13:18:13.666882 16342 leader_election.cc:343] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:13.668196 16345 leader_election.cc:343] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.670257 16345 leader_election.cc:304] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:13.671657 16794 raft_consensus.cc:2804] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:13.671763 16531 raft_consensus.cc:2749] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.672345 16794 raft_consensus.cc:697] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:13.673305 16794 consensus_queue.cc:237] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:13.675810 16799 raft_consensus.cc:493] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.665567 16499 raft_consensus.cc:740] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.679737 16502 tablet_bootstrap.cc:492] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:13.680362 16502 ts_tablet_manager.cc:1403] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.152s	user 0.019s	sys 0.005s
I20260709 13:18:13.680523 16498 tablet_bootstrap.cc:492] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:13.681032 16498 ts_tablet_manager.cc:1403] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.232s	user 0.027s	sys 0.038s
I20260709 13:18:13.676396 16799 raft_consensus.cc:515] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.678074 16499 consensus_queue.cc:260] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:13.691905 16799 leader_election.cc:290] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:13.693068 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13fb80f9cf64345a2b3e9f4009281b6" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:13.693395 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a13fb80f9cf64345a2b3e9f4009281b6" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:13.694273 16499 ts_tablet_manager.cc:1434] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:18:13.695426 16499 tablet_bootstrap.cc:492] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:13.694270 16378 raft_consensus.cc:2393] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0763e17c84d248738dade73ded2c5f71 in this term.
I20260709 13:18:13.697067 16194 leader_election.cc:304] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:13.700214 16498 raft_consensus.cc:359] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.701022 16498 raft_consensus.cc:385] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.701277 16498 raft_consensus.cc:740] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.701706 16499 tablet_bootstrap.cc:654] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.702052 16498 consensus_queue.cc:260] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.707911 16745 consensus_queue.cc:1048] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:13.703986 16799 raft_consensus.cc:3060] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.714985 16602 raft_consensus.cc:493] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.715636 16602 raft_consensus.cc:515] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.718349 16602 leader_election.cc:290] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:13.717723 16123 catalog_manager.cc:5697] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.721900 16502 raft_consensus.cc:359] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.722661 16502 raft_consensus.cc:385] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.720716 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf1f8703ff64c89afb0d1dbe0eab26f" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:13.722950 16502 raft_consensus.cc:740] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.723403 16379 raft_consensus.cc:2468] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:13.723699 16502 consensus_queue.cc:260] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.725916 16502 ts_tablet_manager.cc:1434] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 13:18:13.726059 16500 tablet_bootstrap.cc:492] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:13.720777 16228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf1f8703ff64c89afb0d1dbe0eab26f" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:13.726646 16500 ts_tablet_manager.cc:1403] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.229s	user 0.014s	sys 0.001s
I20260709 13:18:13.729580 16498 ts_tablet_manager.cc:1434] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:18:13.730662 16498 tablet_bootstrap.cc:492] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
W20260709 13:18:13.731367 16419 leader_election.cc:343] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.736593 16498 tablet_bootstrap.cc:654] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.739204 16502 tablet_bootstrap.cc:492] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:13.742175 16500 raft_consensus.cc:359] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.743207 16500 raft_consensus.cc:385] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.743332 16417 leader_election.cc:304] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:13.744879 16794 raft_consensus.cc:2804] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:13.745585 16794 raft_consensus.cc:493] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.746057 16794 raft_consensus.cc:3060] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.743533 16500 raft_consensus.cc:740] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.755991 16500 consensus_queue.cc:260] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.758301 16502 tablet_bootstrap.cc:654] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.758848 16500 ts_tablet_manager.cc:1434] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:18:13.758767 16794 raft_consensus.cc:515] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.763196 16500 tablet_bootstrap.cc:492] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:13.767675 16799 raft_consensus.cc:2749] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.777745 16602 raft_consensus.cc:493] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.783699 16602 raft_consensus.cc:515] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.784858 16499 tablet_bootstrap.cc:492] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:13.785386 16499 ts_tablet_manager.cc:1403] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.027s
I20260709 13:18:13.785796 16602 leader_election.cc:290] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:13.787652 16228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acf3d9f73d4f38817c4ea25ba9139b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:13.789315 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf1f8703ff64c89afb0d1dbe0eab26f" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:13.789970 16379 raft_consensus.cc:3060] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:13.791903 16419 leader_election.cc:343] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.792959 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acf3d9f73d4f38817c4ea25ba9139b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:13.795565 16500 tablet_bootstrap.cc:654] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:13.795984 16417 leader_election.cc:343] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.796500 16417 leader_election.cc:304] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:13.798269 16732 raft_consensus.cc:2749] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.799149 16498 tablet_bootstrap.cc:492] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:13.799739 16498 ts_tablet_manager.cc:1403] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.003s
I20260709 13:18:13.811674 16795 consensus_queue.cc:1048] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:13.814082 16498 raft_consensus.cc:359] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:13.816051 16498 raft_consensus.cc:385] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.816701 16498 raft_consensus.cc:740] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.822081 16794 leader_election.cc:290] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:13.822381 16498 consensus_queue.cc:260] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:13.824849 16228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf1f8703ff64c89afb0d1dbe0eab26f" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:13.818284 16499 raft_consensus.cc:359] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.829182 16499 raft_consensus.cc:385] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.829537 16499 raft_consensus.cc:740] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.830669 16499 consensus_queue.cc:260] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:13.833279 16499 ts_tablet_manager.cc:1434] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.048s	user 0.010s	sys 0.000s
I20260709 13:18:13.833909 16502 tablet_bootstrap.cc:492] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:13.834451 16499 tablet_bootstrap.cc:492] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:13.825321 16498 ts_tablet_manager.cc:1434] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:18:13.835861 16498 tablet_bootstrap.cc:492] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
W20260709 13:18:13.836761 16419 leader_election.cc:343] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:13.841866 16175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:13.842329 16500 tablet_bootstrap.cc:492] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:13.842947 16500 ts_tablet_manager.cc:1403] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.000s
I20260709 13:18:13.834510 16502 ts_tablet_manager.cc:1403] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.012s
I20260709 13:18:13.849175 16502 raft_consensus.cc:359] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:13.849918 16502 raft_consensus.cc:385] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.850214 16502 raft_consensus.cc:740] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.851060 16502 consensus_queue.cc:260] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:13.853789 16502 ts_tablet_manager.cc:1434] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:13.825294 16379 raft_consensus.cc:2468] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:13.855758 16417 leader_election.cc:304] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:13.842463 16498 tablet_bootstrap.cc:654] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.856907 16602 raft_consensus.cc:2804] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:13.857525 16602 raft_consensus.cc:697] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:13.858389 16602 consensus_queue.cc:237] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:13.861024 16502 tablet_bootstrap.cc:492] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:13.845844 16500 raft_consensus.cc:359] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:13.870389 16500 raft_consensus.cc:385] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.871098 16500 raft_consensus.cc:740] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.871904 16500 consensus_queue.cc:260] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:13.923641 16498 tablet_bootstrap.cc:492] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:13.925714 16498 ts_tablet_manager.cc:1403] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.090s	user 0.023s	sys 0.000s
I20260709 13:18:13.871127 16499 tablet_bootstrap.cc:654] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.970428 16745 raft_consensus.cc:493] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.974277 16500 ts_tablet_manager.cc:1434] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.004s
I20260709 13:18:13.975592 16745 raft_consensus.cc:515] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:13.982777 16745 leader_election.cc:290] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:13.982254 16228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbce7ea12f554f25812e7ef8fdcc892e" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:13.983696 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbce7ea12f554f25812e7ef8fdcc892e" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:13.984246 16228 raft_consensus.cc:2468] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:13.997768 16271 leader_election.cc:304] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:13.984927 16379 raft_consensus.cc:2468] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:13.991663 16602 consensus_queue.cc:1048] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:18:14.000664 16745 raft_consensus.cc:2804] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:14.001156 16745 raft_consensus.cc:493] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.001746 16745 raft_consensus.cc:3060] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.998804 16502 tablet_bootstrap.cc:700] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c: Time spent opening tablet: real 0.122s	user 0.000s	sys 0.003s
I20260709 13:18:14.003968 16502 tablet_bootstrap.cc:654] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.005880 16799 consensus_queue.cc:1048] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:13.977221 16500 tablet_bootstrap.cc:492] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:14.008651 16498 raft_consensus.cc:359] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:14.012056 16498 raft_consensus.cc:385] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.012498 16498 raft_consensus.cc:740] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.014451 16498 consensus_queue.cc:260] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:14.011047 16602 consensus_queue.cc:1048] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:18:14.031955 16499 tablet_bootstrap.cc:492] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:14.032837 16499 ts_tablet_manager.cc:1403] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.199s	user 0.029s	sys 0.012s
I20260709 13:18:14.054600 16500 tablet_bootstrap.cc:654] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.060633 16745 raft_consensus.cc:515] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.061559 16499 raft_consensus.cc:359] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.062772 16499 raft_consensus.cc:385] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.065528 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbce7ea12f554f25812e7ef8fdcc892e" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:14.066705 16230 raft_consensus.cc:3060] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.066017 16498 ts_tablet_manager.cc:1434] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.140s	user 0.014s	sys 0.000s
I20260709 13:18:14.071560 16125 catalog_manager.cc:5697] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.063401 16499 raft_consensus.cc:740] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.079046 16745 leader_election.cc:290] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:14.081492 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbce7ea12f554f25812e7ef8fdcc892e" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:14.082352 16378 raft_consensus.cc:3060] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.090025 16303 raft_consensus.cc:3060] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.079349 16499 consensus_queue.cc:260] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.134701 16499 ts_tablet_manager.cc:1434] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.004s
I20260709 13:18:14.148514 16502 tablet_bootstrap.cc:492] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:14.149261 16502 ts_tablet_manager.cc:1403] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.289s	user 0.011s	sys 0.009s
I20260709 13:18:14.157522 16498 tablet_bootstrap.cc:492] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:14.131453 16378 raft_consensus.cc:2468] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:14.165442 16499 tablet_bootstrap.cc:492] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:14.165592 16799 raft_consensus.cc:493] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.166152 16794 consensus_queue.cc:1048] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:14.166440 16799 raft_consensus.cc:515] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:14.172055 16531 raft_consensus.cc:493] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.172991 16531 raft_consensus.cc:515] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:14.174876 16230 raft_consensus.cc:2468] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:14.179175 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3943f59d05384cb0b44c356da96441c8" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:14.182749 16745 raft_consensus.cc:493] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.182597 16796 consensus_queue.cc:1048] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:14.183785 16745 raft_consensus.cc:515] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:14.185089 16271 leader_election.cc:304] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:14.186290 16656 raft_consensus.cc:2804] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:14.187783 16745 leader_election.cc:290] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:14.187556 16449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145398d14cf9402e819285d9fc5253b9" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:14.190752 16656 raft_consensus.cc:697] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
W20260709 13:18:14.191004 16342 leader_election.cc:343] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.195452 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145398d14cf9402e819285d9fc5253b9" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:14.196300 16229 raft_consensus.cc:2468] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:14.196368 16449 raft_consensus.cc:2468] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:14.194229 16656 consensus_queue.cc:237] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.204859 16531 leader_election.cc:290] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:14.205528 16502 raft_consensus.cc:359] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.206403 16271 leader_election.cc:304] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:14.206475 16502 raft_consensus.cc:385] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.211493 16502 raft_consensus.cc:740] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.216598 16795 raft_consensus.cc:2804] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:14.217265 16795 raft_consensus.cc:493] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.217639 16795 raft_consensus.cc:3060] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.218869 16500 tablet_bootstrap.cc:492] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:14.219460 16500 ts_tablet_manager.cc:1403] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.243s	user 0.022s	sys 0.003s
I20260709 13:18:14.222250 16502 consensus_queue.cc:260] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.227057 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3943f59d05384cb0b44c356da96441c8" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:14.235055 16602 consensus_queue.cc:1048] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:14.286825 16499 tablet_bootstrap.cc:654] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.302798 16502 ts_tablet_manager.cc:1434] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.153s	user 0.005s	sys 0.010s
I20260709 13:18:14.313658 16799 leader_election.cc:290] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:14.316090 16502 tablet_bootstrap.cc:492] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:14.316991 16795 raft_consensus.cc:515] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
W20260709 13:18:14.318830 16345 leader_election.cc:343] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.321069 16345 leader_election.cc:304] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:14.324965 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145398d14cf9402e819285d9fc5253b9" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:14.328744 16502 tablet_bootstrap.cc:654] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:14.329659 16343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 81067.6us
I20260709 13:18:14.331971 16498 tablet_bootstrap.cc:654] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.347357 16499 tablet_bootstrap.cc:492] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:14.347939 16499 ts_tablet_manager.cc:1403] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.183s	user 0.014s	sys 0.004s
I20260709 13:18:14.345038 16303 raft_consensus.cc:2393] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:14.359207 16500 raft_consensus.cc:359] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.375130 16500 raft_consensus.cc:385] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.375644 16500 raft_consensus.cc:740] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
W20260709 13:18:14.369521 16345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 67118us
I20260709 13:18:14.393193 16500 consensus_queue.cc:260] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.394886 16634 raft_consensus.cc:493] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.395275 16841 raft_consensus.cc:2749] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:14.395686 16634 raft_consensus.cc:515] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:14.411763 16848 consensus_queue.cc:1048] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:14.415961 16125 catalog_manager.cc:5697] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.425590 16499 raft_consensus.cc:359] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:14.430465 16499 raft_consensus.cc:385] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.430955 16499 raft_consensus.cc:740] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.431967 16499 consensus_queue.cc:260] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:14.435520 16499 ts_tablet_manager.cc:1434] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.087s	user 0.011s	sys 0.000s
I20260709 13:18:14.443122 16502 tablet_bootstrap.cc:492] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:14.443686 16634 leader_election.cc:290] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:14.443921 16502 ts_tablet_manager.cc:1403] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.128s	user 0.025s	sys 0.018s
I20260709 13:18:14.482415 16499 tablet_bootstrap.cc:492] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:14.485558 16795 leader_election.cc:290] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:14.506973 16498 tablet_bootstrap.cc:492] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:14.507592 16498 ts_tablet_manager.cc:1403] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.434s	user 0.025s	sys 0.005s
I20260709 13:18:14.503592 16502 raft_consensus.cc:359] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:14.509284 16502 raft_consensus.cc:385] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.509567 16502 raft_consensus.cc:740] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.502110 16794 raft_consensus.cc:493] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.511524 16500 ts_tablet_manager.cc:1434] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.292s	user 0.010s	sys 0.003s
I20260709 13:18:14.513139 16502 consensus_queue.cc:260] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:14.523568 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145398d14cf9402e819285d9fc5253b9" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:14.524433 16450 raft_consensus.cc:2468] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:14.526342 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb3c242fc743cf98a4f1d7cffd975b" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:14.508307 16796 raft_consensus.cc:493] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.529129 16502 ts_tablet_manager.cc:1434] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.004s
I20260709 13:18:14.534935 16230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145398d14cf9402e819285d9fc5253b9" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:14.535811 16230 raft_consensus.cc:3060] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:14.541256 16343 leader_election.cc:343] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.547340 16664 raft_consensus.cc:493] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.546928 16796 raft_consensus.cc:515] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.547936 16664 raft_consensus.cc:515] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:14.549562 16796 leader_election.cc:290] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:14.542250 16794 raft_consensus.cc:515] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:14.551239 16500 tablet_bootstrap.cc:492] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:14.550514 16664 leader_election.cc:290] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:14.552289 16794 leader_election.cc:290] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:14.565402 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:14.566296 16379 raft_consensus.cc:2468] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:14.530100 16193 leader_election.cc:304] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:14.567358 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20206667639a48e8a81abb2b99441995" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:14.567510 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:14.568177 16376 raft_consensus.cc:2468] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:14.568303 16377 raft_consensus.cc:2468] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:14.565402 16449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb3c242fc743cf98a4f1d7cffd975b" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:14.576560 16498 raft_consensus.cc:359] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:14.577405 16498 raft_consensus.cc:385] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.577680 16498 raft_consensus.cc:740] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.586162 16502 tablet_bootstrap.cc:492] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:14.587520 16417 leader_election.cc:304] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:14.588683 16664 raft_consensus.cc:2804] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:14.589097 16664 raft_consensus.cc:493] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.589010 16417 leader_election.cc:304] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:14.589753 16664 raft_consensus.cc:3060] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.589738 16194 leader_election.cc:304] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 
W20260709 13:18:14.580137 16269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 61324.3us
I20260709 13:18:14.595290 16842 raft_consensus.cc:2804] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:14.595795 16842 raft_consensus.cc:493] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.596179 16842 raft_consensus.cc:3060] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.596225 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:14.601095 16850 raft_consensus.cc:2804] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:14.601605 16850 raft_consensus.cc:493] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.601975 16850 raft_consensus.cc:3060] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.607364 16856 raft_consensus.cc:493] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.608023 16856 raft_consensus.cc:515] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.615710 16305 raft_consensus.cc:2468] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:14.622035 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145398d14cf9402e819285d9fc5253b9" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:14.623096 16452 raft_consensus.cc:3060] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:14.631101 16342 leader_election.cc:343] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.631742 16342 leader_election.cc:304] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:14.633239 16531 raft_consensus.cc:2749] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:14.633122 16498 consensus_queue.cc:260] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:14.636490 16842 raft_consensus.cc:515] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.640102 16500 tablet_bootstrap.cc:654] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.641542 16499 tablet_bootstrap.cc:654] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:14.650884 16269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 45228.4us
I20260709 13:18:14.656657 16226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:14.657861 16664 raft_consensus.cc:515] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:14.663338 16498 ts_tablet_manager.cc:1434] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.155s	user 0.004s	sys 0.004s
I20260709 13:18:14.667270 16452 raft_consensus.cc:2468] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:14.676697 16856 leader_election.cc:290] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:14.643929 16230 raft_consensus.cc:2468] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:14.681241 16845 raft_consensus.cc:2764] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:18:14.681262 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:14.682111 16376 raft_consensus.cc:3060] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.673795 16842 leader_election.cc:290] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:14.683889 16837 raft_consensus.cc:493] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.684715 16664 leader_election.cc:290] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:14.684537 16837 raft_consensus.cc:515] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.679884 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:14.692025 16377 raft_consensus.cc:3060] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.693579 16376 raft_consensus.cc:2468] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:14.691282 16226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d2386a536042dcb0271fdc91474697" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:14.694478 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d2386a536042dcb0271fdc91474697" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:14.688630 16837 leader_election.cc:290] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:14.700129 16498 tablet_bootstrap.cc:492] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:14.711129 16502 tablet_bootstrap.cc:654] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:14.716202 16343 leader_election.cc:343] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.719110 16417 leader_election.cc:304] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
W20260709 13:18:14.721335 16345 leader_election.cc:343] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.721954 16345 leader_election.cc:304] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:14.723374 16860 raft_consensus.cc:2749] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:14.724273 16498 tablet_bootstrap.cc:654] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.725512 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:14.725951 16664 raft_consensus.cc:2804] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:14.726194 16305 raft_consensus.cc:3060] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.726601 16664 raft_consensus.cc:697] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:14.727638 16664 consensus_queue.cc:237] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:14.734522 16305 raft_consensus.cc:2468] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:14.740638 16194 leader_election.cc:304] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:14.741724 16845 raft_consensus.cc:2804] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:14.742004 16850 raft_consensus.cc:515] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:14.742424 16845 raft_consensus.cc:697] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:14.744583 16850 leader_election.cc:290] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:14.744102 16845 consensus_queue.cc:237] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.745693 16271 leader_election.cc:304] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:14.746779 16859 raft_consensus.cc:2804] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:14.748171 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:14.750419 16226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:14.751358 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20206667639a48e8a81abb2b99441995" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:14.752208 16378 raft_consensus.cc:3060] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.749786 16859 raft_consensus.cc:697] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:14.753822 16859 consensus_queue.cc:237] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:14.768625 16301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20206667639a48e8a81abb2b99441995" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:14.793743 16417 leader_election.cc:343] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.804674 16502 tablet_bootstrap.cc:492] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:14.805266 16502 ts_tablet_manager.cc:1403] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.219s	user 0.011s	sys 0.019s
I20260709 13:18:14.774286 16301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20206667639a48e8a81abb2b99441995" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:14.746407 16377 raft_consensus.cc:2468] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:14.814224 16500 tablet_bootstrap.cc:492] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:14.815089 16500 ts_tablet_manager.cc:1403] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.264s	user 0.016s	sys 0.001s
I20260709 13:18:14.819016 16842 raft_consensus.cc:493] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.819587 16842 raft_consensus.cc:515] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:14.821795 16842 leader_election.cc:290] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:14.823853 16856 consensus_queue.cc:1048] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:14.825434 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acf3d9f73d4f38817c4ea25ba9139b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:14.827661 16502 raft_consensus.cc:359] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.828344 16502 raft_consensus.cc:385] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.828598 16502 raft_consensus.cc:740] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.828963 16500 raft_consensus.cc:359] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:14.829437 16502 consensus_queue.cc:260] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.829972 16500 raft_consensus.cc:385] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.830413 16500 raft_consensus.cc:740] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.841084 16502 ts_tablet_manager.cc:1434] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
W20260709 13:18:14.841210 16419 consensus_peers.cc:597] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:14.846313 16419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 96898.7us
I20260709 13:18:14.847687 16126 catalog_manager.cc:5697] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.847746 16269 leader_election.cc:304] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:14.852140 16856 raft_consensus.cc:2749] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:14.844919 16125 catalog_manager.cc:5697] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.855401 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acf3d9f73d4f38817c4ea25ba9139b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:14.856395 16837 raft_consensus.cc:493] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.856304 16452 raft_consensus.cc:2468] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:14.857990 16500 consensus_queue.cc:260] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
W20260709 13:18:14.858783 16417 leader_election.cc:343] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.860704 16500 ts_tablet_manager.cc:1434] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:18:14.861918 16500 tablet_bootstrap.cc:492] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:14.863483 16378 raft_consensus.cc:2468] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:14.857067 16837 raft_consensus.cc:515] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:14.865728 16417 leader_election.cc:304] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:14.866832 16664 raft_consensus.cc:2804] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:14.867362 16664 raft_consensus.cc:697] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:14.866858 16305 raft_consensus.cc:2468] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:14.868964 16664 consensus_queue.cc:237] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:14.870113 16194 leader_election.cc:304] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:14.871081 16842 raft_consensus.cc:2804] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:14.871495 16842 raft_consensus.cc:493] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.871847 16842 raft_consensus.cc:3060] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.873275 16226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2962c590b5497da58a885103a32aef" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:14.867772 16837 leader_election.cc:290] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:14.875591 16502 tablet_bootstrap.cc:492] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:14.883021 16500 tablet_bootstrap.cc:654] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:14.883884 16345 leader_election.cc:343] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:14.885842 16419 leader_election.cc:343] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.881022 16842 raft_consensus.cc:515] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
W20260709 13:18:14.870702 16866 log.cc:927] Time spent T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:18:14.898466 16842 leader_election.cc:290] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:14.902128 16502 tablet_bootstrap.cc:654] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.906276 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acf3d9f73d4f38817c4ea25ba9139b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:14.906563 16226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:14.907006 16305 raft_consensus.cc:3060] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.909650 16499 tablet_bootstrap.cc:492] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:14.910211 16499 ts_tablet_manager.cc:1403] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.428s	user 0.055s	sys 0.036s
I20260709 13:18:14.913396 16499 raft_consensus.cc:359] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:14.913810 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acf3d9f73d4f38817c4ea25ba9139b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:14.914152 16499 raft_consensus.cc:385] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.914812 16452 raft_consensus.cc:3060] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.915534 16499 raft_consensus.cc:740] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.933362 16305 raft_consensus.cc:2468] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:14.935496 16194 leader_election.cc:304] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
W20260709 13:18:14.937606 16419 leader_election.cc:343] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.938710 16796 raft_consensus.cc:2804] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:14.939666 16796 raft_consensus.cc:697] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:14.941532 16499 consensus_queue.cc:260] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:14.953284 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2962c590b5497da58a885103a32aef" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:14.953151 16125 catalog_manager.cc:5697] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.940923 16796 consensus_queue.cc:237] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:14.958774 16859 consensus_queue.cc:1048] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:14.970412 16342 leader_election.cc:343] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.971104 16342 leader_election.cc:304] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:14.972004 16860 raft_consensus.cc:2749] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:14.981079 16452 raft_consensus.cc:2468] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:14.935925 16126 catalog_manager.cc:5697] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.987164 16498 tablet_bootstrap.cc:492] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:14.988018 16498 ts_tablet_manager.cc:1403] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.288s	user 0.018s	sys 0.024s
I20260709 13:18:14.994802 16634 raft_consensus.cc:493] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.995483 16634 raft_consensus.cc:515] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:14.997836 16634 leader_election.cc:290] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:15.008237 16498 raft_consensus.cc:359] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.009065 16498 raft_consensus.cc:385] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.009335 16498 raft_consensus.cc:740] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.010280 16226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246e5a50c75e4f0fa58538237d61e585" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:15.013195 16345 leader_election.cc:343] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.019084 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246e5a50c75e4f0fa58538237d61e585" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:15.020373 16868 log.cc:927] Time spent T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:18:15.021129 16343 leader_election.cc:343] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.021643 16343 leader_election.cc:304] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:15.022581 16850 raft_consensus.cc:493] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.023348 16850 raft_consensus.cc:515] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.032644 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2559ecae96646189c0bc8afbe49ce16" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:15.033427 16377 raft_consensus.cc:2468] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:15.033794 16850 leader_election.cc:290] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:15.034013 16860 raft_consensus.cc:2749] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:15.039278 16417 leader_election.cc:304] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:15.040871 16499 ts_tablet_manager.cc:1434] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.130s	user 0.006s	sys 0.002s
I20260709 13:18:15.043709 16498 consensus_queue.cc:260] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.050383 16498 ts_tablet_manager.cc:1434] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 13:18:15.053045 16500 tablet_bootstrap.cc:492] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:15.053642 16500 ts_tablet_manager.cc:1403] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.192s	user 0.023s	sys 0.044s
I20260709 13:18:15.056659 16500 raft_consensus.cc:359] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.057514 16500 raft_consensus.cc:385] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.057838 16500 raft_consensus.cc:740] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.045859 16850 raft_consensus.cc:2804] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:15.061844 16850 raft_consensus.cc:493] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.062958 16500 consensus_queue.cc:260] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.069605 16499 tablet_bootstrap.cc:492] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:15.072949 16850 raft_consensus.cc:3060] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:15.077579 16123 catalog_manager.cc:5697] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:15.086844 16500 ts_tablet_manager.cc:1434] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:18:15.086995 16839 raft_consensus.cc:493] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.087549 16839 raft_consensus.cc:515] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.081590 16850 raft_consensus.cc:515] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.082656 16498 tablet_bootstrap.cc:492] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:15.092293 16850 leader_election.cc:290] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:15.086267 16301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2559ecae96646189c0bc8afbe49ce16" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:15.089903 16839 leader_election.cc:290] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:15.096652 16500 tablet_bootstrap.cc:492] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:15.100628 16499 tablet_bootstrap.cc:654] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.103261 16375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf1f8703ff64c89afb0d1dbe0eab26f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:15.104856 16502 tablet_bootstrap.cc:492] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:15.107364 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf1f8703ff64c89afb0d1dbe0eab26f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:15.109743 16193 leader_election.cc:304] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:15.111575 16839 raft_consensus.cc:2749] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:15.112871 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2559ecae96646189c0bc8afbe49ce16" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:15.113582 16376 raft_consensus.cc:3060] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:15.114982 16301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2559ecae96646189c0bc8afbe49ce16" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
W20260709 13:18:15.119513 16417 leader_election.cc:343] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.105484 16502 ts_tablet_manager.cc:1403] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.230s	user 0.024s	sys 0.051s
I20260709 13:18:15.132014 16664 raft_consensus.cc:493] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.131531 16502 raft_consensus.cc:359] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.132669 16664 raft_consensus.cc:515] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.140376 16498 tablet_bootstrap.cc:654] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.142268 16502 raft_consensus.cc:385] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.142714 16502 raft_consensus.cc:740] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
W20260709 13:18:15.145943 16417 leader_election.cc:343] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.151196 16664 leader_election.cc:290] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:15.152184 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3943f59d05384cb0b44c356da96441c8" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:15.152884 16379 raft_consensus.cc:2468] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:15.155644 16417 leader_election.cc:304] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:15.156800 16602 raft_consensus.cc:2804] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:15.157243 16602 raft_consensus.cc:493] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.148999 16502 consensus_queue.cc:260] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.157029 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3943f59d05384cb0b44c356da96441c8" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:15.170203 16419 leader_election.cc:343] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.157358 16839 consensus_queue.cc:1048] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:18:15.160392 16602 raft_consensus.cc:3060] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:15.177759 16175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:15.183931 16376 raft_consensus.cc:2468] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:15.185571 16417 leader_election.cc:304] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:15.186838 16732 raft_consensus.cc:2804] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:15.187409 16732 raft_consensus.cc:697] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:15.188349 16732 consensus_queue.cc:237] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.194418 16502 ts_tablet_manager.cc:1434] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.002s
I20260709 13:18:15.198010 16498 tablet_bootstrap.cc:492] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:15.198782 16498 ts_tablet_manager.cc:1403] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.009s
I20260709 13:18:15.206594 16498 raft_consensus.cc:359] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.207393 16498 raft_consensus.cc:385] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.207685 16498 raft_consensus.cc:740] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.208410 16498 consensus_queue.cc:260] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.212908 16500 tablet_bootstrap.cc:654] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.210289 16860 raft_consensus.cc:493] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.215358 16860 raft_consensus.cc:515] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.218309 16860 leader_election.cc:290] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:15.221132 16502 tablet_bootstrap.cc:492] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:15.223662 16301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f63940625724ed3a4294375705e345d" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:15.224161 16499 tablet_bootstrap.cc:492] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:15.224848 16499 ts_tablet_manager.cc:1403] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.006s
I20260709 13:18:15.231041 16498 ts_tablet_manager.cc:1434] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 13:18:15.231259 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f63940625724ed3a4294375705e345d" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:15.232524 16498 tablet_bootstrap.cc:492] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
W20260709 13:18:15.234305 16342 leader_election.cc:343] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.230701 16796 consensus_queue.cc:1048] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:18:15.238752 16343 leader_election.cc:343] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.239265 16343 leader_election.cc:304] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:15.239557 16499 raft_consensus.cc:359] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.240386 16499 raft_consensus.cc:385] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.240643 16860 raft_consensus.cc:2749] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:15.240674 16499 raft_consensus.cc:740] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.250837 16499 consensus_queue.cc:260] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.258025 16125 catalog_manager.cc:5697] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:15.282286 16499 ts_tablet_manager.cc:1434] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.007s
I20260709 13:18:15.226128 16602 raft_consensus.cc:515] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.300921 16502 tablet_bootstrap.cc:654] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.303732 16499 tablet_bootstrap.cc:492] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:15.303268 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3943f59d05384cb0b44c356da96441c8" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:15.304914 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3943f59d05384cb0b44c356da96441c8" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:15.305598 16376 raft_consensus.cc:3060] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:15.306713 16498 tablet_bootstrap.cc:654] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:15.308959 16419 leader_election.cc:343] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:15.311545 16877 log.cc:927] Time spent T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:18:15.325220 16857 consensus_queue.cc:1048] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:15.333298 16229 raft_consensus.cc:3060] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:15.298470 16602 leader_election.cc:290] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:15.354012 16499 tablet_bootstrap.cc:654] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.361078 16376 raft_consensus.cc:2468] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:15.363340 16500 tablet_bootstrap.cc:492] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:15.364200 16500 ts_tablet_manager.cc:1403] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.268s	user 0.024s	sys 0.014s
I20260709 13:18:15.374969 16500 raft_consensus.cc:359] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:15.376209 16500 raft_consensus.cc:385] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.376622 16500 raft_consensus.cc:740] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.377178 16498 tablet_bootstrap.cc:492] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:15.377985 16498 ts_tablet_manager.cc:1403] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.009s
I20260709 13:18:15.380388 16417 leader_election.cc:304] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:15.379961 16500 consensus_queue.cc:260] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:15.381292 16664 raft_consensus.cc:2804] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:15.381917 16664 raft_consensus.cc:697] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:15.382840 16664 consensus_queue.cc:237] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.384578 16500 ts_tablet_manager.cc:1434] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 13:18:15.387091 16500 tablet_bootstrap.cc:492] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:15.388178 16856 consensus_queue.cc:1048] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:15.390650 16882 consensus_queue.cc:1048] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:15.395148 16732 consensus_queue.cc:1048] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:15.396456 16794 consensus_queue.cc:1048] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:15.408232 16502 tablet_bootstrap.cc:492] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:15.408809 16502 ts_tablet_manager.cc:1403] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.188s	user 0.016s	sys 0.013s
I20260709 13:18:15.431023 16499 tablet_bootstrap.cc:492] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:15.432133 16499 ts_tablet_manager.cc:1403] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.137s	user 0.020s	sys 0.005s
I20260709 13:18:15.437306 16301 raft_consensus.cc:3060] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:15.443492 16498 raft_consensus.cc:359] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:15.455782 16500 tablet_bootstrap.cc:654] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.444958 16498 raft_consensus.cc:385] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.460824 16498 raft_consensus.cc:740] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.461884 16498 consensus_queue.cc:260] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:15.463567 16796 consensus_queue.cc:1048] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:15.477269 16602 raft_consensus.cc:493] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.483065 16602 raft_consensus.cc:515] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.489491 16602 leader_election.cc:290] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:15.491416 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb3c242fc743cf98a4f1d7cffd975b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:15.484102 16839 consensus_queue.cc:1048] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:18:15.495114 16417 leader_election.cc:343] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.496662 16499 raft_consensus.cc:359] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:15.499994 16499 raft_consensus.cc:385] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.500385 16499 raft_consensus.cc:740] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.512938 16499 consensus_queue.cc:260] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:15.516964 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb3c242fc743cf98a4f1d7cffd975b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:15.517812 16377 raft_consensus.cc:2468] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:15.522437 16417 leader_election.cc:304] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:15.527536 16859 raft_consensus.cc:493] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.528160 16859 raft_consensus.cc:515] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:15.532552 16602 raft_consensus.cc:2804] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:15.533057 16602 raft_consensus.cc:493] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.533398 16602 raft_consensus.cc:3060] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:15.534102 16499 ts_tablet_manager.cc:1434] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.001s
I20260709 13:18:15.535427 16499 tablet_bootstrap.cc:492] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:15.526109 16498 ts_tablet_manager.cc:1434] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.148s	user 0.009s	sys 0.001s
I20260709 13:18:15.530483 16859 leader_election.cc:290] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:15.548028 16732 raft_consensus.cc:493] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.572108 16230 raft_consensus.cc:3060] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:15.555351 16856 raft_consensus.cc:493] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.572988 16226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d2386a536042dcb0271fdc91474697" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:15.568636 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d2386a536042dcb0271fdc91474697" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:15.578500 16502 raft_consensus.cc:359] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:15.590269 16502 raft_consensus.cc:385] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.590605 16502 raft_consensus.cc:740] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
W20260709 13:18:15.591388 16194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 45490.1us
I20260709 13:18:15.591562 16498 tablet_bootstrap.cc:492] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:15.593734 16502 consensus_queue.cc:260] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:15.579659 16856 raft_consensus.cc:515] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.588872 16226 raft_consensus.cc:2468] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:15.579982 16732 raft_consensus.cc:515] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:15.595494 16376 raft_consensus.cc:2468] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:15.619845 16125 catalog_manager.cc:5697] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:15.626693 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20206667639a48e8a81abb2b99441995" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:15.630435 16732 leader_election.cc:290] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:15.632301 16732 consensus_queue.cc:1048] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:15.634258 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d99e00427c045ab9f5b3c444ecf06a0" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:15.638098 16419 leader_election.cc:343] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.644263 16856 leader_election.cc:290] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:15.657613 16602 raft_consensus.cc:515] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.662364 16271 leader_election.cc:304] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
W20260709 13:18:15.683099 16345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 73057.7us
I20260709 13:18:15.689524 16602 leader_election.cc:290] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:15.685907 16859 raft_consensus.cc:2804] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:15.700470 16859 raft_consensus.cc:493] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.706547 16859 raft_consensus.cc:3060] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:15.699766 16301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d99e00427c045ab9f5b3c444ecf06a0" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:15.715485 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20206667639a48e8a81abb2b99441995" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:15.746891 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb3c242fc743cf98a4f1d7cffd975b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:15.748212 16376 raft_consensus.cc:3060] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:15.760946 16376 raft_consensus.cc:2468] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:15.766916 16417 leader_election.cc:304] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:15.779887 16602 raft_consensus.cc:2804] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:15.780539 16602 raft_consensus.cc:697] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:15.781472 16602 consensus_queue.cc:237] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.789786 16499 tablet_bootstrap.cc:654] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.810797 16500 tablet_bootstrap.cc:492] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:15.811734 16500 ts_tablet_manager.cc:1403] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.425s	user 0.017s	sys 0.013s
I20260709 13:18:15.814162 16498 tablet_bootstrap.cc:654] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.814716 16500 raft_consensus.cc:359] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.815507 16500 raft_consensus.cc:385] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.815771 16500 raft_consensus.cc:740] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.816592 16500 consensus_queue.cc:260] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.818164 16500 ts_tablet_manager.cc:1434] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:18:15.819053 16837 raft_consensus.cc:493] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.848347 16500 tablet_bootstrap.cc:492] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:15.809702 16901 consensus_queue.cc:1048] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:18:15.871941 16499 tablet_bootstrap.cc:492] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:15.872952 16499 ts_tablet_manager.cc:1403] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.338s	user 0.013s	sys 0.005s
I20260709 13:18:15.882372 16502 ts_tablet_manager.cc:1434] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.473s	user 0.011s	sys 0.004s
I20260709 13:18:15.857486 16859 raft_consensus.cc:515] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:15.884157 16502 tablet_bootstrap.cc:492] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:15.885927 16859 leader_election.cc:290] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:15.889846 16500 tablet_bootstrap.cc:654] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.840412 16837 raft_consensus.cc:515] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:15.921039 16850 consensus_queue.cc:1048] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:15.922935 16837 leader_election.cc:290] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:15.925536 16499 raft_consensus.cc:359] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.933128 16499 raft_consensus.cc:385] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.938053 16498 tablet_bootstrap.cc:492] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:15.939709 16498 ts_tablet_manager.cc:1403] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.374s	user 0.016s	sys 0.024s
I20260709 13:18:15.940538 16499 raft_consensus.cc:740] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
W20260709 13:18:15.872910 16269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 69493.8us
I20260709 13:18:15.938038 16502 tablet_bootstrap.cc:654] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.954491 16498 raft_consensus.cc:359] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.955255 16499 consensus_queue.cc:260] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.957125 16498 raft_consensus.cc:385] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.954919 16269 leader_election.cc:304] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:15.958592 16498 raft_consensus.cc:740] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.959903 16498 consensus_queue.cc:260] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:15.962904 16500 tablet_bootstrap.cc:492] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:15.962992 16498 ts_tablet_manager.cc:1434] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.008s
I20260709 13:18:15.963016 16230 raft_consensus.cc:3060] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:15.965143 16499 ts_tablet_manager.cc:1434] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.000s
I20260709 13:18:15.965831 16857 raft_consensus.cc:2749] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:15.959757 16268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 136283us
I20260709 13:18:15.969515 16500 ts_tablet_manager.cc:1403] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.129s	user 0.016s	sys 0.029s
I20260709 13:18:15.966429 16499 tablet_bootstrap.cc:492] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:15.979130 16498 tablet_bootstrap.cc:492] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:15.986341 16498 tablet_bootstrap.cc:654] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.993618 16903 consensus_queue.cc:1048] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:15.993961 16500 raft_consensus.cc:359] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.994810 16500 raft_consensus.cc:385] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.997293 16500 raft_consensus.cc:740] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.999092 16500 consensus_queue.cc:260] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:15.999267 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d2386a536042dcb0271fdc91474697" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:16.004900 16500 ts_tablet_manager.cc:1434] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:18:16.005465 16376 raft_consensus.cc:3060] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.006294 16500 tablet_bootstrap.cc:492] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:16.011425 16502 tablet_bootstrap.cc:492] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:16.012148 16502 ts_tablet_manager.cc:1403] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.128s	user 0.019s	sys 0.007s
I20260709 13:18:16.012658 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb3c242fc743cf98a4f1d7cffd975b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:16.013367 16305 raft_consensus.cc:3060] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.018244 16302 raft_consensus.cc:3060] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.019728 16502 raft_consensus.cc:359] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:16.020715 16502 raft_consensus.cc:385] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.021016 16502 raft_consensus.cc:740] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.022007 16502 consensus_queue.cc:260] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:16.020139 16376 raft_consensus.cc:2468] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
W20260709 13:18:16.026974 16417 leader_election.cc:343] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.027514 16417 leader_election.cc:304] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:16.030931 16500 tablet_bootstrap.cc:654] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.031801 16850 raft_consensus.cc:2749] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:16.037660 16499 tablet_bootstrap.cc:654] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.040462 16226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8b6cdc63734f54b3ebb138b4e0b94c" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:16.052127 16305 raft_consensus.cc:2468] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:16.053871 16502 ts_tablet_manager.cc:1434] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.003s
I20260709 13:18:16.056217 16269 leader_election.cc:304] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:16.066259 16858 raft_consensus.cc:2804] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.066936 16858 raft_consensus.cc:697] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:16.067811 16858 consensus_queue.cc:237] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.069826 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d2386a536042dcb0271fdc91474697" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:16.070917 16227 raft_consensus.cc:3060] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:16.075009 16345 leader_election.cc:343] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.099402 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8b6cdc63734f54b3ebb138b4e0b94c" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:16.100729 16498 tablet_bootstrap.cc:492] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:16.101305 16498 ts_tablet_manager.cc:1403] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.122s	user 0.013s	sys 0.006s
I20260709 13:18:16.078006 16903 raft_consensus.cc:493] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.116050 16227 raft_consensus.cc:2468] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:16.114012 16903 raft_consensus.cc:515] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:16.127121 16903 leader_election.cc:290] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:16.129544 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2962c590b5497da58a885103a32aef" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:16.131155 16419 leader_election.cc:343] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.133440 16498 raft_consensus.cc:359] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.134229 16498 raft_consensus.cc:385] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.134505 16498 raft_consensus.cc:740] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.137603 16498 consensus_queue.cc:260] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.138005 16900 raft_consensus.cc:493] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.138803 16900 raft_consensus.cc:515] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:16.139946 16498 ts_tablet_manager.cc:1434] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:18:16.141880 16498 tablet_bootstrap.cc:492] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:16.142982 16900 leader_election.cc:290] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:16.145107 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:16.145639 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:16.147519 16342 leader_election.cc:343] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:16.148695 16345 leader_election.cc:343] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.149143 16345 leader_election.cc:304] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:16.150187 16499 tablet_bootstrap.cc:492] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:16.150805 16499 ts_tablet_manager.cc:1403] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.185s	user 0.022s	sys 0.029s
I20260709 13:18:16.154409 16502 tablet_bootstrap.cc:492] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:16.152053 16900 raft_consensus.cc:2749] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:16.170388 16498 tablet_bootstrap.cc:654] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.174067 16499 raft_consensus.cc:359] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.174957 16499 raft_consensus.cc:385] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.175323 16499 raft_consensus.cc:740] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.171001 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2962c590b5497da58a885103a32aef" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:16.181371 16376 raft_consensus.cc:2468] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:16.189555 16500 tablet_bootstrap.cc:492] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:16.192351 16500 ts_tablet_manager.cc:1403] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.186s	user 0.021s	sys 0.039s
I20260709 13:18:16.193223 16125 catalog_manager.cc:5697] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.191486 16417 leader_election.cc:304] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:16.182555 16499 consensus_queue.cc:260] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.195536 16901 raft_consensus.cc:2804] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.195976 16901 raft_consensus.cc:493] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.196331 16901 raft_consensus.cc:3060] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.196442 16500 raft_consensus.cc:359] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.197364 16500 raft_consensus.cc:385] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.197690 16500 raft_consensus.cc:740] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.198472 16500 consensus_queue.cc:260] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.200704 16500 ts_tablet_manager.cc:1434] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:18:16.201819 16500 tablet_bootstrap.cc:492] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:16.207667 16500 tablet_bootstrap.cc:654] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.211627 16911 raft_consensus.cc:493] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.212476 16911 raft_consensus.cc:515] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:16.216070 16499 ts_tablet_manager.cc:1434] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:18:16.217446 16499 tablet_bootstrap.cc:492] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:16.230825 16898 consensus_queue.cc:1048] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:18:16.240038 16911 leader_election.cc:290] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:16.242357 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2559ecae96646189c0bc8afbe49ce16" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
W20260709 13:18:16.299211 16343 leader_election.cc:343] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.300055 16343 leader_election.cc:304] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:16.301537 16837 raft_consensus.cc:2749] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:16.245127 16499 tablet_bootstrap.cc:654] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.298820 16502 tablet_bootstrap.cc:654] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.246218 16901 raft_consensus.cc:515] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:16.312094 16500 tablet_bootstrap.cc:492] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
W20260709 13:18:16.312248 16194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 64944.7us
I20260709 13:18:16.312744 16500 ts_tablet_manager.cc:1403] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.111s	user 0.044s	sys 0.021s
I20260709 13:18:16.313772 16901 leader_election.cc:290] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:16.254172 16858 raft_consensus.cc:493] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.319941 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2962c590b5497da58a885103a32aef" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:16.317983 16858 raft_consensus.cc:515] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.326989 16373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2962c590b5497da58a885103a32aef" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:16.346251 16373 raft_consensus.cc:3060] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.349179 16858 leader_election.cc:290] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:16.349431 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:16.351668 16271 leader_election.cc:343] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.360694 16499 tablet_bootstrap.cc:492] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:16.360855 16732 consensus_queue.cc:1048] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:16.361335 16499 ts_tablet_manager.cc:1403] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.006s
I20260709 13:18:16.362564 16732 raft_consensus.cc:493] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.363212 16732 raft_consensus.cc:515] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.361280 16373 raft_consensus.cc:2468] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:16.364841 16499 raft_consensus.cc:359] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.335522 16500 raft_consensus.cc:359] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.365638 16499 raft_consensus.cc:385] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.366009 16499 raft_consensus.cc:740] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
W20260709 13:18:16.322507 16419 leader_election.cc:343] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.366058 16500 raft_consensus.cc:385] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:16.366933 16419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 44471us
I20260709 13:18:16.367455 16500 raft_consensus.cc:740] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.366087 16901 consensus_queue.cc:1048] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:16.366957 16499 consensus_queue.cc:260] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.370093 16449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2559ecae96646189c0bc8afbe49ce16" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:16.370805 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:16.339341 16498 tablet_bootstrap.cc:492] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:16.372437 16499 ts_tablet_manager.cc:1434] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:18:16.373510 16499 tablet_bootstrap.cc:492] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:16.372449 16498 ts_tablet_manager.cc:1403] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.231s	user 0.013s	sys 0.003s
I20260709 13:18:16.375090 16799 raft_consensus.cc:493] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.375666 16799 raft_consensus.cc:515] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.377394 16498 raft_consensus.cc:359] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:16.377864 16799 leader_election.cc:290] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:16.368222 16500 consensus_queue.cc:260] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.382747 16301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246e5a50c75e4f0fa58538237d61e585" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:16.384954 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246e5a50c75e4f0fa58538237d61e585" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:16.385687 16379 raft_consensus.cc:2468] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
W20260709 13:18:16.387199 16194 leader_election.cc:343] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.388206 16194 leader_election.cc:304] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:16.388648 16500 ts_tablet_manager.cc:1434] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:18:16.389864 16500 tablet_bootstrap.cc:492] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
W20260709 13:18:16.392594 16419 leader_election.cc:343] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.393867 16268 leader_election.cc:304] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:16.393971 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:16.394984 16859 raft_consensus.cc:2749] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:16.395081 16452 raft_consensus.cc:2468] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:16.378196 16498 raft_consensus.cc:385] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.396242 16499 tablet_bootstrap.cc:654] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.396339 16498 raft_consensus.cc:740] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.398900 16732 leader_election.cc:290] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:16.399822 16498 consensus_queue.cc:260] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:16.400748 16500 tablet_bootstrap.cc:654] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.402319 16498 ts_tablet_manager.cc:1434] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:18:16.403216 16839 raft_consensus.cc:2804] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.403540 16498 tablet_bootstrap.cc:492] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:16.403656 16839 raft_consensus.cc:493] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.404106 16839 raft_consensus.cc:3060] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.368655 16502 tablet_bootstrap.cc:492] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:16.416529 16502 ts_tablet_manager.cc:1403] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.303s	user 0.012s	sys 0.002s
I20260709 13:18:16.418035 16268 leader_election.cc:304] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:16.425590 16417 leader_election.cc:304] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:16.437650 16839 raft_consensus.cc:515] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.443800 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:16.444896 16498 tablet_bootstrap.cc:654] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:16.445327 16175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:16.448276 16502 raft_consensus.cc:359] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.449041 16502 raft_consensus.cc:385] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.449294 16502 raft_consensus.cc:740] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.441916 16901 raft_consensus.cc:2804] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.459961 16901 raft_consensus.cc:697] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:16.460868 16901 consensus_queue.cc:237] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:16.450065 16502 consensus_queue.cc:260] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.473446 16839 leader_election.cc:290] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:16.441483 16859 raft_consensus.cc:2804] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.474205 16859 raft_consensus.cc:493] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.474563 16859 raft_consensus.cc:3060] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.479202 16300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246e5a50c75e4f0fa58538237d61e585" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
W20260709 13:18:16.481092 16194 leader_election.cc:343] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.482823 16502 ts_tablet_manager.cc:1434] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:18:16.484477 16502 tablet_bootstrap.cc:492] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:16.470811 16123 catalog_manager.cc:5697] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.503196 16498 tablet_bootstrap.cc:492] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:16.503393 16499 tablet_bootstrap.cc:492] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:16.503806 16498 ts_tablet_manager.cc:1403] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.010s
I20260709 13:18:16.507053 16499 ts_tablet_manager.cc:1403] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.134s	user 0.009s	sys 0.006s
I20260709 13:18:16.509876 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246e5a50c75e4f0fa58538237d61e585" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:16.510560 16379 raft_consensus.cc:3060] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.511456 16499 raft_consensus.cc:359] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.512184 16499 raft_consensus.cc:385] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.512480 16499 raft_consensus.cc:740] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.513207 16499 consensus_queue.cc:260] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.516534 16499 ts_tablet_manager.cc:1434] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:18:16.532672 16498 raft_consensus.cc:359] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:16.533499 16498 raft_consensus.cc:385] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.533787 16498 raft_consensus.cc:740] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.536283 16379 raft_consensus.cc:2468] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:16.534511 16498 consensus_queue.cc:260] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:16.542114 16500 tablet_bootstrap.cc:492] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:16.542721 16500 ts_tablet_manager.cc:1403] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.153s	user 0.020s	sys 0.000s
I20260709 13:18:16.545150 16498 ts_tablet_manager.cc:1434] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.003s
I20260709 13:18:16.545261 16913 consensus_queue.cc:1048] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:16.545770 16502 tablet_bootstrap.cc:654] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.545703 16500 raft_consensus.cc:359] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.546705 16500 raft_consensus.cc:385] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.547019 16500 raft_consensus.cc:740] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.546383 16498 tablet_bootstrap.cc:492] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:16.551637 16859 raft_consensus.cc:515] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.553102 16304 raft_consensus.cc:2393] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0763e17c84d248738dade73ded2c5f71 in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:16.538267 16194 leader_election.cc:304] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:16.555490 16921 raft_consensus.cc:2804] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.556447 16921 raft_consensus.cc:697] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:16.557189 16417 leader_election.cc:304] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:16.563704 16921 consensus_queue.cc:237] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.564988 16839 raft_consensus.cc:493] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.565543 16839 raft_consensus.cc:515] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.567624 16499 tablet_bootstrap.cc:492] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:16.567749 16839 leader_election.cc:290] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:16.572731 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d99e00427c045ab9f5b3c444ecf06a0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:16.572800 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d99e00427c045ab9f5b3c444ecf06a0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:16.573668 16304 raft_consensus.cc:2468] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:16.573908 16452 raft_consensus.cc:2468] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 0.
I20260709 13:18:16.575843 16194 leader_election.cc:304] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:16.577054 16799 raft_consensus.cc:2804] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.577508 16799 raft_consensus.cc:493] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.577879 16799 raft_consensus.cc:3060] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.564003 16794 raft_consensus.cc:3060] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.557466 16500 consensus_queue.cc:260] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.590976 16845 raft_consensus.cc:493] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.638398 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:16.616127 16911 raft_consensus.cc:493] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.640899 16500 ts_tablet_manager.cc:1434] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.000s
W20260709 13:18:16.651932 16940 log.cc:927] Time spent T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 13:18:16.667891 16901 raft_consensus.cc:493] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.668548 16901 raft_consensus.cc:515] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:16.676887 16502 tablet_bootstrap.cc:492] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:16.677515 16502 ts_tablet_manager.cc:1403] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.193s	user 0.013s	sys 0.012s
I20260709 13:18:16.678160 16499 tablet_bootstrap.cc:654] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.646662 16911 raft_consensus.cc:515] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.682163 16911 leader_election.cc:290] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:16.683665 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8b6cdc63734f54b3ebb138b4e0b94c" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:16.684815 16379 raft_consensus.cc:2468] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:16.685408 16500 tablet_bootstrap.cc:492] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:16.689528 16269 leader_election.cc:304] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:16.661013 16859 leader_election.cc:290] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:16.644968 16845 raft_consensus.cc:515] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.688978 16898 raft_consensus.cc:493] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.719364 16229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:16.724956 16229 raft_consensus.cc:3060] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.712411 16911 raft_consensus.cc:2804] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.728806 16911 raft_consensus.cc:493] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.745751 16502 raft_consensus.cc:359] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:16.750078 16502 raft_consensus.cc:385] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.750479 16502 raft_consensus.cc:740] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.758157 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7586df8cdd4eff8a7fffe7fde7997d" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:16.742945 16901 leader_election.cc:290] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:16.729794 16898 raft_consensus.cc:515] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:16.763087 16301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7586df8cdd4eff8a7fffe7fde7997d" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:16.765915 16498 tablet_bootstrap.cc:654] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.751384 16911 raft_consensus.cc:3060] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.770109 16229 raft_consensus.cc:2468] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:16.773236 16502 consensus_queue.cc:260] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:16.755745 16228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8b6cdc63734f54b3ebb138b4e0b94c" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:16.788690 16942 log.cc:927] Time spent T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:18:16.772240 16860 raft_consensus.cc:493] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.815250 16193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 61350.4us
I20260709 13:18:16.818500 16502 ts_tablet_manager.cc:1434] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.141s	user 0.010s	sys 0.000s
I20260709 13:18:16.840991 16502 tablet_bootstrap.cc:492] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c: Bootstrap starting.
I20260709 13:18:16.843102 16499 tablet_bootstrap.cc:492] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:16.843681 16499 ts_tablet_manager.cc:1403] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.306s	user 0.018s	sys 0.027s
I20260709 13:18:16.813431 16860 raft_consensus.cc:515] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:16.853076 16898 leader_election.cc:290] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:16.853343 16845 leader_election.cc:290] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:16.854596 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:16.855572 16302 raft_consensus.cc:2393] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:16.859717 16799 raft_consensus.cc:515] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.861126 16500 tablet_bootstrap.cc:654] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.862087 16799 leader_election.cc:290] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:16.849481 16951 raft_consensus.cc:493] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.866765 16951 raft_consensus.cc:515] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.888901 16301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d99e00427c045ab9f5b3c444ecf06a0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:16.889618 16301 raft_consensus.cc:3060] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.887742 16499 raft_consensus.cc:359] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:16.894999 16499 raft_consensus.cc:385] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.895489 16499 raft_consensus.cc:740] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.896847 16951 leader_election.cc:290] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:16.899211 16860 leader_election.cc:290] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:16.902758 16301 raft_consensus.cc:2468] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
I20260709 13:18:16.906544 16794 raft_consensus.cc:2749] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:16.918398 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:16.935148 16376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f63940625724ed3a4294375705e345d" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:16.935989 16376 raft_consensus.cc:2468] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:16.936020 16911 raft_consensus.cc:515] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:16.924010 16502 tablet_bootstrap.cc:654] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.923877 16271 leader_election.cc:304] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:16.927067 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f63940625724ed3a4294375705e345d" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:16.943038 16271 leader_election.cc:343] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.943933 16943 raft_consensus.cc:2804] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.944494 16943 raft_consensus.cc:697] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:16.945372 16943 consensus_queue.cc:237] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.922174 16194 leader_election.cc:304] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:16.948421 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f63940625724ed3a4294375705e345d" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:16.948681 16343 leader_election.cc:343] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.948992 16799 raft_consensus.cc:2804] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.949572 16799 raft_consensus.cc:697] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:16.950464 16799 consensus_queue.cc:237] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:16.953444 16452 raft_consensus.cc:2468] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:16.896410 16499 consensus_queue.cc:260] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:16.964716 16499 ts_tablet_manager.cc:1434] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.002s
W20260709 13:18:16.964706 16417 leader_election.cc:343] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:16.973855 16417 leader_election.cc:343] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.974661 16417 leader_election.cc:304] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:16.977520 16193 leader_election.cc:304] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:16.979698 16417 leader_election.cc:304] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:16.965286 16911 leader_election.cc:290] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:16.986570 16903 raft_consensus.cc:2749] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:17.040031 16417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 55270.2us
I20260709 13:18:16.977990 16952 consensus_queue.cc:1048] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:18:16.989260 16950 raft_consensus.cc:2749] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:16.990527 16449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f63940625724ed3a4294375705e345d" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:16.988539 16301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:17.008915 16850 raft_consensus.cc:2804] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:17.015483 16226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:17.074877 16224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8b6cdc63734f54b3ebb138b4e0b94c" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:17.080184 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d99e00427c045ab9f5b3c444ecf06a0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:17.080928 16452 raft_consensus.cc:3060] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.064594 16374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8b6cdc63734f54b3ebb138b4e0b94c" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:17.069489 16850 raft_consensus.cc:493] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.069176 16845 raft_consensus.cc:493] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:17.088900 16417 leader_election.cc:343] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:17.108312 16345 leader_election.cc:343] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.112295 16499 tablet_bootstrap.cc:492] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:17.105625 16374 raft_consensus.cc:3060] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.095104 16850 raft_consensus.cc:3060] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.102595 16845 raft_consensus.cc:515] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:17.277791 16230 raft_consensus.cc:3060] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.285250 16845 leader_election.cc:290] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:17.287091 16498 tablet_bootstrap.cc:492] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:17.287686 16498 ts_tablet_manager.cc:1403] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.742s	user 0.013s	sys 0.028s
I20260709 13:18:17.292557 16452 raft_consensus.cc:2468] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 1.
W20260709 13:18:17.294806 16417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 190361us
W20260709 13:18:17.289600 16194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 170724us
W20260709 13:18:17.312107 16194 consensus_peers.cc:597] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:17.331771 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2962c590b5497da58a885103a32aef" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
W20260709 13:18:17.337548 16342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 225769us
I20260709 13:18:17.339797 16499 tablet_bootstrap.cc:654] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.347221 16377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2962c590b5497da58a885103a32aef" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:17.348573 16377 raft_consensus.cc:2393] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0763e17c84d248738dade73ded2c5f71 in this term.
W20260709 13:18:17.351837 16343 leader_election.cc:343] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.354471 16343 leader_election.cc:304] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:17.328102 16839 consensus_queue.cc:1048] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
W20260709 13:18:17.310330 16271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 93564us
I20260709 13:18:17.365084 16899 raft_consensus.cc:2749] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:17.366104 16271 leader_election.cc:343] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.374153 16502 tablet_bootstrap.cc:492] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c: No bootstrap required, opened a new log
I20260709 13:18:17.375027 16502 ts_tablet_manager.cc:1403] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c: Time spent bootstrapping tablet: real 0.542s	user 0.067s	sys 0.036s
I20260709 13:18:17.361722 16128 catalog_manager.cc:5697] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.354405 16498 raft_consensus.cc:359] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:17.390347 16498 raft_consensus.cc:385] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.390779 16498 raft_consensus.cc:740] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
W20260709 13:18:17.393492 16194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 53020.1us
W20260709 13:18:17.401064 16419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 105018us
I20260709 13:18:17.413998 16193 leader_election.cc:304] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:17.413560 16502 raft_consensus.cc:359] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:17.414646 16502 raft_consensus.cc:385] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.415058 16502 raft_consensus.cc:740] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.410478 16900 raft_consensus.cc:493] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.433004 16900 raft_consensus.cc:515] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:17.435592 16900 leader_election.cc:290] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:17.442245 16502 consensus_queue.cc:260] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:17.444967 16502 ts_tablet_manager.cc:1434] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:18:17.453402 16498 consensus_queue.cc:260] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:17.461349 16921 raft_consensus.cc:2749] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:17.461741 16374 raft_consensus.cc:2468] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:17.461790 16500 tablet_bootstrap.cc:492] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:17.465341 16500 ts_tablet_manager.cc:1403] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.804s	user 0.036s	sys 0.040s
I20260709 13:18:17.486672 16269 leader_election.cc:304] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:17.483578 16123 catalog_manager.cc:5697] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:17.497130 16342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 67941.8us
I20260709 13:18:17.498169 16123 catalog_manager.cc:5697] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.504390 16498 ts_tablet_manager.cc:1434] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.216s	user 0.012s	sys 0.002s
I20260709 13:18:17.496492 16952 raft_consensus.cc:2804] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:17.519995 16193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 106070us
W20260709 13:18:17.509841 16194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 96959.2us
I20260709 13:18:17.539022 16952 raft_consensus.cc:697] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:17.557651 16498 tablet_bootstrap.cc:492] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:17.510281 16969 consensus_queue.cc:1048] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:18:17.566030 16223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d21ba5abb841f1bd1d8564ddbb78c2" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:17.563488 16850 raft_consensus.cc:515] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:17.576913 16500 raft_consensus.cc:359] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:17.577764 16500 raft_consensus.cc:385] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.578042 16500 raft_consensus.cc:740] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.578974 16449 raft_consensus.cc:2393] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c736bf768804f2e86a875366c12a71c in current term 1: Already voted for candidate 0763e17c84d248738dade73ded2c5f71 in this term.
I20260709 13:18:17.581214 16499 tablet_bootstrap.cc:492] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:17.581750 16499 ts_tablet_manager.cc:1403] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.483s	user 0.014s	sys 0.015s
I20260709 13:18:17.551138 16952 consensus_queue.cc:237] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:17.585541 16500 consensus_queue.cc:260] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:17.574455 16850 leader_election.cc:290] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
W20260709 13:18:17.602919 16345 leader_election.cc:343] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.599647 16900 raft_consensus.cc:493] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.605494 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d21ba5abb841f1bd1d8564ddbb78c2" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:17.617908 16500 ts_tablet_manager.cc:1434] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.152s	user 0.007s	sys 0.000s
I20260709 13:18:17.618592 16453 raft_consensus.cc:2468] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:17.622922 16499 raft_consensus.cc:359] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:17.623867 16499 raft_consensus.cc:385] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.624217 16499 raft_consensus.cc:740] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.647516 16499 consensus_queue.cc:260] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:17.607429 16945 consensus_queue.cc:1048] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:18:17.665899 16500 tablet_bootstrap.cc:492] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:17.668404 16370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f63940625724ed3a4294375705e345d" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:17.622186 16900 raft_consensus.cc:515] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:17.670331 16950 raft_consensus.cc:493] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.696311 16370 raft_consensus.cc:3060] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.729667 16499 ts_tablet_manager.cc:1434] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.148s	user 0.016s	sys 0.010s
I20260709 13:18:17.789391 16900 leader_election.cc:290] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:17.706763 16859 consensus_queue.cc:1048] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:18:17.713665 16950 raft_consensus.cc:515] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:17.797940 16976 consensus_queue.cc:1048] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:17.799237 16950 leader_election.cc:290] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:17.800280 16300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f63940625724ed3a4294375705e345d" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:17.800990 16300 raft_consensus.cc:3060] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.801932 16498 tablet_bootstrap.cc:654] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.820504 16342 leader_election.cc:304] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:17.806279 16950 raft_consensus.cc:493] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0763e17c84d248738dade73ded2c5f71)
I20260709 13:18:17.827716 16954 raft_consensus.cc:2804] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:17.840090 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7586df8cdd4eff8a7fffe7fde7997d" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:17.847627 16343 leader_election.cc:343] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.840454 16954 raft_consensus.cc:493] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:17.865557 16175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:17.833070 16950 raft_consensus.cc:515] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:17.911682 16954 raft_consensus.cc:3060] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:17.911337 16271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 51556.4us
I20260709 13:18:17.944628 16370 raft_consensus.cc:2468] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:18.043292 16950 leader_election.cc:290] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:18.045022 16300 raft_consensus.cc:2468] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:18.060391 16500 tablet_bootstrap.cc:654] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.065836 16955 raft_consensus.cc:493] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.072196 16955 raft_consensus.cc:515] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:18.102373 16374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8b6cdc63734f54b3ebb138b4e0b94c" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:18.103372 16374 raft_consensus.cc:2393] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:18.112222 16417 leader_election.cc:304] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 
I20260709 13:18:18.119647 16499 tablet_bootstrap.cc:492] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:18.139372 16498 tablet_bootstrap.cc:492] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:18.139972 16498 ts_tablet_manager.cc:1403] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.611s	user 0.016s	sys 0.014s
I20260709 13:18:18.127159 16901 raft_consensus.cc:2804] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.145157 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8b6cdc63734f54b3ebb138b4e0b94c" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:18.155270 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7586df8cdd4eff8a7fffe7fde7997d" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:18.155820 16955 leader_election.cc:290] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:18.156177 16451 raft_consensus.cc:2468] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 0.
I20260709 13:18:18.159809 16499 tablet_bootstrap.cc:654] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.140700 16954 raft_consensus.cc:515] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:18.161985 16298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738b09b19983412bbbf2fccd7c5687b5" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:18.163991 16342 leader_election.cc:304] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:18.172297 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:18.172331 16975 raft_consensus.cc:2804] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.175873 16975 raft_consensus.cc:493] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.176280 16975 raft_consensus.cc:3060] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.179333 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738b09b19983412bbbf2fccd7c5687b5" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
W20260709 13:18:18.183295 16342 leader_election.cc:343] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.150200 16901 raft_consensus.cc:697] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:18.185247 16449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45288 (request call id 119) took 1219 ms. Trace:
I20260709 13:18:18.185739 16449 rpcz_store.cc:276] 0709 13:18:16.966321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.968188 (+  1867us) service_pool.cc:224] Handling call
0709 13:18:18.185023 (+1216835us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540069bed4. stack: 00007fece611d343 00007fece611d240 00007fece5aac1d4 00007fecef7ea304 00007fecef7ea299 00007fece91a5571 00007fece92402fa 00007fecee201b17 00007fece777c6d4 00007fece777c662 00007fece777c591 00007fece777c50c 00007fece777b7c2 00007fece757748c 00007fece75768c6 00007fece757626f
0709 13:18:18.185163 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176756608}
I20260709 13:18:18.185833 16901 consensus_queue.cc:237] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:18.187958 16960 consensus_queue.cc:1048] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:18.193316 16498 raft_consensus.cc:359] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.194264 16498 raft_consensus.cc:385] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.198243 16954 leader_election.cc:290] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:18.200933 16342 leader_election.cc:304] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:18.194540 16498 raft_consensus.cc:740] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.208644 16954 raft_consensus.cc:2749] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.206959 16498 consensus_queue.cc:260] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.233462 16500 tablet_bootstrap.cc:492] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:18.234303 16500 ts_tablet_manager.cc:1403] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.579s	user 0.022s	sys 0.022s
I20260709 13:18:18.237118 16194 leader_election.cc:304] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
W20260709 13:18:18.251909 16268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 47780us
I20260709 13:18:18.238240 16449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d21ba5abb841f1bd1d8564ddbb78c2" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:18.239814 16799 consensus_queue.cc:1048] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:18:18.250666 16950 raft_consensus.cc:3060] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.278021 16498 ts_tablet_manager.cc:1434] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.138s	user 0.002s	sys 0.008s
I20260709 13:18:18.253307 16228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:18.299010 16194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 45532.3us
I20260709 13:18:18.272410 16449 raft_consensus.cc:3060] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.311410 16194 leader_election.cc:304] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:18.339268 16500 raft_consensus.cc:359] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:18.340345 16500 raft_consensus.cc:385] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.340605 16500 raft_consensus.cc:740] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.341241 16500 consensus_queue.cc:260] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:18.361809 16500 ts_tablet_manager.cc:1434] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.001s
I20260709 13:18:18.368860 16498 tablet_bootstrap.cc:492] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
W20260709 13:18:18.387459 16194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 76194.7us
W20260709 13:18:18.391388 16345 leader_election.cc:343] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.392532 16345 leader_election.cc:304] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
W20260709 13:18:18.388774 16996 log.cc:927] Time spent T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.004s
I20260709 13:18:18.399742 16964 raft_consensus.cc:2749] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.400043 16981 raft_consensus.cc:2749] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.383467 16975 raft_consensus.cc:515] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:18.411118 16500 tablet_bootstrap.cc:492] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:18.426162 16221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d21ba5abb841f1bd1d8564ddbb78c2" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
W20260709 13:18:18.429436 16345 leader_election.cc:343] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.433284 16498 tablet_bootstrap.cc:654] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.440927 16500 tablet_bootstrap.cc:654] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.442008 16975 leader_election.cc:290] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:18.398761 16950 raft_consensus.cc:2749] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.449905 16449 raft_consensus.cc:2468] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:18.451916 16304 raft_consensus.cc:3060] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.450765 16952 consensus_queue.cc:1048] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:18:18.437520 16126 catalog_manager.cc:5697] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.462507 16448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7586df8cdd4eff8a7fffe7fde7997d" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:18.463400 16448 raft_consensus.cc:3060] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:18.473301 16417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 201319us
I20260709 13:18:18.481973 16342 leader_election.cc:304] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:18.484859 17006 consensus_queue.cc:1048] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:18:18.485348 16837 raft_consensus.cc:2804] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.499377 16837 raft_consensus.cc:697] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:18.501163 16837 consensus_queue.cc:237] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:18.494877 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7586df8cdd4eff8a7fffe7fde7997d" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
W20260709 13:18:18.507258 16343 leader_election.cc:343] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.525250 16499 tablet_bootstrap.cc:492] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:18.525725 16499 ts_tablet_manager.cc:1403] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.434s	user 0.014s	sys 0.013s
I20260709 13:18:18.531603 16500 tablet_bootstrap.cc:492] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:18.532266 16500 ts_tablet_manager.cc:1403] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.124s	user 0.006s	sys 0.011s
I20260709 13:18:18.535597 16498 tablet_bootstrap.cc:492] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:18.536303 16498 ts_tablet_manager.cc:1403] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.168s	user 0.017s	sys 0.006s
I20260709 13:18:18.544492 16498 raft_consensus.cc:359] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.545253 16498 raft_consensus.cc:385] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.545517 16498 raft_consensus.cc:740] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.547468 16498 consensus_queue.cc:260] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.552088 16498 ts_tablet_manager.cc:1434] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:18:18.552186 16500 raft_consensus.cc:359] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.553074 16500 raft_consensus.cc:385] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.553428 16500 raft_consensus.cc:740] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.554160 16500 consensus_queue.cc:260] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.557931 16498 tablet_bootstrap.cc:492] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71: Bootstrap starting.
I20260709 13:18:18.560403 16500 ts_tablet_manager.cc:1434] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:18:18.569365 16499 raft_consensus.cc:359] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.570201 16499 raft_consensus.cc:385] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.570465 16499 raft_consensus.cc:740] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.573382 16499 consensus_queue.cc:260] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.577811 16125 catalog_manager.cc:5697] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.586796 16499 ts_tablet_manager.cc:1434] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:18:18.591923 16126 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41702 (request call id 76) took 1251 ms. Trace:
W20260709 13:18:18.615702 16417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 122706us
I20260709 13:18:18.620215 16500 tablet_bootstrap.cc:492] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:18.607758 16126 rpcz_store.cc:276] 0709 13:18:17.337607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.337805 (+   198us) service_pool.cc:224] Handling call
0709 13:18:18.588468 (+1250663us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:18.480142 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:18.504187 (+ 24045us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:18.504242 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:18:18.504269 (+    27us) tablet.cc:662] Decoding operations
0709 13:18:18.504700 (+   431us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:18.504753 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:18.504782 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:18.505024 (+   242us) tablet.cc:701] Row locks acquired
0709 13:18:18.505049 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:18:18.505272 (+   223us) write_op.cc:270] Start()
0709 13:18:18.505404 (+   132us) write_op.cc:276] Timestamp: P: 1783603098505213 usec, L: 0
0709 13:18:18.505433 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:18:18.509687 (+  4254us) log.cc:844] Serialized 540 byte log entry
0709 13:18:18.512686 (+  2999us) op_driver.cc:464] REPLICATION: finished
0709 13:18:18.513147 (+   461us) write_op.cc:301] APPLY: starting
0709 13:18:18.513234 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:18.513351 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:18.513456 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:18.513707 (+   251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:18.514099 (+   392us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:18.514163 (+    64us) write_op.cc:312] APPLY: finished
0709 13:18:18.514424 (+   261us) log.cc:844] Serialized 22 byte log entry
0709 13:18:18.519847 (+  5423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:18.520698 (+   851us) write_op.cc:454] Released schema lock
0709 13:18:18.520747 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:18.521085 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:18.521126 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64727,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":258,"apply.run_cpu_time_us":2097,"apply.run_wall_time_us":7912,"num_ops":1,"prepare.queue_time_us":149,"prepare.run_cpu_time_us":3375,"prepare.run_wall_time_us":32988,"replication_time_us":7126}]]}
I20260709 13:18:18.629563 16901 raft_consensus.cc:493] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.634142 16901 raft_consensus.cc:515] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.635044 16500 tablet_bootstrap.cc:654] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.637367 16901 leader_election.cc:290] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:18.644997 16448 raft_consensus.cc:2468] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:18.647193 16342 leader_election.cc:304] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e
I20260709 13:18:18.648138 16954 raft_consensus.cc:2804] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.648644 16954 raft_consensus.cc:697] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:18.649506 16954 consensus_queue.cc:237] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:18.663295 16499 tablet_bootstrap.cc:492] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:18.662338 16221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53592287efd4b3ba8208b91130d38cd" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:18.672529 16419 leader_election.cc:343] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.688550 16498 tablet_bootstrap.cc:654] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.740262 16499 tablet_bootstrap.cc:654] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.748261 16125 catalog_manager.cc:5697] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.764216 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53592287efd4b3ba8208b91130d38cd" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:18.784722 16498 tablet_bootstrap.cc:492] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71: No bootstrap required, opened a new log
I20260709 13:18:18.785356 16498 ts_tablet_manager.cc:1403] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71: Time spent bootstrapping tablet: real 0.228s	user 0.003s	sys 0.011s
I20260709 13:18:18.789189 16498 raft_consensus.cc:359] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:18.789947 16498 raft_consensus.cc:385] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.790148 16498 raft_consensus.cc:740] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.791383 16850 consensus_queue.cc:1048] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:18.793119 16417 leader_election.cc:343] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.793718 16417 leader_election.cc:304] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:18.794214 16499 tablet_bootstrap.cc:492] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:18.794520 16944 raft_consensus.cc:2749] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.794893 16499 ts_tablet_manager.cc:1403] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.179s	user 0.016s	sys 0.015s
I20260709 13:18:18.790834 16498 consensus_queue.cc:260] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:18.799401 16500 tablet_bootstrap.cc:492] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:18.800100 16500 ts_tablet_manager.cc:1403] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.180s	user 0.050s	sys 0.037s
I20260709 13:18:18.801267 16850 raft_consensus.cc:493] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.801828 16850 raft_consensus.cc:515] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:18.804167 16850 leader_election.cc:290] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:18.804364 16500 raft_consensus.cc:359] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:18.805172 16500 raft_consensus.cc:385] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.805509 16500 raft_consensus.cc:740] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.806483 16500 consensus_queue.cc:260] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:18.808848 16498 ts_tablet_manager.cc:1434] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:18:18.809134 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:18.811275 16500 ts_tablet_manager.cc:1434] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
W20260709 13:18:18.811941 16419 leader_election.cc:343] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.812502 16500 tablet_bootstrap.cc:492] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:18.818694 16372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:18.819617 16372 raft_consensus.cc:2468] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 0.
I20260709 13:18:18.819478 16128 catalog_manager.cc:5697] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.822041 16500 tablet_bootstrap.cc:654] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.822331 16128 catalog_manager.cc:5697] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 1 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.825970 16901 consensus_queue.cc:1048] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:18.826167 16499 raft_consensus.cc:359] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:18.827224 16499 raft_consensus.cc:385] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.827528 16499 raft_consensus.cc:740] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.828332 16499 consensus_queue.cc:260] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:18.830852 16500 tablet_bootstrap.cc:492] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
I20260709 13:18:18.830956 16499 ts_tablet_manager.cc:1434] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:18:18.831776 16500 ts_tablet_manager.cc:1403] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.001s
I20260709 13:18:18.832441 16499 tablet_bootstrap.cc:492] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:18.825941 16417 leader_election.cc:304] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:18.839043 16901 raft_consensus.cc:2804] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.838536 16500 raft_consensus.cc:359] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.839486 16901 raft_consensus.cc:493] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.839699 16500 raft_consensus.cc:385] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.839973 16901 raft_consensus.cc:3060] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.840222 16500 raft_consensus.cc:740] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.857131 16500 consensus_queue.cc:260] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.893321 16500 ts_tablet_manager.cc:1434] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.001s
I20260709 13:18:18.894593 16500 tablet_bootstrap.cc:492] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e: Bootstrap starting.
I20260709 13:18:18.907366 16500 tablet_bootstrap.cc:654] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.864734 16499 tablet_bootstrap.cc:654] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.853912 16901 raft_consensus.cc:515] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:18.934125 16221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:18.935838 16500 tablet_bootstrap.cc:492] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e: No bootstrap required, opened a new log
W20260709 13:18:18.935818 16419 leader_election.cc:343] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.936925 16500 ts_tablet_manager.cc:1403] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.009s
I20260709 13:18:18.936967 16370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:18.937824 16370 raft_consensus.cc:3060] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.940624 16500 raft_consensus.cc:359] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:18.943799 16500 raft_consensus.cc:385] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.944209 16500 raft_consensus.cc:740] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.945101 16500 consensus_queue.cc:260] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:18.947819 16500 ts_tablet_manager.cc:1434] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:18:18.951037 16499 tablet_bootstrap.cc:492] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:18.951584 16499 ts_tablet_manager.cc:1403] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.119s	user 0.007s	sys 0.010s
I20260709 13:18:18.953850 16499 raft_consensus.cc:359] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.954581 16499 raft_consensus.cc:385] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.954873 16499 raft_consensus.cc:740] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.955631 16499 consensus_queue.cc:260] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.957849 16499 ts_tablet_manager.cc:1434] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:18.963090 16901 leader_election.cc:290] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:18.966563 16952 raft_consensus.cc:493] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.967283 16952 raft_consensus.cc:515] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.970834 16952 leader_election.cc:290] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:18.971043 16448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38373beeca944c692d0895d25f56ad8" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:18.971827 16448 raft_consensus.cc:2468] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:18.973016 16221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38373beeca944c692d0895d25f56ad8" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:18.973745 16221 raft_consensus.cc:2468] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:18.975792 16268 leader_election.cc:304] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:18.976819 16952 raft_consensus.cc:2804] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.977288 16952 raft_consensus.cc:493] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.978823 16952 raft_consensus.cc:3060] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.983907 16839 raft_consensus.cc:493] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.984568 16839 raft_consensus.cc:515] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:18.985849 16499 tablet_bootstrap.cc:492] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:18.988122 16372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d21ba5abb841f1bd1d8564ddbb78c2" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:18.995078 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d21ba5abb841f1bd1d8564ddbb78c2" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:18.996111 16452 raft_consensus.cc:2393] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0c736bf768804f2e86a875366c12a71c in this term.
I20260709 13:18:19.000030 16370 raft_consensus.cc:2468] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:18.988937 16952 raft_consensus.cc:515] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:18.989738 16839 leader_election.cc:290] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:19.005257 16952 leader_election.cc:290] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:19.006966 16221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38373beeca944c692d0895d25f56ad8" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:19.007997 16221 raft_consensus.cc:3060] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.016220 16193 leader_election.cc:304] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:19.027778 16954 consensus_queue.cc:1048] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:19.013046 16448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38373beeca944c692d0895d25f56ad8" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:19.030354 16950 raft_consensus.cc:3060] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.033526 16417 leader_election.cc:304] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:19.031390 16837 raft_consensus.cc:493] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.054193 16901 raft_consensus.cc:2804] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.057161 16901 raft_consensus.cc:697] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:19.058228 16901 consensus_queue.cc:237] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:19.055529 16837 raft_consensus.cc:515] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:19.064872 16837 leader_election.cc:290] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:19.068594 16499 tablet_bootstrap.cc:654] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.071851 16225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:19.072235 16960 raft_consensus.cc:493] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.072844 16960 raft_consensus.cc:515] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:19.075147 16960 leader_election.cc:290] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
W20260709 13:18:19.076246 16345 leader_election.cc:343] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.078024 16225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
W20260709 13:18:19.079980 16271 leader_election.cc:343] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.046969 16448 raft_consensus.cc:3060] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.086078 16221 raft_consensus.cc:2468] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:19.087934 16271 leader_election.cc:304] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:19.088863 16952 raft_consensus.cc:2804] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.089459 16952 raft_consensus.cc:697] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:19.097982 16370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:19.102686 16370 raft_consensus.cc:2468] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
W20260709 13:18:19.104233 16175 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:19.113438 16952 consensus_queue.cc:237] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:19.121536 16269 leader_election.cc:304] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
W20260709 13:18:19.129583 16343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 65573.5us
I20260709 13:18:19.132239 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:19.125905 17006 raft_consensus.cc:2804] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.142159 16448 raft_consensus.cc:2468] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:19.138562 17006 raft_consensus.cc:493] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.147142 17006 raft_consensus.cc:3060] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.148322 16950 raft_consensus.cc:2749] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.159770 16499 tablet_bootstrap.cc:492] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:19.160315 16499 ts_tablet_manager.cc:1403] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.175s	user 0.032s	sys 0.015s
I20260709 13:18:19.173826 16499 raft_consensus.cc:359] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:19.174594 16499 raft_consensus.cc:385] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.174894 16499 raft_consensus.cc:740] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.175632 16499 consensus_queue.cc:260] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:19.177995 16499 ts_tablet_manager.cc:1434] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:18:19.181972 16911 raft_consensus.cc:493] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.182977 16499 tablet_bootstrap.cc:492] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:19.182597 16911 raft_consensus.cc:515] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:19.185369 16911 leader_election.cc:290] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:19.187990 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53592287efd4b3ba8208b91130d38cd" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:19.188755 16452 raft_consensus.cc:2468] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 0.
I20260709 13:18:19.191078 16124 catalog_manager.cc:5697] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 1 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.192049 16305 raft_consensus.cc:3060] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.197458 16268 leader_election.cc:304] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:19.200968 16960 raft_consensus.cc:2804] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.201432 16960 raft_consensus.cc:493] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.201845 16960 raft_consensus.cc:3060] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.205065 16911 raft_consensus.cc:493] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.206200 16499 tablet_bootstrap.cc:654] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.205694 16911 raft_consensus.cc:515] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:19.207474 16954 consensus_queue.cc:1048] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.219348 16985 consensus_queue.cc:1048] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:18:19.226579 16960 raft_consensus.cc:515] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:19.225384 17033 consensus_queue.cc:1048] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:19.230347 16372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7586df8cdd4eff8a7fffe7fde7997d" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:19.229388 16128 catalog_manager.cc:5697] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.230985 16960 leader_election.cc:290] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:19.231793 16911 leader_election.cc:290] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:19.229931 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53592287efd4b3ba8208b91130d38cd" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:19.233144 16452 raft_consensus.cc:3060] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.232995 16447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7586df8cdd4eff8a7fffe7fde7997d" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:19.235281 17006 raft_consensus.cc:515] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:19.239180 16269 leader_election.cc:304] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:19.247511 16950 raft_consensus.cc:493] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.248222 16950 raft_consensus.cc:515] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:19.248895 16304 raft_consensus.cc:2393] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c736bf768804f2e86a875366c12a71c in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:19.250952 16950 leader_election.cc:290] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:19.252550 16447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53592287efd4b3ba8208b91130d38cd" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:19.253217 17006 leader_election.cc:290] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:19.254243 16343 leader_election.cc:304] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:19.255550 17033 raft_consensus.cc:3060] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.261965 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53592287efd4b3ba8208b91130d38cd" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:19.269250 16222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53592287efd4b3ba8208b91130d38cd" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
I20260709 13:18:19.270051 16222 raft_consensus.cc:3060] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.269596 16302 raft_consensus.cc:2393] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:19.276806 16194 leader_election.cc:304] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:19.274744 16372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:19.286415 16452 raft_consensus.cc:2468] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:19.287742 16268 leader_election.cc:304] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:19.293926 16228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53592287efd4b3ba8208b91130d38cd" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184" is_pre_election: true
I20260709 13:18:19.295220 16960 raft_consensus.cc:2804] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.291101 16227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
W20260709 13:18:19.330039 16271 leader_election.cc:343] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.330698 16952 raft_consensus.cc:2749] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:19.346010 16222 raft_consensus.cc:2468] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:19.367739 16960 raft_consensus.cc:697] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:19.362720 16799 raft_consensus.cc:2749] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.371439 16982 raft_consensus.cc:493] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.438481 16982 raft_consensus.cc:515] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:19.439953 16960 consensus_queue.cc:237] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
W20260709 13:18:19.436576 16345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 43577.1us
I20260709 13:18:19.442564 17033 raft_consensus.cc:2749] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.443071 16371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:19.442656 16982 leader_election.cc:290] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:19.444031 16371 raft_consensus.cc:2393] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 0763e17c84d248738dade73ded2c5f71 in this term.
I20260709 13:18:19.455681 16499 tablet_bootstrap.cc:492] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184: No bootstrap required, opened a new log
I20260709 13:18:19.456347 16499 ts_tablet_manager.cc:1403] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.274s	user 0.009s	sys 0.019s
I20260709 13:18:19.459499 16499 raft_consensus.cc:359] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:19.460283 16499 raft_consensus.cc:385] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.460635 16499 raft_consensus.cc:740] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.454589 16372 raft_consensus.cc:2468] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:19.470558 16499 consensus_queue.cc:260] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:19.472510 16499 ts_tablet_manager.cc:1434] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:18:19.474566 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:19.485921 16193 leader_election.cc:304] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:19.487633 16982 raft_consensus.cc:3060] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.503798 16269 leader_election.cc:304] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:19.507755 16960 raft_consensus.cc:2804] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.508337 16960 raft_consensus.cc:697] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:19.509258 16960 consensus_queue.cc:237] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:19.518615 16128 catalog_manager.cc:5697] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.531855 16982 raft_consensus.cc:2749] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.535840 16957 consensus_queue.cc:1048] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:19.552821 16850 consensus_queue.cc:1048] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:19.545719 16128 catalog_manager.cc:5697] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 0 to 1, leader changed from <none> to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 1 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.636605 16799 raft_consensus.cc:493] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.637193 16799 raft_consensus.cc:515] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:19.639221 16799 leader_election.cc:290] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:19.640015 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:19.640275 16372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:19.641018 16372 raft_consensus.cc:2393] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe046a372b6a4df982eebe83cf3ee184 in current term 1: Already voted for candidate 35e0de78970041afb173662b1c34598e in this term.
I20260709 13:18:19.642351 16194 leader_election.cc:304] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:19.643218 16799 raft_consensus.cc:3060] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.650547 16799 raft_consensus.cc:2749] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.738848 17035 consensus_queue.cc:1048] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.751256 17006 consensus_queue.cc:1048] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.921170 17006 consensus_queue.cc:1048] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.946714 17035 consensus_queue.cc:1048] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.953040 17006 consensus_queue.cc:1048] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.993714 16960 consensus_queue.cc:1048] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.773501  6030 tablet_server.cc:179] TabletServer@127.5.227.129:0 shutting down...
W20260709 13:18:20.779443 16345 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:20.788923 16345 consensus_peers.cc:597] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:20.794117 16345 consensus_peers.cc:597] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:20.838343 16271 consensus_peers.cc:597] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:20.838375 16419 consensus_peers.cc:597] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:20.843878 16271 consensus_peers.cc:597] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.847295  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:20.848995  6030 tablet_replica.cc:333] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.850322  6030 raft_consensus.cc:2243] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.851235  6030 raft_consensus.cc:2272] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:20.851295 16419 consensus_peers.cc:597] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.855116  6030 tablet_replica.cc:333] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.856113  6030 raft_consensus.cc:2243] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.856590  6030 raft_consensus.cc:2272] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.859354  6030 tablet_replica.cc:333] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.860344  6030 raft_consensus.cc:2243] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.860919  6030 raft_consensus.cc:2272] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.863214  6030 tablet_replica.cc:333] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.863898  6030 raft_consensus.cc:2243] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.864398  6030 raft_consensus.cc:2272] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.867018  6030 tablet_replica.cc:333] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.868016  6030 raft_consensus.cc:2243] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:20.869045  6030 raft_consensus.cc:2272] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:20.869522 16419 consensus_peers.cc:597] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.871634  6030 tablet_replica.cc:333] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.872387  6030 raft_consensus.cc:2243] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.872939  6030 raft_consensus.cc:2272] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.875092  6030 tablet_replica.cc:333] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.875746  6030 raft_consensus.cc:2243] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.876217  6030 raft_consensus.cc:2272] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.878064  6030 tablet_replica.cc:333] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.879076  6030 raft_consensus.cc:2243] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.879590  6030 raft_consensus.cc:2272] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.882977  6030 tablet_replica.cc:333] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.884258  6030 raft_consensus.cc:2243] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:20.885546  6030 raft_consensus.cc:2272] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:20.886317 16345 consensus_peers.cc:597] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.888376  6030 tablet_replica.cc:333] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.889209  6030 raft_consensus.cc:2243] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:20.890201  6030 raft_consensus.cc:2272] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.892771  6030 tablet_replica.cc:333] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.893743  6030 raft_consensus.cc:2243] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.894361  6030 raft_consensus.cc:2272] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.897042  6030 tablet_replica.cc:333] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.897785  6030 raft_consensus.cc:2243] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.898360  6030 raft_consensus.cc:2272] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.902040  6030 tablet_replica.cc:333] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.903183  6030 raft_consensus.cc:2243] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:20.904613  6030 raft_consensus.cc:2272] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.907126  6030 tablet_replica.cc:333] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.907966  6030 raft_consensus.cc:2243] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:20.909268  6030 raft_consensus.cc:2272] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.912730  6030 tablet_replica.cc:333] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.913769  6030 raft_consensus.cc:2243] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:20.914306 16271 consensus_peers.cc:597] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.914356  6030 raft_consensus.cc:2272] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.917754  6030 tablet_replica.cc:333] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.918606  6030 raft_consensus.cc:2243] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:20.919806  6030 raft_consensus.cc:2272] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.923074  6030 tablet_replica.cc:333] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
W20260709 13:18:20.922967 16271 consensus_peers.cc:597] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.924089  6030 raft_consensus.cc:2243] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.924693  6030 raft_consensus.cc:2272] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.928515  6030 tablet_replica.cc:333] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.929216  6030 raft_consensus.cc:2243] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.929740  6030 raft_consensus.cc:2272] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.932612  6030 tablet_replica.cc:333] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.933439  6030 raft_consensus.cc:2243] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:20.934695  6030 raft_consensus.cc:2272] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.937202  6030 tablet_replica.cc:333] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.937774  6030 raft_consensus.cc:2243] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:20.938829  6030 raft_consensus.cc:2272] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.941324  6030 tablet_replica.cc:333] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.942231  6030 raft_consensus.cc:2243] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.943001  6030 raft_consensus.cc:2272] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.945639  6030 tablet_replica.cc:333] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.946659  6030 raft_consensus.cc:2243] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.947433  6030 raft_consensus.cc:2272] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.950881  6030 tablet_replica.cc:333] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.951597  6030 raft_consensus.cc:2243] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.952167  6030 raft_consensus.cc:2272] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:20.954588 16345 consensus_peers.cc:597] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:20.955622 16271 consensus_peers.cc:597] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.957221  6030 tablet_replica.cc:333] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.958232  6030 raft_consensus.cc:2243] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:20.959359  6030 raft_consensus.cc:2272] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.962402  6030 tablet_replica.cc:333] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.963313  6030 raft_consensus.cc:2243] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.963898  6030 raft_consensus.cc:2272] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.967401  6030 tablet_replica.cc:333] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.968329  6030 raft_consensus.cc:2243] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.968950  6030 raft_consensus.cc:2272] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.972175  6030 tablet_replica.cc:333] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.973016  6030 raft_consensus.cc:2243] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.973628  6030 raft_consensus.cc:2272] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.976537  6030 tablet_replica.cc:333] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.977437  6030 raft_consensus.cc:2243] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.978132  6030 raft_consensus.cc:2272] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.981843  6030 tablet_replica.cc:333] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.982697  6030 raft_consensus.cc:2243] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:20.984005  6030 raft_consensus.cc:2272] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:20.985260 16419 consensus_peers.cc:597] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:20.987646 16419 consensus_peers.cc:597] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.988015  6030 tablet_replica.cc:333] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.990291  6030 raft_consensus.cc:2243] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.991212  6030 raft_consensus.cc:2272] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.993916  6030 tablet_replica.cc:333] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:20.994813  6030 raft_consensus.cc:2243] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:20.996193  6030 raft_consensus.cc:2272] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.999287  6030 tablet_replica.cc:333] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
W20260709 13:18:20.999338 16271 consensus_peers.cc:597] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.000159  6030 raft_consensus.cc:2243] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.000646  6030 raft_consensus.cc:2272] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.003700  6030 tablet_replica.cc:333] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.004477  6030 raft_consensus.cc:2243] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.005163  6030 raft_consensus.cc:2272] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.008530  6030 tablet_replica.cc:333] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.009594  6030 raft_consensus.cc:2243] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.010358  6030 raft_consensus.cc:2272] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.013283  6030 tablet_replica.cc:333] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.014077  6030 raft_consensus.cc:2243] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.014508  6030 raft_consensus.cc:2272] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.016978  6030 tablet_replica.cc:333] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
W20260709 13:18:21.017655 16419 consensus_peers.cc:597] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.017700  6030 raft_consensus.cc:2243] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.018724  6030 raft_consensus.cc:2272] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.022397  6030 tablet_replica.cc:333] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.023411  6030 raft_consensus.cc:2243] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.024122  6030 raft_consensus.cc:2272] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.027638  6030 tablet_replica.cc:333] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.028573  6030 raft_consensus.cc:2243] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.029201  6030 raft_consensus.cc:2272] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.032047  6030 tablet_replica.cc:333] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.032835  6030 raft_consensus.cc:2243] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.033675  6030 raft_consensus.cc:2272] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:21.032780 16419 consensus_peers.cc:597] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.036635  6030 tablet_replica.cc:333] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.037508  6030 raft_consensus.cc:2243] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:21.037971 16419 consensus_peers.cc:597] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.038434  6030 raft_consensus.cc:2272] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.042289  6030 tablet_replica.cc:333] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.043340  6030 raft_consensus.cc:2243] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.044138  6030 raft_consensus.cc:2272] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.048069  6030 tablet_replica.cc:333] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.049000  6030 raft_consensus.cc:2243] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:21.050498  6030 raft_consensus.cc:2272] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:21.053105 16345 consensus_peers.cc:597] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.054234  6030 tablet_replica.cc:333] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.055141  6030 raft_consensus.cc:2243] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.055812  6030 raft_consensus.cc:2272] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:21.063786 16271 consensus_peers.cc:597] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.065260  6030 tablet_replica.cc:333] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.066220  6030 raft_consensus.cc:2243] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.066886  6030 raft_consensus.cc:2272] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:21.067991 16271 consensus_peers.cc:597] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:21.066938 16419 consensus_peers.cc:597] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:21.069581 16419 consensus_peers.cc:597] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.070080  6030 tablet_replica.cc:333] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184: stopping tablet replica
I20260709 13:18:21.070817  6030 raft_consensus.cc:2243] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:21.071998  6030 raft_consensus.cc:2272] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:21.073469 16271 consensus_peers.cc:597] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:21.098009 16271 consensus_peers.cc:597] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:21.116207 16419 consensus_peers.cc:597] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:21.119442 16345 consensus_peers.cc:597] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.153206  6030 tablet_server.cc:196] TabletServer@127.5.227.129:0 shutdown complete.
W20260709 13:18:21.159850 16419 consensus_peers.cc:597] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:21.223814 16345 consensus_peers.cc:597] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:21.236181 16419 consensus_peers.cc:597] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:21.254170 16271 consensus_peers.cc:597] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.275496  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:21.289084 17068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:21.290510 17067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:21.301194  6030 server_base.cc:1061] running on GCE node
W20260709 13:18:21.302007 17070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:21.304980  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:21.305387  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:21.305675  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603101305650 us; error 0 us; skew 500 ppm
I20260709 13:18:21.306772  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:21.314663  6030 webserver.cc:533] Webserver started at http://127.5.227.129:44797/ using document root <none> and password file <none>
I20260709 13:18:21.315475  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:21.315724  6030 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:18:21.320962  6030 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:18:21.333424 17075 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:21.334689  6030 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:18:21.335323  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-0-root
uuid: "fe046a372b6a4df982eebe83cf3ee184"
format_stamp: "Formatted at 2026-07-09 13:18:05 on dist-test-slave-tbwl"
I20260709 13:18:21.335937  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602741015013-6030-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:18:21.337000 16271 consensus_peers.cc:597] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.413631  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:21.415464  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:21.417687  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:21.423293 17083 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:18:21.804613  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:18:21.804894  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.383s	user 0.011s	sys 0.000s
I20260709 13:18:21.805259  6030 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:18:21.811242 17083 tablet_bootstrap.cc:492] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:21.827721 17083 tablet_bootstrap.cc:492] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.829061 17083 tablet_bootstrap.cc:492] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:21.829718 17083 ts_tablet_manager.cc:1403] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:18:21.833817 17083 raft_consensus.cc:359] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:21.834553 17083 raft_consensus.cc:740] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.835399 17083 consensus_queue.cc:260] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:21.838042 17083 ts_tablet_manager.cc:1434] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:21.838923 17083 tablet_bootstrap.cc:492] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:21.855634 17083 tablet_bootstrap.cc:492] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.856582 17083 tablet_bootstrap.cc:492] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:21.857416 17083 ts_tablet_manager.cc:1403] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:18:21.860041 17083 raft_consensus.cc:359] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:21.860715 17083 raft_consensus.cc:740] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.861349 17083 consensus_queue.cc:260] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:21.863183 17083 ts_tablet_manager.cc:1434] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:18:21.863981 17083 tablet_bootstrap.cc:492] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:21.876881 17083 tablet_bootstrap.cc:492] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.877691 17083 tablet_bootstrap.cc:492] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:21.878304 17083 ts_tablet_manager.cc:1403] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 13:18:21.880404 17083 raft_consensus.cc:359] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:21.881067 17083 raft_consensus.cc:740] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.881848 17083 consensus_queue.cc:260] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:21.883735 17083 ts_tablet_manager.cc:1434] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:18:21.884572 17083 tablet_bootstrap.cc:492] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:21.900197 17085 raft_consensus.cc:493] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:21.901067 17085 raft_consensus.cc:515] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:21.905027 17083 tablet_bootstrap.cc:492] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.906268 17083 tablet_bootstrap.cc:492] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:21.908959 17083 ts_tablet_manager.cc:1403] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 13:18:21.911237 17085 leader_election.cc:290] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
W20260709 13:18:21.913030 16419 leader_election.cc:336] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:21.913710 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:21.914467 17083 raft_consensus.cc:359] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:21.915428 16417 leader_election.cc:304] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:21.915331 17083 raft_consensus.cc:740] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.916256 17085 raft_consensus.cc:2749] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:21.916535 17083 consensus_queue.cc:260] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:21.918797 17083 ts_tablet_manager.cc:1434] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:18:21.919720 17083 tablet_bootstrap.cc:492] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:21.936672 17083 tablet_bootstrap.cc:492] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.937675 17083 tablet_bootstrap.cc:492] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:21.938323 17083 ts_tablet_manager.cc:1403] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:18:21.940546 17083 raft_consensus.cc:359] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:21.941244 17083 raft_consensus.cc:740] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.941123 17035 raft_consensus.cc:493] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:21.942106 17035 raft_consensus.cc:515] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:21.942313 17083 consensus_queue.cc:260] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:21.943430 17040 raft_consensus.cc:493] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:21.944017 17040 raft_consensus.cc:515] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:21.944895 17083 ts_tablet_manager.cc:1434] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:18:21.945863 17083 tablet_bootstrap.cc:492] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:21.948030 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:21.948740 16450 raft_consensus.cc:2468] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:21.952661 16268 leader_election.cc:304] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:21.954731 17086 raft_consensus.cc:2804] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:21.955144 17086 raft_consensus.cc:493] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:21.955538 17086 raft_consensus.cc:3060] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:21.946411 17040 leader_election.cc:290] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:21.963114 17040 raft_consensus.cc:493] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:21.963758 17035 leader_election.cc:290] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:21.964020 17040 raft_consensus.cc:515] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:21.965715 16370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6196aafd32f448a7964c50df2be2a4b3" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:21.967636 17085 raft_consensus.cc:493] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:21.968549 17085 raft_consensus.cc:515] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
W20260709 13:18:21.967932 16271 leader_election.cc:336] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:21.970881 16271 leader_election.cc:304] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
W20260709 13:18:21.973992 16271 leader_election.cc:336] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:21.975219 17035 raft_consensus.cc:2749] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:21.994232 16419 leader_election.cc:336] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:21.977600 17085 leader_election.cc:290] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:21.978689 17044 raft_consensus.cc:493] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:21.992334 17040 leader_election.cc:290] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:21.994336 16370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:22.000609 17044 raft_consensus.cc:515] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.003451 17044 leader_election.cc:290] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.014837 17086 raft_consensus.cc:515] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.017371 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d99e00427c045ab9f5b3c444ecf06a0" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:22.017390 17086 leader_election.cc:290] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
W20260709 13:18:22.026322 16271 leader_election.cc:336] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.027259 16417 leader_election.cc:304] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
W20260709 13:18:22.030925 16345 leader_election.cc:336] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.032014 17085 raft_consensus.cc:2749] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.034514 16271 leader_election.cc:304] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.035012 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246e5a50c75e4f0fa58538237d61e585" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:22.039700 17040 raft_consensus.cc:2749] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.041684 16343 leader_election.cc:304] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.042961 17044 raft_consensus.cc:2749] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.043042 16732 raft_consensus.cc:493] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.043776 17084 raft_consensus.cc:493] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.043717 16732 raft_consensus.cc:515] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.044353 17084 raft_consensus.cc:515] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.045815 16732 leader_election.cc:290] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.046604 17084 leader_election.cc:290] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.062399 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:22.062585 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:22.063136 16450 raft_consensus.cc:3060] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.064276 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acf3d9f73d4f38817c4ea25ba9139b" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:22.066800 16271 leader_election.cc:336] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.071604 16450 raft_consensus.cc:2468] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 2.
W20260709 13:18:22.076002 16419 leader_election.cc:336] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.078025 16268 leader_election.cc:304] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.080098 16419 leader_election.cc:304] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.080919 17084 raft_consensus.cc:2749] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.081230 17040 raft_consensus.cc:2804] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:22.081449 17083 tablet_bootstrap.cc:492] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:18:22.082216 16419 leader_election.cc:336] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.082496 17040 raft_consensus.cc:697] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:22.082865 16419 leader_election.cc:304] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.083727 17084 raft_consensus.cc:2749] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.083567 17040 consensus_queue.cc:237] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.082684 17083 tablet_bootstrap.cc:492] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:22.085435 17044 raft_consensus.cc:493] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.086066 17044 raft_consensus.cc:515] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.092754 17044 leader_election.cc:290] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.094954 17083 ts_tablet_manager.cc:1403] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.149s	user 0.051s	sys 0.047s
W20260709 13:18:22.097421 16345 leader_election.cc:336] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.099260 17083 raft_consensus.cc:359] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:22.099624 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6196aafd32f448a7964c50df2be2a4b3" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:22.100096 17083 raft_consensus.cc:740] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.100289 16305 raft_consensus.cc:2468] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:22.101006 17083 consensus_queue.cc:260] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:22.101532 16343 leader_election.cc:304] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.102372 17044 raft_consensus.cc:2804] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.102799 17044 raft_consensus.cc:493] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.103149 17044 raft_consensus.cc:3060] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.103372 17083 ts_tablet_manager.cc:1434] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:22.104473 17083 tablet_bootstrap.cc:492] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:22.112004 17044 raft_consensus.cc:515] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.112447 17033 raft_consensus.cc:493] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.113125 17033 raft_consensus.cc:515] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.113541  6030 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:18:22.113916  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.309s	user 0.296s	sys 0.006s
I20260709 13:18:22.115533 17033 leader_election.cc:290] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:22.112605 17086 raft_consensus.cc:493] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.120759 17086 raft_consensus.cc:515] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.118288 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:22.127023 16345 leader_election.cc:336] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.127271 17086 leader_election.cc:290] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:22.127959 16345 leader_election.cc:304] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.129091 17087 raft_consensus.cc:2749] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:22.129616 16271 leader_election.cc:336] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.134029 17083 tablet_bootstrap.cc:492] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:22.134653 16372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b93db33f164564bbded82c6ca74a3a" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:22.135612 17083 tablet_bootstrap.cc:492] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:22.136529 17083 ts_tablet_manager.cc:1403] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.002s
I20260709 13:18:22.137795 17094 raft_consensus.cc:493] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.138599 17094 raft_consensus.cc:515] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.141664 17083 raft_consensus.cc:359] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.142555 17083 raft_consensus.cc:740] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.143802 17044 leader_election.cc:290] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.143368 17083 consensus_queue.cc:260] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.147302 17083 ts_tablet_manager.cc:1434] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:18:22.147763 16269 leader_election.cc:304] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
W20260709 13:18:22.149703 16345 leader_election.cc:336] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.150779 17040 raft_consensus.cc:2749] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.156152 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acf3d9f73d4f38817c4ea25ba9139b" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:22.157223 16452 raft_consensus.cc:2468] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:22.151988 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6196aafd32f448a7964c50df2be2a4b3" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:22.157555 17094 leader_election.cc:290] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:22.158990 16305 raft_consensus.cc:3060] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.159348 17094 raft_consensus.cc:493] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.159914 17094 raft_consensus.cc:515] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.159006 16268 leader_election.cc:304] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:22.148219 17083 tablet_bootstrap.cc:492] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:22.168587 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
W20260709 13:18:22.169731 16271 leader_election.cc:336] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.173774 17035 raft_consensus.cc:2804] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.174185 17035 raft_consensus.cc:493] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.174579 17035 raft_consensus.cc:3060] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.176757 17080 raft_consensus.cc:493] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.177440 17080 raft_consensus.cc:515] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.180424 17080 leader_election.cc:290] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:22.185700 17087 raft_consensus.cc:493] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.186506 17087 raft_consensus.cc:515] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.189270 17087 leader_election.cc:290] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
W20260709 13:18:22.189816 16271 leader_election.cc:336] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.190308 17083 tablet_bootstrap.cc:492] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:22.191586 17083 tablet_bootstrap.cc:492] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:22.192301 17083 ts_tablet_manager.cc:1403] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.007s
W20260709 13:18:22.193884 16345 leader_election.cc:336] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.195974 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:22.196672 16304 raft_consensus.cc:2468] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:22.153427 16128 catalog_manager.cc:5697] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 2 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.195039 17083 raft_consensus.cc:359] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:22.197781 17083 raft_consensus.cc:740] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.169764 16452 raft_consensus.cc:2468] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
W20260709 13:18:22.196853 16271 leader_election.cc:336] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.199048 17083 consensus_queue.cc:260] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:22.198342 17035 raft_consensus.cc:515] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.200829 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d99e00427c045ab9f5b3c444ecf06a0" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:22.201524 16452 raft_consensus.cc:2468] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:22.201849 17083 ts_tablet_manager.cc:1434] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:18:22.202922 17083 tablet_bootstrap.cc:492] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:22.202992 16343 leader_election.cc:304] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.203495 16268 leader_election.cc:304] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.204636 17044 raft_consensus.cc:2804] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.205058 17044 raft_consensus.cc:493] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.205631 17044 raft_consensus.cc:3060] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.205997 17086 raft_consensus.cc:2804] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.206447 17086 raft_consensus.cc:493] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.206831 17086 raft_consensus.cc:3060] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:22.207566 16271 leader_election.cc:336] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.208186 17033 raft_consensus.cc:493] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.208389 17035 leader_election.cc:290] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:22.208773 17033 raft_consensus.cc:515] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.205142 16268 leader_election.cc:304] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.211143 17040 raft_consensus.cc:2804] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.211534 17040 raft_consensus.cc:493] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.211907 17040 raft_consensus.cc:3060] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.211827 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6acf3d9f73d4f38817c4ea25ba9139b" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:22.212616 16452 raft_consensus.cc:3060] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.162003 17094 leader_election.cc:290] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
W20260709 13:18:22.219252 16345 leader_election.cc:336] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.221966 17033 leader_election.cc:290] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.225463 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0799b6996943f9b0b9093d073d6dbd" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:22.244810 17084 raft_consensus.cc:493] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.246884 17084 raft_consensus.cc:515] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.249238 17084 leader_election.cc:290] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.251674 16343 leader_election.cc:304] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.253003 17033 raft_consensus.cc:2749] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.253496 16300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:22.254293 17094 raft_consensus.cc:493] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.254870 17094 raft_consensus.cc:515] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.257021 17094 leader_election.cc:290] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
W20260709 13:18:22.258811 16419 leader_election.cc:336] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.259389 16372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:22.260143 16372 raft_consensus.cc:2468] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:22.261467 17044 raft_consensus.cc:515] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.263541 16269 leader_election.cc:304] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:22.264230 17044 leader_election.cc:290] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.259408 16419 leader_election.cc:304] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.258811 17083 tablet_bootstrap.cc:492] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:22.265341 17080 raft_consensus.cc:2804] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.265856 17084 raft_consensus.cc:2749] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.266417 17083 tablet_bootstrap.cc:492] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:22.266986 16305 raft_consensus.cc:2468] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 2.
I20260709 13:18:22.267308 17083 ts_tablet_manager.cc:1403] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.012s
I20260709 13:18:22.265931 17080 raft_consensus.cc:493] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.271689 17080 raft_consensus.cc:3060] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.274156 17083 raft_consensus.cc:359] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.275063 17083 raft_consensus.cc:740] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.275923 17083 consensus_queue.cc:260] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.278554 17040 raft_consensus.cc:515] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.280654 17083 ts_tablet_manager.cc:1434] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:22.281877 17083 tablet_bootstrap.cc:492] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:22.282095 17040 leader_election.cc:290] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:22.293294 17040 raft_consensus.cc:493] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.294492 17040 raft_consensus.cc:515] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.284471 16452 raft_consensus.cc:2468] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 2.
I20260709 13:18:22.298045 16300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:22.298768 16343 leader_election.cc:304] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.298839 16300 raft_consensus.cc:3060] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.299269 17040 leader_election.cc:290] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:22.305641 17044 raft_consensus.cc:2804] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:22.306295 17044 raft_consensus.cc:697] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:22.307190 17044 consensus_queue.cc:237] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.308024 16300 raft_consensus.cc:2468] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 2.
I20260709 13:18:22.313102 17033 raft_consensus.cc:493] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.314023 17033 raft_consensus.cc:515] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:22.318703 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0408e10512d4613a6250d70072ab152" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:22.319732 17033 leader_election.cc:290] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:22.336750 16371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0799b6996943f9b0b9093d073d6dbd" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:22.337663 16371 raft_consensus.cc:2468] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
W20260709 13:18:22.321498 16271 leader_election.cc:336] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.344758 16268 leader_election.cc:304] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.345649 17094 raft_consensus.cc:2804] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:22.346174 17094 raft_consensus.cc:697] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:22.347067 17094 consensus_queue.cc:237] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.320161 17086 raft_consensus.cc:515] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.359066 16343 leader_election.cc:304] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:22.360872 17044 raft_consensus.cc:2804] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:22.358266 17040 raft_consensus.cc:493] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.362067 17040 raft_consensus.cc:515] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.367797 17040 leader_election.cc:290] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:22.368544 17044 raft_consensus.cc:697] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:22.363828 17035 raft_consensus.cc:493] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.370291 17044 consensus_queue.cc:237] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.371255 17035 raft_consensus.cc:515] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.373415 17035 leader_election.cc:290] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:22.323588 17080 raft_consensus.cc:515] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.327191 16732 raft_consensus.cc:493] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.329861 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d99e00427c045ab9f5b3c444ecf06a0" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:22.375365 16732 raft_consensus.cc:515] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:22.375490 16452 raft_consensus.cc:3060] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.379065 16732 leader_election.cc:290] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:22.382302 17086 leader_election.cc:290] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:22.385308 17080 leader_election.cc:290] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
W20260709 13:18:22.391916 16271 leader_election.cc:336] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
W20260709 13:18:22.399169 16419 leader_election.cc:336] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
W20260709 13:18:22.399734 16271 leader_election.cc:336] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
W20260709 13:18:22.405869 16345 leader_election.cc:336] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.405767 16452 raft_consensus.cc:2468] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 2.
I20260709 13:18:22.414963 17083 tablet_bootstrap.cc:492] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:22.416997 17083 tablet_bootstrap.cc:492] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:22.415673 16452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:22.420432 16452 raft_consensus.cc:2468] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:22.420764 17084 raft_consensus.cc:493] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.421680 17083 ts_tablet_manager.cc:1403] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.140s	user 0.019s	sys 0.009s
I20260709 13:18:22.421355 17084 raft_consensus.cc:515] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.423736 17094 raft_consensus.cc:493] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.424578 17094 raft_consensus.cc:515] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.423980 17084 leader_election.cc:290] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.424685 17083 raft_consensus.cc:359] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.425573 17083 raft_consensus.cc:740] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.426808 17094 leader_election.cc:290] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:22.427914 17083 consensus_queue.cc:260] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.429134 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
W20260709 13:18:22.429404 16271 leader_election.cc:336] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.429849 16450 raft_consensus.cc:3060] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.430399 17083 ts_tablet_manager.cc:1434] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:22.431376 17083 tablet_bootstrap.cc:492] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
W20260709 13:18:22.433122 16271 leader_election.cc:336] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
W20260709 13:18:22.433809 16271 leader_election.cc:336] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
W20260709 13:18:22.434988 16271 leader_election.cc:336] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
W20260709 13:18:22.440510 16345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 81448.3us
I20260709 13:18:22.443117 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84888dc6b86747d6b08b125a8df5394c" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:22.443885 16305 raft_consensus.cc:2468] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:22.445971 16268 leader_election.cc:304] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.447443 16124 catalog_manager.cc:5697] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 2 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.452446 16450 raft_consensus.cc:2468] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 2.
I20260709 13:18:22.454456 17083 tablet_bootstrap.cc:492] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:22.455591 17083 tablet_bootstrap.cc:492] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:22.456300 17083 ts_tablet_manager.cc:1403] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 13:18:22.457324 16128 catalog_manager.cc:5697] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 2 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.459064 17083 raft_consensus.cc:359] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.459834 17083 raft_consensus.cc:740] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.460784 17083 consensus_queue.cc:260] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.461925 16269 leader_election.cc:304] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.463295 17083 ts_tablet_manager.cc:1434] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:18:22.464228 17083 tablet_bootstrap.cc:492] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:22.465029 17080 raft_consensus.cc:2804] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.465548 17080 raft_consensus.cc:493] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.465936 17080 raft_consensus.cc:3060] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.469132 16417 leader_election.cc:304] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:22.470825 16732 raft_consensus.cc:2804] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.471302 16732 raft_consensus.cc:493] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.471717 16732 raft_consensus.cc:3060] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.476330 17086 raft_consensus.cc:2804] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:22.476990 17086 raft_consensus.cc:697] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:22.477947 17086 consensus_queue.cc:237] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.479343 17080 raft_consensus.cc:515] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.481719 17080 leader_election.cc:290] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:22.487576 17044 raft_consensus.cc:493] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.488384 17044 raft_consensus.cc:515] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.489689 17083 tablet_bootstrap.cc:492] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:22.490926 17083 tablet_bootstrap.cc:492] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:22.491669 17083 ts_tablet_manager.cc:1403] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
W20260709 13:18:22.493783 16268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 47897.9us
I20260709 13:18:22.494688 17044 leader_election.cc:290] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.494556 17083 raft_consensus.cc:359] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.495529 17083 raft_consensus.cc:740] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.494576 16268 leader_election.cc:304] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.498255 17086 raft_consensus.cc:2804] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.498720 16370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0408e10512d4613a6250d70072ab152" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:22.498941 17086 raft_consensus.cc:493] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.499533 17086 raft_consensus.cc:3060] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.499454 16370 raft_consensus.cc:2468] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 1.
I20260709 13:18:22.497828 16268 leader_election.cc:304] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.499462 17083 consensus_queue.cc:260] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.502543 17083 ts_tablet_manager.cc:1434] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:18:22.503471 17083 tablet_bootstrap.cc:492] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
W20260709 13:18:22.507277 16419 leader_election.cc:336] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.508342 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b93db33f164564bbded82c6ca74a3a" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:22.509076 16305 raft_consensus.cc:2468] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 1.
I20260709 13:18:22.509228 17113 raft_consensus.cc:2804] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:22.508522 17086 raft_consensus.cc:515] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.510119 16343 leader_election.cc:304] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
W20260709 13:18:22.513689 16271 leader_election.cc:336] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.508597 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84888dc6b86747d6b08b125a8df5394c" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:22.516232 17033 raft_consensus.cc:2804] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.521785 17033 raft_consensus.cc:493] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.522367 17033 raft_consensus.cc:3060] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.516810 17086 leader_election.cc:290] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
W20260709 13:18:22.527381 16271 leader_election.cc:336] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.521800 16124 catalog_manager.cc:5697] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 2 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:22.535621 16345 leader_election.cc:336] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.536206 16345 leader_election.cc:304] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.538709 16732 raft_consensus.cc:515] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
W20260709 13:18:22.536583 16271 leader_election.cc:336] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.539916 16450 raft_consensus.cc:2393] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35e0de78970041afb173662b1c34598e in current term 2: Already voted for candidate 0763e17c84d248738dade73ded2c5f71 in this term.
I20260709 13:18:22.544667 17033 raft_consensus.cc:515] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.512163 17113 raft_consensus.cc:697] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:22.546855 17113 consensus_queue.cc:237] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.551378 16732 leader_election.cc:290] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.555091 16448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:22.556012 16448 raft_consensus.cc:3060] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.556926 17083 tablet_bootstrap.cc:492] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:22.556046 17044 raft_consensus.cc:2749] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.557987 17083 tablet_bootstrap.cc:492] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:22.558722 16268 leader_election.cc:304] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35e0de78970041afb173662b1c34598e; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.559585 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84888dc6b86747d6b08b125a8df5394c" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:22.559787 16417 leader_election.cc:304] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.560118 17080 raft_consensus.cc:3060] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:22.560418 16271 consensus_peers.cc:597] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.560997 17084 raft_consensus.cc:2804] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.561460 17084 raft_consensus.cc:493] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.561846 17084 raft_consensus.cc:3060] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.562271 17083 ts_tablet_manager.cc:1403] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.059s	user 0.023s	sys 0.019s
I20260709 13:18:22.567813 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48b93db33f164564bbded82c6ca74a3a" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:22.568559 16304 raft_consensus.cc:3060] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.568632 17033 leader_election.cc:290] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:22.572882 17080 raft_consensus.cc:2749] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:22.581372 16448 raft_consensus.cc:2468] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 2.
I20260709 13:18:22.584090 16268 leader_election.cc:304] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.565295 17083 raft_consensus.cc:359] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.585891 17083 raft_consensus.cc:740] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.586679 16304 raft_consensus.cc:2468] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 2.
I20260709 13:18:22.587393 16305 raft_consensus.cc:2468] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 2.
I20260709 13:18:22.595444 16372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246e5a50c75e4f0fa58538237d61e585" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:22.596501 16372 raft_consensus.cc:2468] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 1.
I20260709 13:18:22.598802 16372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:22.600152 16372 raft_consensus.cc:3060] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.587644 17080 raft_consensus.cc:2804] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:22.604635 17080 raft_consensus.cc:697] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:22.588908 17084 raft_consensus.cc:515] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:22.586683 17083 consensus_queue.cc:260] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
W20260709 13:18:22.592531 16419 leader_election.cc:336] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.603202 16343 leader_election.cc:304] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:22.611361 17033 raft_consensus.cc:2804] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:22.611847 16371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0799b6996943f9b0b9093d073d6dbd" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:22.611860 16417 leader_election.cc:304] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.612468 17083 ts_tablet_manager.cc:1434] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:18:22.612617 16371 raft_consensus.cc:3060] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.613402 17083 tablet_bootstrap.cc:492] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:22.613284 16732 raft_consensus.cc:2804] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:22.614687 16732 raft_consensus.cc:697] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 2 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:22.612659 17033 raft_consensus.cc:697] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:22.615859 16732 consensus_queue.cc:237] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.616426 17033 consensus_queue.cc:237] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.608997 17080 consensus_queue.cc:237] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.643169 16448 raft_consensus.cc:1275] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer 35e0de78970041afb173662b1c34598e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:22.642360 17084 leader_election.cc:290] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:22.654562 16269 leader_election.cc:304] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.666610 17035 raft_consensus.cc:2804] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.661062 17086 consensus_queue.cc:1048] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 13:18:22.726286 16269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 62218.6us
I20260709 13:18:22.694204 17035 raft_consensus.cc:493] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:22.729375 17035 raft_consensus.cc:3060] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.763182 16372 raft_consensus.cc:2468] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 2.
I20260709 13:18:22.771957 16371 raft_consensus.cc:2468] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 2.
W20260709 13:18:22.787974 16345 leader_election.cc:336] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
W20260709 13:18:22.790337 16419 leader_election.cc:336] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.793286 17083 tablet_bootstrap.cc:492] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:22.795002 16269 leader_election.cc:304] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.803877 17083 tablet_bootstrap.cc:492] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:22.805157 17083 ts_tablet_manager.cc:1403] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.192s	user 0.029s	sys 0.004s
I20260709 13:18:22.813055 17094 raft_consensus.cc:2804] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:22.813455 16269 leader_election.cc:304] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:22.813665 17094 raft_consensus.cc:697] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:22.813841 16374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0408e10512d4613a6250d70072ab152" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:22.814541 16374 raft_consensus.cc:3060] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.814677 17094 consensus_queue.cc:237] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.815387 17138 raft_consensus.cc:2804] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:22.817499 17138 raft_consensus.cc:697] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:22.818758 17138 consensus_queue.cc:237] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.820859 16124 catalog_manager.cc:5697] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:22.812575 16345 leader_election.cc:336] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:22.835335 16128 catalog_manager.cc:5697] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 2 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.837450 16128 catalog_manager.cc:5697] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 2 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:22.844120 16343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 49371.7us
W20260709 13:18:22.848762 16417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 72793.6us
I20260709 13:18:22.861580 17035 raft_consensus.cc:515] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:22.877954 17083 raft_consensus.cc:359] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.880777 17083 raft_consensus.cc:740] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.881615 17083 consensus_queue.cc:260] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:22.949769 17083 ts_tablet_manager.cc:1434] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.144s	user 0.007s	sys 0.022s
I20260709 13:18:22.961977 16447 raft_consensus.cc:1275] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer 35e0de78970041afb173662b1c34598e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:22.963017 17035 leader_election.cc:290] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Requested vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:22.959831 16374 raft_consensus.cc:2468] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 2.
I20260709 13:18:23.024111 17083 tablet_bootstrap.cc:492] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:23.071165 16374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246e5a50c75e4f0fa58538237d61e585" candidate_uuid: "35e0de78970041afb173662b1c34598e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:23.093107 16374 raft_consensus.cc:3060] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:23.101207 16417 leader_election.cc:304] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c; no voters: fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:23.107990 16374 raft_consensus.cc:2468] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35e0de78970041afb173662b1c34598e in term 2.
I20260709 13:18:23.119939 16124 catalog_manager.cc:5697] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 2 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:23.132786 16732 raft_consensus.cc:2804] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:23.133013 16417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 60476.2us
I20260709 13:18:23.133525 16732 raft_consensus.cc:697] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 2 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:23.134572 16732 consensus_queue.cc:237] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
W20260709 13:18:23.139674 16345 consensus_peers.cc:597] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.140250 16345 consensus_peers.cc:597] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:23.141916 16269 leader_election.cc:304] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:23.079699 17094 consensus_queue.cc:1048] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:18:23.145915 17131 raft_consensus.cc:2804] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:23.166536 16125 catalog_manager.cc:5697] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 2 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:23.176935 17089 raft_consensus.cc:493] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.179023 17089 raft_consensus.cc:515] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
W20260709 13:18:23.182606 16271 leader_election.cc:336] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:23.176138 17131 raft_consensus.cc:697] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Leader. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:23.190325 16451 raft_consensus.cc:1275] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer 35e0de78970041afb173662b1c34598e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:23.178061 16125 catalog_manager.cc:5697] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 2 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.189114 17131 consensus_queue.cc:237] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:23.226696 17089 leader_election.cc:290] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:23.205878 16125 catalog_manager.cc:5697] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 2 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:23.234742 16345 consensus_peers.cc:597] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.235406 16271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 51931.8us
I20260709 13:18:23.240806 17083 tablet_bootstrap.cc:492] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:23.240639 17163 raft_consensus.cc:493] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.242863 16343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 371564us
W20260709 13:18:23.245767 16417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 44487.7us
W20260709 13:18:23.279613 16345 consensus_peers.cc:597] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:23.285164 17083 tablet_bootstrap.cc:492] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:23.286111 17083 ts_tablet_manager.cc:1403] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.336s	user 0.025s	sys 0.003s
I20260709 13:18:23.301338 16300 raft_consensus.cc:1275] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer 0c736bf768804f2e86a875366c12a71c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:23.298290 17083 raft_consensus.cc:359] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:23.304406 17083 raft_consensus.cc:740] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.305290 17083 consensus_queue.cc:260] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:23.318404 17083 ts_tablet_manager.cc:1434] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:18:23.266155 17163 raft_consensus.cc:515] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:23.320930 16305 raft_consensus.cc:1275] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer 0c736bf768804f2e86a875366c12a71c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:23.322579 17083 tablet_bootstrap.cc:492] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:23.320895 16124 catalog_manager.cc:5697] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:23.322705 16271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 66178.7us
W20260709 13:18:23.326507 16345 consensus_peers.cc:597] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:23.337472 16345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 57273.1us
I20260709 13:18:23.339905 17156 consensus_queue.cc:1048] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:23.362807 16450 raft_consensus.cc:1275] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer 35e0de78970041afb173662b1c34598e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:23.363961 16419 consensus_peers.cc:597] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:23.334789 17040 consensus_queue.cc:1048] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:23.385370 16451 raft_consensus.cc:1275] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer 35e0de78970041afb173662b1c34598e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:23.339167 17132 consensus_queue.cc:1048] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:18:23.389094 16342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 47225.5us
I20260709 13:18:23.392633 16305 raft_consensus.cc:1275] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer 0c736bf768804f2e86a875366c12a71c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:23.388784 17089 raft_consensus.cc:493] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.396055 17089 raft_consensus.cc:515] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:23.398305 17044 consensus_queue.cc:1048] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:18:23.404112 17089 leader_election.cc:290] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:23.394963 17094 consensus_queue.cc:1048] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:18:23.434551 16125 catalog_manager.cc:5697] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e reported cstate change: term changed from 1 to 2, leader changed from fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129) to 35e0de78970041afb173662b1c34598e (127.5.227.130). New cstate: current_term: 2 leader_uuid: "35e0de78970041afb173662b1c34598e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.457605 17174 consensus_queue.cc:1048] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:18:23.435361 17089 raft_consensus.cc:493] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.517784 16268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 46038.3us
I20260709 13:18:23.496090 17089 raft_consensus.cc:515] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
W20260709 13:18:23.555142 16271 consensus_peers.cc:597] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.558789 16271 consensus_peers.cc:597] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:23.536936 17163 leader_election.cc:290] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
W20260709 13:18:23.576638 16268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 57916.9us
I20260709 13:18:23.605765 16298 raft_consensus.cc:1275] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer 0763e17c84d248738dade73ded2c5f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:23.600003 17163 raft_consensus.cc:493] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.620241 17182 raft_consensus.cc:493] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.626077 16271 consensus_peers.cc:597] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.626797 16271 consensus_peers.cc:597] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.627197 16271 consensus_peers.cc:597] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:23.627518 16271 consensus_peers.cc:597] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:23.627832 16271 consensus_peers.cc:597] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:23.631968 16375 raft_consensus.cc:1275] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer 35e0de78970041afb173662b1c34598e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:23.636260 16345 consensus_peers.cc:597] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:23.636953 16345 consensus_peers.cc:597] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:23.642899 17083 tablet_bootstrap.cc:492] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:23.650476 17135 consensus_queue.cc:1048] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:23.653949 17083 tablet_bootstrap.cc:492] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:23.655992 17083 ts_tablet_manager.cc:1403] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.337s	user 0.031s	sys 0.008s
I20260709 13:18:23.661471 16375 raft_consensus.cc:1275] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer 35e0de78970041afb173662b1c34598e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:23.668776 17083 raft_consensus.cc:359] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:23.670652 17083 raft_consensus.cc:740] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.672416 17083 consensus_queue.cc:260] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:23.620862 17163 raft_consensus.cc:515] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:23.641235 17089 leader_election.cc:290] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
W20260709 13:18:23.708235 16271 consensus_peers.cc:597] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:23.628046 17182 raft_consensus.cc:515] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:23.708209 17089 raft_consensus.cc:493] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.779583 16269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 53666.1us
W20260709 13:18:23.816257 17189 log.cc:927] Time spent T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:23.817510 17163 leader_election.cc:290] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:23.818351 17163 raft_consensus.cc:493] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.818935 17163 raft_consensus.cc:515] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:23.821333 17163 leader_election.cc:290] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:23.791726 17135 consensus_queue.cc:1048] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:18:23.829324 17182 leader_election.cc:290] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
W20260709 13:18:23.830757 17191 log.cc:927] Time spent T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:18:23.833719 16419 consensus_peers.cc:597] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:23.752069 17089 raft_consensus.cc:515] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:23.838608 17089 leader_election.cc:290] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:23.851442 17083 ts_tablet_manager.cc:1434] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.194s	user 0.021s	sys 0.024s
I20260709 13:18:23.897153 17083 tablet_bootstrap.cc:492] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:23.913525 16445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
W20260709 13:18:23.917387 16417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 212334us
I20260709 13:18:23.928071 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:23.936403 16448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:23.949515 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d2386a536042dcb0271fdc91474697" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:23.985582 16301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295c483df4e74d1a8314d5219167cc16" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:23.993566 16373 raft_consensus.cc:1275] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer 35e0de78970041afb173662b1c34598e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:23.970750 16445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:23.996726 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029ee74f09f8428c81f8feae77fd8e84" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:24.016782 16417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 86349us
I20260709 13:18:24.037442 17152 consensus_queue.cc:1048] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 13:18:24.046150 16446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:24.020280 17136 consensus_queue.cc:1048] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:18:24.057112 17196 log.cc:927] Time spent T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:18:24.043421 17198 raft_consensus.cc:493] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.058215 17198 raft_consensus.cc:515] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:24.060645 17198 leader_election.cc:290] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
W20260709 13:18:24.101698 16269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 80807.4us
I20260709 13:18:24.018528 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506096b267e14e6f8e28c082062c6481" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
W20260709 13:18:24.109851 16271 consensus_peers.cc:597] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:24.116981 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246e5a50c75e4f0fa58538237d61e585" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:24.124243 16448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:24.014684 17077 leader_election.cc:304] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
W20260709 13:18:24.140028 17077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:42747, user_credentials={real_user=slave}} blocked reactor thread for 133231us
I20260709 13:18:24.144260 17077 leader_election.cc:304] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:24.156482 16373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
W20260709 13:18:24.177798 16345 consensus_peers.cc:597] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:24.179024 17076 leader_election.cc:304] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:24.195343 17089 raft_consensus.cc:2749] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.196902 17197 raft_consensus.cc:493] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.196830 17182 raft_consensus.cc:2749] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.207401 16370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029ee74f09f8428c81f8feae77fd8e84" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:24.208524 17163 raft_consensus.cc:493] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.209698 16379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "246e5a50c75e4f0fa58538237d61e585" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:24.209540 17163 raft_consensus.cc:515] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:24.211496 16374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d2386a536042dcb0271fdc91474697" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:24.213315 17198 raft_consensus.cc:2749] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.197407 17089 raft_consensus.cc:493] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.216444 17089 raft_consensus.cc:515] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:24.198453 17077 leader_election.cc:304] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:24.225363 17182 raft_consensus.cc:2749] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:24.216805 16417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 171517us
I20260709 13:18:24.226879 17089 leader_election.cc:290] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:24.233080 17163 leader_election.cc:290] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:24.242451 17163 raft_consensus.cc:493] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.244843 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d99e00427c045ab9f5b3c444ecf06a0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:24.243268 17163 raft_consensus.cc:515] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:24.247360 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38373beeca944c692d0895d25f56ad8" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:24.249336 17077 leader_election.cc:304] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:24.198367 17197 raft_consensus.cc:515] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:24.252802 17077 leader_election.cc:304] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:24.254168 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8b6cdc63734f54b3ebb138b4e0b94c" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:24.257263 16374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8b6cdc63734f54b3ebb138b4e0b94c" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:24.254258 17197 leader_election.cc:290] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:24.263262 17163 leader_election.cc:290] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:24.264362 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:24.271540 17182 raft_consensus.cc:2749] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.272719 17182 raft_consensus.cc:2749] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.276057 17077 leader_election.cc:304] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
W20260709 13:18:24.277081 16419 consensus_peers.cc:597] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:24.277675 17089 raft_consensus.cc:2749] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.283435 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:24.283834 17077 leader_election.cc:304] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
W20260709 13:18:24.277921 16419 consensus_peers.cc:597] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.288751 16419 consensus_peers.cc:597] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:24.288859 17089 raft_consensus.cc:2749] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:24.291649 16419 consensus_peers.cc:597] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.292563 16419 consensus_peers.cc:597] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.312465 16345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:36859, user_credentials={real_user=slave}} blocked reactor thread for 97354.9us
I20260709 13:18:24.331120 17083 tablet_bootstrap.cc:492] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:24.331342 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86655b05b814b00bcf81c0da904bdaf" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:24.332556 17083 tablet_bootstrap.cc:492] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:24.333019 17077 leader_election.cc:304] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:24.333611 17083 ts_tablet_manager.cc:1403] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.478s	user 0.031s	sys 0.017s
I20260709 13:18:24.333422 16451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d99e00427c045ab9f5b3c444ecf06a0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:24.334579 17089 raft_consensus.cc:2749] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.334784 16448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38373beeca944c692d0895d25f56ad8" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:24.336323 16374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b562a19c9d1947508c77a1a946dc873b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:24.346812 17077 leader_election.cc:304] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:24.348387 17089 raft_consensus.cc:2749] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.334873 16371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b86655b05b814b00bcf81c0da904bdaf" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
W20260709 13:18:24.349851 16345 consensus_peers.cc:597] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.340857 16419 consensus_peers.cc:597] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.350720 16345 consensus_peers.cc:597] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.350937 16419 consensus_peers.cc:597] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:24.352500 16419 consensus_peers.cc:597] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.376578 16419 consensus_peers.cc:597] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:24.377763 17083 raft_consensus.cc:359] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:24.382736 17083 raft_consensus.cc:740] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.383654 17083 consensus_queue.cc:260] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:24.383905 17076 leader_election.cc:304] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:24.392359 17163 raft_consensus.cc:2749] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.392257 17076 leader_election.cc:304] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:24.394001 17163 raft_consensus.cc:2749] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.454563 17083 ts_tablet_manager.cc:1434] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.100s	user 0.011s	sys 0.000s
I20260709 13:18:24.456483 17083 tablet_bootstrap.cc:492] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:24.475510 16379 raft_consensus.cc:1275] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer 0763e17c84d248738dade73ded2c5f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:24.515018 17076 leader_election.cc:304] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
I20260709 13:18:24.516464 17089 raft_consensus.cc:2749] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:24.519147 16419 consensus_peers.cc:597] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.528267 16419 consensus_peers.cc:597] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.530994 16419 consensus_peers.cc:597] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.536991 16271 consensus_peers.cc:597] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.570431 16271 consensus_peers.cc:597] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.574137 16271 consensus_peers.cc:597] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.576529 16271 consensus_peers.cc:597] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.583417 16271 consensus_peers.cc:597] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.586699 16271 consensus_peers.cc:597] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:24.590848 17142 consensus_queue.cc:1048] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:24.600481 17089 raft_consensus.cc:493] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.601312 17089 raft_consensus.cc:515] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:24.605756 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:24.605827 17089 leader_election.cc:290] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:24.606320 16446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
W20260709 13:18:24.614867 17223 log.cc:927] Time spent T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:18:24.624270 17076 leader_election.cc:304] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e
W20260709 13:18:24.622125 16271 consensus_peers.cc:597] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.648661 16271 consensus_peers.cc:597] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:24.649219 16271 consensus_peers.cc:597] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:24.650007 17163 raft_consensus.cc:2749] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:24.650048 17089 raft_consensus.cc:493] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.655982 17089 raft_consensus.cc:515] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
W20260709 13:18:24.657825 16419 consensus_peers.cc:597] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:24.674135 16371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8997dd86a5ac421ba825e30c817e3ceb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:24.708021 17089 leader_election.cc:290] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:24.765468 16449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8997dd86a5ac421ba825e30c817e3ceb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:24.778294 17076 leader_election.cc:304] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0763e17c84d248738dade73ded2c5f71, 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:24.779546 17083 tablet_bootstrap.cc:492] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:24.779982 17089 raft_consensus.cc:2749] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.780741 17083 tablet_bootstrap.cc:492] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:24.781770 17083 ts_tablet_manager.cc:1403] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.326s	user 0.046s	sys 0.054s
I20260709 13:18:24.784940 17083 raft_consensus.cc:359] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:24.785712 17083 raft_consensus.cc:740] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.796172 17083 consensus_queue.cc:260] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:24.805701 17083 ts_tablet_manager.cc:1434] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:18:24.806836 17083 tablet_bootstrap.cc:492] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:24.879644 17083 tablet_bootstrap.cc:492] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:24.881016 17083 tablet_bootstrap.cc:492] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:24.882341 17083 ts_tablet_manager.cc:1403] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.076s	user 0.027s	sys 0.017s
I20260709 13:18:24.886000 17083 raft_consensus.cc:359] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:24.886823 17083 raft_consensus.cc:740] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.887573 17083 consensus_queue.cc:260] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
W20260709 13:18:24.888595 16271 consensus_peers.cc:597] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:24.890583 17083 ts_tablet_manager.cc:1434] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:18:24.891825 17083 tablet_bootstrap.cc:492] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:24.948729 17083 tablet_bootstrap.cc:492] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:24.949872 17083 tablet_bootstrap.cc:492] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:24.950696 17083 ts_tablet_manager.cc:1403] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.022s
I20260709 13:18:24.956913 17083 raft_consensus.cc:359] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:24.958236 17083 raft_consensus.cc:740] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.959259 17083 consensus_queue.cc:260] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:24.962250 17083 ts_tablet_manager.cc:1434] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:18:24.963315 17083 tablet_bootstrap.cc:492] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.005157 17083 tablet_bootstrap.cc:492] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.006157 17083 tablet_bootstrap.cc:492] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.006887 17083 ts_tablet_manager.cc:1403] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.018s
I20260709 13:18:25.043270 17083 raft_consensus.cc:359] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.044817 17083 raft_consensus.cc:740] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.056272 17083 consensus_queue.cc:260] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.069123 17083 ts_tablet_manager.cc:1434] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 13:18:25.070176 17083 tablet_bootstrap.cc:492] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.091023 17083 tablet_bootstrap.cc:492] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.092227 17083 tablet_bootstrap.cc:492] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.092911 17083 ts_tablet_manager.cc:1403] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 13:18:25.093911 17089 raft_consensus.cc:493] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.094561 17089 raft_consensus.cc:515] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.096843 17089 leader_election.cc:290] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:25.098987 16374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c736bf768804f2e86a875366c12a71c" is_pre_election: true
I20260709 13:18:25.101586 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35e0de78970041afb173662b1c34598e" is_pre_election: true
I20260709 13:18:25.101773 17083 raft_consensus.cc:359] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.106225 17083 raft_consensus.cc:740] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.107105 17083 consensus_queue.cc:260] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.120589 17077 leader_election.cc:304] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe046a372b6a4df982eebe83cf3ee184; no voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e
I20260709 13:18:25.127976 17163 raft_consensus.cc:2749] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:25.150591 17083 ts_tablet_manager.cc:1434] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.057s	user 0.017s	sys 0.025s
I20260709 13:18:25.151963 17083 tablet_bootstrap.cc:492] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.177124 17083 tablet_bootstrap.cc:492] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.178233 17083 tablet_bootstrap.cc:492] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.179235 17083 ts_tablet_manager.cc:1403] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 13:18:25.182302 17083 raft_consensus.cc:359] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.183120 17083 raft_consensus.cc:740] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.183889 17083 consensus_queue.cc:260] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.186110 17083 ts_tablet_manager.cc:1434] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:25.187119 17083 tablet_bootstrap.cc:492] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.208593 17083 tablet_bootstrap.cc:492] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.209805 17083 tablet_bootstrap.cc:492] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.210582 17083 ts_tablet_manager.cc:1403] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:18:25.215056 17083 raft_consensus.cc:359] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.216007 17083 raft_consensus.cc:740] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.216948 17083 consensus_queue.cc:260] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.219321 17264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.129:36859 every 8 connection(s)
I20260709 13:18:25.219600 17083 ts_tablet_manager.cc:1434] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:25.219818  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.129:36859
I20260709 13:18:25.220687 17083 tablet_bootstrap.cc:492] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.254108 17083 tablet_bootstrap.cc:492] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.255400 17083 tablet_bootstrap.cc:492] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.256312 17083 ts_tablet_manager.cc:1403] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.007s
I20260709 13:18:25.264354 17224 raft_consensus.cc:3060] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.261050 17083 raft_consensus.cc:359] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.268163 17083 raft_consensus.cc:740] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.270829 17083 consensus_queue.cc:260] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.273335 17083 ts_tablet_manager.cc:1434] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:18:25.276508 17083 tablet_bootstrap.cc:492] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.307678 17266 heartbeater.cc:344] Connected to a master server at 127.5.227.190:42867
I20260709 13:18:25.308229 17266 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:25.309424 17266 heartbeater.cc:507] Master 127.5.227.190:42867 requested a full tablet report, sending...
I20260709 13:18:25.313241 17218 raft_consensus.cc:3060] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.315737 17083 tablet_bootstrap.cc:492] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.321313 17083 tablet_bootstrap.cc:492] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.322129 17083 ts_tablet_manager.cc:1403] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.010s
I20260709 13:18:25.327476 17083 raft_consensus.cc:359] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.328265 17083 raft_consensus.cc:740] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.328985 17083 consensus_queue.cc:260] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.330791 17083 ts_tablet_manager.cc:1434] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:18:25.331802 17083 tablet_bootstrap.cc:492] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.338122 17228 raft_consensus.cc:3060] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.403106 17218 raft_consensus.cc:3060] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.461767 17200 raft_consensus.cc:3060] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.474433 17083 tablet_bootstrap.cc:492] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.475695 17083 tablet_bootstrap.cc:492] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.476480 17083 ts_tablet_manager.cc:1403] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.145s	user 0.044s	sys 0.074s
I20260709 13:18:25.477308 16125 ts_manager.cc:194] Re-registered known tserver with Master: fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:25.480013 17083 raft_consensus.cc:359] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.481403 17083 raft_consensus.cc:740] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.482434 17083 consensus_queue.cc:260] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.485597 17083 ts_tablet_manager.cc:1434] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:18:25.486614 17083 tablet_bootstrap.cc:492] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.526356 17083 tablet_bootstrap.cc:492] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.527488 17083 tablet_bootstrap.cc:492] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.528220 17083 ts_tablet_manager.cc:1403] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.019s
I20260709 13:18:25.531093 17083 raft_consensus.cc:359] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.531818 17083 raft_consensus.cc:740] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.532588 17083 consensus_queue.cc:260] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.534791 17083 ts_tablet_manager.cc:1434] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:18:25.535732 17083 tablet_bootstrap.cc:492] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.535374 17218 raft_consensus.cc:3060] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.547992 17200 raft_consensus.cc:3060] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.563386 17218 raft_consensus.cc:3060] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.566197 16125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54248
I20260709 13:18:25.577420 17266 heartbeater.cc:499] Master 127.5.227.190:42867 was elected leader, sending a full tablet report...
I20260709 13:18:25.578585 17083 tablet_bootstrap.cc:492] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.579923 17083 tablet_bootstrap.cc:492] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.580715 17083 ts_tablet_manager.cc:1403] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.008s
I20260709 13:18:25.583909 17083 raft_consensus.cc:359] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.584734 17083 raft_consensus.cc:740] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.585512 17083 consensus_queue.cc:260] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.587728 17083 ts_tablet_manager.cc:1434] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:18:25.588598 17083 tablet_bootstrap.cc:492] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.605748 17083 tablet_bootstrap.cc:492] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.606834 17083 tablet_bootstrap.cc:492] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.607575 17083 ts_tablet_manager.cc:1403] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:18:25.610293 17083 raft_consensus.cc:359] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.611040 17083 raft_consensus.cc:740] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.611773 17083 consensus_queue.cc:260] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.613885 17083 ts_tablet_manager.cc:1434] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:25.614782 17083 tablet_bootstrap.cc:492] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.633198 17083 tablet_bootstrap.cc:492] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.634259 17083 tablet_bootstrap.cc:492] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.634955 17083 ts_tablet_manager.cc:1403] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:18:25.637753 17083 raft_consensus.cc:359] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.638466 17083 raft_consensus.cc:740] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.639252 17083 consensus_queue.cc:260] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.641377 17083 ts_tablet_manager.cc:1434] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:25.642206 17083 tablet_bootstrap.cc:492] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.662230 17083 tablet_bootstrap.cc:492] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.663659 17083 tablet_bootstrap.cc:492] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.664412 17083 ts_tablet_manager.cc:1403] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:18:25.667198 17083 raft_consensus.cc:359] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.667917 17083 raft_consensus.cc:740] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.668633 17083 consensus_queue.cc:260] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.670826 17083 ts_tablet_manager.cc:1434] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:18:25.671641 17083 tablet_bootstrap.cc:492] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.689524 17083 tablet_bootstrap.cc:492] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.690739 17083 tablet_bootstrap.cc:492] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.691501 17083 ts_tablet_manager.cc:1403] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:18:25.694810 17083 raft_consensus.cc:359] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.696310 17083 raft_consensus.cc:740] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.696966 17083 consensus_queue.cc:260] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.699360 17083 ts_tablet_manager.cc:1434] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 13:18:25.700234 17083 tablet_bootstrap.cc:492] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
W20260709 13:18:25.762495 16419 consensus_peers.cc:597] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:25.777428 17083 tablet_bootstrap.cc:492] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.778528 17083 tablet_bootstrap.cc:492] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.779247 17083 ts_tablet_manager.cc:1403] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.079s	user 0.035s	sys 0.034s
I20260709 13:18:25.782450 17083 raft_consensus.cc:359] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.783375 17083 raft_consensus.cc:740] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.784085 17083 consensus_queue.cc:260] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.786064 17083 ts_tablet_manager.cc:1434] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:25.786885 17083 tablet_bootstrap.cc:492] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.806121 17083 tablet_bootstrap.cc:492] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.807631 17083 tablet_bootstrap.cc:492] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.808395 17083 ts_tablet_manager.cc:1403] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 13:18:25.811338 17083 raft_consensus.cc:359] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.812939 17083 raft_consensus.cc:740] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.813746 17083 consensus_queue.cc:260] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.816001 17083 ts_tablet_manager.cc:1434] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:25.816963 17083 tablet_bootstrap.cc:492] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.833972 17083 tablet_bootstrap.cc:492] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.834975 17083 tablet_bootstrap.cc:492] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.835707 17083 ts_tablet_manager.cc:1403] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:18:25.838461 17083 raft_consensus.cc:359] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.839216 17083 raft_consensus.cc:740] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.839924 17083 consensus_queue.cc:260] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:25.842496 17083 ts_tablet_manager.cc:1434] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:18:25.844287 17083 tablet_bootstrap.cc:492] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.858191 17083 tablet_bootstrap.cc:492] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.859107 17083 tablet_bootstrap.cc:492] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.859748 17083 ts_tablet_manager.cc:1403] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:18:25.861810 17083 raft_consensus.cc:359] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.862319 17083 raft_consensus.cc:740] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.862998 17083 consensus_queue.cc:260] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.864519 17083 ts_tablet_manager.cc:1434] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:18:25.865389 17083 tablet_bootstrap.cc:492] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.883379 17083 tablet_bootstrap.cc:492] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.884749 17083 tablet_bootstrap.cc:492] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.885493 17083 ts_tablet_manager.cc:1403] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:18:25.888394 17083 raft_consensus.cc:359] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:25.889870 17083 raft_consensus.cc:740] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.890611 17083 consensus_queue.cc:260] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:25.893136 17083 ts_tablet_manager.cc:1434] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:25.894043 17083 tablet_bootstrap.cc:492] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.913471 17083 tablet_bootstrap.cc:492] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.914489 17083 tablet_bootstrap.cc:492] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.915292 17083 ts_tablet_manager.cc:1403] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:18:25.918035 17083 raft_consensus.cc:359] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.918839 17083 raft_consensus.cc:740] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.919581 17083 consensus_queue.cc:260] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.921849 17083 ts_tablet_manager.cc:1434] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:18:25.922735 17083 tablet_bootstrap.cc:492] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.943074 17083 tablet_bootstrap.cc:492] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.944197 17083 tablet_bootstrap.cc:492] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.944948 17083 ts_tablet_manager.cc:1403] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.004s
I20260709 13:18:25.947674 17083 raft_consensus.cc:359] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.948410 17083 raft_consensus.cc:740] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.949158 17083 consensus_queue.cc:260] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:25.951395 17083 ts_tablet_manager.cc:1434] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:18:25.952330 17083 tablet_bootstrap.cc:492] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:25.984597 17083 tablet_bootstrap.cc:492] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:25.985620 17083 tablet_bootstrap.cc:492] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:25.986333 17083 ts_tablet_manager.cc:1403] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.012s
I20260709 13:18:25.988960 17083 raft_consensus.cc:359] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.989673 17083 raft_consensus.cc:740] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.990477 17218 raft_consensus.cc:3060] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.990476 17083 consensus_queue.cc:260] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:25.995148 17083 ts_tablet_manager.cc:1434] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:18:25.996482 17083 tablet_bootstrap.cc:492] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:26.042354 17200 raft_consensus.cc:3060] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:26.102576 17083 tablet_bootstrap.cc:492] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:26.103799 17083 tablet_bootstrap.cc:492] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:26.104527 17083 ts_tablet_manager.cc:1403] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.108s	user 0.036s	sys 0.031s
I20260709 13:18:26.118027 17083 raft_consensus.cc:359] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:26.119704 17083 raft_consensus.cc:740] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:26.120548 17083 consensus_queue.cc:260] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:26.122368 17083 ts_tablet_manager.cc:1434] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 13:18:26.123250 17083 tablet_bootstrap.cc:492] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:26.171439 17218 raft_consensus.cc:3060] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:26.228783 17083 tablet_bootstrap.cc:492] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:26.229803 17083 tablet_bootstrap.cc:492] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:26.230530 17083 ts_tablet_manager.cc:1403] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.041s
I20260709 13:18:26.233381 17083 raft_consensus.cc:359] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:26.234099 17083 raft_consensus.cc:740] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:26.234856 17083 consensus_queue.cc:260] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:26.237185 17083 ts_tablet_manager.cc:1434] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:26.238063 17083 tablet_bootstrap.cc:492] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:26.258826 17083 tablet_bootstrap.cc:492] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:26.259644 17083 tablet_bootstrap.cc:492] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:26.260341 17083 ts_tablet_manager.cc:1403] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:18:26.263118 17083 raft_consensus.cc:359] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:26.263854 17083 raft_consensus.cc:740] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:26.264612 17083 consensus_queue.cc:260] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:26.266405 17083 ts_tablet_manager.cc:1434] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:26.268164 17083 tablet_bootstrap.cc:492] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap starting.
I20260709 13:18:26.298772 17083 tablet_bootstrap.cc:492] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:26.299692 17083 tablet_bootstrap.cc:492] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184: Bootstrap complete.
I20260709 13:18:26.300304 17083 ts_tablet_manager.cc:1403] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.009s
I20260709 13:18:26.306824 17083 raft_consensus.cc:359] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:26.307633 17083 raft_consensus.cc:740] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Initialized, Role: FOLLOWER
I20260709 13:18:26.308341 17083 consensus_queue.cc:260] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:26.310801 17083 ts_tablet_manager.cc:1434] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.003s
I20260709 13:18:26.319247 17218 raft_consensus.cc:3060] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:26.607228 17218 raft_consensus.cc:3060] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.243510  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:35.317414 16450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead"
dest_uuid: "0763e17c84d248738dade73ded2c5f71"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:52564
I20260709 13:18:35.318303 16450 raft_consensus.cc:606] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:35.329608 16450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "751bec01e5d145adac78c28b7b581d73"
dest_uuid: "0763e17c84d248738dade73ded2c5f71"
mode: GRACEFUL
new_leader_uuid: "0c736bf768804f2e86a875366c12a71c"
 from {username='slave'} at 127.0.0.1:52564
I20260709 13:18:35.330304 16450 raft_consensus.cc:606] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Received request to transfer leadership to TS 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:35.332964 16450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78eb3c242fc743cf98a4f1d7cffd975b"
dest_uuid: "0763e17c84d248738dade73ded2c5f71"
mode: GRACEFUL
new_leader_uuid: "0c736bf768804f2e86a875366c12a71c"
 from {username='slave'} at 127.0.0.1:52564
I20260709 13:18:35.333621 16450 raft_consensus.cc:606] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Received request to transfer leadership to TS 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:35.336567 16450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dc2538e6830475791d9f70a5adcee9b"
dest_uuid: "0763e17c84d248738dade73ded2c5f71"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:52564
I20260709 13:18:35.337248 16450 raft_consensus.cc:606] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:35.340137 16450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55"
dest_uuid: "0763e17c84d248738dade73ded2c5f71"
mode: GRACEFUL
new_leader_uuid: "0c736bf768804f2e86a875366c12a71c"
 from {username='slave'} at 127.0.0.1:52564
I20260709 13:18:35.340787 16450 raft_consensus.cc:606] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Received request to transfer leadership to TS 0c736bf768804f2e86a875366c12a71c
I20260709 13:18:35.357558 16303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f"
dest_uuid: "35e0de78970041afb173662b1c34598e"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:55324
I20260709 13:18:35.358196 16303 raft_consensus.cc:606] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:35.359790  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:35.361284  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:35.419255 17327 raft_consensus.cc:993] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:35.419950 17330 raft_consensus.cc:1081] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:35.421846 17228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56396
I20260709 13:18:35.422369 17228 raft_consensus.cc:493] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:35.422801 17228 raft_consensus.cc:3060] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.432407 17228 raft_consensus.cc:515] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:35.434368 17228 leader_election.cc:290] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:35.435499 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:35.435766 16373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0abdbd9a6846b5a7aef90fef35d03f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:35.436482 16303 raft_consensus.cc:3055] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.436596 16373 raft_consensus.cc:3060] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.436870 16303 raft_consensus.cc:740] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:35.437987 16303 consensus_queue.cc:260] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:35.439406 16303 raft_consensus.cc:3060] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.446029 16373 raft_consensus.cc:2468] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:35.448648 17077 leader_election.cc:304] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:35.449985 16303 raft_consensus.cc:2468] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:35.452682 17337 raft_consensus.cc:2804] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.456408 17337 raft_consensus.cc:697] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:35.459124 17337 consensus_queue.cc:237] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:35.474063 16128 catalog_manager.cc:5697] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 1 to 2, leader changed from 35e0de78970041afb173662b1c34598e (127.5.227.130) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.499215 17331 raft_consensus.cc:993] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:35.499723 17331 raft_consensus.cc:1081] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:35.501695 17228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dc2538e6830475791d9f70a5adcee9b"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56414
I20260709 13:18:35.502395 17228 raft_consensus.cc:493] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:35.502822 17228 raft_consensus.cc:3060] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.517793 17228 raft_consensus.cc:515] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:35.521142 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc2538e6830475791d9f70a5adcee9b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:35.521871 16303 raft_consensus.cc:3060] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.526252 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc2538e6830475791d9f70a5adcee9b" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:35.526839 17228 leader_election.cc:290] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:35.527148 16450 raft_consensus.cc:3055] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.527782 16450 raft_consensus.cc:740] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:35.528702 16450 consensus_queue.cc:260] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:35.530071 16450 raft_consensus.cc:3060] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.532335 16303 raft_consensus.cc:2468] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:35.533576 17077 leader_election.cc:304] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:35.534430 17337 raft_consensus.cc:2804] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.534950 17337 raft_consensus.cc:697] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:35.535897 17337 consensus_queue.cc:237] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:35.549542 16128 catalog_manager.cc:5697] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 1 to 2, leader changed from 0763e17c84d248738dade73ded2c5f71 (127.5.227.132) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.551143 16450 raft_consensus.cc:2468] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:35.568861 17335 raft_consensus.cc:993] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:35.569682 17326 raft_consensus.cc:1081] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:35.571923 17228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56414
I20260709 13:18:35.572597 17228 raft_consensus.cc:493] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:35.572939 17228 raft_consensus.cc:3060] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.580993 17228 raft_consensus.cc:515] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:35.583585 17228 leader_election.cc:290] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:35.584118 17335 raft_consensus.cc:993] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71: : Instructing follower 0c736bf768804f2e86a875366c12a71c to start an election
I20260709 13:18:35.584802 17335 raft_consensus.cc:1081] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Signalling peer 0c736bf768804f2e86a875366c12a71c to start an election
I20260709 13:18:35.584824 16372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:35.585299 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec87a6842274eeeb8d174967fd4cead" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:35.585964 16372 raft_consensus.cc:3060] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.586207 16450 raft_consensus.cc:3055] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.586756 16450 raft_consensus.cc:740] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:35.587561 16450 consensus_queue.cc:260] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:35.588898 16450 raft_consensus.cc:3060] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.595057 16373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55"
dest_uuid: "0c736bf768804f2e86a875366c12a71c"
 from {username='slave'} at 127.0.0.1:39538
I20260709 13:18:35.595780 16373 raft_consensus.cc:493] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:35.596002 16372 raft_consensus.cc:2468] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:35.596217 16373 raft_consensus.cc:3060] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.596402 16450 raft_consensus.cc:2468] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:35.597337 17077 leader_election.cc:304] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:35.598495 17337 raft_consensus.cc:2804] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.599081 17337 raft_consensus.cc:697] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:35.600016 17337 consensus_queue.cc:237] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:35.612725 16373 raft_consensus.cc:515] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:35.618225 16373 leader_election.cc:290] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:35.618264 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:35.618427 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afba79efe5d1481e8a1a31d1da74dd55" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:35.619426 16303 raft_consensus.cc:3060] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.619971 16450 raft_consensus.cc:3055] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.620415 16450 raft_consensus.cc:740] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:35.621546 16450 consensus_queue.cc:260] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:35.623548 16450 raft_consensus.cc:3060] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.626035 16128 catalog_manager.cc:5697] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 1 to 2, leader changed from 0763e17c84d248738dade73ded2c5f71 (127.5.227.132) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.632779 16303 raft_consensus.cc:2468] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 2.
I20260709 13:18:35.634274 16343 leader_election.cc:304] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:35.635430 17332 raft_consensus.cc:2804] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.635989 17332 raft_consensus.cc:697] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:35.637451 17332 consensus_queue.cc:237] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:35.638808 16450 raft_consensus.cc:2468] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 2.
I20260709 13:18:35.660821 16128 catalog_manager.cc:5697] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 1 to 2, leader changed from 0763e17c84d248738dade73ded2c5f71 (127.5.227.132) to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 2 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.759178 17326 raft_consensus.cc:993] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71: : Instructing follower 0c736bf768804f2e86a875366c12a71c to start an election
I20260709 13:18:35.759939 17335 raft_consensus.cc:1081] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Signalling peer 0c736bf768804f2e86a875366c12a71c to start an election
I20260709 13:18:35.761683 16372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78eb3c242fc743cf98a4f1d7cffd975b"
dest_uuid: "0c736bf768804f2e86a875366c12a71c"
 from {username='slave'} at 127.0.0.1:39538
I20260709 13:18:35.762166 16372 raft_consensus.cc:493] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:35.762444 16372 raft_consensus.cc:3060] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.770505 16372 raft_consensus.cc:515] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:35.772445 16372 leader_election.cc:290] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:35.773248 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb3c242fc743cf98a4f1d7cffd975b" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:35.773413 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb3c242fc743cf98a4f1d7cffd975b" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:35.773844 16303 raft_consensus.cc:3060] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.774163 16450 raft_consensus.cc:3055] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.774643 16450 raft_consensus.cc:740] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:35.775383 16450 consensus_queue.cc:260] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:35.776397 16450 raft_consensus.cc:3060] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.779564 16303 raft_consensus.cc:2468] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 2.
I20260709 13:18:35.781479 16343 leader_election.cc:304] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:35.782469 17332 raft_consensus.cc:2804] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.782931 16450 raft_consensus.cc:2468] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 2.
I20260709 13:18:35.783123 17332 raft_consensus.cc:697] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:35.784364 17332 consensus_queue.cc:237] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:35.809440 16128 catalog_manager.cc:5697] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 1 to 2, leader changed from 0763e17c84d248738dade73ded2c5f71 (127.5.227.132) to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 2 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.850291 16373 raft_consensus.cc:1275] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:35.852514 17337 consensus_queue.cc:1048] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:35.968748 17346 raft_consensus.cc:993] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71: : Instructing follower 0c736bf768804f2e86a875366c12a71c to start an election
I20260709 13:18:35.969398 17331 raft_consensus.cc:1081] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Signalling peer 0c736bf768804f2e86a875366c12a71c to start an election
I20260709 13:18:35.976323 16371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "751bec01e5d145adac78c28b7b581d73"
dest_uuid: "0c736bf768804f2e86a875366c12a71c"
 from {username='slave'} at 127.0.0.1:39538
I20260709 13:18:35.976984 16371 raft_consensus.cc:493] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:35.977411 16371 raft_consensus.cc:3060] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:35.988477 16269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:34771, user_credentials={real_user=slave}} blocked reactor thread for 46763.3us
I20260709 13:18:35.991137 16444 raft_consensus.cc:1275] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:35.992885 16303 raft_consensus.cc:1275] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:35.993180 16299 raft_consensus.cc:1275] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:35.995627 17337 consensus_queue.cc:1048] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.997054 16371 raft_consensus.cc:515] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:35.999208 17338 consensus_queue.cc:1048] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:35.998409 17337 consensus_queue.cc:1048] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:36.025177 16371 leader_election.cc:290] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:36.032186 16450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "751bec01e5d145adac78c28b7b581d73" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:36.032825 16450 raft_consensus.cc:3055] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.033195 16450 raft_consensus.cc:740] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:36.034288 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "751bec01e5d145adac78c28b7b581d73" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:36.034207 16450 consensus_queue.cc:260] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:36.034957 16304 raft_consensus.cc:3060] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.035666 16450 raft_consensus.cc:3060] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.057566 16450 raft_consensus.cc:2468] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 2.
I20260709 13:18:36.058652 16304 raft_consensus.cc:2468] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c736bf768804f2e86a875366c12a71c in term 2.
I20260709 13:18:36.058755 16299 raft_consensus.cc:1275] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer 0c736bf768804f2e86a875366c12a71c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.060153 16343 leader_election.cc:304] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:36.061471 17325 raft_consensus.cc:2804] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.062005 17325 raft_consensus.cc:697] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Becoming Leader. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:36.063047 17325 consensus_queue.cc:237] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:36.061743 17332 consensus_queue.cc:1048] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:36.109479 16450 raft_consensus.cc:1275] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer 0c736bf768804f2e86a875366c12a71c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.112437 17325 consensus_queue.cc:1048] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.116952 16449 raft_consensus.cc:1275] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.119226 16125 catalog_manager.cc:5697] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c reported cstate change: term changed from 1 to 2, leader changed from 0763e17c84d248738dade73ded2c5f71 (127.5.227.132) to 0c736bf768804f2e86a875366c12a71c (127.5.227.131). New cstate: current_term: 2 leader_uuid: "0c736bf768804f2e86a875366c12a71c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.125552 17360 consensus_queue.cc:1048] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:36.167850 16373 raft_consensus.cc:1275] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.174471 17337 consensus_queue.cc:1048] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:36.242792 16453 raft_consensus.cc:1275] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer 0c736bf768804f2e86a875366c12a71c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.244606 17344 consensus_queue.cc:1048] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:36.253449 16303 raft_consensus.cc:1275] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer 0c736bf768804f2e86a875366c12a71c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.256997 17344 consensus_queue.cc:1048] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.362607  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:36.409139  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:36.468402 16371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab0b93ad21849139b174c34a46ce646"
dest_uuid: "0c736bf768804f2e86a875366c12a71c"
mode: GRACEFUL
new_leader_uuid: "0763e17c84d248738dade73ded2c5f71"
 from {username='slave'} at 127.0.0.1:36750
I20260709 13:18:36.469121 16371 raft_consensus.cc:606] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Received request to transfer leadership to TS 0763e17c84d248738dade73ded2c5f71
I20260709 13:18:36.472748 16449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108"
dest_uuid: "0763e17c84d248738dade73ded2c5f71"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:52564
I20260709 13:18:36.473379 16449 raft_consensus.cc:606] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:36.476311 16304 raft_consensus.cc:1275] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer 0c736bf768804f2e86a875366c12a71c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.476464 16303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58607755710543c9809dbf53631f4738"
dest_uuid: "35e0de78970041afb173662b1c34598e"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:55324
I20260709 13:18:36.477160 16303 raft_consensus.cc:606] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:36.478334 17344 consensus_queue.cc:1048] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:36.482431 16449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb"
dest_uuid: "0763e17c84d248738dade73ded2c5f71"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:52564
I20260709 13:18:36.483296 16449 raft_consensus.cc:606] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:36.487761 16371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc75ff85212648e2accfc8fa2e73685e"
dest_uuid: "0c736bf768804f2e86a875366c12a71c"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:36750
I20260709 13:18:36.488541 16371 raft_consensus.cc:606] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:36.492782 16371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb"
dest_uuid: "0c736bf768804f2e86a875366c12a71c"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:36750
I20260709 13:18:36.493753 16371 raft_consensus.cc:606] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:36.503014 16453 raft_consensus.cc:1275] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer 0c736bf768804f2e86a875366c12a71c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.503986  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:36.505653 17332 consensus_queue.cc:1048] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.506764  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:36.525717 17344 raft_consensus.cc:993] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c: : Instructing follower 0763e17c84d248738dade73ded2c5f71 to start an election
I20260709 13:18:36.526381 17332 raft_consensus.cc:1081] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Signalling peer 0763e17c84d248738dade73ded2c5f71 to start an election
I20260709 13:18:36.528422 16453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ab0b93ad21849139b174c34a46ce646"
dest_uuid: "0763e17c84d248738dade73ded2c5f71"
 from {username='slave'} at 127.0.0.1:45288
I20260709 13:18:36.529024 16453 raft_consensus.cc:493] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:36.529430 16453 raft_consensus.cc:3060] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.537256 16453 raft_consensus.cc:515] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:36.540524 16453 leader_election.cc:290] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:36.541153 17330 raft_consensus.cc:993] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:36.541867 17330 raft_consensus.cc:1081] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:36.543475 16371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab0b93ad21849139b174c34a46ce646" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:36.544205 16371 raft_consensus.cc:3055] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.544763 16371 raft_consensus.cc:740] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:36.545384 17218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58607755710543c9809dbf53631f4738"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56396
I20260709 13:18:36.545696 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab0b93ad21849139b174c34a46ce646" candidate_uuid: "0763e17c84d248738dade73ded2c5f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:36.546090 17218 raft_consensus.cc:493] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:36.546484 16303 raft_consensus.cc:3060] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.546543 17218 raft_consensus.cc:3060] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.546285 16371 consensus_queue.cc:260] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:36.548007 16371 raft_consensus.cc:3060] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.555923 16303 raft_consensus.cc:2468] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 2.
I20260709 13:18:36.558470 16417 leader_election.cc:304] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, 35e0de78970041afb173662b1c34598e; no voters: 
I20260709 13:18:36.559464 17335 raft_consensus.cc:2804] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.560088 17335 raft_consensus.cc:697] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 2 LEADER]: Becoming Leader. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:36.562446 17335 consensus_queue.cc:237] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } }
I20260709 13:18:36.566504 16371 raft_consensus.cc:2468] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0763e17c84d248738dade73ded2c5f71 in term 2.
I20260709 13:18:36.578747 17218 raft_consensus.cc:515] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:36.584429 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58607755710543c9809dbf53631f4738" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:36.585107 16453 raft_consensus.cc:3060] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.585423 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58607755710543c9809dbf53631f4738" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:36.586103 16303 raft_consensus.cc:3055] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.586393 16303 raft_consensus.cc:740] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:36.587534 17218 leader_election.cc:290] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:36.587383 16128 catalog_manager.cc:5697] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 reported cstate change: term changed from 1 to 2, leader changed from 0c736bf768804f2e86a875366c12a71c (127.5.227.131) to 0763e17c84d248738dade73ded2c5f71 (127.5.227.132). New cstate: current_term: 2 leader_uuid: "0763e17c84d248738dade73ded2c5f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.587441 16303 consensus_queue.cc:260] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:36.591118 16303 raft_consensus.cc:3060] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.592553 16453 raft_consensus.cc:2468] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:36.594024 17076 leader_election.cc:304] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:36.595177 17338 raft_consensus.cc:2804] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.595680 17338 raft_consensus.cc:697] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:36.596729 17338 consensus_queue.cc:237] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:36.598263 16303 raft_consensus.cc:2468] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:36.612865 16128 catalog_manager.cc:5697] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 1 to 2, leader changed from 35e0de78970041afb173662b1c34598e (127.5.227.130) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.655839 17335 raft_consensus.cc:993] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:36.656387 17346 raft_consensus.cc:1081] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:36.658488 17218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56414
I20260709 13:18:36.659155 17218 raft_consensus.cc:493] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:36.659561 17218 raft_consensus.cc:3060] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.666239 17218 raft_consensus.cc:515] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:36.668321 17218 leader_election.cc:290] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:36.668963 16373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:36.669634 16373 raft_consensus.cc:3060] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.670176 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4702fc1d81a24e6683bf2a12ebd8d108" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:36.670763 16453 raft_consensus.cc:3055] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.671066 16453 raft_consensus.cc:740] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:36.671934 16453 consensus_queue.cc:260] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:36.673278 16453 raft_consensus.cc:3060] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.678174 16373 raft_consensus.cc:2468] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:36.680212 17077 leader_election.cc:304] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:36.682194 16453 raft_consensus.cc:2468] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:36.682399 17337 raft_consensus.cc:2804] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.684402 17337 raft_consensus.cc:697] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:36.685316 17337 consensus_queue.cc:237] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:36.686838 17346 raft_consensus.cc:993] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:36.687388 17346 raft_consensus.cc:1081] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:36.692860 17218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56414
I20260709 13:18:36.693688 17218 raft_consensus.cc:493] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:36.694182 17218 raft_consensus.cc:3060] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.699127 17344 raft_consensus.cc:993] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:36.699776 17344 raft_consensus.cc:1081] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:36.702759 17218 raft_consensus.cc:515] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:36.703826 17228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56402
I20260709 13:18:36.704492 17228 raft_consensus.cc:493] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:36.704913 17228 raft_consensus.cc:3060] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.705189 17218 leader_election.cc:290] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:36.715119 16373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:36.715852 16373 raft_consensus.cc:3060] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.714977 16128 catalog_manager.cc:5697] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 1 to 2, leader changed from 0763e17c84d248738dade73ded2c5f71 (127.5.227.132) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.718319 16449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99394f0dfd1046148485eae1db42c1fb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:36.719106 16449 raft_consensus.cc:3055] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.719419 16449 raft_consensus.cc:740] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:36.720331 16449 consensus_queue.cc:260] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:36.724622 16449 raft_consensus.cc:3060] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.735061 17228 raft_consensus.cc:515] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:36.735709 16373 raft_consensus.cc:2468] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:36.735939 16449 raft_consensus.cc:2468] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:36.736953 17077 leader_election.cc:304] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:36.737340 17228 leader_election.cc:290] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:36.739009 17337 raft_consensus.cc:2804] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.739212 16371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:36.739367 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1767e0ec9e442fd80d03d4f83e02ddb" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:36.739708 17337 raft_consensus.cc:697] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:36.739807 16371 raft_consensus.cc:3055] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.740131 16303 raft_consensus.cc:3060] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.740293 16371 raft_consensus.cc:740] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:36.740887 17337 consensus_queue.cc:237] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:36.741278 16371 consensus_queue.cc:260] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:36.742687 16371 raft_consensus.cc:3060] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.753378 16303 raft_consensus.cc:2468] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:36.754817 17077 leader_election.cc:304] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:36.755764 17360 raft_consensus.cc:2804] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.756331 17360 raft_consensus.cc:697] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:36.757506 17360 consensus_queue.cc:237] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:36.765365 16371 raft_consensus.cc:2468] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:36.767710 16128 catalog_manager.cc:5697] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 1 to 2, leader changed from 0763e17c84d248738dade73ded2c5f71 (127.5.227.132) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.788379 16128 catalog_manager.cc:5697] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 1 to 2, leader changed from 0c736bf768804f2e86a875366c12a71c (127.5.227.131) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.796903 17325 raft_consensus.cc:993] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:36.797690 17332 raft_consensus.cc:1081] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:36.799886 17228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc75ff85212648e2accfc8fa2e73685e"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56402
I20260709 13:18:36.800619 17228 raft_consensus.cc:493] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:36.801128 17228 raft_consensus.cc:3060] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.808012 17228 raft_consensus.cc:515] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:36.809809 17228 leader_election.cc:290] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:36.810775 16371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc75ff85212648e2accfc8fa2e73685e" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:36.810940 16449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc75ff85212648e2accfc8fa2e73685e" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:36.811439 16371 raft_consensus.cc:3055] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.811582 16449 raft_consensus.cc:3060] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.811751 16371 raft_consensus.cc:740] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c736bf768804f2e86a875366c12a71c, State: Running, Role: LEADER
I20260709 13:18:36.812567 16371 consensus_queue.cc:260] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:36.813661 16371 raft_consensus.cc:3060] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.817834 16449 raft_consensus.cc:2468] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:36.819156 17076 leader_election.cc:304] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:36.820096 17360 raft_consensus.cc:2804] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.820449 16371 raft_consensus.cc:2468] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:36.820794 17360 raft_consensus.cc:697] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:36.821828 17360 consensus_queue.cc:237] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:36.834131 16128 catalog_manager.cc:5697] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 1 to 2, leader changed from 0c736bf768804f2e86a875366c12a71c (127.5.227.131) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.986871 16303 raft_consensus.cc:1275] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer 0763e17c84d248738dade73ded2c5f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.988148 17346 consensus_queue.cc:1048] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:37.011328 16371 raft_consensus.cc:1275] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer 0763e17c84d248738dade73ded2c5f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.017119 17335 consensus_queue.cc:1048] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:37.129180 16450 raft_consensus.cc:1275] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.131110 17360 consensus_queue.cc:1048] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:37.146207 16303 raft_consensus.cc:1275] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.148515 17360 consensus_queue.cc:1048] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:37.164920 16373 raft_consensus.cc:1275] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.152448 16371 raft_consensus.cc:1275] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.167588 17375 consensus_queue.cc:1048] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:37.192708 16450 raft_consensus.cc:1275] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.171483 17360 consensus_queue.cc:1048] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:37.206179 17360 consensus_queue.cc:1048] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:37.228555 16449 raft_consensus.cc:1275] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.261582 17387 consensus_queue.cc:1048] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:37.270287 16373 raft_consensus.cc:1275] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.272125 17360 consensus_queue.cc:1048] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:37.291381 16450 raft_consensus.cc:1275] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.297215 17375 consensus_queue.cc:1048] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:37.323292 16304 raft_consensus.cc:1275] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.325337 17360 consensus_queue.cc:1048] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:37.346815 16372 raft_consensus.cc:1275] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.349457 17390 consensus_queue.cc:1048] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:37.508087  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:37.550957  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:37.594456 16449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3943f59d05384cb0b44c356da96441c8"
dest_uuid: "0763e17c84d248738dade73ded2c5f71"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:52564
I20260709 13:18:37.595429 16449 raft_consensus.cc:606] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:37.598750 16303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1"
dest_uuid: "35e0de78970041afb173662b1c34598e"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:55324
I20260709 13:18:37.599407 16303 raft_consensus.cc:606] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:37.602598 16303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae815525899842d7983214ddeeec135f"
dest_uuid: "35e0de78970041afb173662b1c34598e"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:55324
I20260709 13:18:37.603241 16303 raft_consensus.cc:606] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:37.608196 16303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2"
dest_uuid: "35e0de78970041afb173662b1c34598e"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:55324
I20260709 13:18:37.608774 16303 raft_consensus.cc:606] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:37.613574 16304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0"
dest_uuid: "35e0de78970041afb173662b1c34598e"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:55324
I20260709 13:18:37.614209 16304 raft_consensus.cc:606] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:37.615485  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:37.616959  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:37.636828 17353 raft_consensus.cc:993] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:37.637450 17335 raft_consensus.cc:1081] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:37.639158 17228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3943f59d05384cb0b44c356da96441c8"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56414
I20260709 13:18:37.639807 17228 raft_consensus.cc:493] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:37.640203 17228 raft_consensus.cc:3060] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.646763 17228 raft_consensus.cc:515] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:37.649118 17228 leader_election.cc:290] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Requested vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671)
I20260709 13:18:37.649614 16372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3943f59d05384cb0b44c356da96441c8" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:37.649935 16449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3943f59d05384cb0b44c356da96441c8" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:37.650499 16372 raft_consensus.cc:3060] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.651034 16449 raft_consensus.cc:3055] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:37.651571 16449 raft_consensus.cc:740] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0763e17c84d248738dade73ded2c5f71, State: Running, Role: LEADER
I20260709 13:18:37.652503 16449 consensus_queue.cc:260] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:37.653820 16449 raft_consensus.cc:3060] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.658097 16372 raft_consensus.cc:2468] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:37.659655 17077 leader_election.cc:304] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:37.660058 16449 raft_consensus.cc:2468] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:37.660406 17390 raft_consensus.cc:2804] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.661005 17390 raft_consensus.cc:697] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:37.661864 17390 consensus_queue.cc:237] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:37.672789 16125 catalog_manager.cc:5697] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 1 to 2, leader changed from 0763e17c84d248738dade73ded2c5f71 (127.5.227.132) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.699157 17397 raft_consensus.cc:993] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:37.699712 17397 raft_consensus.cc:1081] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:37.701568 17228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56396
I20260709 13:18:37.702406 17228 raft_consensus.cc:493] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:37.702992 17228 raft_consensus.cc:3060] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.711977 17228 raft_consensus.cc:515] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:37.715219 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:37.715978 16303 raft_consensus.cc:3055] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:37.716284 16303 raft_consensus.cc:740] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:37.717191 16303 consensus_queue.cc:260] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:37.718222 16303 raft_consensus.cc:3060] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.719429 17228 leader_election.cc:290] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 3 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:37.720939 16373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c139e8f552d449faa03901839fb43b1" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:37.721670 16373 raft_consensus.cc:3060] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.726969 16303 raft_consensus.cc:2468] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 3.
I20260709 13:18:37.728407 17077 leader_election.cc:304] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:37.729429 17360 raft_consensus.cc:2804] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:37.729954 17360 raft_consensus.cc:697] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 3 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:37.731020 17360 consensus_queue.cc:237] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:37.738564 16373 raft_consensus.cc:2468] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 3.
I20260709 13:18:37.753877 17320 raft_consensus.cc:993] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:37.754803 17351 raft_consensus.cc:1081] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:37.756697 17218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56396
I20260709 13:18:37.757269 17218 raft_consensus.cc:493] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:37.757624 17218 raft_consensus.cc:3060] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.764545 16125 catalog_manager.cc:5697] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 2 to 3, leader changed from 35e0de78970041afb173662b1c34598e (127.5.227.130) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 3 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:37.768311 17218 raft_consensus.cc:515] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:37.771355 16449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:37.771517 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96fff68e07b4c3f82332cd44d0dd3d2" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:37.771917 16449 raft_consensus.cc:3060] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.772179 16304 raft_consensus.cc:3055] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:37.772557 16304 raft_consensus.cc:740] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:37.773466 16304 consensus_queue.cc:260] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:37.779367 16304 raft_consensus.cc:3060] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.780901 16449 raft_consensus.cc:2468] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 3.
I20260709 13:18:37.782287 17076 leader_election.cc:304] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:37.783198 17337 raft_consensus.cc:2804] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:37.783723 17337 raft_consensus.cc:697] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 3 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:37.784708 17337 consensus_queue.cc:237] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:37.788923 17218 leader_election.cc:290] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 3 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:37.788975 16304 raft_consensus.cc:2468] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 3.
I20260709 13:18:37.810979 16125 catalog_manager.cc:5697] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 2 to 3, leader changed from 35e0de78970041afb173662b1c34598e (127.5.227.130) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 3 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:37.832101 17351 raft_consensus.cc:993] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:37.832669 17351 raft_consensus.cc:1081] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:37.834399 17218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56396
I20260709 13:18:37.835829 17218 raft_consensus.cc:493] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:37.836390 17218 raft_consensus.cc:3060] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.848845 17218 raft_consensus.cc:515] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:37.850664 17218 leader_election.cc:290] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:37.851613 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:37.851889 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d360c4d961f74b5e95455c5f84d85ad0" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:37.852380 16304 raft_consensus.cc:3055] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:37.852376 16453 raft_consensus.cc:3060] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.852918 16304 raft_consensus.cc:740] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:37.853713 16304 consensus_queue.cc:260] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:37.855028 16304 raft_consensus.cc:3060] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.860160 16453 raft_consensus.cc:2468] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:37.861483 17076 leader_election.cc:304] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:37.862468 17337 raft_consensus.cc:2804] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.862579 16304 raft_consensus.cc:2468] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:37.863159 17337 raft_consensus.cc:697] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:37.864107 17337 consensus_queue.cc:237] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:37.884462 16125 catalog_manager.cc:5697] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 1 to 2, leader changed from 35e0de78970041afb173662b1c34598e (127.5.227.130) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:37.889262 17320 raft_consensus.cc:993] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:37.889810 17351 raft_consensus.cc:1081] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:37.891652 17218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae815525899842d7983214ddeeec135f"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56396
I20260709 13:18:37.892226 17218 raft_consensus.cc:493] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:37.892582 17218 raft_consensus.cc:3060] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.898983 17218 raft_consensus.cc:515] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:37.900718 17218 leader_election.cc:290] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 3 election: Requested vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:37.902177 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0763e17c84d248738dade73ded2c5f71"
I20260709 13:18:37.902200 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae815525899842d7983214ddeeec135f" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:37.903453 16453 raft_consensus.cc:3060] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.903558 16304 raft_consensus.cc:3055] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:37.904107 16304 raft_consensus.cc:740] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:37.904824 16304 consensus_queue.cc:260] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:37.906303 16304 raft_consensus.cc:3060] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.911226 16453 raft_consensus.cc:2468] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 3.
I20260709 13:18:37.912946 17076 leader_election.cc:304] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:37.913913 17337 raft_consensus.cc:2804] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:37.915073 17337 raft_consensus.cc:697] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 3 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:37.915994 17337 consensus_queue.cc:237] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:37.922439 16304 raft_consensus.cc:2468] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 3.
I20260709 13:18:37.930094 16125 catalog_manager.cc:5697] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 2 to 3, leader changed from 35e0de78970041afb173662b1c34598e (127.5.227.130) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 3 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.203583 16304 raft_consensus.cc:1275] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:38.205139 17387 consensus_queue.cc:1048] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.222725 16449 raft_consensus.cc:1275] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:38.224748 17387 consensus_queue.cc:1048] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.246335 16449 raft_consensus.cc:1275] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:38.248337 17337 consensus_queue.cc:1048] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:38.256218 16373 raft_consensus.cc:1275] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 3 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:38.257754 17387 consensus_queue.cc:1048] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.258275 16373 raft_consensus.cc:1275] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:38.260370 17375 consensus_queue.cc:1048] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:38.275301 16453 raft_consensus.cc:1275] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:38.280264 17360 consensus_queue.cc:1048] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:38.294612 16303 raft_consensus.cc:1275] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:38.298657 17360 consensus_queue.cc:1048] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:38.430406 16303 raft_consensus.cc:1275] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:38.446059 17390 consensus_queue.cc:1048] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:18:38.477487 16303 raft_consensus.cc:1275] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:38.484367 17387 consensus_queue.cc:1048] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:38.486577 16268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.132:42671, user_credentials={real_user=slave}} blocked reactor thread for 112305us
I20260709 13:18:38.510146 16450 raft_consensus.cc:1275] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:38.519557 17390 consensus_queue.cc:1048] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:18:38.617969  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:38.672060  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:38.721071 16299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbce7ea12f554f25812e7ef8fdcc892e"
dest_uuid: "35e0de78970041afb173662b1c34598e"
mode: GRACEFUL
new_leader_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:55324
I20260709 13:18:38.721987 16299 raft_consensus.cc:606] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Received request to transfer leadership to TS fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:38.723770  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:18:38.725965  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:38.900439 17427 raft_consensus.cc:993] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e: : Instructing follower fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:38.900949 17427 raft_consensus.cc:1081] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Signalling peer fe046a372b6a4df982eebe83cf3ee184 to start an election
I20260709 13:18:38.903293 17218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbce7ea12f554f25812e7ef8fdcc892e"
dest_uuid: "fe046a372b6a4df982eebe83cf3ee184"
 from {username='slave'} at 127.0.0.1:56396
I20260709 13:18:38.904168 17218 raft_consensus.cc:493] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.904719 17218 raft_consensus.cc:3060] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.913362 17218 raft_consensus.cc:515] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:38.915338 17218 leader_election.cc:290] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Requested vote from peers 35e0de78970041afb173662b1c34598e (127.5.227.130:42747), 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771)
I20260709 13:18:38.916213 16303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbce7ea12f554f25812e7ef8fdcc892e" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35e0de78970041afb173662b1c34598e"
I20260709 13:18:38.916584 16371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbce7ea12f554f25812e7ef8fdcc892e" candidate_uuid: "fe046a372b6a4df982eebe83cf3ee184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c736bf768804f2e86a875366c12a71c"
I20260709 13:18:38.916906 16303 raft_consensus.cc:3055] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:38.917246 16371 raft_consensus.cc:3060] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.917260 16303 raft_consensus.cc:740] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35e0de78970041afb173662b1c34598e, State: Running, Role: LEADER
I20260709 13:18:38.918344 16303 consensus_queue.cc:260] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:38.921106 16303 raft_consensus.cc:3060] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.925632 16371 raft_consensus.cc:2468] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:38.927383 17077 leader_election.cc:304] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184; no voters: 
I20260709 13:18:38.930425 17360 raft_consensus.cc:2804] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:38.931128 17360 raft_consensus.cc:697] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Becoming Leader. State: Replica: fe046a372b6a4df982eebe83cf3ee184, State: Running, Role: LEADER
I20260709 13:18:38.931221 16303 raft_consensus.cc:2468] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe046a372b6a4df982eebe83cf3ee184 in term 2.
I20260709 13:18:38.932278 17360 consensus_queue.cc:237] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:38.953792 16125 catalog_manager.cc:5697] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 reported cstate change: term changed from 1 to 2, leader changed from 35e0de78970041afb173662b1c34598e (127.5.227.130) to fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "fe046a372b6a4df982eebe83cf3ee184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:39.485788 16371 raft_consensus.cc:1275] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.488454 17360 consensus_queue.cc:1048] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:39.532188 16304 raft_consensus.cc:1275] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Refusing update from remote peer fe046a372b6a4df982eebe83cf3ee184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.534121 17360 consensus_queue.cc:1048] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.727303  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:39.773903  6030 tablet_server.cc:179] TabletServer@127.5.227.129:36859 shutting down...
W20260709 13:18:39.780280 16271 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 329 similar messages]
W20260709 13:18:39.787350 16271 consensus_peers.cc:597] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:39.810287 16419 consensus_peers.cc:597] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.822254  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:39.823632  6030 tablet_replica.cc:333] stopping tablet replica
W20260709 13:18:39.824451 16345 consensus_peers.cc:597] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.824874  6030 raft_consensus.cc:2243] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.825634  6030 raft_consensus.cc:2272] T c883f64d971d4eeeb73836cdb95e1071 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.829403  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.830499  6030 raft_consensus.cc:2243] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:18:39.831372 16345 consensus_peers.cc:597] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.831732  6030 raft_consensus.cc:2272] T 3943f59d05384cb0b44c356da96441c8 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.836503  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.837596  6030 raft_consensus.cc:2243] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.838398  6030 raft_consensus.cc:2272] T d0408e10512d4613a6250d70072ab152 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:39.841070 16271 consensus_peers.cc:597] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.842161  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.843170  6030 raft_consensus.cc:2243] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.843722  6030 raft_consensus.cc:2272] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.847337  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.848408  6030 raft_consensus.cc:2243] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.849037  6030 raft_consensus.cc:2272] T cf2962c590b5497da58a885103a32aef P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.852782  6030 tablet_replica.cc:333] stopping tablet replica
W20260709 13:18:39.852835 16345 consensus_peers.cc:597] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.854030  6030 raft_consensus.cc:2243] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.854787  6030 raft_consensus.cc:2272] T a13fb80f9cf64345a2b3e9f4009281b6 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.857398  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.858192  6030 raft_consensus.cc:2243] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:39.859335  6030 raft_consensus.cc:2272] T 8dc2538e6830475791d9f70a5adcee9b P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.864598  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.865562  6030 raft_consensus.cc:2243] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.866180  6030 raft_consensus.cc:2272] T 3a5ed6ba8f644df7bcec53f34c63a569 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.869649  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.870810  6030 raft_consensus.cc:2243] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:39.872045  6030 raft_consensus.cc:2272] T 58607755710543c9809dbf53631f4738 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.874931  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.875638  6030 raft_consensus.cc:2243] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.876145  6030 raft_consensus.cc:2272] T ccf1f8703ff64c89afb0d1dbe0eab26f P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.879407  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.880409  6030 raft_consensus.cc:2243] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:39.881609  6030 raft_consensus.cc:2272] T dc75ff85212648e2accfc8fa2e73685e P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:39.883340 16419 consensus_peers.cc:597] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.885196  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.886732  6030 raft_consensus.cc:2243] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.887413  6030 raft_consensus.cc:2272] T 128dfcd70ea847fbae9691a10e6db1a5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.890931  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.891728  6030 raft_consensus.cc:2243] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.892283  6030 raft_consensus.cc:2272] T 48b93db33f164564bbded82c6ca74a3a P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.895010  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.896164  6030 raft_consensus.cc:2243] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.896910  6030 raft_consensus.cc:2272] T 246e5a50c75e4f0fa58538237d61e585 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.900941  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.901788  6030 raft_consensus.cc:2243] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:39.903000  6030 raft_consensus.cc:2272] T c96fff68e07b4c3f82332cd44d0dd3d2 P fe046a372b6a4df982eebe83cf3ee184 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.906313  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.907243  6030 raft_consensus.cc:2243] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:18:39.907691 16345 consensus_peers.cc:597] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.908421  6030 raft_consensus.cc:2272] T 4702fc1d81a24e6683bf2a12ebd8d108 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:39.910077 16419 consensus_peers.cc:597] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.912020  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.912968  6030 raft_consensus.cc:2243] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.913475  6030 raft_consensus.cc:2272] T a53592287efd4b3ba8208b91130d38cd P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.916540  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.917342  6030 raft_consensus.cc:2243] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.917883  6030 raft_consensus.cc:2272] T 506096b267e14e6f8e28c082062c6481 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.920290  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.920943  6030 raft_consensus.cc:2243] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.921389  6030 raft_consensus.cc:2272] T 403c864cda0f4da0b0547c0a3f1cb3ea P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.924053  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.925068  6030 raft_consensus.cc:2243] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.925757  6030 raft_consensus.cc:2272] T 8997dd86a5ac421ba825e30c817e3ceb P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.929565  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.930572  6030 raft_consensus.cc:2243] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:39.931766  6030 raft_consensus.cc:2272] T 6c139e8f552d449faa03901839fb43b1 P fe046a372b6a4df982eebe83cf3ee184 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.935001  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.935778  6030 raft_consensus.cc:2243] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.936417  6030 raft_consensus.cc:2272] T 295c483df4e74d1a8314d5219167cc16 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.939628  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.940479  6030 raft_consensus.cc:2243] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:39.941561  6030 raft_consensus.cc:2272] T dbce7ea12f554f25812e7ef8fdcc892e P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:39.942951 16419 consensus_peers.cc:597] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.944914  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.945708  6030 raft_consensus.cc:2243] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.946278  6030 raft_consensus.cc:2272] T e6acf3d9f73d4f38817c4ea25ba9139b P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.948639  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.949318  6030 raft_consensus.cc:2243] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.949832  6030 raft_consensus.cc:2272] T 8c8b6cdc63734f54b3ebb138b4e0b94c P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.953425  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.954470  6030 raft_consensus.cc:2243] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.955260  6030 raft_consensus.cc:2272] T 0a15949e759d40be9560228008490390 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.958961  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.959728  6030 raft_consensus.cc:2243] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.960266  6030 raft_consensus.cc:2272] T 84888dc6b86747d6b08b125a8df5394c P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.963124  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.963897  6030 raft_consensus.cc:2243] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.964473  6030 raft_consensus.cc:2272] T e1d2386a536042dcb0271fdc91474697 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.967089  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.967757  6030 raft_consensus.cc:2243] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:39.968745  6030 raft_consensus.cc:2272] T ae815525899842d7983214ddeeec135f P fe046a372b6a4df982eebe83cf3ee184 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.972119  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.973084  6030 raft_consensus.cc:2243] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.973768  6030 raft_consensus.cc:2272] T b562a19c9d1947508c77a1a946dc873b P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.977068  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.977837  6030 raft_consensus.cc:2243] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.978350  6030 raft_consensus.cc:2272] T 6196aafd32f448a7964c50df2be2a4b3 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.981397  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.982028  6030 raft_consensus.cc:2243] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.982549  6030 raft_consensus.cc:2272] T b86655b05b814b00bcf81c0da904bdaf P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.985468  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.986277  6030 raft_consensus.cc:2243] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:39.987350  6030 raft_consensus.cc:2272] T de0abdbd9a6846b5a7aef90fef35d03f P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.990609  6030 tablet_replica.cc:333] stopping tablet replica
W20260709 13:18:39.991277 16419 consensus_peers.cc:597] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.991874  6030 raft_consensus.cc:2243] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.992673  6030 raft_consensus.cc:2272] T 145398d14cf9402e819285d9fc5253b9 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:39.996037  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:39.996896  6030 raft_consensus.cc:2243] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:39.997496  6030 raft_consensus.cc:2272] T 1f28345dd0f24a26b496904242ab1d87 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:39.999141 16271 consensus_peers.cc:597] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.000483  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:40.001624  6030 raft_consensus.cc:2243] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.002357  6030 raft_consensus.cc:2272] T 738b09b19983412bbbf2fccd7c5687b5 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.005684  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:40.006610  6030 raft_consensus.cc:2243] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.007612  6030 raft_consensus.cc:2272] T 1ec87a6842274eeeb8d174967fd4cead P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.011150  6030 tablet_replica.cc:333] stopping tablet replica
W20260709 13:18:40.011612 16271 consensus_peers.cc:597] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.011777  6030 raft_consensus.cc:2243] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.012456  6030 raft_consensus.cc:2272] T 029ee74f09f8428c81f8feae77fd8e84 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.015810  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:40.016680  6030 raft_consensus.cc:2243] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.017274  6030 raft_consensus.cc:2272] T d0d21ba5abb841f1bd1d8564ddbb78c2 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.019773 16271 consensus_peers.cc:597] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.020913  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:40.021694  6030 raft_consensus.cc:2243] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.022279  6030 raft_consensus.cc:2272] T 2d99e00427c045ab9f5b3c444ecf06a0 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.026283  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:40.027094  6030 raft_consensus.cc:2243] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.027894  6030 raft_consensus.cc:2272] T b38373beeca944c692d0895d25f56ad8 P fe046a372b6a4df982eebe83cf3ee184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.031379  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:40.032121  6030 raft_consensus.cc:2243] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.032637  6030 raft_consensus.cc:2272] T 3e0799b6996943f9b0b9093d073d6dbd P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.035207 16271 consensus_peers.cc:597] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.035908  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:40.036528  6030 raft_consensus.cc:2243] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.037492  6030 raft_consensus.cc:2272] T 99394f0dfd1046148485eae1db42c1fb P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.040810  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:40.041545  6030 raft_consensus.cc:2243] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:18:40.042002 16419 consensus_peers.cc:597] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.042852  6030 raft_consensus.cc:2272] T e1767e0ec9e442fd80d03d4f83e02ddb P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.045140 16345 consensus_peers.cc:597] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.046536  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:40.048877  6030 raft_consensus.cc:2243] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.050359  6030 raft_consensus.cc:2272] T d360c4d961f74b5e95455c5f84d85ad0 P fe046a372b6a4df982eebe83cf3ee184 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.050863 16271 consensus_peers.cc:597] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.098443 16345 consensus_peers.cc:597] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.135504 16419 consensus_peers.cc:597] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.137957 16419 consensus_peers.cc:597] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.140949  6030 tablet_server.cc:196] TabletServer@127.5.227.129:36859 shutdown complete.
W20260709 13:18:40.163635 16271 consensus_peers.cc:597] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.168290 16419 consensus_peers.cc:597] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.173036 16345 consensus_peers.cc:597] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.183285 16271 consensus_peers.cc:597] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.198951 16271 consensus_peers.cc:597] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.230351 16271 consensus_peers.cc:597] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.270378 16271 consensus_peers.cc:597] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.273981  6030 tablet_server.cc:179] TabletServer@127.5.227.130:0 shutting down...
W20260709 13:18:40.273944 16419 consensus_peers.cc:597] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.337143 16343 consensus_peers.cc:597] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.338052 16343 consensus_peers.cc:597] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.349743 16271 consensus_peers.cc:597] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.350860 16417 consensus_peers.cc:597] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.351657 16417 consensus_peers.cc:597] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.363965 16345 consensus_peers.cc:597] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c -> Peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Couldn't send request to peer fe046a372b6a4df982eebe83cf3ee184. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.377323 16343 consensus_peers.cc:597] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.377883  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:18:40.378036 16343 consensus_peers.cc:597] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.379334  6030 tablet_replica.cc:333] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.380558  6030 raft_consensus.cc:2243] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.381632  6030 raft_consensus.cc:2272] T a53592287efd4b3ba8208b91130d38cd P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.384881  6030 tablet_replica.cc:333] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.385834  6030 raft_consensus.cc:2243] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.387459  6030 raft_consensus.cc:2272] T b38373beeca944c692d0895d25f56ad8 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.392534  6030 tablet_replica.cc:333] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.393654  6030 raft_consensus.cc:2243] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.394435  6030 raft_consensus.cc:2272] T 0c7586df8cdd4eff8a7fffe7fde7997d P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.395437 16343 consensus_peers.cc:597] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.404444  6030 tablet_replica.cc:333] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.405748  6030 raft_consensus.cc:2243] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.406424  6030 raft_consensus.cc:2272] T d360c4d961f74b5e95455c5f84d85ad0 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.410478  6030 tablet_replica.cc:333] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.411710  6030 raft_consensus.cc:2243] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.412364  6030 raft_consensus.cc:2272] T a2559ecae96646189c0bc8afbe49ce16 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.416411  6030 tablet_replica.cc:333] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.417371  6030 raft_consensus.cc:2243] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.417810  6030 raft_consensus.cc:2272] T 78eb3c242fc743cf98a4f1d7cffd975b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.420149  6030 tablet_replica.cc:333] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.421339  6030 raft_consensus.cc:2243] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.421958  6030 raft_consensus.cc:2272] T 20206667639a48e8a81abb2b99441995 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.425422  6030 tablet_replica.cc:333] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.426182  6030 raft_consensus.cc:2243] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.427248  6030 raft_consensus.cc:2272] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.429798  6030 tablet_replica.cc:333] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.430491  6030 raft_consensus.cc:2243] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.431860  6030 raft_consensus.cc:2272] T e6acf3d9f73d4f38817c4ea25ba9139b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.436600  6030 tablet_replica.cc:333] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.437551  6030 raft_consensus.cc:2243] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.438201  6030 raft_consensus.cc:2272] T 751bec01e5d145adac78c28b7b581d73 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.441392  6030 tablet_replica.cc:333] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.442375  6030 raft_consensus.cc:2243] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.443631  6030 raft_consensus.cc:2272] T 246e5a50c75e4f0fa58538237d61e585 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.447031  6030 tablet_replica.cc:333] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.447973  6030 raft_consensus.cc:2243] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.448565  6030 raft_consensus.cc:2272] T c96fff68e07b4c3f82332cd44d0dd3d2 P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.451903  6030 tablet_replica.cc:333] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.452877  6030 raft_consensus.cc:2243] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.454182  6030 raft_consensus.cc:2272] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.457705  6030 tablet_replica.cc:333] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.458668  6030 raft_consensus.cc:2243] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.459303  6030 raft_consensus.cc:2272] T 0ab0b93ad21849139b174c34a46ce646 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.462555  6030 tablet_replica.cc:333] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.463419  6030 raft_consensus.cc:2243] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.464425  6030 raft_consensus.cc:2272] T 1e67f760e0414db092683b5e5ce3ef8f P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.467777  6030 tablet_replica.cc:333] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.469005  6030 raft_consensus.cc:2243] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.469592  6030 raft_consensus.cc:2272] T 6196aafd32f448a7964c50df2be2a4b3 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.472599  6030 tablet_replica.cc:333] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.473420  6030 raft_consensus.cc:2243] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.473958  6030 raft_consensus.cc:2272] T afba79efe5d1481e8a1a31d1da74dd55 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.476902  6030 tablet_replica.cc:333] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.477674  6030 raft_consensus.cc:2243] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.478284  6030 raft_consensus.cc:2272] T 58607755710543c9809dbf53631f4738 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.481307  6030 tablet_replica.cc:333] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.482152  6030 raft_consensus.cc:2243] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.482607  6030 raft_consensus.cc:2272] T dbce7ea12f554f25812e7ef8fdcc892e P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.483047 16417 consensus_peers.cc:597] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.485291  6030 tablet_replica.cc:333] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.486130  6030 raft_consensus.cc:2243] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.486604  6030 raft_consensus.cc:2272] T 6c139e8f552d449faa03901839fb43b1 P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.488883  6030 tablet_replica.cc:333] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.489490  6030 raft_consensus.cc:2243] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.490595  6030 raft_consensus.cc:2272] T 295c483df4e74d1a8314d5219167cc16 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.492929  6030 tablet_replica.cc:333] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.493593  6030 raft_consensus.cc:2243] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.494701  6030 raft_consensus.cc:2272] T 3e0799b6996943f9b0b9093d073d6dbd P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.497422  6030 tablet_replica.cc:333] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.498245  6030 raft_consensus.cc:2243] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.498829  6030 raft_consensus.cc:2272] T ae815525899842d7983214ddeeec135f P 35e0de78970041afb173662b1c34598e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.498947 16417 consensus_peers.cc:597] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.501015  6030 tablet_replica.cc:333] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.501811  6030 raft_consensus.cc:2243] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.502312  6030 raft_consensus.cc:2272] T b562a19c9d1947508c77a1a946dc873b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.504709  6030 tablet_replica.cc:333] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.505472  6030 raft_consensus.cc:2243] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.505986  6030 raft_consensus.cc:2272] T eab0948ebbcd4a558567e5fbab88a4b1 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.509049  6030 tablet_replica.cc:333] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.509886  6030 raft_consensus.cc:2243] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.511056  6030 raft_consensus.cc:2272] T e1d2386a536042dcb0271fdc91474697 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.513764  6030 tablet_replica.cc:333] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.514424  6030 raft_consensus.cc:2243] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.515450  6030 raft_consensus.cc:2272] T 0a15949e759d40be9560228008490390 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.518841  6030 tablet_replica.cc:333] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.519785  6030 raft_consensus.cc:2243] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.520548  6030 raft_consensus.cc:2272] T 84888dc6b86747d6b08b125a8df5394c P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.524617  6030 tablet_replica.cc:333] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.525427  6030 raft_consensus.cc:2243] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:40.525830 16417 consensus_peers.cc:597] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.526046  6030 raft_consensus.cc:2272] T 08e2d2c479b141a9be75ed9b938e974b P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.528702  6030 tablet_replica.cc:333] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.529690  6030 raft_consensus.cc:2243] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.530535  6030 raft_consensus.cc:2272] T 8dc2538e6830475791d9f70a5adcee9b P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.533386  6030 tablet_replica.cc:333] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.534090  6030 raft_consensus.cc:2243] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.535203  6030 raft_consensus.cc:2272] T 403c864cda0f4da0b0547c0a3f1cb3ea P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.537781  6030 tablet_replica.cc:333] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.538398  6030 raft_consensus.cc:2243] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.539284  6030 raft_consensus.cc:2272] T 506096b267e14e6f8e28c082062c6481 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.542223  6030 tablet_replica.cc:333] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.543530  6030 raft_consensus.cc:2243] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.544749  6030 raft_consensus.cc:2272] T 28e25b852f6d47959be47bdd036d45a2 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.548543  6030 tablet_replica.cc:333] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.549610  6030 raft_consensus.cc:2243] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.550166  6030 raft_consensus.cc:2272] T 1f63940625724ed3a4294375705e345d P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.553231  6030 tablet_replica.cc:333] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.553764  6030 raft_consensus.cc:2243] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.554322  6030 raft_consensus.cc:2272] T 48b93db33f164564bbded82c6ca74a3a P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.557528  6030 tablet_replica.cc:333] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.558348  6030 raft_consensus.cc:2243] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.559283  6030 raft_consensus.cc:2272] T 2d99e00427c045ab9f5b3c444ecf06a0 P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.562266  6030 tablet_replica.cc:333] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.563388  6030 raft_consensus.cc:2243] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:40.563405 16417 consensus_peers.cc:597] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.564318  6030 raft_consensus.cc:2272] T 780cc3fe16024ae9837ab737de1d769c P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.567553  6030 tablet_replica.cc:333] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.568357  6030 raft_consensus.cc:2243] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.568909  6030 raft_consensus.cc:2272] T 029ee74f09f8428c81f8feae77fd8e84 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.572359  6030 tablet_replica.cc:333] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.573052  6030 raft_consensus.cc:2243] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.573606  6030 raft_consensus.cc:2272] T de0abdbd9a6846b5a7aef90fef35d03f P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.579169  6030 tablet_replica.cc:333] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.579967  6030 raft_consensus.cc:2243] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.581077  6030 raft_consensus.cc:2272] T 145398d14cf9402e819285d9fc5253b9 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.583617  6030 tablet_replica.cc:333] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.584378  6030 raft_consensus.cc:2243] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.584967  6030 raft_consensus.cc:2272] T 1f28345dd0f24a26b496904242ab1d87 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.587949  6030 tablet_replica.cc:333] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.588729  6030 raft_consensus.cc:2243] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.589304  6030 raft_consensus.cc:2272] T 738b09b19983412bbbf2fccd7c5687b5 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.592217 16343 consensus_peers.cc:597] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.592461  6030 tablet_replica.cc:333] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.593386  6030 raft_consensus.cc:2243] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.593989  6030 raft_consensus.cc:2272] T e1767e0ec9e442fd80d03d4f83e02ddb P 35e0de78970041afb173662b1c34598e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.596326  6030 tablet_replica.cc:333] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e: stopping tablet replica
I20260709 13:18:40.596906  6030 raft_consensus.cc:2243] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.597886  6030 raft_consensus.cc:2272] T 6c5c65063a9241f6a62a7867005e3e57 P 35e0de78970041afb173662b1c34598e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.618072 16343 consensus_peers.cc:597] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.662175 16343 consensus_peers.cc:597] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.675490 16343 consensus_peers.cc:597] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:42747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.688550  6030 tablet_server.cc:196] TabletServer@127.5.227.130:0 shutdown complete.
W20260709 13:18:40.692075 16343 consensus_peers.cc:597] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:42747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.704370 16417 consensus_peers.cc:597] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:42747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.713379 16343 consensus_peers.cc:597] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:42747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.733858 16343 consensus_peers.cc:597] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:42747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:40.773121 16343 consensus_peers.cc:597] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c -> Peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Couldn't send request to peer 35e0de78970041afb173662b1c34598e. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:42747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.802727  6030 tablet_server.cc:179] TabletServer@127.5.227.131:0 shutting down...
W20260709 13:18:40.844889 16417 consensus_peers.cc:597] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.883391 17458 raft_consensus.cc:493] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:40.884167 17458 raft_consensus.cc:515] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:40.889622 17458 leader_election.cc:290] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:40.891413  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:18:40.891867 16417 leader_election.cc:336] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:40.894795  6030 tablet_replica.cc:333] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.895953  6030 raft_consensus.cc:2243] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:18:40.897877 16419 leader_election.cc:336] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:40.898113  6030 raft_consensus.cc:2272] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.898422 16417 consensus_peers.cc:597] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.898547 16419 leader_election.cc:304] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:40.899423 17458 raft_consensus.cc:2749] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:40.901752  6030 tablet_replica.cc:333] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.902861  6030 raft_consensus.cc:2243] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.903508  6030 raft_consensus.cc:2272] T 8c8b6cdc63734f54b3ebb138b4e0b94c P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.906498 16417 consensus_peers.cc:597] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.907455  6030 tablet_replica.cc:333] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.908345  6030 raft_consensus.cc:2243] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.909065  6030 raft_consensus.cc:2272] T 246e5a50c75e4f0fa58538237d61e585 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.912240  6030 tablet_replica.cc:333] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.913256  6030 raft_consensus.cc:2243] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.914517  6030 raft_consensus.cc:2272] T 78eb3c242fc743cf98a4f1d7cffd975b P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.917508  6030 tablet_replica.cc:333] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.918273  6030 raft_consensus.cc:2243] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.918861  6030 raft_consensus.cc:2272] T 3943f59d05384cb0b44c356da96441c8 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.921723  6030 tablet_replica.cc:333] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.922519  6030 raft_consensus.cc:2243] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.923161  6030 raft_consensus.cc:2272] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.926132  6030 tablet_replica.cc:333] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.927184  6030 raft_consensus.cc:2243] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.927830  6030 raft_consensus.cc:2272] T a2559ecae96646189c0bc8afbe49ce16 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.931227  6030 tablet_replica.cc:333] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
W20260709 13:18:40.932176 16417 consensus_peers.cc:597] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.932068  6030 raft_consensus.cc:2243] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.933240  6030 raft_consensus.cc:2272] T 20206667639a48e8a81abb2b99441995 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.936735  6030 tablet_replica.cc:333] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.937637  6030 raft_consensus.cc:2243] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.938287  6030 raft_consensus.cc:2272] T 2485b97ef87a4855b8cc1c0f6e0ba2c7 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.941495  6030 tablet_replica.cc:333] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.942394  6030 raft_consensus.cc:2243] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.943604  6030 raft_consensus.cc:2272] T 751bec01e5d145adac78c28b7b581d73 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.946817  6030 tablet_replica.cc:333] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.947715  6030 raft_consensus.cc:2243] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.948467  6030 raft_consensus.cc:2272] T cf2962c590b5497da58a885103a32aef P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.951690  6030 tablet_replica.cc:333] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.952605  6030 raft_consensus.cc:2243] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.953168  6030 raft_consensus.cc:2272] T 0ab0b93ad21849139b174c34a46ce646 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.956280  6030 tablet_replica.cc:333] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.957158  6030 raft_consensus.cc:2243] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.957775  6030 raft_consensus.cc:2272] T b86655b05b814b00bcf81c0da904bdaf P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.960889  6030 tablet_replica.cc:333] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.961613  6030 raft_consensus.cc:2243] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:18:40.962002 16417 consensus_peers.cc:597] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.962734  6030 raft_consensus.cc:2272] T 6196aafd32f448a7964c50df2be2a4b3 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.966197  6030 tablet_replica.cc:333] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.967087  6030 raft_consensus.cc:2243] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.967758  6030 raft_consensus.cc:2272] T a13fb80f9cf64345a2b3e9f4009281b6 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.970741  6030 tablet_replica.cc:333] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.971470  6030 raft_consensus.cc:2243] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.972697  6030 raft_consensus.cc:2272] T afba79efe5d1481e8a1a31d1da74dd55 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.975592  6030 tablet_replica.cc:333] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.976433  6030 raft_consensus.cc:2243] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.977169  6030 raft_consensus.cc:2272] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.982509  6030 tablet_replica.cc:333] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.983546  6030 raft_consensus.cc:2243] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:40.984162  6030 raft_consensus.cc:2272] T 99394f0dfd1046148485eae1db42c1fb P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:40.984833 16417 consensus_peers.cc:597] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.987303  6030 tablet_replica.cc:333] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
W20260709 13:18:40.987910 16417 consensus_peers.cc:597] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.988312  6030 raft_consensus.cc:2243] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:40.988867 16417 consensus_peers.cc:597] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:40.989073  6030 raft_consensus.cc:2272] T 3e0799b6996943f9b0b9093d073d6dbd P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.992924  6030 tablet_replica.cc:333] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.993857  6030 raft_consensus.cc:2243] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:40.995180  6030 raft_consensus.cc:2272] T b562a19c9d1947508c77a1a946dc873b P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:40.995282 17462 raft_consensus.cc:493] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:40.995910 17462 raft_consensus.cc:515] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:40.998262 17462 leader_election.cc:290] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0763e17c84d248738dade73ded2c5f71 (127.5.227.132:42671), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:40.998807  6030 tablet_replica.cc:333] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:40.999220 16453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc75ff85212648e2accfc8fa2e73685e" candidate_uuid: "0c736bf768804f2e86a875366c12a71c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0763e17c84d248738dade73ded2c5f71" is_pre_election: true
I20260709 13:18:40.999843  6030 raft_consensus.cc:2243] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.001152  6030 raft_consensus.cc:2272] T eab0948ebbcd4a558567e5fbab88a4b1 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.004087  6030 tablet_replica.cc:333] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.005026  6030 raft_consensus.cc:2243] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.005612  6030 raft_consensus.cc:2272] T 08e2d2c479b141a9be75ed9b938e974b P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.005590 16345 leader_election.cc:336] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:41.006318 16345 leader_election.cc:304] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 0763e17c84d248738dade73ded2c5f71, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:41.007210 17462 raft_consensus.cc:2749] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.008862  6030 tablet_replica.cc:333] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.009760  6030 raft_consensus.cc:2243] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.010272  6030 raft_consensus.cc:2272] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.013175  6030 tablet_replica.cc:333] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.013990  6030 raft_consensus.cc:2243] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.014480  6030 raft_consensus.cc:2272] T 1ec87a6842274eeeb8d174967fd4cead P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.016850  6030 tablet_replica.cc:333] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.017656  6030 raft_consensus.cc:2243] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.019075  6030 raft_consensus.cc:2272] T 029ee74f09f8428c81f8feae77fd8e84 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.022603  6030 tablet_replica.cc:333] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.023700 17459 raft_consensus.cc:493] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:41.024354 17459 raft_consensus.cc:515] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:41.026713 17459 leader_election.cc:290] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
I20260709 13:18:41.027329 17462 raft_consensus.cc:493] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:41.027941 17462 raft_consensus.cc:515] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } } peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } }
I20260709 13:18:41.023767  6030 raft_consensus.cc:2243] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.031869  6030 raft_consensus.cc:2272] T de0abdbd9a6846b5a7aef90fef35d03f P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.035120  6030 tablet_replica.cc:333] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.035974  6030 raft_consensus.cc:2243] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.037096  6030 raft_consensus.cc:2272] T 1f28345dd0f24a26b496904242ab1d87 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.036229 16345 leader_election.cc:336] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
W20260709 13:18:41.038355 16419 leader_election.cc:336] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
W20260709 13:18:41.038478 16343 leader_election.cc:336] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Network error: Client connection negotiation failed: client connection to 127.5.227.130:42747: connect: Connection refused (error 111)
I20260709 13:18:41.039058 16343 leader_election.cc:304] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c736bf768804f2e86a875366c12a71c; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:41.039940 17453 raft_consensus.cc:2749] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.041103  6030 tablet_replica.cc:333] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.042047  6030 raft_consensus.cc:2243] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.042773  6030 raft_consensus.cc:2272] T e1d2386a536042dcb0271fdc91474697 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.036746 17462 leader_election.cc:290] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
W20260709 13:18:41.045414 16417 leader_election.cc:336] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Network error: Client connection negotiation failed: client connection to 127.5.227.130:42747: connect: Connection refused (error 111)
I20260709 13:18:41.045751  6030 tablet_replica.cc:333] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.046576 16417 leader_election.cc:304] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:41.047119  6030 raft_consensus.cc:2243] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.048580  6030 raft_consensus.cc:2272] T 0a15949e759d40be9560228008490390 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.049042 17459 raft_consensus.cc:2749] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.052134  6030 tablet_replica.cc:333] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.053428  6030 raft_consensus.cc:2243] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:18:41.053870 16417 consensus_peers.cc:597] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.054760  6030 raft_consensus.cc:2272] T 28e25b852f6d47959be47bdd036d45a2 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.057173  6030 tablet_replica.cc:333] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.057754  6030 raft_consensus.cc:2243] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.058190  6030 raft_consensus.cc:2272] T 1f63940625724ed3a4294375705e345d P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.061136  6030 tablet_replica.cc:333] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.062139  6030 raft_consensus.cc:2243] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.063498  6030 raft_consensus.cc:2272] T 48b93db33f164564bbded82c6ca74a3a P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.066911  6030 tablet_replica.cc:333] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.067836  6030 raft_consensus.cc:2243] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:18:41.068080 16417 consensus_peers.cc:597] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.069280  6030 raft_consensus.cc:2272] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.071887  6030 tablet_replica.cc:333] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.072638  6030 raft_consensus.cc:2243] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.073614  6030 raft_consensus.cc:2272] T 780cc3fe16024ae9837ab737de1d769c P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.076624  6030 tablet_replica.cc:333] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.077391  6030 raft_consensus.cc:2243] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.077859  6030 raft_consensus.cc:2272] T dc75ff85212648e2accfc8fa2e73685e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.080150  6030 tablet_replica.cc:333] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.080761  6030 raft_consensus.cc:2243] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.082034  6030 raft_consensus.cc:2272] T 128dfcd70ea847fbae9691a10e6db1a5 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.084676  6030 tablet_replica.cc:333] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.085345  6030 raft_consensus.cc:2243] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.085865  6030 raft_consensus.cc:2272] T 6c5c65063a9241f6a62a7867005e3e57 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.088518  6030 tablet_replica.cc:333] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.089218  6030 raft_consensus.cc:2243] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.089775  6030 raft_consensus.cc:2272] T e1767e0ec9e442fd80d03d4f83e02ddb P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.092703  6030 tablet_replica.cc:333] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.093439  6030 raft_consensus.cc:2243] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.093988  6030 raft_consensus.cc:2272] T c883f64d971d4eeeb73836cdb95e1071 P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.097141  6030 tablet_replica.cc:333] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.097790  6030 raft_consensus.cc:2243] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.098491  6030 raft_consensus.cc:2272] T dbce7ea12f554f25812e7ef8fdcc892e P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.099069 16417 consensus_peers.cc:597] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.101236  6030 tablet_replica.cc:333] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.101954  6030 raft_consensus.cc:2243] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.102432  6030 raft_consensus.cc:2272] T 6c139e8f552d449faa03901839fb43b1 P 0c736bf768804f2e86a875366c12a71c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.105115  6030 tablet_replica.cc:333] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.106118  6030 raft_consensus.cc:2243] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.106904  6030 raft_consensus.cc:2272] T 1e67f760e0414db092683b5e5ce3ef8f P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.109602  6030 tablet_replica.cc:333] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.110332  6030 raft_consensus.cc:2243] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.111093  6030 raft_consensus.cc:2272] T 8997dd86a5ac421ba825e30c817e3ceb P 0c736bf768804f2e86a875366c12a71c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.114427  6030 tablet_replica.cc:333] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c: stopping tablet replica
I20260709 13:18:41.115293  6030 raft_consensus.cc:2243] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.115969  6030 raft_consensus.cc:2272] T d0408e10512d4613a6250d70072ab152 P 0c736bf768804f2e86a875366c12a71c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.133016 16417 consensus_peers.cc:597] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.160491 16417 consensus_peers.cc:597] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 -> Peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Couldn't send request to peer 0c736bf768804f2e86a875366c12a71c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.174490 17459 raft_consensus.cc:493] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:41.176306 17459 raft_consensus.cc:515] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:41.178817 17459 leader_election.cc:290] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
W20260709 13:18:41.180197 16417 connection.cc:573] client connection to 127.5.227.131:34771 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:18:41.185401 16417 leader_election.cc:336] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Network error: Client connection negotiation failed: client connection to 127.5.227.131:34771: connect: Connection refused (error 111)
W20260709 13:18:41.187371 16419 leader_election.cc:336] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:41.187909 16419 leader_election.cc:304] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:41.188534 17459 raft_consensus.cc:2749] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.188799 17428 raft_consensus.cc:493] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:41.189626 17428 raft_consensus.cc:515] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:41.192169 17428 leader_election.cc:290] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
W20260709 13:18:41.197093 16419 leader_election.cc:336] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
W20260709 13:18:41.197988 16417 leader_election.cc:336] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Network error: Client connection negotiation failed: client connection to 127.5.227.130:42747: connect: Connection refused (error 111)
I20260709 13:18:41.198467 16417 leader_election.cc:304] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:41.199206  6030 tablet_server.cc:196] TabletServer@127.5.227.131:0 shutdown complete.
I20260709 13:18:41.199343 17458 raft_consensus.cc:2749] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.227366 17459 raft_consensus.cc:493] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:41.228216 17459 raft_consensus.cc:515] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:41.231741 17459 leader_election.cc:290] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
W20260709 13:18:41.236281 16419 leader_election.cc:336] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
W20260709 13:18:41.236944 16417 leader_election.cc:336] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Network error: Client connection negotiation failed: client connection to 127.5.227.131:34771: connect: Connection refused (error 111)
I20260709 13:18:41.237463 16417 leader_election.cc:304] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:41.238284 17459 raft_consensus.cc:2749] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.294360  6030 tablet_server.cc:179] TabletServer@127.5.227.132:0 shutting down...
I20260709 13:18:41.296931 17459 raft_consensus.cc:493] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:41.298946 17459 raft_consensus.cc:515] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:41.301277 17459 leader_election.cc:290] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
W20260709 13:18:41.305513 16419 leader_election.cc:336] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:41.306272 17459 raft_consensus.cc:493] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
W20260709 13:18:41.307403 16417 leader_election.cc:336] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Network error: Client connection negotiation failed: client connection to 127.5.227.130:42747: connect: Connection refused (error 111)
I20260709 13:18:41.307943 16417 leader_election.cc:304] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:41.308863 17428 raft_consensus.cc:2749] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.306960 17459 raft_consensus.cc:515] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } } peers { permanent_uuid: "35e0de78970041afb173662b1c34598e" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 42747 } }
I20260709 13:18:41.315500 17459 leader_election.cc:290] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859), 35e0de78970041afb173662b1c34598e (127.5.227.130:42747)
W20260709 13:18:41.324923 16417 leader_election.cc:336] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 35e0de78970041afb173662b1c34598e (127.5.227.130:42747): Network error: Client connection negotiation failed: client connection to 127.5.227.130:42747: connect: Connection refused (error 111)
W20260709 13:18:41.325851 16419 leader_election.cc:336] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:41.326359 16419 leader_election.cc:304] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 35e0de78970041afb173662b1c34598e, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:41.328843 17459 raft_consensus.cc:2749] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.339591 17459 raft_consensus.cc:493] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:41.340230 17459 raft_consensus.cc:515] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:41.345945 17459 leader_election.cc:290] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
W20260709 13:18:41.349097 16417 leader_election.cc:336] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Network error: Client connection negotiation failed: client connection to 127.5.227.131:34771: connect: Connection refused (error 111)
W20260709 13:18:41.352335 16419 leader_election.cc:336] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:41.352773 16419 leader_election.cc:304] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
I20260709 13:18:41.353932 17459 raft_consensus.cc:2749] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.360448  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:41.361672  6030 tablet_replica.cc:333] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.362879  6030 raft_consensus.cc:2243] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.363514  6030 raft_consensus.cc:2272] T 1ec87a6842274eeeb8d174967fd4cead P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.366567  6030 tablet_replica.cc:333] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.367455  6030 raft_consensus.cc:2243] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.368013  6030 raft_consensus.cc:2272] T b38373beeca944c692d0895d25f56ad8 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.371111  6030 tablet_replica.cc:333] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.371965  6030 raft_consensus.cc:2243] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.373092  6030 raft_consensus.cc:2272] T 1f63940625724ed3a4294375705e345d P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.376034  6030 tablet_replica.cc:333] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.376847  6030 raft_consensus.cc:2243] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.377466  6030 raft_consensus.cc:2272] T 0c7586df8cdd4eff8a7fffe7fde7997d P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.382047  6030 tablet_replica.cc:333] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.383137  6030 raft_consensus.cc:2243] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.383739  6030 raft_consensus.cc:2272] T d360c4d961f74b5e95455c5f84d85ad0 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.386972  6030 tablet_replica.cc:333] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.387841  6030 raft_consensus.cc:2243] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.388435  6030 raft_consensus.cc:2272] T 78eb3c242fc743cf98a4f1d7cffd975b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.391314  6030 tablet_replica.cc:333] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.392184  6030 raft_consensus.cc:2243] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.392773  6030 raft_consensus.cc:2272] T 3943f59d05384cb0b44c356da96441c8 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.395593  6030 tablet_replica.cc:333] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.396370  6030 raft_consensus.cc:2243] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.397626  6030 raft_consensus.cc:2272] T a2559ecae96646189c0bc8afbe49ce16 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.399837 17459 raft_consensus.cc:493] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe046a372b6a4df982eebe83cf3ee184)
I20260709 13:18:41.400946  6030 tablet_replica.cc:333] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.400678 17459 raft_consensus.cc:515] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c736bf768804f2e86a875366c12a71c" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 34771 } } peers { permanent_uuid: "0763e17c84d248738dade73ded2c5f71" member_type: VOTER last_known_addr { host: "127.5.227.132" port: 42671 } } peers { permanent_uuid: "fe046a372b6a4df982eebe83cf3ee184" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36859 } }
I20260709 13:18:41.401906  6030 raft_consensus.cc:2243] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.402413  6030 raft_consensus.cc:2272] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.402675 17459 leader_election.cc:290] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771), fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859)
I20260709 13:18:41.405910  6030 tablet_replica.cc:333] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
W20260709 13:18:41.406466 16417 leader_election.cc:336] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c736bf768804f2e86a875366c12a71c (127.5.227.131:34771): Network error: Client connection negotiation failed: client connection to 127.5.227.131:34771: connect: Connection refused (error 111)
I20260709 13:18:41.406827  6030 raft_consensus.cc:2243] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.407743  6030 raft_consensus.cc:2272] T 20206667639a48e8a81abb2b99441995 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.407716 16419 leader_election.cc:336] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe046a372b6a4df982eebe83cf3ee184 (127.5.227.129:36859): Network error: Client connection negotiation failed: client connection to 127.5.227.129:36859: connect: Connection refused (error 111)
I20260709 13:18:41.408579 16419 leader_election.cc:304] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0763e17c84d248738dade73ded2c5f71; no voters: 0c736bf768804f2e86a875366c12a71c, fe046a372b6a4df982eebe83cf3ee184
W20260709 13:18:41.409207 16419 raft_consensus.cc:2686] T 99394f0dfd1046148485eae1db42c1fb P 0763e17c84d248738dade73ded2c5f71: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:18:41.411126  6030 tablet_replica.cc:333] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.411844  6030 raft_consensus.cc:2243] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.412330  6030 raft_consensus.cc:2272] T e6acf3d9f73d4f38817c4ea25ba9139b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.414449  6030 tablet_replica.cc:333] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.415165  6030 raft_consensus.cc:2243] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.416023  6030 raft_consensus.cc:2272] T ccf1f8703ff64c89afb0d1dbe0eab26f P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.418224  6030 tablet_replica.cc:333] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.418946  6030 raft_consensus.cc:2243] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.419909  6030 raft_consensus.cc:2272] T 751bec01e5d145adac78c28b7b581d73 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.422612  6030 tablet_replica.cc:333] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.423457  6030 raft_consensus.cc:2243] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.423962  6030 raft_consensus.cc:2272] T 145398d14cf9402e819285d9fc5253b9 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.426854  6030 tablet_replica.cc:333] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.427557  6030 raft_consensus.cc:2243] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.428047  6030 raft_consensus.cc:2272] T c96fff68e07b4c3f82332cd44d0dd3d2 P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.430167  6030 tablet_replica.cc:333] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.430828  6030 raft_consensus.cc:2243] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.431668  6030 raft_consensus.cc:2272] T b86655b05b814b00bcf81c0da904bdaf P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.433748  6030 tablet_replica.cc:333] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.434378  6030 raft_consensus.cc:2243] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.434876  6030 raft_consensus.cc:2272] T 58607755710543c9809dbf53631f4738 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.436812  6030 tablet_replica.cc:333] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.437410  6030 raft_consensus.cc:2243] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.437871  6030 raft_consensus.cc:2272] T 295c483df4e74d1a8314d5219167cc16 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.440053  6030 tablet_replica.cc:333] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.440657  6030 raft_consensus.cc:2243] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.441478  6030 raft_consensus.cc:2272] T a13fb80f9cf64345a2b3e9f4009281b6 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.444123  6030 tablet_replica.cc:333] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.444890  6030 raft_consensus.cc:2243] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.445439  6030 raft_consensus.cc:2272] T afba79efe5d1481e8a1a31d1da74dd55 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.448058  6030 tablet_replica.cc:333] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.448670  6030 raft_consensus.cc:2243] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.449136  6030 raft_consensus.cc:2272] T 8dc2538e6830475791d9f70a5adcee9b P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.451395  6030 tablet_replica.cc:333] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.451982  6030 raft_consensus.cc:2243] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.452759  6030 raft_consensus.cc:2272] T 3a5ed6ba8f644df7bcec53f34c63a569 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.454979  6030 tablet_replica.cc:333] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.455585  6030 raft_consensus.cc:2243] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.455996  6030 raft_consensus.cc:2272] T eab0948ebbcd4a558567e5fbab88a4b1 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.458000  6030 tablet_replica.cc:333] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.458561  6030 raft_consensus.cc:2243] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.459059  6030 raft_consensus.cc:2272] T a53592287efd4b3ba8208b91130d38cd P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.461045  6030 tablet_replica.cc:333] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.461555  6030 raft_consensus.cc:2243] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.461930  6030 raft_consensus.cc:2272] T 4702fc1d81a24e6683bf2a12ebd8d108 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.464507  6030 tablet_replica.cc:333] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.465148  6030 raft_consensus.cc:2243] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.465844  6030 raft_consensus.cc:2272] T ae815525899842d7983214ddeeec135f P 0763e17c84d248738dade73ded2c5f71 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.468678  6030 tablet_replica.cc:333] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.469359  6030 raft_consensus.cc:2243] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.469995  6030 raft_consensus.cc:2272] T dc75ff85212648e2accfc8fa2e73685e P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.472589  6030 tablet_replica.cc:333] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.473191  6030 raft_consensus.cc:2243] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.473683  6030 raft_consensus.cc:2272] T 128dfcd70ea847fbae9691a10e6db1a5 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.476648  6030 tablet_replica.cc:333] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.477353  6030 raft_consensus.cc:2243] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.478271  6030 raft_consensus.cc:2272] T 84888dc6b86747d6b08b125a8df5394c P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.480902  6030 tablet_replica.cc:333] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.481520  6030 raft_consensus.cc:2243] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.482429  6030 raft_consensus.cc:2272] T c883f64d971d4eeeb73836cdb95e1071 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.484927  6030 tablet_replica.cc:333] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.485591  6030 raft_consensus.cc:2243] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.486080  6030 raft_consensus.cc:2272] T 28e25b852f6d47959be47bdd036d45a2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.488436  6030 tablet_replica.cc:333] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.489120  6030 raft_consensus.cc:2243] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.489607  6030 raft_consensus.cc:2272] T d0d21ba5abb841f1bd1d8564ddbb78c2 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.491865  6030 tablet_replica.cc:333] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.492499  6030 raft_consensus.cc:2243] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.493080  6030 raft_consensus.cc:2272] T 2d99e00427c045ab9f5b3c444ecf06a0 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.495378  6030 tablet_replica.cc:333] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.496028  6030 raft_consensus.cc:2243] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.496524  6030 raft_consensus.cc:2272] T 780cc3fe16024ae9837ab737de1d769c P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.498980  6030 tablet_replica.cc:333] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.499607  6030 raft_consensus.cc:2243] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.500079  6030 raft_consensus.cc:2272] T 506096b267e14e6f8e28c082062c6481 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.502301  6030 tablet_replica.cc:333] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.503012  6030 raft_consensus.cc:2243] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.503515  6030 raft_consensus.cc:2272] T 403c864cda0f4da0b0547c0a3f1cb3ea P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.505689  6030 tablet_replica.cc:333] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.506300  6030 raft_consensus.cc:2243] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.506824  6030 raft_consensus.cc:2272] T 6c5c65063a9241f6a62a7867005e3e57 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.509156  6030 tablet_replica.cc:333] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.509775  6030 raft_consensus.cc:2243] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.510753  6030 raft_consensus.cc:2272] T cf2962c590b5497da58a885103a32aef P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.512952  6030 tablet_replica.cc:333] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.513576  6030 raft_consensus.cc:2243] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.514441  6030 raft_consensus.cc:2272] T 0ab0b93ad21849139b174c34a46ce646 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.516561  6030 tablet_replica.cc:333] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.517134  6030 raft_consensus.cc:2243] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.517933  6030 raft_consensus.cc:2272] T 738b09b19983412bbbf2fccd7c5687b5 P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.520098  6030 tablet_replica.cc:333] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.520742  6030 raft_consensus.cc:2243] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.521587  6030 raft_consensus.cc:2272] T 08e2d2c479b141a9be75ed9b938e974b P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.523677  6030 tablet_replica.cc:333] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.524195  6030 raft_consensus.cc:2243] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.524650  6030 raft_consensus.cc:2272] T 1e67f760e0414db092683b5e5ce3ef8f P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.526757  6030 tablet_replica.cc:333] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.527248  6030 raft_consensus.cc:2243] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.528095  6030 raft_consensus.cc:2272] T 8997dd86a5ac421ba825e30c817e3ceb P 0763e17c84d248738dade73ded2c5f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.530038  6030 tablet_replica.cc:333] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71: stopping tablet replica
I20260709 13:18:41.530531  6030 raft_consensus.cc:2243] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.531327  6030 raft_consensus.cc:2272] T d0408e10512d4613a6250d70072ab152 P 0763e17c84d248738dade73ded2c5f71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.603183  6030 tablet_server.cc:196] TabletServer@127.5.227.132:0 shutdown complete.
I20260709 13:18:41.671414  6030 master.cc:562] Master@127.5.227.190:42867 shutting down...
I20260709 13:18:41.705246  6030 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.705839  6030 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.706167  6030 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9ab76ab2e13548cd9aa4ff9d5112da32: stopping tablet replica
I20260709 13:18:41.732008  6030 master.cc:584] Master@127.5.227.190:42867 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36501 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:18:41.840978  6030 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.227.190:46061
I20260709 13:18:41.842780  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:41.849746 17464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:41.850978 17465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:41.851739 17467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:41.853183  6030 server_base.cc:1061] running on GCE node
I20260709 13:18:41.854377  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:41.854579  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:41.854796  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603121854779 us; error 0 us; skew 500 ppm
I20260709 13:18:41.855315  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:41.858165  6030 webserver.cc:533] Webserver started at http://127.5.227.190:39527/ using document root <none> and password file <none>
I20260709 13:18:41.858742  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:41.858914  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:41.859160  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:41.860316  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/master-0-root/instance:
uuid: "acc6ff720cb5415b900333910b2a5eee"
format_stamp: "Formatted at 2026-07-09 13:18:41 on dist-test-slave-tbwl"
I20260709 13:18:41.865738  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:18:41.869839 17472 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:41.871006  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:18:41.871464  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/master-0-root
uuid: "acc6ff720cb5415b900333910b2a5eee"
format_stamp: "Formatted at 2026-07-09 13:18:41 on dist-test-slave-tbwl"
I20260709 13:18:41.871832  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:41.891100  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:41.892402  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:41.937103  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.190:46061
I20260709 13:18:41.937354 17523 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.190:46061 every 8 connection(s)
I20260709 13:18:41.941237 17524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:41.955264 17524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee: Bootstrap starting.
I20260709 13:18:41.960588 17524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:41.966876 17524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee: No bootstrap required, opened a new log
I20260709 13:18:41.969614 17524 raft_consensus.cc:359] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc6ff720cb5415b900333910b2a5eee" member_type: VOTER }
I20260709 13:18:41.970055 17524 raft_consensus.cc:385] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:41.970419 17524 raft_consensus.cc:740] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc6ff720cb5415b900333910b2a5eee, State: Initialized, Role: FOLLOWER
I20260709 13:18:41.971177 17524 consensus_queue.cc:260] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc6ff720cb5415b900333910b2a5eee" member_type: VOTER }
I20260709 13:18:41.971678 17524 raft_consensus.cc:399] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:41.971913 17524 raft_consensus.cc:493] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:41.972486 17524 raft_consensus.cc:3060] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:41.978112 17524 raft_consensus.cc:515] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc6ff720cb5415b900333910b2a5eee" member_type: VOTER }
I20260709 13:18:41.978788 17524 leader_election.cc:304] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: acc6ff720cb5415b900333910b2a5eee; no voters: 
I20260709 13:18:41.980242 17524 leader_election.cc:290] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:41.980737 17527 raft_consensus.cc:2804] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:41.982589 17527 raft_consensus.cc:697] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [term 1 LEADER]: Becoming Leader. State: Replica: acc6ff720cb5415b900333910b2a5eee, State: Running, Role: LEADER
I20260709 13:18:41.983345 17527 consensus_queue.cc:237] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc6ff720cb5415b900333910b2a5eee" member_type: VOTER }
I20260709 13:18:41.983641 17524 sys_catalog.cc:565] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:41.988624 17529 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc6ff720cb5415b900333910b2a5eee. Latest consensus state: current_term: 1 leader_uuid: "acc6ff720cb5415b900333910b2a5eee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc6ff720cb5415b900333910b2a5eee" member_type: VOTER } }
I20260709 13:18:41.988714 17528 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "acc6ff720cb5415b900333910b2a5eee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc6ff720cb5415b900333910b2a5eee" member_type: VOTER } }
I20260709 13:18:41.989585 17529 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:41.989616 17528 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:41.999801 17533 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:42.009755 17533 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:42.011229  6030 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:42.021905 17533 catalog_manager.cc:1383] Generated new cluster ID: 03a6bd5e09884d15adde345761b97edb
I20260709 13:18:42.022297 17533 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:42.042164 17533 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:42.043921 17533 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:42.061590 17533 catalog_manager.cc:6070] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee: Generated new TSK 0
I20260709 13:18:42.062353 17533 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:42.079443  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:42.086943 17545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:42.087855 17546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:42.089378 17548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:42.090559  6030 server_base.cc:1061] running on GCE node
I20260709 13:18:42.091585  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:42.091777  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:42.091909  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603122091891 us; error 0 us; skew 500 ppm
I20260709 13:18:42.092411  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:42.095247  6030 webserver.cc:533] Webserver started at http://127.5.227.129:33663/ using document root <none> and password file <none>
I20260709 13:18:42.095723  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:42.095889  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:42.096285  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:42.097509  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-0-root/instance:
uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
format_stamp: "Formatted at 2026-07-09 13:18:42 on dist-test-slave-tbwl"
I20260709 13:18:42.102860  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.007s
I20260709 13:18:42.108103 17553 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:42.109251  6030 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:18:42.109740  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-0-root
uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
format_stamp: "Formatted at 2026-07-09 13:18:42 on dist-test-slave-tbwl"
I20260709 13:18:42.110170  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:42.124764  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:42.127671  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:42.129729  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:42.132687  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:42.132937  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:42.133227  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:42.133430  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:42.187300  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.129:42223
I20260709 13:18:42.187438 17615 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.129:42223 every 8 connection(s)
I20260709 13:18:42.193463  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:42.201397 17620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:42.205541 17623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:42.206045 17621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:42.206878  6030 server_base.cc:1061] running on GCE node
I20260709 13:18:42.209470  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:42.209864  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:42.210103  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603122210079 us; error 0 us; skew 500 ppm
I20260709 13:18:42.210983  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:42.213368 17616 heartbeater.cc:344] Connected to a master server at 127.5.227.190:46061
I20260709 13:18:42.213873 17616 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:42.214856  6030 webserver.cc:533] Webserver started at http://127.5.227.130:45739/ using document root <none> and password file <none>
I20260709 13:18:42.214964 17616 heartbeater.cc:507] Master 127.5.227.190:46061 requested a full tablet report, sending...
I20260709 13:18:42.215762  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:42.216064  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:42.216460  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:42.218279  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-1-root/instance:
uuid: "8b919b60c8ad45c59fc72cd87e339a55"
format_stamp: "Formatted at 2026-07-09 13:18:42 on dist-test-slave-tbwl"
I20260709 13:18:42.218398 17489 ts_manager.cc:194] Registered new tserver with Master: 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223)
I20260709 13:18:42.220659 17489 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36318
I20260709 13:18:42.224691  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:42.229264 17628 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:42.230494  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:18:42.231078  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-1-root
uuid: "8b919b60c8ad45c59fc72cd87e339a55"
format_stamp: "Formatted at 2026-07-09 13:18:42 on dist-test-slave-tbwl"
I20260709 13:18:42.231436  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:42.283814  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:42.285641  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:42.287542  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:42.290202  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:42.290468  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:42.290773  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:42.290984  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:42.341315  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.130:34463
I20260709 13:18:42.341550 17690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.130:34463 every 8 connection(s)
I20260709 13:18:42.347853  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:42.357158 17694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:42.360219 17695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:42.361742  6030 server_base.cc:1061] running on GCE node
W20260709 13:18:42.362835 17697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:42.364387  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:42.364719  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:42.364943  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603122364898 us; error 0 us; skew 500 ppm
I20260709 13:18:42.365550 17691 heartbeater.cc:344] Connected to a master server at 127.5.227.190:46061
I20260709 13:18:42.365854  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:42.366080 17691 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:42.367499 17691 heartbeater.cc:507] Master 127.5.227.190:46061 requested a full tablet report, sending...
I20260709 13:18:42.369544  6030 webserver.cc:533] Webserver started at http://127.5.227.131:44527/ using document root <none> and password file <none>
I20260709 13:18:42.370258  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:42.370486  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:42.370837  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:42.370821 17489 ts_manager.cc:194] Registered new tserver with Master: 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:42.372794  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-2-root/instance:
uuid: "024aac28af264d6ca6dad603ea427363"
format_stamp: "Formatted at 2026-07-09 13:18:42 on dist-test-slave-tbwl"
I20260709 13:18:42.372944 17489 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36326
I20260709 13:18:42.378582  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:18:42.383370 17702 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:42.384538  6030 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:42.384989  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-2-root
uuid: "024aac28af264d6ca6dad603ea427363"
format_stamp: "Formatted at 2026-07-09 13:18:42 on dist-test-slave-tbwl"
I20260709 13:18:42.385407  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:42.408077  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:42.409716  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:42.411628  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:42.414911  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:42.415360  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:42.415737  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:42.415938  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:42.466519  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.131:40149
I20260709 13:18:42.466676 17764 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.131:40149 every 8 connection(s)
I20260709 13:18:42.483506 17765 heartbeater.cc:344] Connected to a master server at 127.5.227.190:46061
I20260709 13:18:42.484133 17765 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:42.485194 17765 heartbeater.cc:507] Master 127.5.227.190:46061 requested a full tablet report, sending...
I20260709 13:18:42.488077 17489 ts_manager.cc:194] Registered new tserver with Master: 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:42.488646  6030 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018218554s
I20260709 13:18:42.490114 17489 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36342
I20260709 13:18:42.521106 17489 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36344:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:42.524784 17489 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:42.616307 17656 tablet_service.cc:1511] Processing CreateTablet for tablet 18bb358f5c1f4484bce622696859c5b7 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:18:42.618114 17656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bb358f5c1f4484bce622696859c5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.626816 17730 tablet_service.cc:1511] Processing CreateTablet for tablet 18bb358f5c1f4484bce622696859c5b7 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:18:42.628794 17729 tablet_service.cc:1511] Processing CreateTablet for tablet da3b300755fb4bf382d645207da71f46 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:18:42.630203 17727 tablet_service.cc:1511] Processing CreateTablet for tablet 81e57d617b4045c68e8eb710c202b4e3 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:18:42.630586 17728 tablet_service.cc:1511] Processing CreateTablet for tablet 87fbdbbec4e74cd1bfae903b4f236771 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:18:42.628794 17655 tablet_service.cc:1511] Processing CreateTablet for tablet da3b300755fb4bf382d645207da71f46 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:18:42.628839 17730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bb358f5c1f4484bce622696859c5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.632815 17655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3b300755fb4bf382d645207da71f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.632754 17726 tablet_service.cc:1511] Processing CreateTablet for tablet d2cacc9c3f28442aa7d2a52537bfea1c (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:18:42.635427 17725 tablet_service.cc:1511] Processing CreateTablet for tablet 9518b3380e154d17876bb6b91364c35b (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:18:42.638075 17729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3b300755fb4bf382d645207da71f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.642067 17727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e57d617b4045c68e8eb710c202b4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.643309 17725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9518b3380e154d17876bb6b91364c35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.644160 17726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cacc9c3f28442aa7d2a52537bfea1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.644532 17654 tablet_service.cc:1511] Processing CreateTablet for tablet 87fbdbbec4e74cd1bfae903b4f236771 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:18:42.646198 17654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fbdbbec4e74cd1bfae903b4f236771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.646595 17728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fbdbbec4e74cd1bfae903b4f236771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.657294 17724 tablet_service.cc:1511] Processing CreateTablet for tablet df211c55e6264e56947d0d2ee1330fdb (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:18:42.657593 17653 tablet_service.cc:1511] Processing CreateTablet for tablet 81e57d617b4045c68e8eb710c202b4e3 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:18:42.659042 17724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df211c55e6264e56947d0d2ee1330fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.659924 17653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e57d617b4045c68e8eb710c202b4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.669570 17652 tablet_service.cc:1511] Processing CreateTablet for tablet d2cacc9c3f28442aa7d2a52537bfea1c (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:18:42.671983 17652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cacc9c3f28442aa7d2a52537bfea1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.673856 17723 tablet_service.cc:1511] Processing CreateTablet for tablet d1e900916a7d43d183e0820cd724c9fa (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:18:42.675601 17723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e900916a7d43d183e0820cd724c9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.677234 17651 tablet_service.cc:1511] Processing CreateTablet for tablet 9518b3380e154d17876bb6b91364c35b (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:18:42.679688 17651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9518b3380e154d17876bb6b91364c35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.681191 17722 tablet_service.cc:1511] Processing CreateTablet for tablet 512c3713a10b496d9aec989bf5647642 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:18:42.682859 17722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512c3713a10b496d9aec989bf5647642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.689265 17726 tablet_service.cc:1511] Processing CreateTablet for tablet 07c03d5f5d6047339a59e50daa5e6743 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:18:42.691293 17726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07c03d5f5d6047339a59e50daa5e6743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.716645 17581 tablet_service.cc:1511] Processing CreateTablet for tablet 18bb358f5c1f4484bce622696859c5b7 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:18:42.718240 17581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bb358f5c1f4484bce622696859c5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.719825 17579 tablet_service.cc:1511] Processing CreateTablet for tablet 87fbdbbec4e74cd1bfae903b4f236771 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:18:42.721453 17579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fbdbbec4e74cd1bfae903b4f236771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.722360 17650 tablet_service.cc:1511] Processing CreateTablet for tablet df211c55e6264e56947d0d2ee1330fdb (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:18:42.723981 17650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df211c55e6264e56947d0d2ee1330fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.725270 17577 tablet_service.cc:1511] Processing CreateTablet for tablet d2cacc9c3f28442aa7d2a52537bfea1c (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:18:42.727993 17576 tablet_service.cc:1511] Processing CreateTablet for tablet 9518b3380e154d17876bb6b91364c35b (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:18:42.723968 17578 tablet_service.cc:1511] Processing CreateTablet for tablet 81e57d617b4045c68e8eb710c202b4e3 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:18:42.735877 17572 tablet_service.cc:1511] Processing CreateTablet for tablet 512c3713a10b496d9aec989bf5647642 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:18:42.740325 17574 tablet_service.cc:1511] Processing CreateTablet for tablet 07c03d5f5d6047339a59e50daa5e6743 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:18:42.743814 17573 tablet_service.cc:1511] Processing CreateTablet for tablet d1e900916a7d43d183e0820cd724c9fa (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:18:42.747845 17647 tablet_service.cc:1511] Processing CreateTablet for tablet 512c3713a10b496d9aec989bf5647642 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:18:42.729266 17648 tablet_service.cc:1511] Processing CreateTablet for tablet d1e900916a7d43d183e0820cd724c9fa (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:18:42.727998 17649 tablet_service.cc:1511] Processing CreateTablet for tablet 07c03d5f5d6047339a59e50daa5e6743 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:18:42.756680 17575 tablet_service.cc:1511] Processing CreateTablet for tablet df211c55e6264e56947d0d2ee1330fdb (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:18:42.751263 17580 tablet_service.cc:1511] Processing CreateTablet for tablet da3b300755fb4bf382d645207da71f46 (DEFAULT_TABLE table=test-workload [id=7fc448ee0ec043f39ef87a427fca7bd8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:18:42.759981 17577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cacc9c3f28442aa7d2a52537bfea1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.763288 17572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512c3713a10b496d9aec989bf5647642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.765692 17578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e57d617b4045c68e8eb710c202b4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.766760 17647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512c3713a10b496d9aec989bf5647642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.767184 17576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9518b3380e154d17876bb6b91364c35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.770824 17573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e900916a7d43d183e0820cd724c9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.771170 17648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e900916a7d43d183e0820cd724c9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.773224 17574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07c03d5f5d6047339a59e50daa5e6743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.775182 17649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07c03d5f5d6047339a59e50daa5e6743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.783033 17580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da3b300755fb4bf382d645207da71f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.788488 17575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df211c55e6264e56947d0d2ee1330fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.811492 17781 tablet_bootstrap.cc:492] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55: Bootstrap starting.
I20260709 13:18:42.816177 17780 tablet_bootstrap.cc:492] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363: Bootstrap starting.
I20260709 13:18:42.850425 17782 tablet_bootstrap.cc:492] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:42.860343 17782 tablet_bootstrap.cc:654] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.867166 17781 tablet_bootstrap.cc:654] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.874925 17782 tablet_bootstrap.cc:492] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: No bootstrap required, opened a new log
I20260709 13:18:42.875587 17782 ts_tablet_manager.cc:1403] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 13:18:42.878968 17782 raft_consensus.cc:359] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:42.879777 17782 raft_consensus.cc:385] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.880096 17782 raft_consensus.cc:740] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.881016 17782 consensus_queue.cc:260] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:42.887436 17780 tablet_bootstrap.cc:654] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.904280 17781 tablet_bootstrap.cc:492] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55: No bootstrap required, opened a new log
I20260709 13:18:42.904919 17781 ts_tablet_manager.cc:1403] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.009s
I20260709 13:18:42.917559 17616 heartbeater.cc:499] Master 127.5.227.190:46061 was elected leader, sending a full tablet report...
I20260709 13:18:42.919921 17782 ts_tablet_manager.cc:1434] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.017s
I20260709 13:18:42.919723 17781 raft_consensus.cc:359] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:42.920594 17781 raft_consensus.cc:385] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.920889 17781 raft_consensus.cc:740] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.921305 17782 tablet_bootstrap.cc:492] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:42.921665 17781 consensus_queue.cc:260] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:42.925817 17780 tablet_bootstrap.cc:492] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363: No bootstrap required, opened a new log
I20260709 13:18:42.926424 17780 ts_tablet_manager.cc:1403] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363: Time spent bootstrapping tablet: real 0.111s	user 0.005s	sys 0.010s
I20260709 13:18:42.930392 17782 tablet_bootstrap.cc:654] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.930521 17780 raft_consensus.cc:359] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:42.931938 17780 raft_consensus.cc:385] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.932368 17780 raft_consensus.cc:740] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.933601 17780 consensus_queue.cc:260] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
W20260709 13:18:42.942926 17617 tablet.cc:2406] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:18:42.945262 17781 ts_tablet_manager.cc:1434] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55: Time spent starting tablet: real 0.040s	user 0.015s	sys 0.007s
I20260709 13:18:42.946933 17691 heartbeater.cc:499] Master 127.5.227.190:46061 was elected leader, sending a full tablet report...
I20260709 13:18:42.947413 17781 tablet_bootstrap.cc:492] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55: Bootstrap starting.
I20260709 13:18:42.955600 17781 tablet_bootstrap.cc:654] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.965159 17765 heartbeater.cc:499] Master 127.5.227.190:46061 was elected leader, sending a full tablet report...
I20260709 13:18:42.966045 17782 tablet_bootstrap.cc:492] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae: No bootstrap required, opened a new log
I20260709 13:18:42.966899 17782 ts_tablet_manager.cc:1403] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.028s
I20260709 13:18:42.970292 17782 raft_consensus.cc:359] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:42.971113 17782 raft_consensus.cc:385] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:42.971405 17782 raft_consensus.cc:740] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.972242 17782 consensus_queue.cc:260] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:42.973781 17780 ts_tablet_manager.cc:1434] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.012s
I20260709 13:18:42.974993 17782 ts_tablet_manager.cc:1434] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:18:42.975627 17780 tablet_bootstrap.cc:492] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363: Bootstrap starting.
I20260709 13:18:42.976184 17782 tablet_bootstrap.cc:492] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:42.985795 17782 tablet_bootstrap.cc:654] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.989375 17781 tablet_bootstrap.cc:492] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55: No bootstrap required, opened a new log
I20260709 13:18:42.989665 17780 tablet_bootstrap.cc:654] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:42.990005 17781 ts_tablet_manager.cc:1403] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.021s
I20260709 13:18:42.993680 17781 raft_consensus.cc:359] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:42.994833 17781 raft_consensus.cc:385] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:42.998329 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:42.998800 17782 tablet_bootstrap.cc:492] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae: No bootstrap required, opened a new log
I20260709 13:18:42.997776 17781 raft_consensus.cc:740] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Initialized, Role: FOLLOWER
I20260709 13:18:42.999547 17782 ts_tablet_manager.cc:1403] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 13:18:43.000123 17781 consensus_queue.cc:260] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.003063 17782 raft_consensus.cc:359] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:43.003410 17781 ts_tablet_manager.cc:1434] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.008s
I20260709 13:18:43.009289 17782 raft_consensus.cc:385] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.010529 17782 raft_consensus.cc:740] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.011318 17781 tablet_bootstrap.cc:492] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55: Bootstrap starting.
I20260709 13:18:43.003089 17780 tablet_bootstrap.cc:492] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363: No bootstrap required, opened a new log
I20260709 13:18:43.011576 17782 consensus_queue.cc:260] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:43.012419 17780 ts_tablet_manager.cc:1403] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.009s
I20260709 13:18:43.015966 17780 raft_consensus.cc:359] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.016914 17780 raft_consensus.cc:385] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.016933 17782 ts_tablet_manager.cc:1434] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:18:43.017295 17780 raft_consensus.cc:740] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.018735 17782 tablet_bootstrap.cc:492] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:43.019291 17781 tablet_bootstrap.cc:654] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.022007 17785 raft_consensus.cc:493] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.022682 17785 raft_consensus.cc:515] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:43.018167 17780 consensus_queue.cc:260] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.027273 17785 leader_election.cc:290] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.027925 17780 ts_tablet_manager.cc:1434] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:18:43.029523 17780 tablet_bootstrap.cc:492] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363: Bootstrap starting.
I20260709 13:18:43.038750 17780 tablet_bootstrap.cc:654] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.040228 17781 tablet_bootstrap.cc:492] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55: No bootstrap required, opened a new log
I20260709 13:18:43.040879 17781 ts_tablet_manager.cc:1403] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.001s
I20260709 13:18:43.038779 17782 tablet_bootstrap.cc:654] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.045995 17781 raft_consensus.cc:359] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.047331 17781 raft_consensus.cc:385] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.047771 17781 raft_consensus.cc:740] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.049458 17781 consensus_queue.cc:260] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.053385 17781 ts_tablet_manager.cc:1434] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.002s
I20260709 13:18:43.054484 17781 tablet_bootstrap.cc:492] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55: Bootstrap starting.
I20260709 13:18:43.056820 17780 tablet_bootstrap.cc:492] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363: No bootstrap required, opened a new log
I20260709 13:18:43.057818 17780 ts_tablet_manager.cc:1403] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.012s
I20260709 13:18:43.059018 17782 tablet_bootstrap.cc:492] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae: No bootstrap required, opened a new log
I20260709 13:18:43.059809 17782 ts_tablet_manager.cc:1403] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.007s
I20260709 13:18:43.061918 17780 raft_consensus.cc:359] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.062747 17781 tablet_bootstrap.cc:654] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.063068 17780 raft_consensus.cc:385] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.063426 17780 raft_consensus.cc:740] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.064742 17780 consensus_queue.cc:260] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.068804 17782 raft_consensus.cc:359] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.069739 17782 raft_consensus.cc:385] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.070242 17782 raft_consensus.cc:740] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.071152 17782 consensus_queue.cc:260] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.072886 17780 ts_tablet_manager.cc:1434] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:18:43.074779 17780 tablet_bootstrap.cc:492] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363: Bootstrap starting.
I20260709 13:18:43.080583 17782 ts_tablet_manager.cc:1434] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:18:43.082063 17782 tablet_bootstrap.cc:492] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:43.084420 17780 tablet_bootstrap.cc:654] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.089877 17781 tablet_bootstrap.cc:492] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55: No bootstrap required, opened a new log
I20260709 13:18:43.090873 17781 ts_tablet_manager.cc:1403] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent bootstrapping tablet: real 0.037s	user 0.030s	sys 0.004s
I20260709 13:18:43.095858 17781 raft_consensus.cc:359] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:43.097461 17781 raft_consensus.cc:385] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.097904 17781 raft_consensus.cc:740] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.099488 17782 tablet_bootstrap.cc:654] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.099222 17781 consensus_queue.cc:260] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:43.103161 17781 ts_tablet_manager.cc:1434] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 13:18:43.104723 17781 tablet_bootstrap.cc:492] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55: Bootstrap starting.
I20260709 13:18:43.115391 17781 tablet_bootstrap.cc:654] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.118585 17782 tablet_bootstrap.cc:492] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae: No bootstrap required, opened a new log
I20260709 13:18:43.119243 17782 ts_tablet_manager.cc:1403] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.006s
I20260709 13:18:43.150902 17785 raft_consensus.cc:493] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.151547 17785 raft_consensus.cc:515] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.153815 17785 leader_election.cc:290] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.173206 17781 tablet_bootstrap.cc:492] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55: No bootstrap required, opened a new log
I20260709 13:18:43.174304 17781 ts_tablet_manager.cc:1403] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.039s
I20260709 13:18:43.128809 17782 raft_consensus.cc:359] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.179774 17782 raft_consensus.cc:385] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.180251 17782 raft_consensus.cc:740] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.180518 17781 raft_consensus.cc:359] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.181324 17781 raft_consensus.cc:385] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.181118 17782 consensus_queue.cc:260] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.181684 17781 raft_consensus.cc:740] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.179855 17780 tablet_bootstrap.cc:492] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363: No bootstrap required, opened a new log
I20260709 13:18:43.182523 17781 consensus_queue.cc:260] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.184975 17781 ts_tablet_manager.cc:1434] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:43.186201 17781 tablet_bootstrap.cc:492] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55: Bootstrap starting.
I20260709 13:18:43.188023 17789 raft_consensus.cc:493] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.188616 17789 raft_consensus.cc:515] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.191639 17789 leader_election.cc:290] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:43.193014 17781 tablet_bootstrap.cc:654] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.193701 17780 ts_tablet_manager.cc:1403] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363: Time spent bootstrapping tablet: real 0.119s	user 0.035s	sys 0.058s
I20260709 13:18:43.196566 17666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:43.197651 17666 raft_consensus.cc:2468] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 0.
I20260709 13:18:43.204994 17782 ts_tablet_manager.cc:1434] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.085s	user 0.003s	sys 0.004s
I20260709 13:18:43.206405 17789 raft_consensus.cc:493] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.207192 17789 raft_consensus.cc:515] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.208647 17665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:43.209434 17787 raft_consensus.cc:493] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.209439 17665 raft_consensus.cc:2468] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 0.
I20260709 13:18:43.210307 17787 raft_consensus.cc:515] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.215238 17789 leader_election.cc:290] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:43.218307 17780 raft_consensus.cc:359] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.221063 17782 tablet_bootstrap.cc:492] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:43.219504 17780 raft_consensus.cc:385] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.224610 17780 raft_consensus.cc:740] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.227948 17787 leader_election.cc:290] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.231802 17556 leader_election.cc:304] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.233217 17785 raft_consensus.cc:2804] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.233711 17785 raft_consensus.cc:493] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.234150 17785 raft_consensus.cc:3060] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.233841 17780 consensus_queue.cc:260] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.238423 17787 raft_consensus.cc:493] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.239121 17787 raft_consensus.cc:515] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.241948 17787 leader_election.cc:290] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.245327 17780 ts_tablet_manager.cc:1434] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:18:43.247222 17780 tablet_bootstrap.cc:492] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363: Bootstrap starting.
I20260709 13:18:43.266310 17782 tablet_bootstrap.cc:654] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.275228 17785 raft_consensus.cc:515] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.283927 17780 tablet_bootstrap.cc:654] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.284788 17740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.286011 17740 raft_consensus.cc:2468] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 0.
I20260709 13:18:43.287660 17666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:43.288388 17666 raft_consensus.cc:3060] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.288687 17556 leader_election.cc:304] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.287398 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
W20260709 13:18:43.295010 17557 leader_election.cc:343] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.302740 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
W20260709 13:18:43.305087 17557 leader_election.cc:343] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.305847 17665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:43.306342 17785 leader_election.cc:290] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 election: Requested vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.306945 17665 raft_consensus.cc:2468] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 0.
I20260709 13:18:43.307464 17785 raft_consensus.cc:2804] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.308076 17785 raft_consensus.cc:493] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.308591 17785 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.309091 17665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:43.311158 17705 leader_election.cc:304] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.312618 17789 raft_consensus.cc:2804] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.313171 17789 raft_consensus.cc:493] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.313658 17789 raft_consensus.cc:3060] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.319351 17781 tablet_bootstrap.cc:492] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55: No bootstrap required, opened a new log
I20260709 13:18:43.320050 17781 ts_tablet_manager.cc:1403] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent bootstrapping tablet: real 0.134s	user 0.031s	sys 0.100s
I20260709 13:18:43.322042 17782 tablet_bootstrap.cc:492] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae: No bootstrap required, opened a new log
I20260709 13:18:43.322734 17782 ts_tablet_manager.cc:1403] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.102s	user 0.022s	sys 0.011s
I20260709 13:18:43.323361 17781 raft_consensus.cc:359] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.324218 17781 raft_consensus.cc:385] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:43.324383 17705 leader_election.cc:343] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.324553 17781 raft_consensus.cc:740] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.325598 17781 consensus_queue.cc:260] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.326426 17782 raft_consensus.cc:359] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.327390 17782 raft_consensus.cc:385] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.327968 17781 ts_tablet_manager.cc:1434] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:18:43.328080 17782 raft_consensus.cc:740] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.329258 17781 tablet_bootstrap.cc:492] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55: Bootstrap starting.
I20260709 13:18:43.330067 17782 consensus_queue.cc:260] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.337622 17780 tablet_bootstrap.cc:492] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363: No bootstrap required, opened a new log
I20260709 13:18:43.337826 17781 tablet_bootstrap.cc:654] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.338416 17780 ts_tablet_manager.cc:1403] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363: Time spent bootstrapping tablet: real 0.092s	user 0.018s	sys 0.013s
I20260709 13:18:43.338092 17785 raft_consensus.cc:515] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:43.342162 17780 raft_consensus.cc:359] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.344996 17780 raft_consensus.cc:385] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.345466 17780 raft_consensus.cc:740] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.344518 17782 ts_tablet_manager.cc:1434] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:18:43.349766 17810 raft_consensus.cc:493] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.350426 17810 raft_consensus.cc:515] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.353957 17785 leader_election.cc:290] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 election: Requested vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.354739 17810 leader_election.cc:290] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.354939 17782 tablet_bootstrap.cc:492] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:43.356742 17740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:43.357455 17740 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.354183 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c03d5f5d6047339a59e50daa5e6743" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.357648 17780 consensus_queue.cc:260] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
W20260709 13:18:43.360351 17557 leader_election.cc:343] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.363879 17782 tablet_bootstrap.cc:654] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.366825 17810 raft_consensus.cc:493] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.367496 17810 raft_consensus.cc:515] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.372992 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.374017 17739 raft_consensus.cc:2468] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 0.
I20260709 13:18:43.376245 17557 leader_election.cc:304] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:43.377477 17810 leader_election.cc:290] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.377532 17785 raft_consensus.cc:2804] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.378368 17785 raft_consensus.cc:493] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.378906 17785 raft_consensus.cc:3060] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.380846 17740 raft_consensus.cc:2468] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 1.
I20260709 13:18:43.382261 17557 leader_election.cc:304] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:43.383812 17810 raft_consensus.cc:2804] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.387586 17787 raft_consensus.cc:493] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.388466 17787 raft_consensus.cc:515] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.392320 17787 leader_election.cc:290] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.401710 17665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:43.405691 17665 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.411149 17789 raft_consensus.cc:515] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.415794 17789 leader_election.cc:290] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 1 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:43.422212 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c03d5f5d6047339a59e50daa5e6743" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:43.424592 17666 raft_consensus.cc:2468] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 1.
I20260709 13:18:43.392289 17785 raft_consensus.cc:515] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
W20260709 13:18:43.429024 17556 leader_election.cc:343] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.429957 17666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:43.427488 17665 raft_consensus.cc:2468] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 1.
I20260709 13:18:43.429834 17556 leader_election.cc:304] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:43.432483 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:43.433204 17664 raft_consensus.cc:3060] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.435532 17781 tablet_bootstrap.cc:492] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55: No bootstrap required, opened a new log
I20260709 13:18:43.436215 17781 ts_tablet_manager.cc:1403] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55: Time spent bootstrapping tablet: real 0.107s	user 0.031s	sys 0.053s
I20260709 13:18:43.439256 17780 ts_tablet_manager.cc:1434] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363: Time spent starting tablet: real 0.100s	user 0.015s	sys 0.036s
I20260709 13:18:43.440560 17780 tablet_bootstrap.cc:492] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363: Bootstrap starting.
I20260709 13:18:43.440721 17740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.441762 17740 raft_consensus.cc:2468] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 0.
I20260709 13:18:43.442102 17785 leader_election.cc:290] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 election: Requested vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.444754 17738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3b300755fb4bf382d645207da71f46" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.445910 17738 raft_consensus.cc:2468] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 0.
I20260709 13:18:43.443179 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.444509 17664 raft_consensus.cc:2468] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 1.
I20260709 13:18:43.431268 17666 raft_consensus.cc:2468] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 0.
I20260709 13:18:43.450136 17780 tablet_bootstrap.cc:654] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.450556 17705 leader_election.cc:304] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.450937 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:43.451709 17737 raft_consensus.cc:3060] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.448771 17785 raft_consensus.cc:493] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.452252 17785 raft_consensus.cc:515] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.455369 17739 raft_consensus.cc:2393] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b919b60c8ad45c59fc72cd87e339a55 in current term 1: Already voted for candidate 024aac28af264d6ca6dad603ea427363 in this term.
I20260709 13:18:43.456838 17789 raft_consensus.cc:2804] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.426410 17810 raft_consensus.cc:697] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 LEADER]: Becoming Leader. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Running, Role: LEADER
I20260709 13:18:43.454703 17816 raft_consensus.cc:2749] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:43.457505 17789 raft_consensus.cc:697] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 1 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:43.457425 17736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.459939 17632 leader_election.cc:304] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.465348 17781 raft_consensus.cc:359] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.466514 17781 raft_consensus.cc:385] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.466928 17781 raft_consensus.cc:740] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.468039 17787 raft_consensus.cc:2804] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.467782 17781 consensus_queue.cc:260] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.468652 17787 raft_consensus.cc:493] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.469230 17787 raft_consensus.cc:3060] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.469411 17737 raft_consensus.cc:2468] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 1.
I20260709 13:18:43.471026 17557 leader_election.cc:304] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:43.471768 17810 consensus_queue.cc:237] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:43.473073 17816 raft_consensus.cc:2804] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.461409 17789 consensus_queue.cc:237] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.467144 17632 leader_election.cc:304] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.477066 17816 raft_consensus.cc:697] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 LEADER]: Becoming Leader. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Running, Role: LEADER
I20260709 13:18:43.478294 17816 consensus_queue.cc:237] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.479312 17780 tablet_bootstrap.cc:492] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363: No bootstrap required, opened a new log
I20260709 13:18:43.480247 17780 ts_tablet_manager.cc:1403] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363: Time spent bootstrapping tablet: real 0.040s	user 0.026s	sys 0.007s
I20260709 13:18:43.473498 17782 tablet_bootstrap.cc:492] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae: No bootstrap required, opened a new log
I20260709 13:18:43.481179 17782 ts_tablet_manager.cc:1403] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.127s	user 0.035s	sys 0.041s
I20260709 13:18:43.484297 17780 raft_consensus.cc:359] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.459012 17785 leader_election.cc:290] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.487311 17781 ts_tablet_manager.cc:1434] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.001s
W20260709 13:18:43.489737 17556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:34463, user_credentials={real_user=slave}} blocked reactor thread for 60777.6us
I20260709 13:18:43.485342 17820 raft_consensus.cc:2804] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.503000 17810 raft_consensus.cc:493] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.493837 17591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" is_pre_election: true
I20260709 13:18:43.517329 17810 raft_consensus.cc:515] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.496794 17587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" is_pre_election: true
I20260709 13:18:43.519112 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:43.495391 17589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3b300755fb4bf382d645207da71f46" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" is_pre_election: true
W20260709 13:18:43.520143 17705 leader_election.cc:343] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.494596 17590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" is_pre_election: true
I20260709 13:18:43.520545 17782 raft_consensus.cc:359] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
W20260709 13:18:43.521085 17631 leader_election.cc:343] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.521175 17705 leader_election.cc:304] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:43.496178 17586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:43.495949 17588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" is_pre_election: true
I20260709 13:18:43.522187 17782 raft_consensus.cc:385] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.522575 17814 raft_consensus.cc:2749] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:43.522763 17782 raft_consensus.cc:740] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.523288 17820 raft_consensus.cc:493] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.492825 17780 raft_consensus.cc:385] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:43.523798 17632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:40149, user_credentials={real_user=slave}} blocked reactor thread for 56817.3us
I20260709 13:18:43.524041 17780 raft_consensus.cc:740] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.525372 17666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:43.525098 17780 consensus_queue.cc:260] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.526345 17666 raft_consensus.cc:2393] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in current term 1: Already voted for candidate 024aac28af264d6ca6dad603ea427363 in this term.
I20260709 13:18:43.521771 17590 raft_consensus.cc:2468] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 0.
I20260709 13:18:43.509145 17781 tablet_bootstrap.cc:492] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55: Bootstrap starting.
I20260709 13:18:43.527220 17485 catalog_manager.cc:5697] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129). New cstate: current_term: 1 leader_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:43.529752 17486 catalog_manager.cc:5697] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 0 to 1, leader changed from <none> to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:43.531419 17556 leader_election.cc:304] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 024aac28af264d6ca6dad603ea427363
I20260709 13:18:43.531828 17631 leader_election.cc:304] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 024aac28af264d6ca6dad603ea427363
I20260709 13:18:43.532075 17787 raft_consensus.cc:515] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.532863 17821 raft_consensus.cc:2764] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:18:43.533494 17664 raft_consensus.cc:2393] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in current term 1: Already voted for candidate 8b919b60c8ad45c59fc72cd87e339a55 in this term.
I20260709 13:18:43.534580 17816 raft_consensus.cc:2804] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.535135 17787 leader_election.cc:290] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.535579 17590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:43.535184 17816 raft_consensus.cc:697] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 LEADER]: Becoming Leader. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Running, Role: LEADER
I20260709 13:18:43.523895 17820 raft_consensus.cc:3060] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.536924 17816 consensus_queue.cc:237] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.539283 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:43.540210 17737 raft_consensus.cc:2393] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b919b60c8ad45c59fc72cd87e339a55 in current term 1: Already voted for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in this term.
I20260709 13:18:43.541555 17632 leader_election.cc:304] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b919b60c8ad45c59fc72cd87e339a55; no voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:43.542451 17810 leader_election.cc:290] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.542977 17821 raft_consensus.cc:2749] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:43.544087 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
W20260709 13:18:43.545854 17557 leader_election.cc:343] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.546398 17780 ts_tablet_manager.cc:1434] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.008s
I20260709 13:18:43.547850 17780 tablet_bootstrap.cc:492] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363: Bootstrap starting.
I20260709 13:18:43.550940 17782 consensus_queue.cc:260] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.554572 17782 ts_tablet_manager.cc:1434] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.003s
I20260709 13:18:43.556557 17781 tablet_bootstrap.cc:654] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.556665 17782 tablet_bootstrap.cc:492] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:43.540201 17556 leader_election.cc:304] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:43.559592 17780 tablet_bootstrap.cc:654] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.561506 17816 raft_consensus.cc:3060] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.566195 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
W20260709 13:18:43.570225 17556 leader_election.cc:343] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.570910 17556 leader_election.cc:304] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:43.571314 17781 tablet_bootstrap.cc:492] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55: No bootstrap required, opened a new log
I20260709 13:18:43.572031 17781 ts_tablet_manager.cc:1403] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.001s
I20260709 13:18:43.571938 17810 raft_consensus.cc:2749] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:43.572542 17820 raft_consensus.cc:515] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.575341 17816 raft_consensus.cc:2749] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:43.577311 17590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3b300755fb4bf382d645207da71f46" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:43.577615 17781 raft_consensus.cc:359] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.578585 17781 raft_consensus.cc:385] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.578986 17781 raft_consensus.cc:740] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.579015 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3b300755fb4bf382d645207da71f46" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:43.579766 17737 raft_consensus.cc:3060] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.579914 17781 consensus_queue.cc:260] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.583297 17782 tablet_bootstrap.cc:654] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:43.585543 17631 leader_election.cc:343] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.586831 17780 tablet_bootstrap.cc:492] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363: No bootstrap required, opened a new log
I20260709 13:18:43.587600 17780 ts_tablet_manager.cc:1403] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.003s
I20260709 13:18:43.588222 17781 ts_tablet_manager.cc:1434] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:18:43.589349 17781 tablet_bootstrap.cc:492] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55: Bootstrap starting.
I20260709 13:18:43.591101 17780 raft_consensus.cc:359] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.592531 17780 raft_consensus.cc:385] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.592938 17780 raft_consensus.cc:740] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.593855 17780 consensus_queue.cc:260] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.596526 17780 ts_tablet_manager.cc:1434] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:43.598033 17780 tablet_bootstrap.cc:492] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363: Bootstrap starting.
I20260709 13:18:43.599210 17781 tablet_bootstrap.cc:654] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.600457 17816 raft_consensus.cc:493] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.601022 17816 raft_consensus.cc:515] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.603338 17816 leader_election.cc:290] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.605696 17736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512c3713a10b496d9aec989bf5647642" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.606532 17736 raft_consensus.cc:2468] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 0.
I20260709 13:18:43.607301 17780 tablet_bootstrap.cc:654] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.607985 17557 leader_election.cc:304] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:43.609514 17816 raft_consensus.cc:2804] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.609935 17816 raft_consensus.cc:493] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.609710 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512c3713a10b496d9aec989bf5647642" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:43.610407 17816 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.610680 17664 raft_consensus.cc:2468] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 0.
I20260709 13:18:43.619407 17816 raft_consensus.cc:515] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.622960 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512c3713a10b496d9aec989bf5647642" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:43.623692 17664 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.624217 17487 catalog_manager.cc:5697] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129). New cstate: current_term: 1 leader_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.626581 17780 tablet_bootstrap.cc:492] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363: No bootstrap required, opened a new log
I20260709 13:18:43.627414 17780 ts_tablet_manager.cc:1403] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.010s
I20260709 13:18:43.629923 17737 raft_consensus.cc:2468] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 1.
I20260709 13:18:43.630987 17820 leader_election.cc:290] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.631803 17664 raft_consensus.cc:2468] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 1.
I20260709 13:18:43.631527 17780 raft_consensus.cc:359] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.632678 17780 raft_consensus.cc:385] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.626235 17487 catalog_manager.cc:5697] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129). New cstate: current_term: 1 leader_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.633209 17780 raft_consensus.cc:740] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.633239 17556 leader_election.cc:304] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.633239 17632 leader_election.cc:304] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:43.635164 17810 raft_consensus.cc:2804] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.635669 17820 raft_consensus.cc:2804] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.635936 17810 raft_consensus.cc:697] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 LEADER]: Becoming Leader. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Running, Role: LEADER
I20260709 13:18:43.636828 17820 raft_consensus.cc:697] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:43.637436 17810 consensus_queue.cc:237] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.639778 17816 leader_election.cc:290] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 election: Requested vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.640576 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512c3713a10b496d9aec989bf5647642" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:43.642338 17737 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.643458 17780 consensus_queue.cc:260] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.645429 17781 tablet_bootstrap.cc:492] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55: No bootstrap required, opened a new log
I20260709 13:18:43.646325 17781 ts_tablet_manager.cc:1403] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.022s
I20260709 13:18:43.645485 17780 ts_tablet_manager.cc:1434] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:18:43.647634 17780 tablet_bootstrap.cc:492] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363: Bootstrap starting.
I20260709 13:18:43.649487 17781 raft_consensus.cc:359] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.650315 17781 raft_consensus.cc:385] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.650709 17781 raft_consensus.cc:740] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.651552 17781 consensus_queue.cc:260] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.653431 17780 tablet_bootstrap.cc:654] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.653847 17781 ts_tablet_manager.cc:1434] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:43.655310 17781 tablet_bootstrap.cc:492] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55: Bootstrap starting.
I20260709 13:18:43.663605 17781 tablet_bootstrap.cc:654] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.637929 17820 consensus_queue.cc:237] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.675459 17780 tablet_bootstrap.cc:492] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363: No bootstrap required, opened a new log
I20260709 13:18:43.676043 17780 ts_tablet_manager.cc:1403] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.004s
I20260709 13:18:43.676653 17781 tablet_bootstrap.cc:492] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55: No bootstrap required, opened a new log
I20260709 13:18:43.677299 17781 ts_tablet_manager.cc:1403] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:18:43.679364 17782 tablet_bootstrap.cc:492] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae: No bootstrap required, opened a new log
I20260709 13:18:43.679971 17782 ts_tablet_manager.cc:1403] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.124s	user 0.019s	sys 0.040s
I20260709 13:18:43.693662 17780 raft_consensus.cc:359] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.694517 17780 raft_consensus.cc:385] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.694900 17780 raft_consensus.cc:740] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.695777 17782 raft_consensus.cc:359] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.696170 17780 consensus_queue.cc:260] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.696689 17782 raft_consensus.cc:385] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.697167 17782 raft_consensus.cc:740] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.698195 17782 consensus_queue.cc:260] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.700073 17737 raft_consensus.cc:2468] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 1.
I20260709 13:18:43.700600 17782 ts_tablet_manager.cc:1434] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.010s
I20260709 13:18:43.701743 17782 tablet_bootstrap.cc:492] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:43.710028 17782 tablet_bootstrap.cc:654] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.710062 17780 ts_tablet_manager.cc:1434] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363: Time spent starting tablet: real 0.034s	user 0.012s	sys 0.001s
I20260709 13:18:43.696391 17781 raft_consensus.cc:359] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.715713 17781 raft_consensus.cc:385] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.716235 17781 raft_consensus.cc:740] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.717536 17781 consensus_queue.cc:260] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.719568 17810 raft_consensus.cc:493] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.720553 17780 tablet_bootstrap.cc:492] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363: Bootstrap starting.
I20260709 13:18:43.720181 17810 raft_consensus.cc:515] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.722506 17810 leader_election.cc:290] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.724249 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:43.725124 17664 raft_consensus.cc:2468] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 0.
I20260709 13:18:43.726586 17556 leader_election.cc:304] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.727579 17810 raft_consensus.cc:2804] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.728003 17810 raft_consensus.cc:493] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.728209 17781 ts_tablet_manager.cc:1434] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.003s
I20260709 13:18:43.728338 17810 raft_consensus.cc:3060] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.733752 17780 tablet_bootstrap.cc:654] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.728693 17485 catalog_manager.cc:5697] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129). New cstate: current_term: 1 leader_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.735402 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.736781 17737 raft_consensus.cc:2468] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 0.
I20260709 13:18:43.737784 17821 raft_consensus.cc:493] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.738296 17821 raft_consensus.cc:515] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.738809 17782 tablet_bootstrap.cc:492] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae: No bootstrap required, opened a new log
I20260709 13:18:43.739358 17782 ts_tablet_manager.cc:1403] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.004s
I20260709 13:18:43.741637 17590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" is_pre_election: true
I20260709 13:18:43.742249 17782 raft_consensus.cc:359] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.742386 17590 raft_consensus.cc:2468] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 0.
I20260709 13:18:43.743034 17782 raft_consensus.cc:385] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.743343 17782 raft_consensus.cc:740] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.743407 17810 raft_consensus.cc:515] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.744114 17631 leader_election.cc:304] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.744074 17782 consensus_queue.cc:260] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.746763 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:43.746852 17821 leader_election.cc:290] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.747066 17736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:43.747552 17664 raft_consensus.cc:3060] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.747678 17782 ts_tablet_manager.cc:1434] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:43.747829 17736 raft_consensus.cc:3060] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.748788 17782 tablet_bootstrap.cc:492] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:43.749552 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.754997 17821 raft_consensus.cc:493] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.755577 17820 raft_consensus.cc:2804] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.755756 17782 tablet_bootstrap.cc:654] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.758324 17737 raft_consensus.cc:2468] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 0.
I20260709 13:18:43.758793 17820 raft_consensus.cc:493] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.755579 17664 raft_consensus.cc:2468] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 1.
I20260709 13:18:43.759250 17820 raft_consensus.cc:3060] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.760303 17556 leader_election.cc:304] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.756960 17736 raft_consensus.cc:2468] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in term 1.
I20260709 13:18:43.757429 17810 leader_election.cc:290] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 election: Requested vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.745901 17487 catalog_manager.cc:5697] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.758260 17780 tablet_bootstrap.cc:492] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363: No bootstrap required, opened a new log
I20260709 13:18:43.761168 17785 raft_consensus.cc:2804] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.761729 17780 ts_tablet_manager.cc:1403] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.004s
I20260709 13:18:43.761971 17785 raft_consensus.cc:697] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 LEADER]: Becoming Leader. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Running, Role: LEADER
I20260709 13:18:43.763033 17785 consensus_queue.cc:237] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.764834 17780 raft_consensus.cc:359] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.765653 17780 raft_consensus.cc:385] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.766177 17780 raft_consensus.cc:740] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.767448 17780 consensus_queue.cc:260] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.758392 17821 raft_consensus.cc:515] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.772866 17590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" is_pre_election: true
W20260709 13:18:43.774689 17631 leader_election.cc:343] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:43.777796 17821 leader_election.cc:290] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.780279 17736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.781077 17736 raft_consensus.cc:2468] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 0.
I20260709 13:18:43.781978 17782 tablet_bootstrap.cc:492] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae: No bootstrap required, opened a new log
I20260709 13:18:43.782670 17782 ts_tablet_manager.cc:1403] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.012s
I20260709 13:18:43.782493 17632 leader_election.cc:304] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:43.785828 17821 raft_consensus.cc:2804] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:43.786305 17821 raft_consensus.cc:493] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.786696 17821 raft_consensus.cc:3060] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.786902 17780 ts_tablet_manager.cc:1434] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:18:43.788503 17820 raft_consensus.cc:515] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.785821 17782 raft_consensus.cc:359] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.790038 17782 raft_consensus.cc:385] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.790382 17782 raft_consensus.cc:740] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.790927 17820 leader_election.cc:290] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.791165 17782 consensus_queue.cc:260] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.791851 17590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:43.792477 17590 raft_consensus.cc:3060] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.793956 17782 ts_tablet_manager.cc:1434] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.006s
I20260709 13:18:43.795306 17736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:43.796046 17736 raft_consensus.cc:3060] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.800752 17590 raft_consensus.cc:2468] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 1.
I20260709 13:18:43.802325 17631 leader_election.cc:304] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.801821 17486 catalog_manager.cc:5697] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129). New cstate: current_term: 1 leader_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.800778 17821 raft_consensus.cc:515] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.805218 17820 raft_consensus.cc:2804] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.805974 17736 raft_consensus.cc:2468] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 1.
I20260709 13:18:43.806195 17820 raft_consensus.cc:697] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:43.806368 17586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:43.807068 17586 raft_consensus.cc:3060] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.807262 17820 consensus_queue.cc:237] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.811784 17736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:43.812774 17736 raft_consensus.cc:3060] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.815840 17821 leader_election.cc:290] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.816948 17586 raft_consensus.cc:2468] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 1.
I20260709 13:18:43.820288 17631 leader_election.cc:304] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:43.821398 17821 raft_consensus.cc:2804] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.821986 17821 raft_consensus.cc:697] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:43.822392 17486 catalog_manager.cc:5697] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.823359 17736 raft_consensus.cc:2468] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 1.
I20260709 13:18:43.823172 17821 consensus_queue.cc:237] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.828079 17814 raft_consensus.cc:493] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.828717 17814 raft_consensus.cc:515] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.831282 17814 leader_election.cc:290] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:43.832593 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:43.833544 17664 raft_consensus.cc:2393] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 024aac28af264d6ca6dad603ea427363 in current term 1: Already voted for candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in this term.
I20260709 13:18:43.833738 17586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" is_pre_election: true
I20260709 13:18:43.835455 17705 leader_election.cc:304] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:43.836200 17814 raft_consensus.cc:3060] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.838877 17486 catalog_manager.cc:5697] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.842296 17814 raft_consensus.cc:2749] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:43.868559 17814 consensus_queue.cc:1048] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:43.870910 17810 consensus_queue.cc:1048] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:43.890476 17814 consensus_queue.cc:1048] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:43.900161 17818 consensus_queue.cc:1048] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:43.906540 17816 consensus_queue.cc:1048] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:43.930526 17818 consensus_queue.cc:1048] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:43.964938 17818 raft_consensus.cc:493] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.965471 17818 raft_consensus.cc:515] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:43.967649 17818 leader_election.cc:290] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:43.968449 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3b300755fb4bf382d645207da71f46" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:43.968727 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3b300755fb4bf382d645207da71f46" candidate_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:43.969517 17737 raft_consensus.cc:2393] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 75ab662eb9ed4ecab32ffc0a7e7008ae in current term 1: Already voted for candidate 8b919b60c8ad45c59fc72cd87e339a55 in this term.
I20260709 13:18:43.970541 17557 leader_election.cc:304] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:43.971567 17818 raft_consensus.cc:3060] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.978152 17818 raft_consensus.cc:2749] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:44.005668 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:44.093335 17818 consensus_queue.cc:1048] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.106789 17810 consensus_queue.cc:1048] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.115294 17821 raft_consensus.cc:493] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.115940 17821 raft_consensus.cc:515] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:44.119197 17821 leader_election.cc:290] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:44.119886 17586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c03d5f5d6047339a59e50daa5e6743" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" is_pre_election: true
I20260709 13:18:44.120621 17586 raft_consensus.cc:2468] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 0.
I20260709 13:18:44.120297 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c03d5f5d6047339a59e50daa5e6743" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:44.121315 17737 raft_consensus.cc:2468] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 0.
I20260709 13:18:44.121799 17631 leader_election.cc:304] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:44.122658 17821 raft_consensus.cc:2804] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.123039 17821 raft_consensus.cc:493] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.123335 17821 raft_consensus.cc:3060] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.129879 17821 raft_consensus.cc:515] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:44.131963 17821 leader_election.cc:290] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:44.132943 17586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c03d5f5d6047339a59e50daa5e6743" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:44.133081 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c03d5f5d6047339a59e50daa5e6743" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:44.133730 17586 raft_consensus.cc:3060] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.133929 17737 raft_consensus.cc:3060] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.141372 17586 raft_consensus.cc:2468] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 1.
I20260709 13:18:44.142449 17737 raft_consensus.cc:2468] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 1.
I20260709 13:18:44.142647 17631 leader_election.cc:304] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:44.144953 17821 raft_consensus.cc:2804] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.145654 17820 consensus_queue.cc:1048] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:44.146521 17821 raft_consensus.cc:697] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:44.147457 17821 consensus_queue.cc:237] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:44.149663 17810 consensus_queue.cc:1048] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:44.169739 17821 consensus_queue.cc:1048] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:44.164151 17485 catalog_manager.cc:5697] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.174435 17785 consensus_queue.cc:1048] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.228806 17820 consensus_queue.cc:1048] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.242373 17821 consensus_queue.cc:1048] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:44.249198 17821 consensus_queue.cc:1048] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:44.264062 17821 consensus_queue.cc:1048] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.274536 17785 consensus_queue.cc:1048] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:44.288211 17810 consensus_queue.cc:1048] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.494699  6030 ts_manager.cc:295] Set tserver state for 75ab662eb9ed4ecab32ffc0a7e7008ae to MAINTENANCE_MODE
I20260709 13:18:44.496364  6030 tablet_server.cc:179] TabletServer@127.5.227.129:0 shutting down...
I20260709 13:18:44.538558  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:44.539593  6030 tablet_replica.cc:333] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae: stopping tablet replica
I20260709 13:18:44.540854  6030 raft_consensus.cc:2243] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.541899  6030 raft_consensus.cc:2272] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.547057  6030 tablet_replica.cc:333] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae: stopping tablet replica
I20260709 13:18:44.548360  6030 raft_consensus.cc:2243] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:44.550294  6030 raft_consensus.cc:2272] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.554473  6030 tablet_replica.cc:333] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae: stopping tablet replica
I20260709 13:18:44.555294  6030 raft_consensus.cc:2243] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:44.556898  6030 raft_consensus.cc:2272] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.560451  6030 tablet_replica.cc:333] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae: stopping tablet replica
I20260709 13:18:44.561383  6030 raft_consensus.cc:2243] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.562150  6030 raft_consensus.cc:2272] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.565713  6030 tablet_replica.cc:333] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae: stopping tablet replica
I20260709 13:18:44.566423  6030 raft_consensus.cc:2243] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:44.568101  6030 raft_consensus.cc:2272] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.571436  6030 tablet_replica.cc:333] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae: stopping tablet replica
I20260709 13:18:44.572157  6030 raft_consensus.cc:2243] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:44.574337  6030 raft_consensus.cc:2272] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.579744  6030 tablet_replica.cc:333] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae: stopping tablet replica
W20260709 13:18:44.580330 17631 consensus_peers.cc:597] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:44.580704  6030 raft_consensus.cc:2243] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.581394  6030 raft_consensus.cc:2272] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.584607  6030 tablet_replica.cc:333] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae: stopping tablet replica
I20260709 13:18:44.585300  6030 raft_consensus.cc:2243] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:44.586547  6030 raft_consensus.cc:2272] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.592159  6030 tablet_replica.cc:333] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae: stopping tablet replica
I20260709 13:18:44.593189  6030 raft_consensus.cc:2243] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.594090  6030 raft_consensus.cc:2272] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.599025  6030 tablet_replica.cc:333] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: stopping tablet replica
I20260709 13:18:44.599790  6030 raft_consensus.cc:2243] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.600580  6030 raft_consensus.cc:2272] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.643795  6030 tablet_server.cc:196] TabletServer@127.5.227.129:0 shutdown complete.
W20260709 13:18:44.650813 17631 consensus_peers.cc:597] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:44.722606 17631 consensus_peers.cc:597] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:44.726850 17631 consensus_peers.cc:597] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:44.765877 17821 consensus_queue.cc:1048] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:44.901777 17705 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111) [suppressed 149 similar messages]
W20260709 13:18:44.905709 17705 consensus_peers.cc:597] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.007261 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:45.607152 17787 raft_consensus.cc:493] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.607770 17787 raft_consensus.cc:515] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.609820 17787 leader_election.cc:290] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:45.610783 17878 raft_consensus.cc:493] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.611428 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:45.611652 17878 raft_consensus.cc:515] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.612830 17737 raft_consensus.cc:2468] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 1.
I20260709 13:18:45.614167 17878 leader_election.cc:290] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
W20260709 13:18:45.614673 17631 leader_election.cc:336] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.615576 17632 leader_election.cc:304] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:45.616561 17787 raft_consensus.cc:2804] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:45.616552 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:45.617302 17787 raft_consensus.cc:493] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.617735 17787 raft_consensus.cc:3060] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:45.618264 17705 leader_election.cc:336] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.626367 17787 raft_consensus.cc:515] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.627947 17664 raft_consensus.cc:2393] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 024aac28af264d6ca6dad603ea427363 in current term 2: Already voted for candidate 8b919b60c8ad45c59fc72cd87e339a55 in this term.
I20260709 13:18:45.629783 17787 leader_election.cc:290] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:45.631409 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:45.631456 17705 leader_election.cc:304] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:45.632517 17737 raft_consensus.cc:3060] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:45.634228 17631 leader_election.cc:336] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.639503 17737 raft_consensus.cc:2468] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 2.
I20260709 13:18:45.640175 17878 raft_consensus.cc:2749] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.641021 17632 leader_election.cc:304] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:45.641932 17787 raft_consensus.cc:2804] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:45.642361 17787 raft_consensus.cc:697] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:45.643359 17787 consensus_queue.cc:237] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.652438 17486 catalog_manager.cc:5697] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 1 to 2, leader changed from 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129) to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 2 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:45.672999 17787 raft_consensus.cc:493] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.673727 17787 raft_consensus.cc:515] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.675619 17787 leader_election.cc:290] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:45.676823 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512c3713a10b496d9aec989bf5647642" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
W20260709 13:18:45.679616 17631 leader_election.cc:336] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.680025 17631 leader_election.cc:304] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b919b60c8ad45c59fc72cd87e339a55; no voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:45.680861 17787 raft_consensus.cc:2749] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.682734 17878 raft_consensus.cc:493] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.683548 17878 raft_consensus.cc:515] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.686404 17878 leader_election.cc:290] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:45.688832 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512c3713a10b496d9aec989bf5647642" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:45.689678 17664 raft_consensus.cc:2468] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 1.
W20260709 13:18:45.690722 17705 leader_election.cc:336] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.691639 17705 leader_election.cc:304] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:45.692399 17878 raft_consensus.cc:2804] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:45.692764 17878 raft_consensus.cc:493] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.693068 17878 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.700503 17878 raft_consensus.cc:515] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.702378 17878 leader_election.cc:290] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:45.704239 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512c3713a10b496d9aec989bf5647642" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:45.705255 17664 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:45.707680 17705 leader_election.cc:336] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.712308 17664 raft_consensus.cc:2468] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 2.
I20260709 13:18:45.713588 17705 leader_election.cc:304] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:45.714249 17878 raft_consensus.cc:2804] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:45.714744 17878 raft_consensus.cc:697] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:45.715664 17878 consensus_queue.cc:237] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.724372 17486 catalog_manager.cc:5697] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 1 to 2, leader changed from 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129) to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:45.791604 17876 raft_consensus.cc:493] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.792249 17876 raft_consensus.cc:515] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.792616 17878 raft_consensus.cc:493] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.793264 17878 raft_consensus.cc:515] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.794732 17876 leader_election.cc:290] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:45.795207 17878 leader_election.cc:290] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:45.796852 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
I20260709 13:18:45.796977 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:45.797554 17664 raft_consensus.cc:2468] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 1.
I20260709 13:18:45.797744 17739 raft_consensus.cc:2468] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 1.
I20260709 13:18:45.798851 17705 leader_election.cc:304] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:45.799602 17878 raft_consensus.cc:2804] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:45.799921 17632 leader_election.cc:304] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:45.800072 17878 raft_consensus.cc:493] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.800894 17876 raft_consensus.cc:2804] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:45.800930 17878 raft_consensus.cc:3060] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.801429 17876 raft_consensus.cc:493] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
W20260709 13:18:45.802001 17705 leader_election.cc:336] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.802021 17876 raft_consensus.cc:3060] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:45.802205 17631 leader_election.cc:336] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.811030 17878 raft_consensus.cc:515] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.811304 17876 raft_consensus.cc:515] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.813047 17878 leader_election.cc:290] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:45.813987 17876 leader_election.cc:290] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:45.815883 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:45.815903 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:45.817028 17739 raft_consensus.cc:2393] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b919b60c8ad45c59fc72cd87e339a55 in current term 2: Already voted for candidate 024aac28af264d6ca6dad603ea427363 in this term.
I20260709 13:18:45.817485 17664 raft_consensus.cc:2393] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 024aac28af264d6ca6dad603ea427363 in current term 2: Already voted for candidate 8b919b60c8ad45c59fc72cd87e339a55 in this term.
W20260709 13:18:45.818946 17631 leader_election.cc:336] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
W20260709 13:18:45.818842 17705 leader_election.cc:336] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.819612 17631 leader_election.cc:304] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b919b60c8ad45c59fc72cd87e339a55; no voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:45.820328 17876 raft_consensus.cc:2749] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.821409 17705 leader_election.cc:304] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:45.822608 17878 raft_consensus.cc:2749] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.864794 17878 raft_consensus.cc:493] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.865311 17878 raft_consensus.cc:515] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:45.867395 17878 leader_election.cc:290] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223)
I20260709 13:18:45.868755 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
W20260709 13:18:45.872140 17705 leader_election.cc:336] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.872793 17705 leader_election.cc:304] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:45.873872 17878 raft_consensus.cc:2749] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.875470 17878 raft_consensus.cc:493] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.875980 17878 raft_consensus.cc:515] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.878136 17878 leader_election.cc:290] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:45.879828 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55" is_pre_election: true
W20260709 13:18:45.882421 17705 leader_election.cc:336] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.882926 17705 leader_election.cc:304] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:45.884152 17878 raft_consensus.cc:2749] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.943645 17876 raft_consensus.cc:493] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.944355 17876 raft_consensus.cc:515] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.946141 17876 leader_election.cc:290] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:45.947408 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:45.948136 17739 raft_consensus.cc:2468] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 1.
I20260709 13:18:45.949437 17632 leader_election.cc:304] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:45.950183 17876 raft_consensus.cc:2804] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:45.950508 17876 raft_consensus.cc:493] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
W20260709 13:18:45.950892 17631 leader_election.cc:336] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.950898 17876 raft_consensus.cc:3060] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.952090 17787 raft_consensus.cc:493] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.952544 17787 raft_consensus.cc:515] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:45.954380 17787 leader_election.cc:290] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149), 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223)
I20260709 13:18:45.955461 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:45.956248 17739 raft_consensus.cc:2468] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 1.
I20260709 13:18:45.957439 17632 leader_election.cc:304] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:45.958341 17787 raft_consensus.cc:2804] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:45.958786 17787 raft_consensus.cc:493] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 75ab662eb9ed4ecab32ffc0a7e7008ae)
I20260709 13:18:45.958482 17876 raft_consensus.cc:515] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
W20260709 13:18:45.959110 17631 leader_election.cc:336] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.959242 17787 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.961021 17876 leader_election.cc:290] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:45.962266 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:45.963004 17739 raft_consensus.cc:3060] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:45.965044 17631 leader_election.cc:336] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.968796 17787 raft_consensus.cc:515] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:45.971345 17787 leader_election.cc:290] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: Requested vote from peers 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149), 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223)
I20260709 13:18:45.972448 17739 raft_consensus.cc:2468] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 2.
I20260709 13:18:45.972599 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:45.973240 17737 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.975277 17632 leader_election.cc:304] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:45.976438 17787 raft_consensus.cc:2804] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:45.977674 17631 leader_election.cc:336] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:45.977741 17787 raft_consensus.cc:697] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:45.979045 17787 consensus_queue.cc:237] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:45.981187 17737 raft_consensus.cc:2468] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 2.
I20260709 13:18:45.983095 17632 leader_election.cc:304] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:45.984535 17787 raft_consensus.cc:2804] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:45.985543 17787 raft_consensus.cc:697] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:45.986900 17787 consensus_queue.cc:237] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:45.989543 17486 catalog_manager.cc:5697] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 1 to 2, leader changed from 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129) to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 2 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:46.005945 17486 catalog_manager.cc:5697] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 1 to 2, leader changed from 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129) to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 2 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:46.008535 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:46.100219 17664 raft_consensus.cc:1275] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:46.102274 17878 consensus_queue.cc:1048] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:46.119673 17705 consensus_peers.cc:597] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.159036 17631 consensus_peers.cc:597] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.259455 17737 raft_consensus.cc:1275] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:46.261509 17787 consensus_queue.cc:1048] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:46.388314 17631 consensus_peers.cc:597] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.390232 17737 raft_consensus.cc:1275] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:46.392339 17894 consensus_queue.cc:1048] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.425391 17737 raft_consensus.cc:1275] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:46.427013 17894 consensus_queue.cc:1048] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:46.443936 17631 consensus_peers.cc:597] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.946516 17631 consensus_peers.cc:597] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.009840 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:18:47.036244 17631 consensus_peers.cc:597] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.101432 17631 consensus_peers.cc:597] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.308478 17631 consensus_peers.cc:597] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.353461 17894 raft_consensus.cc:493] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.354012 17894 raft_consensus.cc:515] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:47.355957 17894 leader_election.cc:290] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:47.357273 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363" is_pre_election: true
I20260709 13:18:47.358062 17737 raft_consensus.cc:2468] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 2.
I20260709 13:18:47.359382 17632 leader_election.cc:304] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
W20260709 13:18:47.360005 17631 leader_election.cc:336] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:47.360100 17894 raft_consensus.cc:2804] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:47.360560 17894 raft_consensus.cc:493] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.360831 17894 raft_consensus.cc:3060] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.367775 17894 raft_consensus.cc:515] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:47.370270 17894 leader_election.cc:290] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:47.371727 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:47.372413 17737 raft_consensus.cc:3060] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:47.374055 17631 leader_election.cc:336] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:47.378296 17737 raft_consensus.cc:2468] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 3.
I20260709 13:18:47.379793 17632 leader_election.cc:304] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae
I20260709 13:18:47.380584 17894 raft_consensus.cc:2804] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:47.381068 17894 raft_consensus.cc:697] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:47.382297 17894 consensus_queue.cc:237] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:47.397948 17486 catalog_manager.cc:5697] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 1 to 3, leader changed from 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129) to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 3 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:47.766214 17705 consensus_peers.cc:597] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.788040 17631 consensus_peers.cc:597] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.870172 17737 raft_consensus.cc:1275] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:47.872503 17898 consensus_queue.cc:1048] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:48.011219 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:18:48.593722 17631 consensus_peers.cc:597] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.627014 17705 consensus_peers.cc:597] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.874866 17631 consensus_peers.cc:597] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.957842 17631 consensus_peers.cc:597] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:49.012302 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:18:49.239462 17631 consensus_peers.cc:597] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:49.518019 17631 consensus_peers.cc:597] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:49.684921  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:49.694324 17911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:49.694695 17910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:49.696403 17913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:49.696513  6030 server_base.cc:1061] running on GCE node
I20260709 13:18:49.697894  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:49.698168  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:49.698385  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603129698365 us; error 0 us; skew 500 ppm
I20260709 13:18:49.699028  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:49.702008  6030 webserver.cc:533] Webserver started at http://127.5.227.129:33663/ using document root <none> and password file <none>
I20260709 13:18:49.702586  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:49.702873  6030 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:18:49.707484  6030 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:18:49.712714 17918 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.713670  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:18:49.714054  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-0-root
uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
format_stamp: "Formatted at 2026-07-09 13:18:42 on dist-test-slave-tbwl"
I20260709 13:18:49.714464  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602741015013-6030-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:49.733373  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:49.734934  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:49.736660  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:49.740869 17925 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:18:49.805811  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:18:49.806242  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.067s	user 0.002s	sys 0.002s
I20260709 13:18:49.806602  6030 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
W20260709 13:18:49.813542 17631 consensus_peers.cc:597] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:49.814124 17925 tablet_bootstrap.cc:492] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:49.834000 17925 tablet_bootstrap.cc:492] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:49.834920 17925 tablet_bootstrap.cc:492] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap complete.
I20260709 13:18:49.835592 17925 ts_tablet_manager.cc:1403] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:18:49.837934 17925 raft_consensus.cc:359] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:49.838528 17925 raft_consensus.cc:740] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:49.839339 17925 consensus_queue.cc:260] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:49.841974 17925 ts_tablet_manager.cc:1434] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:18:49.843132 17925 tablet_bootstrap.cc:492] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:49.857115 17925 tablet_bootstrap.cc:492] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:49.857955 17925 tablet_bootstrap.cc:492] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap complete.
I20260709 13:18:49.858592 17925 ts_tablet_manager.cc:1403] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.005s
I20260709 13:18:49.860845 17925 raft_consensus.cc:359] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:49.861766 17925 raft_consensus.cc:740] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:49.862768 17925 consensus_queue.cc:260] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:49.864874 17925 ts_tablet_manager.cc:1434] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:49.865712 17925 tablet_bootstrap.cc:492] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:49.866468  6030 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:18:49.866905  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.060s	user 0.057s	sys 0.003s
I20260709 13:18:49.887341 17925 tablet_bootstrap.cc:492] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:49.888660 17925 tablet_bootstrap.cc:492] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap complete.
I20260709 13:18:49.889384 17925 ts_tablet_manager.cc:1403] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 13:18:49.892014 17925 raft_consensus.cc:359] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:49.892987 17925 raft_consensus.cc:740] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:49.893950 17925 consensus_queue.cc:260] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:49.896328 17925 ts_tablet_manager.cc:1434] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:49.897174 17925 tablet_bootstrap.cc:492] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
W20260709 13:18:49.916366 17631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111) [suppressed 103 similar messages]
I20260709 13:18:49.918849 17925 tablet_bootstrap.cc:492] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:18:49.919727 17631 consensus_peers.cc:597] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:49.920132 17925 tablet_bootstrap.cc:492] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap complete.
I20260709 13:18:49.921032 17925 ts_tablet_manager.cc:1403] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 13:18:49.923987 17925 raft_consensus.cc:359] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:49.924846 17925 raft_consensus.cc:740] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:49.926949 17925 consensus_queue.cc:260] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:49.929015 17925 ts_tablet_manager.cc:1434] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:49.929772 17925 tablet_bootstrap.cc:492] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
W20260709 13:18:49.946395 17705 consensus_peers.cc:597] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:49.947881 17925 tablet_bootstrap.cc:492] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:49.949054 17925 tablet_bootstrap.cc:492] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap complete.
I20260709 13:18:49.949757 17925 ts_tablet_manager.cc:1403] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:18:49.953293 17925 raft_consensus.cc:359] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:49.954063 17925 raft_consensus.cc:740] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:49.954828 17925 consensus_queue.cc:260] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:49.956453  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.129:42223
I20260709 13:18:49.956640 17987 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.129:42223 every 8 connection(s)
I20260709 13:18:49.956830 17925 ts_tablet_manager.cc:1434] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:49.957753 17925 tablet_bootstrap.cc:492] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:49.964030  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:49.981976 17925 tablet_bootstrap.cc:492] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:49.983192 17925 tablet_bootstrap.cc:492] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap complete.
I20260709 13:18:49.983960 17925 ts_tablet_manager.cc:1403] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260709 13:18:49.987160 17925 raft_consensus.cc:359] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:49.987826 17925 raft_consensus.cc:740] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:49.988620 17925 consensus_queue.cc:260] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:49.990864 17925 ts_tablet_manager.cc:1434] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:49.991931 17925 tablet_bootstrap.cc:492] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:49.997432 17988 heartbeater.cc:344] Connected to a master server at 127.5.227.190:46061
I20260709 13:18:49.998167 17988 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:49.999589 17988 heartbeater.cc:507] Master 127.5.227.190:46061 requested a full tablet report, sending...
I20260709 13:18:50.012385 17485 ts_manager.cc:194] Re-registered known tserver with Master: 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223)
I20260709 13:18:50.013495 17925 tablet_bootstrap.cc:492] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:18:50.013839 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:50.015545 17925 tablet_bootstrap.cc:492] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap complete.
I20260709 13:18:50.015725 17664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
mode: GRACEFUL
new_leader_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:56980
I20260709 13:18:50.016503 17925 ts_tablet_manager.cc:1403] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.025s	user 0.022s	sys 0.000s
I20260709 13:18:50.016654 17664 raft_consensus.cc:606] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Received request to transfer leadership to TS 024aac28af264d6ca6dad603ea427363
I20260709 13:18:50.020068 17664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
mode: GRACEFUL
new_leader_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:56980
I20260709 13:18:50.020689 17664 raft_consensus.cc:606] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Received request to transfer leadership to TS 024aac28af264d6ca6dad603ea427363
I20260709 13:18:50.020174 17925 raft_consensus.cc:359] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.021386 17925 raft_consensus.cc:740] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.022250 17925 consensus_queue.cc:260] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.024361 17925 ts_tablet_manager.cc:1434] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:50.025170 17925 tablet_bootstrap.cc:492] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:50.024794 17664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
mode: GRACEFUL
new_leader_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:56980
I20260709 13:18:50.025946 17664 raft_consensus.cc:606] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Received request to transfer leadership to TS 024aac28af264d6ca6dad603ea427363
I20260709 13:18:50.029944 17664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
mode: GRACEFUL
new_leader_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:56980
I20260709 13:18:50.030537 17664 raft_consensus.cc:606] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Received request to transfer leadership to TS 024aac28af264d6ca6dad603ea427363
I20260709 13:18:50.031894  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:18:50.032567  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:50.033416  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:50.033794 17485 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38682
I20260709 13:18:50.040759 17988 heartbeater.cc:499] Master 127.5.227.190:46061 was elected leader, sending a full tablet report...
I20260709 13:18:50.042366 17962 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.048272 17925 tablet_bootstrap.cc:492] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.049607 17925 tablet_bootstrap.cc:492] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap complete.
I20260709 13:18:50.050776 17925 ts_tablet_manager.cc:1403] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.026s	user 0.024s	sys 0.000s
I20260709 13:18:50.053977 17925 raft_consensus.cc:359] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.054800 17925 raft_consensus.cc:740] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.055820 17925 consensus_queue.cc:260] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.058465 17925 ts_tablet_manager.cc:1434] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:50.059623 17925 tablet_bootstrap.cc:492] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:50.078032 17925 tablet_bootstrap.cc:492] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.078915 17925 tablet_bootstrap.cc:492] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap complete.
I20260709 13:18:50.079557 17925 ts_tablet_manager.cc:1403] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:18:50.082424 17925 raft_consensus.cc:359] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.083325 17925 raft_consensus.cc:740] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.084142 17925 consensus_queue.cc:260] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.086539 17925 ts_tablet_manager.cc:1434] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:50.087808 17925 tablet_bootstrap.cc:492] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap starting.
I20260709 13:18:50.103201 17962 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.106277 17925 tablet_bootstrap.cc:492] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.107582 17925 tablet_bootstrap.cc:492] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae: Bootstrap complete.
I20260709 13:18:50.108270 17925 ts_tablet_manager.cc:1403] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:18:50.110842 17925 raft_consensus.cc:359] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.111423 17925 raft_consensus.cc:740] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ab662eb9ed4ecab32ffc0a7e7008ae, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.112489 17925 consensus_queue.cc:260] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.114704 17925 ts_tablet_manager.cc:1434] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:18:50.149757 17962 raft_consensus.cc:3060] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.172914 17898 raft_consensus.cc:993] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55: : Instructing follower 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:50.173563 17909 raft_consensus.cc:1081] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Signalling peer 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:50.175383 17737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:42580
I20260709 13:18:50.175918 17737 raft_consensus.cc:493] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.176220 17737 raft_consensus.cc:3060] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.181195 17737 raft_consensus.cc:515] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.182979 17737 leader_election.cc:290] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:50.184422 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:50.184783 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:50.185612 17664 raft_consensus.cc:3055] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:50.185755 17962 raft_consensus.cc:3060] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.186026 17664 raft_consensus.cc:740] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:50.187534 17664 consensus_queue.cc:260] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.188851 17664 raft_consensus.cc:3060] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.193213 17962 raft_consensus.cc:2468] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 2.
I20260709 13:18:50.194844 17705 leader_election.cc:304] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:50.196086 17664 raft_consensus.cc:2468] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 2.
I20260709 13:18:50.196182 17897 raft_consensus.cc:2804] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:50.197996 17897 raft_consensus.cc:697] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:50.199146 17897 consensus_queue.cc:237] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.208724 17485 catalog_manager.cc:5697] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 1 to 2, leader changed from 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130) to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.287849 17962 raft_consensus.cc:3060] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.360010 17962 raft_consensus.cc:3060] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.414885 17898 raft_consensus.cc:993] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55: : Instructing follower 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:50.415414 17909 raft_consensus.cc:1081] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Signalling peer 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:50.417100 17737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:42580
I20260709 13:18:50.417625 17737 raft_consensus.cc:493] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.417915 17737 raft_consensus.cc:3060] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.423273 17737 raft_consensus.cc:515] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.425508 17737 leader_election.cc:290] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:50.427045 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:50.427789 17962 raft_consensus.cc:3060] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.427477 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:50.428589 17664 raft_consensus.cc:3055] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:50.428900 17664 raft_consensus.cc:740] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:50.429804 17664 consensus_queue.cc:260] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.431020 17664 raft_consensus.cc:3060] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.435976 17962 raft_consensus.cc:2468] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 2.
I20260709 13:18:50.437337 17705 leader_election.cc:304] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:50.438277 17664 raft_consensus.cc:2468] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 2.
I20260709 13:18:50.438284 17897 raft_consensus.cc:2804] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:50.439287 17897 raft_consensus.cc:697] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:50.440196 17897 consensus_queue.cc:237] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.452168 17485 catalog_manager.cc:5697] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 1 to 2, leader changed from 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130) to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.459221 17898 raft_consensus.cc:993] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55: : Instructing follower 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:50.459792 17909 raft_consensus.cc:1081] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Signalling peer 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:50.461796 17737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:42580
I20260709 13:18:50.462438 17737 raft_consensus.cc:493] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.462915 17737 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.470891 17737 raft_consensus.cc:515] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:50.475716 17737 leader_election.cc:290] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 3 election: Requested vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223)
I20260709 13:18:50.476482 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:50.476889 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:50.477205 17664 raft_consensus.cc:3055] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:50.477607 17962 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.477627 17664 raft_consensus.cc:740] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:50.478754 17664 consensus_queue.cc:260] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:50.479796 17664 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.483589 17962 raft_consensus.cc:2468] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 3.
I20260709 13:18:50.484956 17705 leader_election.cc:304] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:50.485677 17664 raft_consensus.cc:2468] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 3.
I20260709 13:18:50.485816 17897 raft_consensus.cc:2804] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:50.486428 17897 raft_consensus.cc:697] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 3 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:50.487432 17897 consensus_queue.cc:237] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:50.495354 17486 catalog_manager.cc:5697] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 2 to 3, leader changed from 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130) to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:50.526037 17898 raft_consensus.cc:993] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55: : Instructing follower 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:50.526690 17909 raft_consensus.cc:1081] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Signalling peer 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:50.528856 17737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:42580
I20260709 13:18:50.529495 17737 raft_consensus.cc:493] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.529767 17737 raft_consensus.cc:3060] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.535202 17737 raft_consensus.cc:515] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.536818 17737 leader_election.cc:290] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 3 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:50.537838 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:50.538070 17664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9518b3380e154d17876bb6b91364c35b" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:50.538600 17664 raft_consensus.cc:3055] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:50.538600 17962 raft_consensus.cc:3060] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.539599 17664 raft_consensus.cc:740] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:50.540506 17664 consensus_queue.cc:260] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.541872 17664 raft_consensus.cc:3060] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.547716 17962 raft_consensus.cc:2468] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 3.
I20260709 13:18:50.549467 17705 leader_election.cc:304] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:50.549492 17664 raft_consensus.cc:2468] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 3.
I20260709 13:18:50.550542 17897 raft_consensus.cc:2804] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:50.551270 17897 raft_consensus.cc:697] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 3 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:50.552333 17897 consensus_queue.cc:237] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:50.561792 17486 catalog_manager.cc:5697] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 2 to 3, leader changed from 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130) to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.627075 17664 raft_consensus.cc:1275] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:50.628726 17897 consensus_queue.cc:1048] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:50.641906 17962 raft_consensus.cc:1275] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:50.643931 18016 consensus_queue.cc:1048] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:50.847925 17664 raft_consensus.cc:1275] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:50.849697 18016 consensus_queue.cc:1048] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:50.861887 17962 raft_consensus.cc:1275] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:50.864223 18016 consensus_queue.cc:1048] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:50.868616 17664 raft_consensus.cc:1275] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:50.870282 18016 consensus_queue.cc:1048] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:50.881664 17962 raft_consensus.cc:1275] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:50.883719 17897 consensus_queue.cc:1048] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:50.945061 17962 raft_consensus.cc:1275] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:50.946509 17897 consensus_queue.cc:1048] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:50.956154 17664 raft_consensus.cc:1275] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:50.958181 18016 consensus_queue.cc:1048] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:51.015667 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:51.043145  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:51.063880 17737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512c3713a10b496d9aec989bf5647642"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
mode: GRACEFUL
new_leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:51776
I20260709 13:18:51.064616 17737 raft_consensus.cc:606] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Received request to transfer leadership to TS 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:51.067961 17737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
mode: GRACEFUL
new_leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:51776
I20260709 13:18:51.068482 17737 raft_consensus.cc:606] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Received request to transfer leadership to TS 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:51.071677 17664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da3b300755fb4bf382d645207da71f46"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
mode: GRACEFUL
new_leader_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:56980
I20260709 13:18:51.072237 17664 raft_consensus.cc:606] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Received request to transfer leadership to TS 024aac28af264d6ca6dad603ea427363
I20260709 13:18:51.073621  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:51.074255  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:51.074945  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:51.153029 17897 raft_consensus.cc:993] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363: : Instructing follower 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:51.153537 18016 raft_consensus.cc:1081] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Signalling peer 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:51.155288 17664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:33740
I20260709 13:18:51.155877 17664 raft_consensus.cc:493] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:51.156137 17664 raft_consensus.cc:3060] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.161653 17664 raft_consensus.cc:515] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:51.163291 17664 leader_election.cc:290] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:51.164702 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:51.164599 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e900916a7d43d183e0820cd724c9fa" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:51.165531 17737 raft_consensus.cc:3055] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:51.165719 17962 raft_consensus.cc:3060] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.165889 17737 raft_consensus.cc:740] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:51.167339 17737 consensus_queue.cc:260] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:51.168897 17737 raft_consensus.cc:3060] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.176347 17962 raft_consensus.cc:2468] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 3.
I20260709 13:18:51.176571 17737 raft_consensus.cc:2468] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 3.
I20260709 13:18:51.177861 17632 leader_election.cc:304] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:51.178831 18014 raft_consensus.cc:2804] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:51.179279 18014 raft_consensus.cc:697] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:51.180017 18014 consensus_queue.cc:237] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:51.186901 17485 catalog_manager.cc:5697] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 2 to 3, leader changed from 024aac28af264d6ca6dad603ea427363 (127.5.227.131) to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 3 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:51.317210 18016 raft_consensus.cc:993] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363: : Instructing follower 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:51.317763 18031 raft_consensus.cc:1081] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Signalling peer 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:51.319198 17664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "512c3713a10b496d9aec989bf5647642"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:33740
I20260709 13:18:51.319636 17664 raft_consensus.cc:493] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:51.319865 17664 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.326300 17664 raft_consensus.cc:515] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:51.328297 17664 leader_election.cc:290] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:51.329345 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512c3713a10b496d9aec989bf5647642" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:51.329394 17737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512c3713a10b496d9aec989bf5647642" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:51.330046 17962 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.330071 17737 raft_consensus.cc:3055] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:51.330518 17737 raft_consensus.cc:740] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:51.331203 17737 consensus_queue.cc:260] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:51.332103 17737 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.336310 17962 raft_consensus.cc:2468] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 3.
I20260709 13:18:51.337050 17737 raft_consensus.cc:2468] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 3.
I20260709 13:18:51.337710 17631 leader_election.cc:304] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:51.338644 18014 raft_consensus.cc:2804] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:51.339187 18014 raft_consensus.cc:697] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:51.340032 18014 consensus_queue.cc:237] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:51.349283 17485 catalog_manager.cc:5697] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 2 to 3, leader changed from 024aac28af264d6ca6dad603ea427363 (127.5.227.131) to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 3 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:51.555799 17898 raft_consensus.cc:993] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55: : Instructing follower 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:51.556310 18014 raft_consensus.cc:1081] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Signalling peer 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:51.557809 17739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da3b300755fb4bf382d645207da71f46"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:42580
I20260709 13:18:51.558337 17739 raft_consensus.cc:493] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:51.558691 17739 raft_consensus.cc:3060] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.567924 17739 raft_consensus.cc:515] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:51.570379 17739 leader_election.cc:290] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:51.571223 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3b300755fb4bf382d645207da71f46" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:51.571772 17666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3b300755fb4bf382d645207da71f46" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:51.572027 17962 raft_consensus.cc:3060] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.572674 17666 raft_consensus.cc:3055] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:51.573022 17666 raft_consensus.cc:740] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:51.573872 17666 consensus_queue.cc:260] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:51.575199 17666 raft_consensus.cc:3060] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.578768 17962 raft_consensus.cc:2468] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 2.
I20260709 13:18:51.580281 17705 leader_election.cc:304] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:51.581153 18016 raft_consensus.cc:2804] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:51.581693 18016 raft_consensus.cc:697] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:51.582177 17666 raft_consensus.cc:2468] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 2.
I20260709 13:18:51.582708 18016 consensus_queue.cc:237] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:51.592535 17485 catalog_manager.cc:5697] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 1 to 2, leader changed from 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130) to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.665781 17739 raft_consensus.cc:1275] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:51.667780 18014 consensus_queue.cc:1048] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:51.681684 17962 raft_consensus.cc:1275] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:51.683346 18036 consensus_queue.cc:1048] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:51.825989 17962 raft_consensus.cc:1275] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:51.827762 18014 consensus_queue.cc:1048] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:51.838428 17739 raft_consensus.cc:1275] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:51.840246 18036 consensus_queue.cc:1048] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:51.981770 17962 raft_consensus.cc:1275] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:51.983647 18016 consensus_queue.cc:1048] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:51.995072 17666 raft_consensus.cc:1275] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:51.997470 18031 consensus_queue.cc:1048] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:52.017055 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:52.083307  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:52.092418 17666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07c03d5f5d6047339a59e50daa5e6743"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
mode: GRACEFUL
new_leader_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:56980
I20260709 13:18:52.093031 17666 raft_consensus.cc:606] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Received request to transfer leadership to TS 024aac28af264d6ca6dad603ea427363
I20260709 13:18:52.096073 17666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
mode: GRACEFUL
new_leader_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:56980
I20260709 13:18:52.096663 17666 raft_consensus.cc:606] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Received request to transfer leadership to TS 024aac28af264d6ca6dad603ea427363
I20260709 13:18:52.099473 17739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da3b300755fb4bf382d645207da71f46"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
mode: GRACEFUL
new_leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:51776
I20260709 13:18:52.100028 17739 raft_consensus.cc:606] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Received request to transfer leadership to TS 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:52.101521  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:52.102082  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:52.102805  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:52.405256 18042 raft_consensus.cc:993] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55: : Instructing follower 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:52.405871 18036 raft_consensus.cc:1081] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Signalling peer 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:52.407872 17739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07c03d5f5d6047339a59e50daa5e6743"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:42580
I20260709 13:18:52.408618 17739 raft_consensus.cc:493] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:52.409000 17739 raft_consensus.cc:3060] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:52.414860 17739 raft_consensus.cc:515] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:52.416939 18042 raft_consensus.cc:993] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55: : Instructing follower 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:52.417044 17739 leader_election.cc:290] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:52.417634 18042 raft_consensus.cc:1081] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Signalling peer 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:52.417761 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c03d5f5d6047339a59e50daa5e6743" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:52.418483 17961 raft_consensus.cc:3060] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:52.418854 17666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c03d5f5d6047339a59e50daa5e6743" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:52.419507 17666 raft_consensus.cc:3055] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:52.419835 17666 raft_consensus.cc:740] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:52.420065 17739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:42580
I20260709 13:18:52.420737 17739 raft_consensus.cc:493] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:52.421370 17739 raft_consensus.cc:3060] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.420719 17666 consensus_queue.cc:260] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:52.422362 17666 raft_consensus.cc:3060] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:52.427353 17961 raft_consensus.cc:2468] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 2.
I20260709 13:18:52.427383 17739 raft_consensus.cc:515] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:52.429044 17705 leader_election.cc:304] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:52.429982 17739 leader_election.cc:290] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 3 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:52.430090 18004 raft_consensus.cc:2804] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:52.430505 17666 raft_consensus.cc:2468] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 2.
I20260709 13:18:52.430704 18004 raft_consensus.cc:697] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:52.431039 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:52.431721 17961 raft_consensus.cc:3060] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.431784 18004 consensus_queue.cc:237] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:52.432596 17666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fbdbbec4e74cd1bfae903b4f236771" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:52.433218 17666 raft_consensus.cc:3055] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:52.433593 17666 raft_consensus.cc:740] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:52.434490 17666 consensus_queue.cc:260] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:52.435968 17666 raft_consensus.cc:3060] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.439757 17961 raft_consensus.cc:2468] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 3.
I20260709 13:18:52.441174 17705 leader_election.cc:304] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:52.442615 18004 raft_consensus.cc:2804] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:52.443464 18004 raft_consensus.cc:697] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 3 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:52.442792 17489 catalog_manager.cc:5697] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 1 to 2, leader changed from 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130) to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.444640 17666 raft_consensus.cc:2468] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 3.
I20260709 13:18:52.445029 18004 consensus_queue.cc:237] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:52.458379 18031 raft_consensus.cc:993] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363: : Instructing follower 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:52.458954 18004 raft_consensus.cc:1081] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Signalling peer 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:52.460764 17666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da3b300755fb4bf382d645207da71f46"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:33740
I20260709 13:18:52.461337 17666 raft_consensus.cc:493] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:52.461704 17666 raft_consensus.cc:3060] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.465473 17489 catalog_manager.cc:5697] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 2 to 3, leader changed from 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130) to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.470011 17666 raft_consensus.cc:515] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:52.473084 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3b300755fb4bf382d645207da71f46" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:52.473254 17666 leader_election.cc:290] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:52.473773 17961 raft_consensus.cc:3060] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.475728 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da3b300755fb4bf382d645207da71f46" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:52.476390 17739 raft_consensus.cc:3055] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:52.476717 17739 raft_consensus.cc:740] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:52.477589 17739 consensus_queue.cc:260] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:52.479092 17739 raft_consensus.cc:3060] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.480999 17961 raft_consensus.cc:2468] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 3.
I20260709 13:18:52.482221 17631 leader_election.cc:304] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:52.483424 18042 raft_consensus.cc:2804] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:52.484125 18042 raft_consensus.cc:697] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:52.485239 18042 consensus_queue.cc:237] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:52.485925 17739 raft_consensus.cc:2468] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 3.
I20260709 13:18:52.495571 17489 catalog_manager.cc:5697] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 2 to 3, leader changed from 024aac28af264d6ca6dad603ea427363 (127.5.227.131) to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 3 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:52.900645 17666 raft_consensus.cc:1275] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:52.902333 18004 consensus_queue.cc:1048] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:52.914253 17961 raft_consensus.cc:1275] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:52.916779 18031 consensus_queue.cc:1048] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:52.923473 17962 raft_consensus.cc:1275] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:52.925414 18031 consensus_queue.cc:1048] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:52.937623 17666 raft_consensus.cc:1275] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:52.939821 18031 consensus_queue.cc:1048] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:52.977571 17961 raft_consensus.cc:1275] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:52.978993 18042 consensus_queue.cc:1048] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:52.988834 17739 raft_consensus.cc:1275] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:52.990590 18042 consensus_queue.cc:1048] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:53.018049 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:53.110911  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:53.119598 17666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "512c3713a10b496d9aec989bf5647642"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
mode: GRACEFUL
new_leader_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:56980
I20260709 13:18:53.120208 17666 raft_consensus.cc:606] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Received request to transfer leadership to TS 024aac28af264d6ca6dad603ea427363
I20260709 13:18:53.123413 17739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
mode: GRACEFUL
new_leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:51776
I20260709 13:18:53.124218 17739 raft_consensus.cc:606] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 1 LEADER]: Received request to transfer leadership to TS 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:53.127894 17739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
mode: GRACEFUL
new_leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:51776
I20260709 13:18:53.128641 17739 raft_consensus.cc:606] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Received request to transfer leadership to TS 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:53.130375  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:53.130509 18031 raft_consensus.cc:993] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363: : Instructing follower 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:53.131234  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:53.131636 18004 raft_consensus.cc:1081] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 1 LEADER]: Signalling peer 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:53.132310  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:53.133821 17666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:33740
I20260709 13:18:53.134529 17666 raft_consensus.cc:493] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.134958 17666 raft_consensus.cc:3060] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:53.140717 17666 raft_consensus.cc:515] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:53.143378 17666 leader_election.cc:290] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:53.144529 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:53.144778 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:53.145274 17961 raft_consensus.cc:3060] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:53.145731 17739 raft_consensus.cc:3055] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:53.146103 17739 raft_consensus.cc:740] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:53.147078 17739 consensus_queue.cc:260] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:53.148629 17739 raft_consensus.cc:3060] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:53.153940 17961 raft_consensus.cc:2468] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 2.
I20260709 13:18:53.155313 17631 leader_election.cc:304] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:53.156047 17739 raft_consensus.cc:2468] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 2.
I20260709 13:18:53.156502 18042 raft_consensus.cc:2804] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:53.157081 18042 raft_consensus.cc:697] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:53.157959 18042 consensus_queue.cc:237] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:53.168460 17485 catalog_manager.cc:5697] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 1 to 2, leader changed from 024aac28af264d6ca6dad603ea427363 (127.5.227.131) to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 2 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.339576 18059 raft_consensus.cc:993] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55: : Instructing follower 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:53.340121 18042 raft_consensus.cc:1081] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Signalling peer 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:53.341746 17739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "512c3713a10b496d9aec989bf5647642"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:42580
I20260709 13:18:53.342244 17739 raft_consensus.cc:493] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.342527 17739 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.349206 17739 raft_consensus.cc:515] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:53.351545 17739 leader_election.cc:290] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:53.352818 17666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512c3713a10b496d9aec989bf5647642" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:53.352860 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512c3713a10b496d9aec989bf5647642" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:53.353554 17666 raft_consensus.cc:3055] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:53.353778 17961 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.353982 17666 raft_consensus.cc:740] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:53.355043 17666 consensus_queue.cc:260] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:53.356174 17666 raft_consensus.cc:3060] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.361372 17961 raft_consensus.cc:2468] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 4.
I20260709 13:18:53.362380 17666 raft_consensus.cc:2468] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 4.
I20260709 13:18:53.363116 17705 leader_election.cc:304] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:53.364104 18004 raft_consensus.cc:2804] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:53.364650 18004 raft_consensus.cc:697] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 4 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:53.365581 18004 consensus_queue.cc:237] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:53.374963 17485 catalog_manager.cc:5697] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 3 to 4, leader changed from 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130) to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 4 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:53.425609 18016 raft_consensus.cc:993] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363: : Instructing follower 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:53.426349 18004 raft_consensus.cc:1081] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Signalling peer 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:53.428584 17666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:33740
I20260709 13:18:53.429361 17666 raft_consensus.cc:493] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.429797 17666 raft_consensus.cc:3060] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.437249 17666 raft_consensus.cc:515] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:53.439409 17666 leader_election.cc:290] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149)
I20260709 13:18:53.440378 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:53.440583 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df211c55e6264e56947d0d2ee1330fdb" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:53.441056 17961 raft_consensus.cc:3060] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.441262 17739 raft_consensus.cc:3055] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:53.441704 17739 raft_consensus.cc:740] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:53.442425 17739 consensus_queue.cc:260] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:53.443697 17739 raft_consensus.cc:3060] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.449255 17961 raft_consensus.cc:2468] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 3.
I20260709 13:18:53.449393 17739 raft_consensus.cc:2468] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 3.
I20260709 13:18:53.450834 17632 leader_election.cc:304] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:53.451627 18042 raft_consensus.cc:2804] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:53.452175 18042 raft_consensus.cc:697] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:53.452997 18042 consensus_queue.cc:237] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:53.461230 17485 catalog_manager.cc:5697] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 2 to 3, leader changed from 024aac28af264d6ca6dad603ea427363 (127.5.227.131) to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 3 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.599493 17739 raft_consensus.cc:1275] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:53.601079 18067 consensus_queue.cc:1048] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:53.614352 17961 raft_consensus.cc:1275] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:53.616201 18067 consensus_queue.cc:1048] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:53.788789 17666 raft_consensus.cc:1275] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:53.790848 18004 consensus_queue.cc:1048] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:53.801450 17961 raft_consensus.cc:1275] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:53.804116 18004 consensus_queue.cc:1048] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:53.956076 17961 raft_consensus.cc:1275] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:53.957370 18067 consensus_queue.cc:1048] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:53.966792 17739 raft_consensus.cc:1275] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:53.968945 18059 consensus_queue.cc:1048] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:54.019411 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:54.141094  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:54.150924 17739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
mode: GRACEFUL
new_leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:51776
I20260709 13:18:54.151859 17739 raft_consensus.cc:606] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 3 LEADER]: Received request to transfer leadership to TS 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:54.154827 17666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
mode: GRACEFUL
new_leader_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:56980
I20260709 13:18:54.155443 17666 raft_consensus.cc:606] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Received request to transfer leadership to TS 024aac28af264d6ca6dad603ea427363
I20260709 13:18:54.158252 17666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
mode: GRACEFUL
new_leader_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:56980
I20260709 13:18:54.158845 17666 raft_consensus.cc:606] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Received request to transfer leadership to TS 024aac28af264d6ca6dad603ea427363
I20260709 13:18:54.159921  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:54.160442  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:54.161069  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:54.429122 18059 raft_consensus.cc:993] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55: : Instructing follower 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:54.430106 18067 raft_consensus.cc:1081] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Signalling peer 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:54.432745 17739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:42580
I20260709 13:18:54.433898 17739 raft_consensus.cc:493] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:54.434280 17739 raft_consensus.cc:3060] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.443517 17739 raft_consensus.cc:515] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:54.445662 17739 leader_election.cc:290] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:54.447932 17666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:54.447964 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e57d617b4045c68e8eb710c202b4e3" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:54.449172 17666 raft_consensus.cc:3055] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:54.449591 17961 raft_consensus.cc:3060] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.449608 17666 raft_consensus.cc:740] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:54.451335 17666 consensus_queue.cc:260] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:54.453577 17666 raft_consensus.cc:3060] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.460515 17961 raft_consensus.cc:2468] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 4.
I20260709 13:18:54.463071 17705 leader_election.cc:304] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:54.464586 18031 raft_consensus.cc:2804] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:54.465111 17666 raft_consensus.cc:2468] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 4.
I20260709 13:18:54.465260 18031 raft_consensus.cc:697] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 4 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:54.467365 18031 consensus_queue.cc:237] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:54.481645 17485 catalog_manager.cc:5697] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 3 to 4, leader changed from 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130) to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 4 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:54.497817 18031 raft_consensus.cc:993] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363: : Instructing follower 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:54.498591 18031 raft_consensus.cc:1081] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 3 LEADER]: Signalling peer 8b919b60c8ad45c59fc72cd87e339a55 to start an election
I20260709 13:18:54.501799 17666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7"
dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
 from {username='slave'} at 127.0.0.1:33740
I20260709 13:18:54.502956 17666 raft_consensus.cc:493] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:54.503549 17666 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.512344 17666 raft_consensus.cc:515] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:54.514256 17666 leader_election.cc:290] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 4 election: Requested vote from peers 024aac28af264d6ca6dad603ea427363 (127.5.227.131:40149), 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223)
I20260709 13:18:54.515730 17739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "024aac28af264d6ca6dad603ea427363"
I20260709 13:18:54.515738 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bb358f5c1f4484bce622696859c5b7" candidate_uuid: "8b919b60c8ad45c59fc72cd87e339a55" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:54.516500 17739 raft_consensus.cc:3055] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:54.516973 17739 raft_consensus.cc:740] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:54.517023 17961 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.518090 17739 consensus_queue.cc:260] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:54.520020 17739 raft_consensus.cc:3060] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.523900 17961 raft_consensus.cc:2468] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 4.
I20260709 13:18:54.525666 17631 leader_election.cc:304] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55; no voters: 
I20260709 13:18:54.526907 18067 raft_consensus.cc:2804] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:54.527405 18067 raft_consensus.cc:697] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 LEADER]: Becoming Leader. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:54.527837 17739 raft_consensus.cc:2468] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b919b60c8ad45c59fc72cd87e339a55 in term 4.
I20260709 13:18:54.528812 18067 consensus_queue.cc:237] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:54.539644 17489 catalog_manager.cc:5697] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 reported cstate change: term changed from 3 to 4, leader changed from 024aac28af264d6ca6dad603ea427363 (127.5.227.131) to 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130). New cstate: current_term: 4 leader_uuid: "8b919b60c8ad45c59fc72cd87e339a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.744007 18059 raft_consensus.cc:993] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55: : Instructing follower 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:54.744725 18067 raft_consensus.cc:1081] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Signalling peer 024aac28af264d6ca6dad603ea427363 to start an election
I20260709 13:18:54.746786 17739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c"
dest_uuid: "024aac28af264d6ca6dad603ea427363"
 from {username='slave'} at 127.0.0.1:42580
I20260709 13:18:54.747344 17739 raft_consensus.cc:493] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:54.747726 17739 raft_consensus.cc:3060] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:54.754065 17739 raft_consensus.cc:515] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:54.755816 17739 leader_election.cc:290] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 3 election: Requested vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
I20260709 13:18:54.756930 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae"
I20260709 13:18:54.757190 17666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cacc9c3f28442aa7d2a52537bfea1c" candidate_uuid: "024aac28af264d6ca6dad603ea427363" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b919b60c8ad45c59fc72cd87e339a55"
I20260709 13:18:54.757652 17961 raft_consensus.cc:3060] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:54.757843 17666 raft_consensus.cc:3055] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:54.758256 17666 raft_consensus.cc:740] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b919b60c8ad45c59fc72cd87e339a55, State: Running, Role: LEADER
I20260709 13:18:54.759172 17666 consensus_queue.cc:260] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:54.760295 17666 raft_consensus.cc:3060] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:54.763932 17961 raft_consensus.cc:2468] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 3.
I20260709 13:18:54.765270 17705 leader_election.cc:304] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024aac28af264d6ca6dad603ea427363, 75ab662eb9ed4ecab32ffc0a7e7008ae; no voters: 
I20260709 13:18:54.765408 17666 raft_consensus.cc:2468] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024aac28af264d6ca6dad603ea427363 in term 3.
I20260709 13:18:54.766460 18016 raft_consensus.cc:2804] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:54.767045 18016 raft_consensus.cc:697] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 3 LEADER]: Becoming Leader. State: Replica: 024aac28af264d6ca6dad603ea427363, State: Running, Role: LEADER
I20260709 13:18:54.768183 18016 consensus_queue.cc:237] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:54.775964 17489 catalog_manager.cc:5697] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 reported cstate change: term changed from 2 to 3, leader changed from 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130) to 024aac28af264d6ca6dad603ea427363 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "024aac28af264d6ca6dad603ea427363" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:54.920462 17666 raft_consensus.cc:1275] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.921810 18016 consensus_queue.cc:1048] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:54.935529 17961 raft_consensus.cc:1275] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.938968 18031 consensus_queue.cc:1048] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:55.021337 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:55.277205 17961 raft_consensus.cc:1275] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:55.279547 18031 consensus_queue.cc:1048] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:55.334828 17962 raft_consensus.cc:1275] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:55.336465 18067 consensus_queue.cc:1048] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:55.362709 17666 raft_consensus.cc:1275] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Refusing update from remote peer 024aac28af264d6ca6dad603ea427363: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:55.456276 17739 raft_consensus.cc:1275] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Refusing update from remote peer 8b919b60c8ad45c59fc72cd87e339a55: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:55.466729 18094 consensus_queue.cc:1048] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:55.449951  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:55.470026 18031 consensus_queue.cc:1048] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:55.523303  6030 tablet_server.cc:179] TabletServer@127.5.227.129:42223 shutting down...
W20260709 13:18:55.543592 17631 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 13:18:55.550753 17631 consensus_peers.cc:597] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:55.557557  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:55.558887  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.559809  6030 raft_consensus.cc:2243] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.560511  6030 raft_consensus.cc:2272] T 512c3713a10b496d9aec989bf5647642 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.563426  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.564225  6030 raft_consensus.cc:2243] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.564771  6030 raft_consensus.cc:2272] T d1e900916a7d43d183e0820cd724c9fa P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.568264  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.569136  6030 raft_consensus.cc:2243] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.569875  6030 raft_consensus.cc:2272] T 9518b3380e154d17876bb6b91364c35b P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.572636  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.573231  6030 raft_consensus.cc:2243] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.573772  6030 raft_consensus.cc:2272] T df211c55e6264e56947d0d2ee1330fdb P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.576584  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.577579  6030 raft_consensus.cc:2243] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.578133  6030 raft_consensus.cc:2272] T 81e57d617b4045c68e8eb710c202b4e3 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.582265  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.583355  6030 raft_consensus.cc:2243] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.583887  6030 raft_consensus.cc:2272] T 18bb358f5c1f4484bce622696859c5b7 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.587356  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.588099  6030 raft_consensus.cc:2243] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.588615  6030 raft_consensus.cc:2272] T d2cacc9c3f28442aa7d2a52537bfea1c P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.592144  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.592876  6030 raft_consensus.cc:2243] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.593708  6030 raft_consensus.cc:2272] T da3b300755fb4bf382d645207da71f46 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.596716  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.597292  6030 raft_consensus.cc:2243] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.597862  6030 raft_consensus.cc:2272] T 87fbdbbec4e74cd1bfae903b4f236771 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.601179  6030 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.601835  6030 raft_consensus.cc:2243] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.602509  6030 raft_consensus.cc:2272] T 07c03d5f5d6047339a59e50daa5e6743 P 75ab662eb9ed4ecab32ffc0a7e7008ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.639726  6030 tablet_server.cc:196] TabletServer@127.5.227.129:42223 shutdown complete.
W20260709 13:18:55.667232 17705 consensus_peers.cc:597] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:55.675082  6030 tablet_server.cc:179] TabletServer@127.5.227.130:0 shutting down...
I20260709 13:18:55.705946  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:55.707026  6030 tablet_replica.cc:333] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55: stopping tablet replica
I20260709 13:18:55.708016  6030 raft_consensus.cc:2243] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.708757  6030 raft_consensus.cc:2272] T 512c3713a10b496d9aec989bf5647642 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.712083  6030 tablet_replica.cc:333] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55: stopping tablet replica
I20260709 13:18:55.712879  6030 raft_consensus.cc:2243] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.713966  6030 raft_consensus.cc:2272] T df211c55e6264e56947d0d2ee1330fdb P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.717685  6030 tablet_replica.cc:333] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55: stopping tablet replica
I20260709 13:18:55.718341  6030 raft_consensus.cc:2243] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.718992  6030 raft_consensus.cc:2272] T 81e57d617b4045c68e8eb710c202b4e3 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.723207  6030 tablet_replica.cc:333] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55: stopping tablet replica
I20260709 13:18:55.724035  6030 raft_consensus.cc:2243] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.725172  6030 raft_consensus.cc:2272] T da3b300755fb4bf382d645207da71f46 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.728142  6030 tablet_replica.cc:333] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55: stopping tablet replica
I20260709 13:18:55.728930  6030 raft_consensus.cc:2243] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.729496  6030 raft_consensus.cc:2272] T d2cacc9c3f28442aa7d2a52537bfea1c P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.733700  6030 tablet_replica.cc:333] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55: stopping tablet replica
I20260709 13:18:55.734475  6030 raft_consensus.cc:2243] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.735529  6030 raft_consensus.cc:2272] T 18bb358f5c1f4484bce622696859c5b7 P 8b919b60c8ad45c59fc72cd87e339a55 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.739159  6030 tablet_replica.cc:333] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55: stopping tablet replica
I20260709 13:18:55.739881  6030 raft_consensus.cc:2243] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.740491  6030 raft_consensus.cc:2272] T 07c03d5f5d6047339a59e50daa5e6743 P 8b919b60c8ad45c59fc72cd87e339a55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.743284  6030 tablet_replica.cc:333] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55: stopping tablet replica
I20260709 13:18:55.743899  6030 raft_consensus.cc:2243] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.744513  6030 raft_consensus.cc:2272] T 87fbdbbec4e74cd1bfae903b4f236771 P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.748504  6030 tablet_replica.cc:333] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55: stopping tablet replica
I20260709 13:18:55.749441  6030 raft_consensus.cc:2243] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.751281  6030 raft_consensus.cc:2272] T d1e900916a7d43d183e0820cd724c9fa P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:55.752570 17705 consensus_peers.cc:597] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:55.755342  6030 tablet_replica.cc:333] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55: stopping tablet replica
I20260709 13:18:55.756143  6030 raft_consensus.cc:2243] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.756857  6030 raft_consensus.cc:2272] T 9518b3380e154d17876bb6b91364c35b P 8b919b60c8ad45c59fc72cd87e339a55 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:55.789515 17705 consensus_peers.cc:597] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:55.792673 17705 consensus_peers.cc:597] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:55.853318 17705 consensus_peers.cc:597] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:55.920715 17705 consensus_peers.cc:597] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:55.963848 17705 consensus_peers.cc:597] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.022899 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:18:56.023980 17705 consensus_peers.cc:597] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.054798 17705 consensus_peers.cc:597] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.057765 17705 consensus_peers.cc:597] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.063484 17705 consensus_peers.cc:597] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.105954 17705 consensus_peers.cc:597] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.383235 17687 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3860 after lost signal to thread 6033
W20260709 13:18:56.384537 17687 debug-util.cc:398] Leaking SignalData structure 0x7b08002b4980 after lost signal to thread 17523
W20260709 13:18:56.386931 17687 debug-util.cc:398] Leaking SignalData structure 0x7b0800125960 after lost signal to thread 17764
W20260709 13:18:56.796691  6030 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17687)
I20260709 13:18:56.959968 18016 raft_consensus.cc:493] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b919b60c8ad45c59fc72cd87e339a55)
I20260709 13:18:56.960736 18016 raft_consensus.cc:515] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:56.962965 18016 leader_election.cc:290] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
W20260709 13:18:56.968839 17705 leader_election.cc:336] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
W20260709 13:18:56.970283 17705 leader_election.cc:336] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111)
I20260709 13:18:56.970882 17705 leader_election.cc:304] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:56.971757 18016 raft_consensus.cc:2749] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:56.986135 18016 raft_consensus.cc:493] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b919b60c8ad45c59fc72cd87e339a55)
I20260709 13:18:56.986752 18016 raft_consensus.cc:515] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:56.989501 18016 leader_election.cc:290] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223)
W20260709 13:18:56.994550 17705 leader_election.cc:336] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111)
W20260709 13:18:56.995546 17705 leader_election.cc:336] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:56.995973 17705 leader_election.cc:304] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:56.996703 18016 raft_consensus.cc:2749] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:57.024432 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:57.069170 18016 raft_consensus.cc:493] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b919b60c8ad45c59fc72cd87e339a55)
I20260709 13:18:57.070079 18016 raft_consensus.cc:515] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:57.072317 18016 leader_election.cc:290] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
W20260709 13:18:57.077390 17705 leader_election.cc:336] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
W20260709 13:18:57.078234 17705 leader_election.cc:336] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111)
I20260709 13:18:57.078740 17705 leader_election.cc:304] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:57.079566 18016 raft_consensus.cc:2749] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:57.083576 18016 raft_consensus.cc:493] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b919b60c8ad45c59fc72cd87e339a55)
I20260709 13:18:57.084087 18016 raft_consensus.cc:515] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:57.086555 18016 leader_election.cc:290] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
W20260709 13:18:57.091677 17705 leader_election.cc:336] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
W20260709 13:18:57.092463 17705 leader_election.cc:336] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111)
I20260709 13:18:57.092980 17705 leader_election.cc:304] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:57.093842 18016 raft_consensus.cc:2749] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:57.797386  6030 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 17687)
W20260709 13:18:58.026089 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:18:58.072638 17705 consensus_peers.cc:597] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:58.288640 17705 consensus_peers.cc:597] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:58.317922 17705 consensus_peers.cc:597] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:58.334393 17705 consensus_peers.cc:597] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:58.420931 17705 consensus_peers.cc:597] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:58.435523 17705 consensus_peers.cc:597] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:58.582108 17705 consensus_peers.cc:597] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:58.635793 17705 consensus_peers.cc:597] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:58.640231 17705 consensus_peers.cc:597] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 -> Peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Couldn't send request to peer 75ab662eb9ed4ecab32ffc0a7e7008ae. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:58.671486 17705 consensus_peers.cc:597] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:58.768277 18108 raft_consensus.cc:493] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b919b60c8ad45c59fc72cd87e339a55)
I20260709 13:18:58.769233 18108 raft_consensus.cc:515] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:58.771800 18108 leader_election.cc:290] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
W20260709 13:18:58.775982 17705 leader_election.cc:336] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
W20260709 13:18:58.776798 17705 leader_election.cc:336] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111)
I20260709 13:18:58.777235 17705 leader_election.cc:304] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:58.778086 18108 raft_consensus.cc:2749] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:58.798188  6030 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 17687)
W20260709 13:18:58.832274 17705 consensus_peers.cc:597] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:58.877976 17705 consensus_peers.cc:597] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 -> Peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Couldn't send request to peer 8b919b60c8ad45c59fc72cd87e339a55. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:59.015584 18108 raft_consensus.cc:493] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b919b60c8ad45c59fc72cd87e339a55)
I20260709 13:18:59.016160 18108 raft_consensus.cc:515] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:59.018083 18108 leader_election.cc:290] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
W20260709 13:18:59.025400 17705 leader_election.cc:336] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
W20260709 13:18:59.026425 17705 leader_election.cc:336] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111)
I20260709 13:18:59.026948 17705 leader_election.cc:304] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
W20260709 13:18:59.027377 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:59.027760 18108 raft_consensus.cc:2749] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:59.227123 18108 raft_consensus.cc:493] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b919b60c8ad45c59fc72cd87e339a55)
I20260709 13:18:59.227674 18108 raft_consensus.cc:515] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } } peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } }
I20260709 13:18:59.230054 18108 leader_election.cc:290] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223), 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463)
W20260709 13:18:59.233963 17705 leader_election.cc:336] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
W20260709 13:18:59.234786 17705 leader_election.cc:336] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111)
I20260709 13:18:59.235210 17705 leader_election.cc:304] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:59.236147 18108 raft_consensus.cc:2749] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:59.246392 18108 raft_consensus.cc:493] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b919b60c8ad45c59fc72cd87e339a55)
I20260709 13:18:59.247232 18108 raft_consensus.cc:515] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b919b60c8ad45c59fc72cd87e339a55" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 34463 } } peers { permanent_uuid: "024aac28af264d6ca6dad603ea427363" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40149 } } peers { permanent_uuid: "75ab662eb9ed4ecab32ffc0a7e7008ae" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 42223 } }
I20260709 13:18:59.249413 18108 leader_election.cc:290] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463), 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223)
W20260709 13:18:59.254119 17705 leader_election.cc:336] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8b919b60c8ad45c59fc72cd87e339a55 (127.5.227.130:34463): Network error: Client connection negotiation failed: client connection to 127.5.227.130:34463: connect: Connection refused (error 111)
W20260709 13:18:59.254915 17705 leader_election.cc:336] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 75ab662eb9ed4ecab32ffc0a7e7008ae (127.5.227.129:42223): Network error: Client connection negotiation failed: client connection to 127.5.227.129:42223: connect: Connection refused (error 111)
I20260709 13:18:59.255362 17705 leader_election.cc:304] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024aac28af264d6ca6dad603ea427363; no voters: 75ab662eb9ed4ecab32ffc0a7e7008ae, 8b919b60c8ad45c59fc72cd87e339a55
I20260709 13:18:59.256326 18108 raft_consensus.cc:2749] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:59.798820  6030 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 17687)
W20260709 13:19:00.028930 17537 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:00.341137  6030 tablet_server.cc:196] TabletServer@127.5.227.130:0 shutdown complete.
I20260709 13:19:00.374262  6030 tablet_server.cc:179] TabletServer@127.5.227.131:0 shutting down...
I20260709 13:19:00.403678  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:00.404561  6030 tablet_replica.cc:333] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363: stopping tablet replica
I20260709 13:19:00.405391  6030 raft_consensus.cc:2243] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.406311  6030 raft_consensus.cc:2272] T 07c03d5f5d6047339a59e50daa5e6743 P 024aac28af264d6ca6dad603ea427363 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.408915  6030 tablet_replica.cc:333] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363: stopping tablet replica
I20260709 13:19:00.409561  6030 raft_consensus.cc:2243] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.410480  6030 raft_consensus.cc:2272] T 87fbdbbec4e74cd1bfae903b4f236771 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.412869  6030 tablet_replica.cc:333] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363: stopping tablet replica
I20260709 13:19:00.413408  6030 raft_consensus.cc:2243] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.414227  6030 raft_consensus.cc:2272] T 512c3713a10b496d9aec989bf5647642 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.416898  6030 tablet_replica.cc:333] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363: stopping tablet replica
I20260709 13:19:00.417701  6030 raft_consensus.cc:2243] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.418300  6030 raft_consensus.cc:2272] T d1e900916a7d43d183e0820cd724c9fa P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.421584  6030 tablet_replica.cc:333] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363: stopping tablet replica
I20260709 13:19:00.422387  6030 raft_consensus.cc:2243] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.423290  6030 raft_consensus.cc:2272] T 9518b3380e154d17876bb6b91364c35b P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.426826  6030 tablet_replica.cc:333] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363: stopping tablet replica
I20260709 13:19:00.427516  6030 raft_consensus.cc:2243] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.428339  6030 raft_consensus.cc:2272] T d2cacc9c3f28442aa7d2a52537bfea1c P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.430982  6030 tablet_replica.cc:333] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363: stopping tablet replica
I20260709 13:19:00.431584  6030 raft_consensus.cc:2243] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.432090  6030 raft_consensus.cc:2272] T da3b300755fb4bf382d645207da71f46 P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.435050  6030 tablet_replica.cc:333] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363: stopping tablet replica
I20260709 13:19:00.435761  6030 raft_consensus.cc:2243] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.436612  6030 raft_consensus.cc:2272] T 81e57d617b4045c68e8eb710c202b4e3 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.439010  6030 tablet_replica.cc:333] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363: stopping tablet replica
I20260709 13:19:00.439639  6030 raft_consensus.cc:2243] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.440176  6030 raft_consensus.cc:2272] T df211c55e6264e56947d0d2ee1330fdb P 024aac28af264d6ca6dad603ea427363 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.443027  6030 tablet_replica.cc:333] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363: stopping tablet replica
I20260709 13:19:00.443632  6030 raft_consensus.cc:2243] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.444123  6030 raft_consensus.cc:2272] T 18bb358f5c1f4484bce622696859c5b7 P 024aac28af264d6ca6dad603ea427363 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.480235  6030 tablet_server.cc:196] TabletServer@127.5.227.131:0 shutdown complete.
I20260709 13:19:00.513948  6030 master.cc:562] Master@127.5.227.190:46061 shutting down...
I20260709 13:19:00.543112  6030 raft_consensus.cc:2243] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.543751  6030 raft_consensus.cc:2272] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.544122  6030 tablet_replica.cc:333] T 00000000000000000000000000000000 P acc6ff720cb5415b900333910b2a5eee: stopping tablet replica
I20260709 13:19:00.569599  6030 master.cc:584] Master@127.5.227.190:46061 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (18779 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:19:00.621021  6030 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.227.190:46819
I20260709 13:19:00.622180  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:00.629511 18111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:00.630203 18112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:00.631546 18114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:00.632319  6030 server_base.cc:1061] running on GCE node
I20260709 13:19:00.633500  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:00.633725  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:00.633854  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603140633842 us; error 0 us; skew 500 ppm
I20260709 13:19:00.634375  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:00.637295  6030 webserver.cc:533] Webserver started at http://127.5.227.190:33095/ using document root <none> and password file <none>
I20260709 13:19:00.637840  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:00.638024  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:00.638264  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:00.639705  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/master-0-root/instance:
uuid: "a14f420f7c304e13b1b26f2e9eeeb8d9"
format_stamp: "Formatted at 2026-07-09 13:19:00 on dist-test-slave-tbwl"
I20260709 13:19:00.645054  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:00.649478 18119 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:00.651039  6030 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:19:00.651437  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/master-0-root
uuid: "a14f420f7c304e13b1b26f2e9eeeb8d9"
format_stamp: "Formatted at 2026-07-09 13:19:00 on dist-test-slave-tbwl"
I20260709 13:19:00.651798  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:00.689072  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:00.691007  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:00.739769  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.190:46819
I20260709 13:19:00.739872 18170 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.190:46819 every 8 connection(s)
I20260709 13:19:00.745460 18171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:00.761445 18171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9: Bootstrap starting.
I20260709 13:19:00.767719 18171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.772847 18171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9: No bootstrap required, opened a new log
I20260709 13:19:00.775393 18171 raft_consensus.cc:359] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14f420f7c304e13b1b26f2e9eeeb8d9" member_type: VOTER }
I20260709 13:19:00.775815 18171 raft_consensus.cc:385] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.775996 18171 raft_consensus.cc:740] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a14f420f7c304e13b1b26f2e9eeeb8d9, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.776533 18171 consensus_queue.cc:260] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14f420f7c304e13b1b26f2e9eeeb8d9" member_type: VOTER }
I20260709 13:19:00.776973 18171 raft_consensus.cc:399] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:00.777165 18171 raft_consensus.cc:493] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:00.777375 18171 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.782996 18171 raft_consensus.cc:515] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14f420f7c304e13b1b26f2e9eeeb8d9" member_type: VOTER }
I20260709 13:19:00.783787 18171 leader_election.cc:304] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a14f420f7c304e13b1b26f2e9eeeb8d9; no voters: 
I20260709 13:19:00.785339 18171 leader_election.cc:290] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:00.785749 18174 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.787850 18174 raft_consensus.cc:697] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [term 1 LEADER]: Becoming Leader. State: Replica: a14f420f7c304e13b1b26f2e9eeeb8d9, State: Running, Role: LEADER
I20260709 13:19:00.788853 18174 consensus_queue.cc:237] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14f420f7c304e13b1b26f2e9eeeb8d9" member_type: VOTER }
I20260709 13:19:00.789132 18171 sys_catalog.cc:565] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:00.794459 18175 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a14f420f7c304e13b1b26f2e9eeeb8d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14f420f7c304e13b1b26f2e9eeeb8d9" member_type: VOTER } }
I20260709 13:19:00.795046 18176 sys_catalog.cc:455] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a14f420f7c304e13b1b26f2e9eeeb8d9. Latest consensus state: current_term: 1 leader_uuid: "a14f420f7c304e13b1b26f2e9eeeb8d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a14f420f7c304e13b1b26f2e9eeeb8d9" member_type: VOTER } }
I20260709 13:19:00.795372 18175 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:00.795704 18176 sys_catalog.cc:458] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:00.799154 18182 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:00.808470 18182 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:00.810333  6030 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:00.820007 18182 catalog_manager.cc:1383] Generated new cluster ID: 4cb9fa55bed24a4e934d428debc8d449
I20260709 13:19:00.820354 18182 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:00.850215 18182 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:00.852038 18182 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:00.870563 18182 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9: Generated new TSK 0
I20260709 13:19:00.871438 18182 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:00.877800  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:00.884927 18192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:00.886291 18193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:00.888820 18195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:00.888973  6030 server_base.cc:1061] running on GCE node
I20260709 13:19:00.890422  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:00.890717  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:00.890940  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603140890918 us; error 0 us; skew 500 ppm
I20260709 13:19:00.891536  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:00.894265  6030 webserver.cc:533] Webserver started at http://127.5.227.129:40657/ using document root <none> and password file <none>
I20260709 13:19:00.894888  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:00.895115  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:00.895421  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:00.896624  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-0-root/instance:
uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
format_stamp: "Formatted at 2026-07-09 13:19:00 on dist-test-slave-tbwl"
I20260709 13:19:00.901638  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:19:00.906184 18200 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:00.907543  6030 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:19:00.907944  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-0-root
uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
format_stamp: "Formatted at 2026-07-09 13:19:00 on dist-test-slave-tbwl"
I20260709 13:19:00.908321  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:00.926113  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:00.927582  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:00.929395  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:00.932119  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:00.932374  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:00.932646  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:00.932869  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:00.986378  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.129:36305
I20260709 13:19:00.986485 18262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.129:36305 every 8 connection(s)
I20260709 13:19:00.993094  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:01.003263 18267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:01.004658 18268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:01.007925 18270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:01.008260  6030 server_base.cc:1061] running on GCE node
I20260709 13:19:01.009495  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:01.009910  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:01.010125  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603141010104 us; error 0 us; skew 500 ppm
I20260709 13:19:01.010865  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:01.014088  6030 webserver.cc:533] Webserver started at http://127.5.227.130:33981/ using document root <none> and password file <none>
I20260709 13:19:01.014530 18263 heartbeater.cc:344] Connected to a master server at 127.5.227.190:46819
I20260709 13:19:01.014761  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:01.015100 18263 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:01.015168  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:01.015641  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:01.016070 18263 heartbeater.cc:507] Master 127.5.227.190:46819 requested a full tablet report, sending...
I20260709 13:19:01.016973  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-1-root/instance:
uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
format_stamp: "Formatted at 2026-07-09 13:19:01 on dist-test-slave-tbwl"
I20260709 13:19:01.018775 18136 ts_manager.cc:194] Registered new tserver with Master: e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129:36305)
I20260709 13:19:01.021576 18136 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54230
I20260709 13:19:01.025193  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:19:01.031813 18275 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.032898  6030 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:19:01.033352  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-1-root
uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
format_stamp: "Formatted at 2026-07-09 13:19:01 on dist-test-slave-tbwl"
I20260709 13:19:01.033677  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:01.050805  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:01.052186  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:01.054340  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:01.057027  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:01.057299  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.057566  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:01.057755  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.109081  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.130:33699
I20260709 13:19:01.109187 18337 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.130:33699 every 8 connection(s)
I20260709 13:19:01.114717  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:01.122576 18341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:01.123025 18342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:01.128420 18344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:01.128917 18338 heartbeater.cc:344] Connected to a master server at 127.5.227.190:46819
I20260709 13:19:01.129495 18338 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:01.129578  6030 server_base.cc:1061] running on GCE node
I20260709 13:19:01.130789 18338 heartbeater.cc:507] Master 127.5.227.190:46819 requested a full tablet report, sending...
I20260709 13:19:01.130955  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:01.131500  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:01.131775  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603141131746 us; error 0 us; skew 500 ppm
I20260709 13:19:01.132660  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:01.133960 18136 ts_manager.cc:194] Registered new tserver with Master: 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130:33699)
I20260709 13:19:01.135843  6030 webserver.cc:533] Webserver started at http://127.5.227.131:45145/ using document root <none> and password file <none>
I20260709 13:19:01.135919 18136 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54240
I20260709 13:19:01.136574  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:01.136838  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:01.137188  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:01.138411  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-2-root/instance:
uuid: "16ccf9f2310d45599296691919816bf4"
format_stamp: "Formatted at 2026-07-09 13:19:01 on dist-test-slave-tbwl"
I20260709 13:19:01.143239  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:19:01.148530 18349 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.149821  6030 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:19:01.150172  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-2-root
uuid: "16ccf9f2310d45599296691919816bf4"
format_stamp: "Formatted at 2026-07-09 13:19:01 on dist-test-slave-tbwl"
I20260709 13:19:01.150501  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602741015013-6030-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:01.167960  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:01.169663  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:01.171814  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:01.174695  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:01.174904  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.175091  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:01.175231  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.226454  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.131:42149
I20260709 13:19:01.226579 18411 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.131:42149 every 8 connection(s)
I20260709 13:19:01.245784 18412 heartbeater.cc:344] Connected to a master server at 127.5.227.190:46819
I20260709 13:19:01.246454 18412 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:01.247342 18412 heartbeater.cc:507] Master 127.5.227.190:46819 requested a full tablet report, sending...
I20260709 13:19:01.251230 18136 ts_manager.cc:194] Registered new tserver with Master: 16ccf9f2310d45599296691919816bf4 (127.5.227.131:42149)
I20260709 13:19:01.251473  6030 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.021309947s
I20260709 13:19:01.253408 18136 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54246
I20260709 13:19:01.284224 18136 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54248:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:01.287359 18136 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:01.341881 18227 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0305a44b53416492262a6290ae98ce (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c9aa2a4015634ad2ac902156c7b5ef94]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:01.343451 18228 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8bb329225e40c09f35a56ef91a6b23 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c9aa2a4015634ad2ac902156c7b5ef94]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:01.344889 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0305a44b53416492262a6290ae98ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.349740 18228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8bb329225e40c09f35a56ef91a6b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.364770 18303 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8bb329225e40c09f35a56ef91a6b23 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c9aa2a4015634ad2ac902156c7b5ef94]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:01.366395 18303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8bb329225e40c09f35a56ef91a6b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.371081 18377 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8bb329225e40c09f35a56ef91a6b23 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c9aa2a4015634ad2ac902156c7b5ef94]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:01.372059 18427 tablet_bootstrap.cc:492] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4: Bootstrap starting.
I20260709 13:19:01.372923 18377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8bb329225e40c09f35a56ef91a6b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.376000 18376 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0305a44b53416492262a6290ae98ce (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c9aa2a4015634ad2ac902156c7b5ef94]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:01.377664 18376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0305a44b53416492262a6290ae98ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.379771 18427 tablet_bootstrap.cc:654] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.374231 18302 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0305a44b53416492262a6290ae98ce (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c9aa2a4015634ad2ac902156c7b5ef94]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:01.382002 18302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0305a44b53416492262a6290ae98ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.412837 18429 tablet_bootstrap.cc:492] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a: Bootstrap starting.
I20260709 13:19:01.425719 18427 tablet_bootstrap.cc:492] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4: No bootstrap required, opened a new log
I20260709 13:19:01.426020 18429 tablet_bootstrap.cc:654] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.426807 18427 ts_tablet_manager.cc:1403] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4: Time spent bootstrapping tablet: real 0.055s	user 0.025s	sys 0.029s
I20260709 13:19:01.430923 18427 raft_consensus.cc:359] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.431736 18427 raft_consensus.cc:385] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.432041 18427 raft_consensus.cc:740] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7d29f68ecd74ec4ad0ecd9572d567e4, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.433108 18427 consensus_queue.cc:260] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.438714 18430 tablet_bootstrap.cc:492] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4: Bootstrap starting.
I20260709 13:19:01.439837 18427 ts_tablet_manager.cc:1434] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 13:19:01.441910 18263 heartbeater.cc:499] Master 127.5.227.190:46819 was elected leader, sending a full tablet report...
I20260709 13:19:01.443255 18427 tablet_bootstrap.cc:492] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4: Bootstrap starting.
I20260709 13:19:01.447120 18430 tablet_bootstrap.cc:654] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.447201 18429 tablet_bootstrap.cc:492] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a: No bootstrap required, opened a new log
I20260709 13:19:01.448173 18429 ts_tablet_manager.cc:1403] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.003s
I20260709 13:19:01.451951 18427 tablet_bootstrap.cc:654] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.451902 18429 raft_consensus.cc:359] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:01.453783 18429 raft_consensus.cc:385] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.454224 18429 raft_consensus.cc:740] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9e2ed5362341d2b37aa8bc9792822a, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.455621 18429 consensus_queue.cc:260] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:01.460565 18430 tablet_bootstrap.cc:492] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4: No bootstrap required, opened a new log
I20260709 13:19:01.461462 18430 ts_tablet_manager.cc:1403] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.016s
I20260709 13:19:01.465494 18429 ts_tablet_manager.cc:1434] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 13:19:01.465574 18430 raft_consensus.cc:359] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:01.466781 18338 heartbeater.cc:499] Master 127.5.227.190:46819 was elected leader, sending a full tablet report...
I20260709 13:19:01.466831 18430 raft_consensus.cc:385] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.467653 18430 raft_consensus.cc:740] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16ccf9f2310d45599296691919816bf4, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.468217 18429 tablet_bootstrap.cc:492] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a: Bootstrap starting.
I20260709 13:19:01.469101 18430 consensus_queue.cc:260] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:01.470378 18427 tablet_bootstrap.cc:492] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4: No bootstrap required, opened a new log
I20260709 13:19:01.470963 18427 ts_tablet_manager.cc:1403] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.010s
I20260709 13:19:01.474546 18427 raft_consensus.cc:359] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:01.475382 18427 raft_consensus.cc:385] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.475703 18427 raft_consensus.cc:740] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7d29f68ecd74ec4ad0ecd9572d567e4, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.476547 18427 consensus_queue.cc:260] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:01.477442 18429 tablet_bootstrap.cc:654] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.478844 18427 ts_tablet_manager.cc:1434] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:01.481261 18412 heartbeater.cc:499] Master 127.5.227.190:46819 was elected leader, sending a full tablet report...
I20260709 13:19:01.484202 18430 ts_tablet_manager.cc:1434] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.009s
I20260709 13:19:01.485479 18430 tablet_bootstrap.cc:492] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4: Bootstrap starting.
I20260709 13:19:01.494481 18430 tablet_bootstrap.cc:654] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.496223 18429 tablet_bootstrap.cc:492] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a: No bootstrap required, opened a new log
I20260709 13:19:01.496901 18429 ts_tablet_manager.cc:1403] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 13:19:01.500108 18429 raft_consensus.cc:359] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.500736 18429 raft_consensus.cc:385] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.501116 18429 raft_consensus.cc:740] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9e2ed5362341d2b37aa8bc9792822a, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.501829 18430 tablet_bootstrap.cc:492] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4: No bootstrap required, opened a new log
I20260709 13:19:01.501885 18429 consensus_queue.cc:260] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.502532 18430 ts_tablet_manager.cc:1403] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.006s
I20260709 13:19:01.504828 18429 ts_tablet_manager.cc:1434] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:19:01.505928 18430 raft_consensus.cc:359] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.506676 18430 raft_consensus.cc:385] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.506986 18430 raft_consensus.cc:740] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16ccf9f2310d45599296691919816bf4, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.507755 18430 consensus_queue.cc:260] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.510479 18430 ts_tablet_manager.cc:1434] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:19:01.539539 18435 raft_consensus.cc:493] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.540158 18435 raft_consensus.cc:515] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.542965 18435 leader_election.cc:290] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129:36305), 16ccf9f2310d45599296691919816bf4 (127.5.227.131:42149)
I20260709 13:19:01.556077 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0305a44b53416492262a6290ae98ce" candidate_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" is_pre_election: true
I20260709 13:19:01.556912 18238 raft_consensus.cc:2468] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9e2ed5362341d2b37aa8bc9792822a in term 0.
I20260709 13:19:01.557070 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0305a44b53416492262a6290ae98ce" candidate_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ccf9f2310d45599296691919816bf4" is_pre_election: true
I20260709 13:19:01.557799 18387 raft_consensus.cc:2468] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9e2ed5362341d2b37aa8bc9792822a in term 0.
I20260709 13:19:01.558293 18277 leader_election.cc:304] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9e2ed5362341d2b37aa8bc9792822a, e7d29f68ecd74ec4ad0ecd9572d567e4; no voters: 
I20260709 13:19:01.559392 18435 raft_consensus.cc:2804] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:01.559726 18435 raft_consensus.cc:493] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.560021 18435 raft_consensus.cc:3060] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.568048 18435 raft_consensus.cc:515] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.570230 18435 leader_election.cc:290] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [CANDIDATE]: Term 1 election: Requested vote from peers e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129:36305), 16ccf9f2310d45599296691919816bf4 (127.5.227.131:42149)
I20260709 13:19:01.571595 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0305a44b53416492262a6290ae98ce" candidate_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
I20260709 13:19:01.571595 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0305a44b53416492262a6290ae98ce" candidate_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ccf9f2310d45599296691919816bf4"
I20260709 13:19:01.572830 18387 raft_consensus.cc:3060] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.572846 18238 raft_consensus.cc:3060] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.581597 18238 raft_consensus.cc:2468] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9e2ed5362341d2b37aa8bc9792822a in term 1.
I20260709 13:19:01.581599 18387 raft_consensus.cc:2468] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9e2ed5362341d2b37aa8bc9792822a in term 1.
I20260709 13:19:01.583680 18276 leader_election.cc:304] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ccf9f2310d45599296691919816bf4, 2b9e2ed5362341d2b37aa8bc9792822a; no voters: 
I20260709 13:19:01.584571 18435 raft_consensus.cc:2804] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:01.585582 18435 raft_consensus.cc:697] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 LEADER]: Becoming Leader. State: Replica: 2b9e2ed5362341d2b37aa8bc9792822a, State: Running, Role: LEADER
I20260709 13:19:01.586341 18435 consensus_queue.cc:237] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.596928 18135 catalog_manager.cc:5697] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130). New cstate: current_term: 1 leader_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:01.608171 18435 raft_consensus.cc:493] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.608783 18435 raft_consensus.cc:515] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:01.610970 18435 leader_election.cc:290] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129:36305), 16ccf9f2310d45599296691919816bf4 (127.5.227.131:42149)
I20260709 13:19:01.612253 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8bb329225e40c09f35a56ef91a6b23" candidate_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ccf9f2310d45599296691919816bf4" is_pre_election: true
I20260709 13:19:01.612040 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8bb329225e40c09f35a56ef91a6b23" candidate_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" is_pre_election: true
I20260709 13:19:01.613396 18238 raft_consensus.cc:2468] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9e2ed5362341d2b37aa8bc9792822a in term 0.
I20260709 13:19:01.613404 18387 raft_consensus.cc:2468] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9e2ed5362341d2b37aa8bc9792822a in term 0.
I20260709 13:19:01.614835 18277 leader_election.cc:304] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9e2ed5362341d2b37aa8bc9792822a, e7d29f68ecd74ec4ad0ecd9572d567e4; no voters: 
I20260709 13:19:01.615638 18435 raft_consensus.cc:2804] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:01.616057 18435 raft_consensus.cc:493] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.616344 18435 raft_consensus.cc:3060] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.622272 18435 raft_consensus.cc:515] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:01.624496 18435 leader_election.cc:290] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [CANDIDATE]: Term 1 election: Requested vote from peers e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129:36305), 16ccf9f2310d45599296691919816bf4 (127.5.227.131:42149)
I20260709 13:19:01.625326 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8bb329225e40c09f35a56ef91a6b23" candidate_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
I20260709 13:19:01.625645 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8bb329225e40c09f35a56ef91a6b23" candidate_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ccf9f2310d45599296691919816bf4"
I20260709 13:19:01.626210 18238 raft_consensus.cc:3060] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.626634 18387 raft_consensus.cc:3060] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.632177 18387 raft_consensus.cc:2468] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9e2ed5362341d2b37aa8bc9792822a in term 1.
I20260709 13:19:01.632177 18238 raft_consensus.cc:2468] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9e2ed5362341d2b37aa8bc9792822a in term 1.
I20260709 13:19:01.633580 18276 leader_election.cc:304] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ccf9f2310d45599296691919816bf4, 2b9e2ed5362341d2b37aa8bc9792822a; no voters: 
I20260709 13:19:01.634548 18435 raft_consensus.cc:2804] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:01.635061 18435 raft_consensus.cc:697] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 LEADER]: Becoming Leader. State: Replica: 2b9e2ed5362341d2b37aa8bc9792822a, State: Running, Role: LEADER
I20260709 13:19:01.635962 18435 consensus_queue.cc:237] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:01.643496 18135 catalog_manager.cc:5697] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130). New cstate: current_term: 1 leader_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.703131 18135 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54252:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:01.705786 18135 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:01.734367 18228 tablet_service.cc:1511] Processing CreateTablet for tablet 8da9f5c8499c41819ca49f52d3994d22 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=718ab83fdf084003ae2cf1e177eed611]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:01.735925 18228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da9f5c8499c41819ca49f52d3994d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.735724 18302 tablet_service.cc:1511] Processing CreateTablet for tablet 8da9f5c8499c41819ca49f52d3994d22 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=718ab83fdf084003ae2cf1e177eed611]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:01.737143 18302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da9f5c8499c41819ca49f52d3994d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.737411 18376 tablet_service.cc:1511] Processing CreateTablet for tablet 8da9f5c8499c41819ca49f52d3994d22 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=718ab83fdf084003ae2cf1e177eed611]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:01.738976 18376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da9f5c8499c41819ca49f52d3994d22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.741387 18303 tablet_service.cc:1511] Processing CreateTablet for tablet 2f404cd0ce3a4225b7258fd89ae2e320 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=718ab83fdf084003ae2cf1e177eed611]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:01.742818 18377 tablet_service.cc:1511] Processing CreateTablet for tablet 2f404cd0ce3a4225b7258fd89ae2e320 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=718ab83fdf084003ae2cf1e177eed611]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:01.744189 18377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f404cd0ce3a4225b7258fd89ae2e320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.744452 18227 tablet_service.cc:1511] Processing CreateTablet for tablet 2f404cd0ce3a4225b7258fd89ae2e320 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=718ab83fdf084003ae2cf1e177eed611]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:01.742841 18303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f404cd0ce3a4225b7258fd89ae2e320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.745819 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f404cd0ce3a4225b7258fd89ae2e320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.765705 18427 tablet_bootstrap.cc:492] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4: Bootstrap starting.
I20260709 13:19:01.772538 18427 tablet_bootstrap.cc:654] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.776779 18430 tablet_bootstrap.cc:492] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4: Bootstrap starting.
I20260709 13:19:01.781375 18429 tablet_bootstrap.cc:492] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a: Bootstrap starting.
I20260709 13:19:01.788267 18430 tablet_bootstrap.cc:654] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.789624 18427 tablet_bootstrap.cc:492] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4: No bootstrap required, opened a new log
I20260709 13:19:01.790282 18427 ts_tablet_manager.cc:1403] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 13:19:01.791059 18429 tablet_bootstrap.cc:654] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.794090 18427 raft_consensus.cc:359] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.794852 18427 raft_consensus.cc:385] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.795207 18427 raft_consensus.cc:740] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7d29f68ecd74ec4ad0ecd9572d567e4, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.796273 18427 consensus_queue.cc:260] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.796731 18430 tablet_bootstrap.cc:492] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4: No bootstrap required, opened a new log
I20260709 13:19:01.797348 18430 ts_tablet_manager.cc:1403] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:19:01.797935 18429 tablet_bootstrap.cc:492] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a: No bootstrap required, opened a new log
I20260709 13:19:01.798506 18429 ts_tablet_manager.cc:1403] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 13:19:01.798738 18427 ts_tablet_manager.cc:1434] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:19:01.799916 18427 tablet_bootstrap.cc:492] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4: Bootstrap starting.
I20260709 13:19:01.800673 18430 raft_consensus.cc:359] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.801522 18430 raft_consensus.cc:385] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:01.801656 18184 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:01.801908 18430 raft_consensus.cc:740] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16ccf9f2310d45599296691919816bf4, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.802894 18430 consensus_queue.cc:260] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.807842 18430 ts_tablet_manager.cc:1434] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:19:01.809017 18430 tablet_bootstrap.cc:492] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4: Bootstrap starting.
I20260709 13:19:01.810667 18429 raft_consensus.cc:359] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.811578 18429 raft_consensus.cc:385] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.811880 18429 raft_consensus.cc:740] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9e2ed5362341d2b37aa8bc9792822a, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.812825 18429 consensus_queue.cc:260] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.813776 18427 tablet_bootstrap.cc:654] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.817130 18430 tablet_bootstrap.cc:654] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.820173 18429 ts_tablet_manager.cc:1434] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:19:01.821509 18429 tablet_bootstrap.cc:492] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a: Bootstrap starting.
I20260709 13:19:01.831218 18429 tablet_bootstrap.cc:654] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.831511 18427 tablet_bootstrap.cc:492] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4: No bootstrap required, opened a new log
I20260709 13:19:01.832273 18427 ts_tablet_manager.cc:1403] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.013s
I20260709 13:19:01.833050 18430 tablet_bootstrap.cc:492] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4: No bootstrap required, opened a new log
I20260709 13:19:01.833869 18430 ts_tablet_manager.cc:1403] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.010s
I20260709 13:19:01.835572 18427 raft_consensus.cc:359] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.836473 18427 raft_consensus.cc:385] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.836778 18427 raft_consensus.cc:740] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7d29f68ecd74ec4ad0ecd9572d567e4, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.837241 18430 raft_consensus.cc:359] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.837798 18429 tablet_bootstrap.cc:492] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a: No bootstrap required, opened a new log
I20260709 13:19:01.837924 18430 raft_consensus.cc:385] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.837564 18427 consensus_queue.cc:260] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.838284 18430 raft_consensus.cc:740] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16ccf9f2310d45599296691919816bf4, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.838444 18429 ts_tablet_manager.cc:1403] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:19:01.839322 18430 consensus_queue.cc:260] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.840332 18427 ts_tablet_manager.cc:1434] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:01.841666 18430 ts_tablet_manager.cc:1434] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:19:01.841763 18429 raft_consensus.cc:359] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.843928 18429 raft_consensus.cc:385] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.844269 18429 raft_consensus.cc:740] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9e2ed5362341d2b37aa8bc9792822a, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.845093 18429 consensus_queue.cc:260] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.847767 18429 ts_tablet_manager.cc:1434] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:19:01.849143 18436 raft_consensus.cc:493] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.849740 18436 raft_consensus.cc:515] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.856282 18436 leader_election.cc:290] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129:36305), 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130:33699)
I20260709 13:19:01.868664 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da9f5c8499c41819ca49f52d3994d22" candidate_uuid: "16ccf9f2310d45599296691919816bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" is_pre_election: true
I20260709 13:19:01.869951 18238 raft_consensus.cc:2468] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16ccf9f2310d45599296691919816bf4 in term 0.
I20260709 13:19:01.871435 18351 leader_election.cc:304] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ccf9f2310d45599296691919816bf4, e7d29f68ecd74ec4ad0ecd9572d567e4; no voters: 
I20260709 13:19:01.872437 18436 raft_consensus.cc:2804] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:01.872856 18436 raft_consensus.cc:493] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.873174 18436 raft_consensus.cc:3060] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.876768 18313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da9f5c8499c41819ca49f52d3994d22" candidate_uuid: "16ccf9f2310d45599296691919816bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" is_pre_election: true
I20260709 13:19:01.877617 18313 raft_consensus.cc:2468] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16ccf9f2310d45599296691919816bf4 in term 0.
I20260709 13:19:01.880710 18436 raft_consensus.cc:515] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.882586 18436 leader_election.cc:290] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129:36305), 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130:33699)
I20260709 13:19:01.883558 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da9f5c8499c41819ca49f52d3994d22" candidate_uuid: "16ccf9f2310d45599296691919816bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
I20260709 13:19:01.883819 18313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da9f5c8499c41819ca49f52d3994d22" candidate_uuid: "16ccf9f2310d45599296691919816bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
I20260709 13:19:01.884307 18238 raft_consensus.cc:3060] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.884328 18313 raft_consensus.cc:3060] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.892722 18313 raft_consensus.cc:2468] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16ccf9f2310d45599296691919816bf4 in term 1.
I20260709 13:19:01.892722 18238 raft_consensus.cc:2468] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16ccf9f2310d45599296691919816bf4 in term 1.
I20260709 13:19:01.894295 18352 leader_election.cc:304] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ccf9f2310d45599296691919816bf4, 2b9e2ed5362341d2b37aa8bc9792822a; no voters: 
I20260709 13:19:01.895447 18436 raft_consensus.cc:2804] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:01.896456 18436 raft_consensus.cc:697] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 16ccf9f2310d45599296691919816bf4, State: Running, Role: LEADER
I20260709 13:19:01.897668 18436 consensus_queue.cc:237] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:01.905807 18134 catalog_manager.cc:5697] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16ccf9f2310d45599296691919816bf4 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "16ccf9f2310d45599296691919816bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.023859 18436 raft_consensus.cc:493] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.024458 18436 raft_consensus.cc:515] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.026165 18436 leader_election.cc:290] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129:36305), 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130:33699)
I20260709 13:19:02.027225 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320" candidate_uuid: "16ccf9f2310d45599296691919816bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" is_pre_election: true
I20260709 13:19:02.027294 18313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320" candidate_uuid: "16ccf9f2310d45599296691919816bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" is_pre_election: true
I20260709 13:19:02.027930 18238 raft_consensus.cc:2468] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16ccf9f2310d45599296691919816bf4 in term 0.
I20260709 13:19:02.028106 18313 raft_consensus.cc:2468] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16ccf9f2310d45599296691919816bf4 in term 0.
I20260709 13:19:02.028980 18351 leader_election.cc:304] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ccf9f2310d45599296691919816bf4, e7d29f68ecd74ec4ad0ecd9572d567e4; no voters: 
I20260709 13:19:02.029793 18436 raft_consensus.cc:2804] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:02.030182 18436 raft_consensus.cc:493] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.030457 18436 raft_consensus.cc:3060] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:02.036111 18436 raft_consensus.cc:515] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.037987 18436 leader_election.cc:290] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129:36305), 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130:33699)
I20260709 13:19:02.038916 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320" candidate_uuid: "16ccf9f2310d45599296691919816bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
I20260709 13:19:02.039177 18313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320" candidate_uuid: "16ccf9f2310d45599296691919816bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
I20260709 13:19:02.039667 18238 raft_consensus.cc:3060] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:02.039754 18313 raft_consensus.cc:3060] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:02.047524 18313 raft_consensus.cc:2468] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16ccf9f2310d45599296691919816bf4 in term 1.
I20260709 13:19:02.047524 18238 raft_consensus.cc:2468] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16ccf9f2310d45599296691919816bf4 in term 1.
I20260709 13:19:02.049358 18352 leader_election.cc:304] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ccf9f2310d45599296691919816bf4, 2b9e2ed5362341d2b37aa8bc9792822a; no voters: 
I20260709 13:19:02.050297 18436 raft_consensus.cc:2804] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:02.050848 18436 raft_consensus.cc:697] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 16ccf9f2310d45599296691919816bf4, State: Running, Role: LEADER
I20260709 13:19:02.051661 18436 consensus_queue.cc:237] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.060701 18134 catalog_manager.cc:5697] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16ccf9f2310d45599296691919816bf4 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "16ccf9f2310d45599296691919816bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.096748 18313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a8bb329225e40c09f35a56ef91a6b23"
dest_uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
mode: GRACEFUL
new_leader_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
 from {username='slave'} at 127.0.0.1:52918
I20260709 13:19:02.097421 18313 raft_consensus.cc:606] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 LEADER]: Received request to transfer leadership to TS e7d29f68ecd74ec4ad0ecd9572d567e4
I20260709 13:19:02.104033 18313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c0305a44b53416492262a6290ae98ce"
dest_uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
mode: GRACEFUL
new_leader_uuid: "16ccf9f2310d45599296691919816bf4"
 from {username='slave'} at 127.0.0.1:52918
I20260709 13:19:02.104800 18313 raft_consensus.cc:606] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 LEADER]: Received request to transfer leadership to TS 16ccf9f2310d45599296691919816bf4
I20260709 13:19:02.123467 18387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8da9f5c8499c41819ca49f52d3994d22"
dest_uuid: "16ccf9f2310d45599296691919816bf4"
mode: GRACEFUL
new_leader_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
 from {username='slave'} at 127.0.0.1:60386
I20260709 13:19:02.124034 18387 raft_consensus.cc:606] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 1 LEADER]: Received request to transfer leadership to TS e7d29f68ecd74ec4ad0ecd9572d567e4
I20260709 13:19:02.130867 18387 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320"
dest_uuid: "16ccf9f2310d45599296691919816bf4"
mode: GRACEFUL
new_leader_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
 from {username='slave'} at 127.0.0.1:60386
I20260709 13:19:02.131378 18387 raft_consensus.cc:606] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 1 LEADER]: Received request to transfer leadership to TS e7d29f68ecd74ec4ad0ecd9572d567e4
I20260709 13:19:02.153663 18435 consensus_queue.cc:1048] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:02.156044 18435 consensus_queue.cc:1048] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [LEADER]: Connected to new peer: Peer: permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:02.185184 18467 consensus_queue.cc:1048] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:02.194190 18435 consensus_queue.cc:1048] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [LEADER]: Connected to new peer: Peer: permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:02.214109 18463 raft_consensus.cc:993] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a: : Instructing follower e7d29f68ecd74ec4ad0ecd9572d567e4 to start an election
I20260709 13:19:02.215286 18463 raft_consensus.cc:1081] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 LEADER]: Signalling peer e7d29f68ecd74ec4ad0ecd9572d567e4 to start an election
I20260709 13:19:02.221799 18237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a8bb329225e40c09f35a56ef91a6b23"
dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
 from {username='slave'} at 127.0.0.1:44210
I20260709 13:19:02.222743 18237 raft_consensus.cc:493] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:02.223222 18237 raft_consensus.cc:3060] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.227386 18467 raft_consensus.cc:993] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a: : Instructing follower 16ccf9f2310d45599296691919816bf4 to start an election
I20260709 13:19:02.228000 18467 raft_consensus.cc:1081] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 LEADER]: Signalling peer 16ccf9f2310d45599296691919816bf4 to start an election
I20260709 13:19:02.231735 18386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c0305a44b53416492262a6290ae98ce"
dest_uuid: "16ccf9f2310d45599296691919816bf4"
 from {username='slave'} at 127.0.0.1:60384
I20260709 13:19:02.232400 18237 raft_consensus.cc:515] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:02.232668 18386 raft_consensus.cc:493] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:02.233489 18386 raft_consensus.cc:3060] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.237684 18237 leader_election.cc:290] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [CANDIDATE]: Term 2 election: Requested vote from peers 16ccf9f2310d45599296691919816bf4 (127.5.227.131:42149), 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130:33699)
I20260709 13:19:02.253274 18386 raft_consensus.cc:515] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.255697 18386 leader_election.cc:290] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129:36305), 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130:33699)
I20260709 13:19:02.256400 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0305a44b53416492262a6290ae98ce" candidate_uuid: "16ccf9f2310d45599296691919816bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
I20260709 13:19:02.256719 18313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8bb329225e40c09f35a56ef91a6b23" candidate_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
I20260709 13:19:02.257113 18237 raft_consensus.cc:3060] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.257407 18313 raft_consensus.cc:3055] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:02.257819 18313 raft_consensus.cc:740] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9e2ed5362341d2b37aa8bc9792822a, State: Running, Role: LEADER
I20260709 13:19:02.258692 18313 consensus_queue.cc:260] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:02.260058 18313 raft_consensus.cc:3060] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.260658 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a8bb329225e40c09f35a56ef91a6b23" candidate_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16ccf9f2310d45599296691919816bf4"
I20260709 13:19:02.261365 18386 raft_consensus.cc:3060] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.263229 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0305a44b53416492262a6290ae98ce" candidate_uuid: "16ccf9f2310d45599296691919816bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
I20260709 13:19:02.263983 18312 raft_consensus.cc:3055] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:02.264420 18312 raft_consensus.cc:740] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b9e2ed5362341d2b37aa8bc9792822a, State: Running, Role: LEADER
I20260709 13:19:02.265141 18237 raft_consensus.cc:2468] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16ccf9f2310d45599296691919816bf4 in term 2.
I20260709 13:19:02.265318 18312 consensus_queue.cc:260] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.266887 18312 raft_consensus.cc:3060] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.267019 18351 leader_election.cc:304] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ccf9f2310d45599296691919816bf4, e7d29f68ecd74ec4ad0ecd9572d567e4; no voters: 
I20260709 13:19:02.268322 18436 raft_consensus.cc:2804] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:02.268879 18436 raft_consensus.cc:697] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 16ccf9f2310d45599296691919816bf4, State: Running, Role: LEADER
I20260709 13:19:02.270813 18386 raft_consensus.cc:2468] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7d29f68ecd74ec4ad0ecd9572d567e4 in term 2.
I20260709 13:19:02.269778 18436 consensus_queue.cc:237] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.272698 18201 leader_election.cc:304] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ccf9f2310d45599296691919816bf4, e7d29f68ecd74ec4ad0ecd9572d567e4; no voters: 
I20260709 13:19:02.273828 18432 raft_consensus.cc:2804] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:02.275575 18313 raft_consensus.cc:2468] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7d29f68ecd74ec4ad0ecd9572d567e4 in term 2.
I20260709 13:19:02.278296 18432 raft_consensus.cc:697] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 LEADER]: Becoming Leader. State: Replica: e7d29f68ecd74ec4ad0ecd9572d567e4, State: Running, Role: LEADER
I20260709 13:19:02.279425 18432 consensus_queue.cc:237] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } }
I20260709 13:19:02.280268 18312 raft_consensus.cc:2468] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16ccf9f2310d45599296691919816bf4 in term 2.
I20260709 13:19:02.283589 18135 catalog_manager.cc:5697] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 reported cstate change: term changed from 1 to 2, leader changed from 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130) to 16ccf9f2310d45599296691919816bf4 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "16ccf9f2310d45599296691919816bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.287925 18133 catalog_manager.cc:5697] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 reported cstate change: term changed from 1 to 2, leader changed from 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130) to e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:02.435153 18436 consensus_queue.cc:1048] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:02.442725 18456 raft_consensus.cc:993] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4: : Instructing follower e7d29f68ecd74ec4ad0ecd9572d567e4 to start an election
I20260709 13:19:02.443596 18436 raft_consensus.cc:1081] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 1 LEADER]: Signalling peer e7d29f68ecd74ec4ad0ecd9572d567e4 to start an election
I20260709 13:19:02.446233 18238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8da9f5c8499c41819ca49f52d3994d22"
dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
 from {username='slave'} at 127.0.0.1:44220
I20260709 13:19:02.447729 18238 raft_consensus.cc:493] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:02.448340 18238 raft_consensus.cc:3060] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.453632 18476 consensus_queue.cc:1048] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:02.458549 18238 raft_consensus.cc:515] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.463778 18238 leader_election.cc:290] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [CANDIDATE]: Term 2 election: Requested vote from peers 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130:33699), 16ccf9f2310d45599296691919816bf4 (127.5.227.131:42149)
I20260709 13:19:02.465348 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da9f5c8499c41819ca49f52d3994d22" candidate_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
I20260709 13:19:02.465730 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da9f5c8499c41819ca49f52d3994d22" candidate_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16ccf9f2310d45599296691919816bf4"
I20260709 13:19:02.466720 18386 raft_consensus.cc:3055] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:02.467063 18386 raft_consensus.cc:740] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 16ccf9f2310d45599296691919816bf4, State: Running, Role: LEADER
I20260709 13:19:02.468029 18386 consensus_queue.cc:260] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.466128 18312 raft_consensus.cc:3060] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.469472 18386 raft_consensus.cc:3060] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.474416 18312 raft_consensus.cc:2468] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7d29f68ecd74ec4ad0ecd9572d567e4 in term 2.
I20260709 13:19:02.475947 18203 leader_election.cc:304] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9e2ed5362341d2b37aa8bc9792822a, e7d29f68ecd74ec4ad0ecd9572d567e4; no voters: 
I20260709 13:19:02.476946 18432 raft_consensus.cc:2804] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:02.477046 18386 raft_consensus.cc:2468] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7d29f68ecd74ec4ad0ecd9572d567e4 in term 2.
I20260709 13:19:02.477552 18432 raft_consensus.cc:697] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 LEADER]: Becoming Leader. State: Replica: e7d29f68ecd74ec4ad0ecd9572d567e4, State: Running, Role: LEADER
I20260709 13:19:02.478503 18432 consensus_queue.cc:237] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.485577 18134 catalog_manager.cc:5697] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 reported cstate change: term changed from 1 to 2, leader changed from 16ccf9f2310d45599296691919816bf4 (127.5.227.131) to e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:02.585759 18476 consensus_queue.cc:1048] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:02.598304 18436 consensus_queue.cc:1048] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:02.607556 18456 raft_consensus.cc:993] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4: : Instructing follower e7d29f68ecd74ec4ad0ecd9572d567e4 to start an election
I20260709 13:19:02.608127 18456 raft_consensus.cc:1081] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 1 LEADER]: Signalling peer e7d29f68ecd74ec4ad0ecd9572d567e4 to start an election
I20260709 13:19:02.610335 18238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320"
dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
 from {username='slave'} at 127.0.0.1:44220
I20260709 13:19:02.611267 18238 raft_consensus.cc:493] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:02.611703 18238 raft_consensus.cc:3060] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.617244 18238 raft_consensus.cc:515] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.619423 18238 leader_election.cc:290] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [CANDIDATE]: Term 2 election: Requested vote from peers 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130:33699), 16ccf9f2310d45599296691919816bf4 (127.5.227.131:42149)
I20260709 13:19:02.620229 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320" candidate_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
I20260709 13:19:02.620538 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320" candidate_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16ccf9f2310d45599296691919816bf4"
I20260709 13:19:02.621294 18386 raft_consensus.cc:3055] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:02.621642 18386 raft_consensus.cc:740] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 16ccf9f2310d45599296691919816bf4, State: Running, Role: LEADER
I20260709 13:19:02.623009 18312 raft_consensus.cc:3060] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.622573 18386 consensus_queue.cc:260] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.624303 18386 raft_consensus.cc:3060] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:02.629243 18312 raft_consensus.cc:2468] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7d29f68ecd74ec4ad0ecd9572d567e4 in term 2.
I20260709 13:19:02.630966 18203 leader_election.cc:304] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9e2ed5362341d2b37aa8bc9792822a, e7d29f68ecd74ec4ad0ecd9572d567e4; no voters: 
I20260709 13:19:02.631940 18432 raft_consensus.cc:2804] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:02.632465 18432 raft_consensus.cc:697] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 LEADER]: Becoming Leader. State: Replica: e7d29f68ecd74ec4ad0ecd9572d567e4, State: Running, Role: LEADER
I20260709 13:19:02.632599 18386 raft_consensus.cc:2468] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7d29f68ecd74ec4ad0ecd9572d567e4 in term 2.
I20260709 13:19:02.633558 18432 consensus_queue.cc:237] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:02.640532 18133 catalog_manager.cc:5697] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 reported cstate change: term changed from 1 to 2, leader changed from 16ccf9f2310d45599296691919816bf4 (127.5.227.131) to e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:02.687187  6030 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:19:02.689319  6030 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:19:02.689846  6030 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:19:02.704046 18238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320"
dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
mode: GRACEFUL
new_leader_uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
 from {username='slave'} at 127.0.0.1:44230
I20260709 13:19:02.704903 18238 raft_consensus.cc:606] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 LEADER]: Received request to transfer leadership to TS 2b9e2ed5362341d2b37aa8bc9792822a
I20260709 13:19:02.707072  6030 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:19:02.745805 18312 raft_consensus.cc:1275] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Refusing update from remote peer 16ccf9f2310d45599296691919816bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:02.747786 18436 consensus_queue.cc:1048] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:02.759181 18238 raft_consensus.cc:1275] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Refusing update from remote peer 16ccf9f2310d45599296691919816bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:02.762974 18476 consensus_queue.cc:1048] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:02.763899 18312 raft_consensus.cc:1275] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Refusing update from remote peer e7d29f68ecd74ec4ad0ecd9572d567e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:02.766523 18432 consensus_queue.cc:1048] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:02.785020 18386 raft_consensus.cc:1275] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Refusing update from remote peer e7d29f68ecd74ec4ad0ecd9572d567e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:02.791476 18484 consensus_queue.cc:1048] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:02.916110 18313 raft_consensus.cc:1275] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Refusing update from remote peer e7d29f68ecd74ec4ad0ecd9572d567e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:02.917564 18484 consensus_queue.cc:1048] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:02.926885 18386 raft_consensus.cc:1275] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Refusing update from remote peer e7d29f68ecd74ec4ad0ecd9572d567e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:02.929220 18474 consensus_queue.cc:1048] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:03.177853 18313 raft_consensus.cc:1275] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Refusing update from remote peer e7d29f68ecd74ec4ad0ecd9572d567e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:03.179334 18474 consensus_queue.cc:1048] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:03.185177 18482 raft_consensus.cc:993] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4: : Instructing follower 2b9e2ed5362341d2b37aa8bc9792822a to start an election
I20260709 13:19:03.185982 18483 raft_consensus.cc:1081] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 LEADER]: Signalling peer 2b9e2ed5362341d2b37aa8bc9792822a to start an election
I20260709 13:19:03.188268 18312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320"
dest_uuid: "2b9e2ed5362341d2b37aa8bc9792822a"
 from {username='slave'} at 127.0.0.1:52930
I20260709 13:19:03.189358 18312 raft_consensus.cc:493] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:03.189900 18312 raft_consensus.cc:3060] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.191054 18386 raft_consensus.cc:1275] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Refusing update from remote peer e7d29f68ecd74ec4ad0ecd9572d567e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:03.194029 18482 consensus_queue.cc:1048] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:03.197970 18312 raft_consensus.cc:515] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:03.202239 18312 leader_election.cc:290] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [CANDIDATE]: Term 3 election: Requested vote from peers e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129:36305), 16ccf9f2310d45599296691919816bf4 (127.5.227.131:42149)
I20260709 13:19:03.202517 18238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320" candidate_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4"
I20260709 13:19:03.203642 18387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f404cd0ce3a4225b7258fd89ae2e320" candidate_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "16ccf9f2310d45599296691919816bf4"
I20260709 13:19:03.204352 18238 raft_consensus.cc:3055] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:03.205657 18387 raft_consensus.cc:3060] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.205677 18238 raft_consensus.cc:740] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e7d29f68ecd74ec4ad0ecd9572d567e4, State: Running, Role: LEADER
I20260709 13:19:03.209033 18238 consensus_queue.cc:260] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:03.210691 18238 raft_consensus.cc:3060] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.214591 18387 raft_consensus.cc:2468] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9e2ed5362341d2b37aa8bc9792822a in term 3.
I20260709 13:19:03.217283 18276 leader_election.cc:304] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ccf9f2310d45599296691919816bf4, 2b9e2ed5362341d2b37aa8bc9792822a; no voters: 
I20260709 13:19:03.218262 18463 raft_consensus.cc:2804] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:03.219442 18463 raft_consensus.cc:697] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 3 LEADER]: Becoming Leader. State: Replica: 2b9e2ed5362341d2b37aa8bc9792822a, State: Running, Role: LEADER
I20260709 13:19:03.220434 18238 raft_consensus.cc:2468] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9e2ed5362341d2b37aa8bc9792822a in term 3.
I20260709 13:19:03.220374 18463 consensus_queue.cc:237] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } }
I20260709 13:19:03.229928 18135 catalog_manager.cc:5697] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a reported cstate change: term changed from 2 to 3, leader changed from e7d29f68ecd74ec4ad0ecd9572d567e4 (127.5.227.129) to 2b9e2ed5362341d2b37aa8bc9792822a (127.5.227.130). New cstate: current_term: 3 leader_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7d29f68ecd74ec4ad0ecd9572d567e4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 36305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9e2ed5362341d2b37aa8bc9792822a" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 33699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16ccf9f2310d45599296691919816bf4" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 42149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:03.375442  6030 tablet_server.cc:179] TabletServer@127.5.227.129:0 shutting down...
I20260709 13:19:03.411281  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:03.412041  6030 tablet_replica.cc:333] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4: stopping tablet replica
I20260709 13:19:03.412899  6030 raft_consensus.cc:2243] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:03.413800  6030 raft_consensus.cc:2272] T 8da9f5c8499c41819ca49f52d3994d22 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.416339  6030 tablet_replica.cc:333] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4: stopping tablet replica
I20260709 13:19:03.416901  6030 raft_consensus.cc:2243] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:03.417795  6030 raft_consensus.cc:2272] T 9a8bb329225e40c09f35a56ef91a6b23 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.420463  6030 tablet_replica.cc:333] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4: stopping tablet replica
I20260709 13:19:03.421020  6030 raft_consensus.cc:2243] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:03.421589  6030 raft_consensus.cc:2272] T 2f404cd0ce3a4225b7258fd89ae2e320 P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.424158  6030 tablet_replica.cc:333] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4: stopping tablet replica
I20260709 13:19:03.424664  6030 raft_consensus.cc:2243] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:03.425274  6030 raft_consensus.cc:2272] T 6c0305a44b53416492262a6290ae98ce P e7d29f68ecd74ec4ad0ecd9572d567e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.451869  6030 tablet_server.cc:196] TabletServer@127.5.227.129:0 shutdown complete.
I20260709 13:19:03.466058  6030 tablet_server.cc:179] TabletServer@127.5.227.130:0 shutting down...
I20260709 13:19:03.490279  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:03.491479  6030 tablet_replica.cc:333] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a: stopping tablet replica
I20260709 13:19:03.492244  6030 raft_consensus.cc:2243] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:03.492873  6030 raft_consensus.cc:2272] T 8da9f5c8499c41819ca49f52d3994d22 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.495601  6030 tablet_replica.cc:333] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a: stopping tablet replica
I20260709 13:19:03.496201  6030 raft_consensus.cc:2243] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:03.496960  6030 pending_rounds.cc:70] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a: Trying to abort 1 pending ops.
I20260709 13:19:03.497182  6030 pending_rounds.cc:77] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638474647179264 op_type: NO_OP noop_request { }
I20260709 13:19:03.497510  6030 raft_consensus.cc:2889] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:03.497814  6030 raft_consensus.cc:2272] T 2f404cd0ce3a4225b7258fd89ae2e320 P 2b9e2ed5362341d2b37aa8bc9792822a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.500466  6030 tablet_replica.cc:333] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a: stopping tablet replica
I20260709 13:19:03.501111  6030 raft_consensus.cc:2243] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:03.501621  6030 raft_consensus.cc:2272] T 6c0305a44b53416492262a6290ae98ce P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.504844  6030 tablet_replica.cc:333] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a: stopping tablet replica
I20260709 13:19:03.505843  6030 raft_consensus.cc:2243] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:03.506456  6030 raft_consensus.cc:2272] T 9a8bb329225e40c09f35a56ef91a6b23 P 2b9e2ed5362341d2b37aa8bc9792822a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.534068  6030 tablet_server.cc:196] TabletServer@127.5.227.130:0 shutdown complete.
I20260709 13:19:03.548323  6030 tablet_server.cc:179] TabletServer@127.5.227.131:0 shutting down...
I20260709 13:19:03.577618  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:03.578333  6030 tablet_replica.cc:333] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4: stopping tablet replica
I20260709 13:19:03.579011  6030 raft_consensus.cc:2243] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:03.579540  6030 raft_consensus.cc:2272] T 8da9f5c8499c41819ca49f52d3994d22 P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.581911  6030 tablet_replica.cc:333] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4: stopping tablet replica
I20260709 13:19:03.582521  6030 raft_consensus.cc:2243] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:03.583104  6030 raft_consensus.cc:2272] T 2f404cd0ce3a4225b7258fd89ae2e320 P 16ccf9f2310d45599296691919816bf4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.585807  6030 tablet_replica.cc:333] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4: stopping tablet replica
I20260709 13:19:03.586844  6030 raft_consensus.cc:2243] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:03.587983  6030 raft_consensus.cc:2272] T 6c0305a44b53416492262a6290ae98ce P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.591313  6030 tablet_replica.cc:333] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4: stopping tablet replica
I20260709 13:19:03.591922  6030 raft_consensus.cc:2243] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:03.592585  6030 raft_consensus.cc:2272] T 9a8bb329225e40c09f35a56ef91a6b23 P 16ccf9f2310d45599296691919816bf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.619566  6030 tablet_server.cc:196] TabletServer@127.5.227.131:0 shutdown complete.
I20260709 13:19:03.635638  6030 master.cc:562] Master@127.5.227.190:46819 shutting down...
I20260709 13:19:03.655004  6030 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:03.655625  6030 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.655925  6030 tablet_replica.cc:333] T 00000000000000000000000000000000 P a14f420f7c304e13b1b26f2e9eeeb8d9: stopping tablet replica
I20260709 13:19:03.676594  6030 master.cc:584] Master@127.5.227.190:46819 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3088 ms)
[----------] 6 tests from LeaderRebalancerTest (402524 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:19:03.710548  6030 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.227.190:37357
I20260709 13:19:03.712172  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:03.718057 18491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:03.718953 18492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:03.719877 18494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:03.720450  6030 server_base.cc:1061] running on GCE node
I20260709 13:19:03.721354  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:03.721540  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:03.721657  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603143721645 us; error 0 us; skew 500 ppm
I20260709 13:19:03.722124  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:03.725185  6030 webserver.cc:533] Webserver started at http://127.5.227.190:39273/ using document root <none> and password file <none>
I20260709 13:19:03.725737  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:03.725924  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:03.726163  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:03.728293  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/master-0-root/instance:
uuid: "6693369d6ebf43038389c271891fa5ab"
format_stamp: "Formatted at 2026-07-09 13:19:03 on dist-test-slave-tbwl"
I20260709 13:19:03.733966  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:19:03.737987 18499 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:03.739044  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:03.739396  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/master-0-root
uuid: "6693369d6ebf43038389c271891fa5ab"
format_stamp: "Formatted at 2026-07-09 13:19:03 on dist-test-slave-tbwl"
I20260709 13:19:03.739686  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:03.760628  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:03.761711  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:03.811326  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.190:37357
I20260709 13:19:03.811437 18550 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.190:37357 every 8 connection(s)
I20260709 13:19:03.815577 18551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.829211 18551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab: Bootstrap starting.
I20260709 13:19:03.835309 18551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.839660 18551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab: No bootstrap required, opened a new log
I20260709 13:19:03.841988 18551 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6693369d6ebf43038389c271891fa5ab" member_type: VOTER }
I20260709 13:19:03.842427 18551 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.842748 18551 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6693369d6ebf43038389c271891fa5ab, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.843425 18551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6693369d6ebf43038389c271891fa5ab" member_type: VOTER }
I20260709 13:19:03.844018 18551 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:03.844266 18551 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:03.844583 18551 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.852396 18551 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6693369d6ebf43038389c271891fa5ab" member_type: VOTER }
I20260709 13:19:03.853319 18551 leader_election.cc:304] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6693369d6ebf43038389c271891fa5ab; no voters: 
I20260709 13:19:03.854607 18551 leader_election.cc:290] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:03.855003 18554 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:03.856434 18554 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [term 1 LEADER]: Becoming Leader. State: Replica: 6693369d6ebf43038389c271891fa5ab, State: Running, Role: LEADER
I20260709 13:19:03.857147 18554 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6693369d6ebf43038389c271891fa5ab" member_type: VOTER }
I20260709 13:19:03.857779 18551 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:03.860239 18555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6693369d6ebf43038389c271891fa5ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6693369d6ebf43038389c271891fa5ab" member_type: VOTER } }
I20260709 13:19:03.860330 18556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6693369d6ebf43038389c271891fa5ab. Latest consensus state: current_term: 1 leader_uuid: "6693369d6ebf43038389c271891fa5ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6693369d6ebf43038389c271891fa5ab" member_type: VOTER } }
I20260709 13:19:03.861315 18556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:03.861831 18555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:03.864641 18561 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:03.870036 18561 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:03.873548  6030 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:03.879865 18561 catalog_manager.cc:1383] Generated new cluster ID: 84eeadb974c647ba8389dc2b14725d40
I20260709 13:19:03.880219 18561 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:03.908295 18561 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:03.909613 18561 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:03.932235 18561 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab: Generated new TSK 0
I20260709 13:19:03.933223 18561 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:03.941075  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:03.947814 18572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:03.949077 18573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:03.951578  6030 server_base.cc:1061] running on GCE node
W20260709 13:19:03.951632 18575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:03.953311  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:03.953693  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:03.953909  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603143953885 us; error 0 us; skew 500 ppm
I20260709 13:19:03.954557  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:03.957617  6030 webserver.cc:533] Webserver started at http://127.5.227.129:42037/ using document root <none> and password file <none>
I20260709 13:19:03.958242  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:03.958477  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:03.958834  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:03.960090  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-0-root/instance:
uuid: "e4f8b938d317462dad5c7a368ad661c4"
format_stamp: "Formatted at 2026-07-09 13:19:03 on dist-test-slave-tbwl"
I20260709 13:19:03.965811  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:19:03.970815 18580 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:03.972208  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:19:03.972610  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-0-root
uuid: "e4f8b938d317462dad5c7a368ad661c4"
format_stamp: "Formatted at 2026-07-09 13:19:03 on dist-test-slave-tbwl"
I20260709 13:19:03.972898  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:03.985180  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:03.986485  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:03.988153  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:03.991036  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:03.991292  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:03.991573  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:03.991768  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:04.040125  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.129:38279
I20260709 13:19:04.040254 18642 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.129:38279 every 8 connection(s)
I20260709 13:19:04.046279  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:04.054953 18647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:04.056313 18648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:04.060520  6030 server_base.cc:1061] running on GCE node
W20260709 13:19:04.061165 18650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:04.062369  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:04.062677  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:04.062929  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603144062906 us; error 0 us; skew 500 ppm
I20260709 13:19:04.063567 18643 heartbeater.cc:344] Connected to a master server at 127.5.227.190:37357
I20260709 13:19:04.063565  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:04.064344 18643 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:04.065653 18643 heartbeater.cc:507] Master 127.5.227.190:37357 requested a full tablet report, sending...
I20260709 13:19:04.067559  6030 webserver.cc:533] Webserver started at http://127.5.227.130:36457/ using document root <none> and password file <none>
I20260709 13:19:04.068343  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:04.068540  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:04.068903 18516 ts_manager.cc:194] Registered new tserver with Master: e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279)
I20260709 13:19:04.068902  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:04.070410  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-1-root/instance:
uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
format_stamp: "Formatted at 2026-07-09 13:19:04 on dist-test-slave-tbwl"
I20260709 13:19:04.070999 18516 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55172
I20260709 13:19:04.076191  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:04.080111 18655 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:04.080996  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:04.081351  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-1-root
uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
format_stamp: "Formatted at 2026-07-09 13:19:04 on dist-test-slave-tbwl"
I20260709 13:19:04.081626  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:04.125517  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:04.127104  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:04.128894  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:04.131973  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:04.132234  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:04.132521  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:04.132707  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:04.182919  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.130:38479
I20260709 13:19:04.183173 18717 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.130:38479 every 8 connection(s)
I20260709 13:19:04.188556  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:04.196527 18721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:04.198321 18722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:04.200825  6030 server_base.cc:1061] running on GCE node
W20260709 13:19:04.203579 18724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:04.203790 18718 heartbeater.cc:344] Connected to a master server at 127.5.227.190:37357
I20260709 13:19:04.204434 18718 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:04.205039  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:04.205250 18718 heartbeater.cc:507] Master 127.5.227.190:37357 requested a full tablet report, sending...
W20260709 13:19:04.205569  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:04.205860  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603144205835 us; error 0 us; skew 500 ppm
I20260709 13:19:04.207106  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:04.208634 18516 ts_manager.cc:194] Registered new tserver with Master: e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:04.210577 18516 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55180
I20260709 13:19:04.210961  6030 webserver.cc:533] Webserver started at http://127.5.227.131:37553/ using document root <none> and password file <none>
I20260709 13:19:04.211757  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:04.212049  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:04.212427  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:04.213901  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-2-root/instance:
uuid: "670ea2028d3c4fb8960a99604387fcdc"
format_stamp: "Formatted at 2026-07-09 13:19:04 on dist-test-slave-tbwl"
I20260709 13:19:04.219676  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:19:04.223881 18729 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:04.225063  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:19:04.225498  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-2-root
uuid: "670ea2028d3c4fb8960a99604387fcdc"
format_stamp: "Formatted at 2026-07-09 13:19:04 on dist-test-slave-tbwl"
I20260709 13:19:04.225857  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602741015013-6030-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:04.245007  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:04.246145  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:04.247624  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:04.250376  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:04.250598  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:04.250995  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:04.251183  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:04.301201  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.131:43579
I20260709 13:19:04.301323 18791 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.131:43579 every 8 connection(s)
I20260709 13:19:04.320329 18792 heartbeater.cc:344] Connected to a master server at 127.5.227.190:37357
I20260709 13:19:04.320850 18792 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:04.321599 18792 heartbeater.cc:507] Master 127.5.227.190:37357 requested a full tablet report, sending...
I20260709 13:19:04.323840 18516 ts_manager.cc:194] Registered new tserver with Master: 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:04.324697  6030 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019978932s
I20260709 13:19:04.325405 18516 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55188
I20260709 13:19:04.356832 18516 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55204:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:04.359962 18516 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:04.439666 18757 tablet_service.cc:1511] Processing CreateTablet for tablet cf1ad187bd824b3e8639199cd787ce9f (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:04.442714 18756 tablet_service.cc:1511] Processing CreateTablet for tablet 52968579e768489dbbda4f45debd689c (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:04.447540 18755 tablet_service.cc:1511] Processing CreateTablet for tablet 58ee81ccb1074ee685bae5c26cc42579 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:04.449466 18757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1ad187bd824b3e8639199cd787ce9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.454996 18754 tablet_service.cc:1511] Processing CreateTablet for tablet 8a403836d14e42268fbc3098bda76d4e (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:04.455994 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ee81ccb1074ee685bae5c26cc42579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.457365 18754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a403836d14e42268fbc3098bda76d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.457244 18607 tablet_service.cc:1511] Processing CreateTablet for tablet 52968579e768489dbbda4f45debd689c (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:04.458309 18756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52968579e768489dbbda4f45debd689c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.458801 18607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52968579e768489dbbda4f45debd689c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.461099 18606 tablet_service.cc:1511] Processing CreateTablet for tablet 58ee81ccb1074ee685bae5c26cc42579 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:04.462649 18606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ee81ccb1074ee685bae5c26cc42579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.467947 18605 tablet_service.cc:1511] Processing CreateTablet for tablet 8a403836d14e42268fbc3098bda76d4e (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:04.470171 18605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a403836d14e42268fbc3098bda76d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.455504 18608 tablet_service.cc:1511] Processing CreateTablet for tablet cf1ad187bd824b3e8639199cd787ce9f (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:04.479655 18608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1ad187bd824b3e8639199cd787ce9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.486680 18753 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8af952bdad465d80c0fa044046163e (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:04.489761 18753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8af952bdad465d80c0fa044046163e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.497191 18808 tablet_bootstrap.cc:492] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:04.504355 18808 tablet_bootstrap.cc:654] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.534435 18808 tablet_bootstrap.cc:492] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:04.537153 18808 ts_tablet_manager.cc:1403] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.014s
I20260709 13:19:04.543329 18808 raft_consensus.cc:359] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.544200 18808 raft_consensus.cc:385] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.544521 18808 raft_consensus.cc:740] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.584708 18604 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8af952bdad465d80c0fa044046163e (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:04.589818 18604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8af952bdad465d80c0fa044046163e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.584827 18603 tablet_service.cc:1511] Processing CreateTablet for tablet 42b2af1c0551436c8a2f2af3dd6b37e5 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:04.599987 18682 tablet_service.cc:1511] Processing CreateTablet for tablet 52968579e768489dbbda4f45debd689c (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:04.605240 18681 tablet_service.cc:1511] Processing CreateTablet for tablet 58ee81ccb1074ee685bae5c26cc42579 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:04.600325 18683 tablet_service.cc:1511] Processing CreateTablet for tablet cf1ad187bd824b3e8639199cd787ce9f (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:04.612149 18602 tablet_service.cc:1511] Processing CreateTablet for tablet 059f35cd2c5447549d0134c5eea2f999 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:04.612656 18680 tablet_service.cc:1511] Processing CreateTablet for tablet 8a403836d14e42268fbc3098bda76d4e (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:04.613871 18679 tablet_service.cc:1511] Processing CreateTablet for tablet 0d8af952bdad465d80c0fa044046163e (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:04.616219 18603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b2af1c0551436c8a2f2af3dd6b37e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.617599 18753 tablet_service.cc:1511] Processing CreateTablet for tablet 42b2af1c0551436c8a2f2af3dd6b37e5 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:04.619129 18602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059f35cd2c5447549d0134c5eea2f999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.619901 18753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b2af1c0551436c8a2f2af3dd6b37e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.620579 18678 tablet_service.cc:1511] Processing CreateTablet for tablet 42b2af1c0551436c8a2f2af3dd6b37e5 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:04.624686 18757 tablet_service.cc:1511] Processing CreateTablet for tablet 059f35cd2c5447549d0134c5eea2f999 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:04.629060 18757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059f35cd2c5447549d0134c5eea2f999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.624754 18677 tablet_service.cc:1511] Processing CreateTablet for tablet 059f35cd2c5447549d0134c5eea2f999 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:04.626829 18682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52968579e768489dbbda4f45debd689c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.545356 18808 consensus_queue.cc:260] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.652786 18683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1ad187bd824b3e8639199cd787ce9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.657460 18606 tablet_service.cc:1511] Processing CreateTablet for tablet ea2f94b4b2bb4bf9b849edebed15af13 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:04.663362 18680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a403836d14e42268fbc3098bda76d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.673275 18681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ee81ccb1074ee685bae5c26cc42579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.686776 18676 tablet_service.cc:1511] Processing CreateTablet for tablet ea2f94b4b2bb4bf9b849edebed15af13 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:04.679720 18606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2f94b4b2bb4bf9b849edebed15af13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.691053 18810 tablet_bootstrap.cc:492] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:04.700942 18676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2f94b4b2bb4bf9b849edebed15af13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.704421 18755 tablet_service.cc:1511] Processing CreateTablet for tablet ea2f94b4b2bb4bf9b849edebed15af13 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:04.711656 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2f94b4b2bb4bf9b849edebed15af13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.712306 18808 ts_tablet_manager.cc:1434] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.175s	user 0.006s	sys 0.022s
I20260709 13:19:04.712940 18607 tablet_service.cc:1511] Processing CreateTablet for tablet d13c8fd8a9ab43f58884c1263ba8f616 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:04.713852 18792 heartbeater.cc:499] Master 127.5.227.190:37357 was elected leader, sending a full tablet report...
I20260709 13:19:04.714581 18607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13c8fd8a9ab43f58884c1263ba8f616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.719260 18679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d8af952bdad465d80c0fa044046163e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.722432 18678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b2af1c0551436c8a2f2af3dd6b37e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.726215 18677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059f35cd2c5447549d0134c5eea2f999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.731288 18808 tablet_bootstrap.cc:492] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:04.737803 18675 tablet_service.cc:1511] Processing CreateTablet for tablet d13c8fd8a9ab43f58884c1263ba8f616 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:04.739840 18675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13c8fd8a9ab43f58884c1263ba8f616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.754758 18754 tablet_service.cc:1511] Processing CreateTablet for tablet d13c8fd8a9ab43f58884c1263ba8f616 (DEFAULT_TABLE table=test-workload [id=326eff91947a4eca906c4224ac53a9ae]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:04.756420 18754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13c8fd8a9ab43f58884c1263ba8f616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.760965 18810 tablet_bootstrap.cc:654] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.786257 18808 tablet_bootstrap.cc:654] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.810107 18810 tablet_bootstrap.cc:492] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:04.810752 18810 ts_tablet_manager.cc:1403] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.015s
I20260709 13:19:04.814786 18810 raft_consensus.cc:359] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } }
I20260709 13:19:04.815795 18810 raft_consensus.cc:385] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.816151 18810 raft_consensus.cc:740] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.816681 18813 tablet_bootstrap.cc:492] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:04.817206 18810 consensus_queue.cc:260] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } }
I20260709 13:19:04.840075 18813 tablet_bootstrap.cc:654] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.843739 18810 ts_tablet_manager.cc:1434] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.010s
I20260709 13:19:04.845238 18643 heartbeater.cc:499] Master 127.5.227.190:37357 was elected leader, sending a full tablet report...
I20260709 13:19:04.849156 18810 tablet_bootstrap.cc:492] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:04.850308 18808 tablet_bootstrap.cc:492] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:04.851063 18808 ts_tablet_manager.cc:1403] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.120s	user 0.029s	sys 0.014s
I20260709 13:19:04.855113 18813 tablet_bootstrap.cc:492] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:04.854974 18808 raft_consensus.cc:359] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } }
I20260709 13:19:04.855909 18808 raft_consensus.cc:385] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.855990 18813 ts_tablet_manager.cc:1403] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.005s
I20260709 13:19:04.856269 18808 raft_consensus.cc:740] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.857002 18810 tablet_bootstrap.cc:654] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.857333 18808 consensus_queue.cc:260] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } }
I20260709 13:19:04.859966 18808 ts_tablet_manager.cc:1434] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:19:04.860515 18813 raft_consensus.cc:359] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } }
I20260709 13:19:04.861440 18813 raft_consensus.cc:385] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.861824 18813 raft_consensus.cc:740] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.862962 18813 consensus_queue.cc:260] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } }
I20260709 13:19:04.862989 18808 tablet_bootstrap.cc:492] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:04.867146 18718 heartbeater.cc:499] Master 127.5.227.190:37357 was elected leader, sending a full tablet report...
I20260709 13:19:04.867617 18813 ts_tablet_manager.cc:1434] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
W20260709 13:19:04.869081 18564 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:04.869345 18813 tablet_bootstrap.cc:492] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:04.873410 18808 tablet_bootstrap.cc:654] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.876817 18810 tablet_bootstrap.cc:492] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:04.877491 18810 ts_tablet_manager.cc:1403] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.005s
I20260709 13:19:04.878113 18813 tablet_bootstrap.cc:654] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.880961 18810 raft_consensus.cc:359] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.882016 18810 raft_consensus.cc:385] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.882427 18810 raft_consensus.cc:740] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.883872 18810 consensus_queue.cc:260] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.887449 18810 ts_tablet_manager.cc:1434] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.005s
I20260709 13:19:04.888568 18810 tablet_bootstrap.cc:492] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:04.897192 18815 raft_consensus.cc:493] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.897943 18815 raft_consensus.cc:515] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.898285 18810 tablet_bootstrap.cc:654] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.912806 18808 tablet_bootstrap.cc:492] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:04.913403 18813 tablet_bootstrap.cc:492] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:04.913583 18808 ts_tablet_manager.cc:1403] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.008s
I20260709 13:19:04.914279 18813 ts_tablet_manager.cc:1403] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.023s
I20260709 13:19:04.914794 18815 leader_election.cc:290] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:04.918812 18813 raft_consensus.cc:359] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.919715 18813 raft_consensus.cc:385] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.920051 18813 raft_consensus.cc:740] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.920856 18813 consensus_queue.cc:260] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.923215 18813 ts_tablet_manager.cc:1434] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:04.923508 18808 raft_consensus.cc:359] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.924539 18813 tablet_bootstrap.cc:492] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:04.933261 18813 tablet_bootstrap.cc:654] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.924913 18808 raft_consensus.cc:385] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.951769 18808 raft_consensus.cc:740] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.952750 18808 consensus_queue.cc:260] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.955319 18808 ts_tablet_manager.cc:1434] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.041s	user 0.013s	sys 0.000s
I20260709 13:19:04.956475 18808 tablet_bootstrap.cc:492] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:04.957463 18810 tablet_bootstrap.cc:492] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:04.958092 18810 ts_tablet_manager.cc:1403] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.070s	user 0.052s	sys 0.009s
I20260709 13:19:04.961738 18810 raft_consensus.cc:359] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.963999 18808 tablet_bootstrap.cc:654] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.962606 18810 raft_consensus.cc:385] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.966277 18810 raft_consensus.cc:740] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.967516 18810 consensus_queue.cc:260] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.968899 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:04.970916 18810 ts_tablet_manager.cc:1434] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.007s
W20260709 13:19:04.972033 18584 leader_election.cc:343] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.972435 18813 tablet_bootstrap.cc:492] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:04.972520 18810 tablet_bootstrap.cc:492] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:04.973038 18813 ts_tablet_manager.cc:1403] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.019s
I20260709 13:19:04.977484 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
W20260709 13:19:04.979524 18583 leader_election.cc:343] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.980031 18583 leader_election.cc:304] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4; no voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:04.980129 18813 raft_consensus.cc:359] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.980937 18813 raft_consensus.cc:385] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.981241 18813 raft_consensus.cc:740] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.981314 18815 raft_consensus.cc:2749] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.982262 18813 consensus_queue.cc:260] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:04.983917 18810 tablet_bootstrap.cc:654] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.985222 18813 ts_tablet_manager.cc:1434] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:19:04.986459 18813 tablet_bootstrap.cc:492] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:04.986536 18818 raft_consensus.cc:493] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.987130 18818 raft_consensus.cc:515] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } }
I20260709 13:19:04.990168 18818 leader_election.cc:290] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:04.995992 18813 tablet_bootstrap.cc:654] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.003237 18811 raft_consensus.cc:493] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.004078 18811 raft_consensus.cc:515] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.009493 18813 tablet_bootstrap.cc:492] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:05.009788 18815 raft_consensus.cc:493] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.016558 18815 raft_consensus.cc:515] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } }
I20260709 13:19:05.020143 18815 leader_election.cc:290] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:05.010030 18811 leader_election.cc:290] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:05.021445 18813 ts_tablet_manager.cc:1403] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.011s
I20260709 13:19:05.025344 18813 raft_consensus.cc:359] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.026237 18813 raft_consensus.cc:385] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.026561 18813 raft_consensus.cc:740] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.044850 18811 raft_consensus.cc:493] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.046103 18811 raft_consensus.cc:515] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.047379 18818 raft_consensus.cc:493] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.047982 18818 raft_consensus.cc:515] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.048611 18811 leader_election.cc:290] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:05.051193 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ad187bd824b3e8639199cd787ce9f" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:05.051898 18693 raft_consensus.cc:2468] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:05.055578 18583 leader_election.cc:304] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.056466 18815 raft_consensus.cc:2804] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.056867 18815 raft_consensus.cc:493] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.050305 18818 leader_election.cc:290] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.057190 18815 raft_consensus.cc:3060] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.033387 18813 consensus_queue.cc:260] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.068279 18813 ts_tablet_manager.cc:1434] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:19:05.069597 18813 tablet_bootstrap.cc:492] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:05.082471 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ad187bd824b3e8639199cd787ce9f" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:05.083397 18767 raft_consensus.cc:2468] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:05.089476 18808 tablet_bootstrap.cc:492] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:05.089411 18618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8af952bdad465d80c0fa044046163e" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:05.090180 18808 ts_tablet_manager.cc:1403] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.134s	user 0.033s	sys 0.029s
I20260709 13:19:05.091886 18618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52968579e768489dbbda4f45debd689c" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:05.093637 18808 raft_consensus.cc:359] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.094480 18808 raft_consensus.cc:385] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.094820 18808 raft_consensus.cc:740] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
W20260709 13:19:05.095947 18731 leader_election.cc:343] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.095693 18808 consensus_queue.cc:260] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.096501 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52968579e768489dbbda4f45debd689c" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:05.098237 18808 ts_tablet_manager.cc:1434] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:19:05.099361 18808 tablet_bootstrap.cc:492] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:05.100775 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8af952bdad465d80c0fa044046163e" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:05.102429 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52968579e768489dbbda4f45debd689c" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:05.103363 18810 tablet_bootstrap.cc:492] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:05.103246 18692 raft_consensus.cc:2468] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 0.
I20260709 13:19:05.103942 18810 ts_tablet_manager.cc:1403] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.132s	user 0.020s	sys 0.030s
W20260709 13:19:05.105221 18732 leader_election.cc:343] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.105710 18732 leader_election.cc:304] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc; no voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b
W20260709 13:19:05.106621 18657 leader_election.cc:343] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.107301 18811 raft_consensus.cc:2749] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.107618 18813 tablet_bootstrap.cc:654] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.107470 18810 raft_consensus.cc:359] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
W20260709 13:19:05.100801 18731 leader_election.cc:343] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.108387 18810 raft_consensus.cc:385] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.108742 18810 raft_consensus.cc:740] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.109748 18810 consensus_queue.cc:260] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.111586 18618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ad187bd824b3e8639199cd787ce9f" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:05.112830 18815 raft_consensus.cc:515] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } }
I20260709 13:19:05.114863 18618 raft_consensus.cc:2393] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b1c25cf3f84ea58304a6e112ff539b in current term 1: Already voted for candidate e4f8b938d317462dad5c7a368ad661c4 in this term.
I20260709 13:19:05.115150 18732 leader_election.cc:304] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:05.117144 18808 tablet_bootstrap.cc:654] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.117431 18815 leader_election.cc:290] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Requested vote from peers 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:05.117707 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ad187bd824b3e8639199cd787ce9f" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:05.118505 18692 raft_consensus.cc:3060] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.123852 18810 ts_tablet_manager.cc:1434] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.003s
I20260709 13:19:05.125312 18810 tablet_bootstrap.cc:492] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:05.130815 18811 raft_consensus.cc:2804] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.131496 18811 raft_consensus.cc:493] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.131923 18811 raft_consensus.cc:3060] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.137642 18810 tablet_bootstrap.cc:654] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.137778 18813 tablet_bootstrap.cc:492] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:05.138543 18813 ts_tablet_manager.cc:1403] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.003s
I20260709 13:19:05.140259 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ad187bd824b3e8639199cd787ce9f" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:05.140946 18767 raft_consensus.cc:3060] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.144130 18813 raft_consensus.cc:359] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.145560 18813 raft_consensus.cc:385] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.146054 18813 raft_consensus.cc:740] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.147549 18813 consensus_queue.cc:260] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.155355 18813 ts_tablet_manager.cc:1434] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:19:05.155565 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1ad187bd824b3e8639199cd787ce9f" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:05.156893 18813 tablet_bootstrap.cc:492] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:05.158854 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52968579e768489dbbda4f45debd689c" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:05.161005 18659 leader_election.cc:304] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b1c25cf3f84ea58304a6e112ff539b; no voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:05.167896 18813 tablet_bootstrap.cc:654] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.178570 18692 raft_consensus.cc:2468] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:05.179685 18818 raft_consensus.cc:2749] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.180037 18808 tablet_bootstrap.cc:492] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:05.180835 18808 ts_tablet_manager.cc:1403] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.024s
I20260709 13:19:05.182320 18813 tablet_bootstrap.cc:492] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:05.183072 18813 ts_tablet_manager.cc:1403] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.016s
I20260709 13:19:05.184758 18808 raft_consensus.cc:359] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.185675 18808 raft_consensus.cc:385] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.186026 18808 raft_consensus.cc:740] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.186853 18583 leader_election.cc:304] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.187005 18813 raft_consensus.cc:359] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.188367 18813 raft_consensus.cc:385] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.188473 18815 raft_consensus.cc:2804] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.188799 18813 raft_consensus.cc:740] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.189127 18815 raft_consensus.cc:697] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:05.189224 18767 raft_consensus.cc:2468] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:05.190091 18813 consensus_queue.cc:260] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.191464 18811 raft_consensus.cc:515] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.192735 18813 ts_tablet_manager.cc:1434] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:19:05.193229 18766 raft_consensus.cc:2393] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b1c25cf3f84ea58304a6e112ff539b in current term 1: Already voted for candidate 670ea2028d3c4fb8960a99604387fcdc in this term.
I20260709 13:19:05.194108 18813 tablet_bootstrap.cc:492] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:05.202339 18618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52968579e768489dbbda4f45debd689c" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:05.203372 18813 tablet_bootstrap.cc:654] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.203329 18618 raft_consensus.cc:3060] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.204031 18659 leader_election.cc:304] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b1c25cf3f84ea58304a6e112ff539b; no voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:05.190271 18815 consensus_queue.cc:237] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } }
I20260709 13:19:05.206885 18818 raft_consensus.cc:3060] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.207149 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52968579e768489dbbda4f45debd689c" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:05.208431 18811 leader_election.cc:290] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:05.186980 18808 consensus_queue.cc:260] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.210774 18811 raft_consensus.cc:493] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.211411 18811 raft_consensus.cc:515] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.213256 18808 ts_tablet_manager.cc:1434] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.002s
I20260709 13:19:05.216435 18808 tablet_bootstrap.cc:492] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:05.222738 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ee81ccb1074ee685bae5c26cc42579" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:05.223914 18617 raft_consensus.cc:2468] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 0.
I20260709 13:19:05.226167 18731 leader_election.cc:304] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
I20260709 13:19:05.231570 18810 tablet_bootstrap.cc:492] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:05.232327 18810 ts_tablet_manager.cc:1403] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.107s	user 0.033s	sys 0.043s
I20260709 13:19:05.232473 18818 raft_consensus.cc:2749] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.235103 18514 catalog_manager.cc:5697] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.240314 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ee81ccb1074ee685bae5c26cc42579" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:05.241169 18693 raft_consensus.cc:2468] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 0.
I20260709 13:19:05.240947 18810 raft_consensus.cc:359] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.242161 18810 raft_consensus.cc:385] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.242574 18810 raft_consensus.cc:740] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.245069 18810 consensus_queue.cc:260] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.254489 18692 raft_consensus.cc:2468] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 1.
I20260709 13:19:05.256503 18618 raft_consensus.cc:2468] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 1.
I20260709 13:19:05.265883 18731 leader_election.cc:304] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
I20260709 13:19:05.266815 18810 ts_tablet_manager.cc:1434] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.034s	user 0.012s	sys 0.001s
I20260709 13:19:05.267230 18841 raft_consensus.cc:2804] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.259585 18839 raft_consensus.cc:2804] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.263096 18808 tablet_bootstrap.cc:654] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.247576 18811 leader_election.cc:290] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:05.268965 18810 tablet_bootstrap.cc:492] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:05.269999 18839 raft_consensus.cc:493] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.272915 18839 raft_consensus.cc:3060] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.276338 18818 raft_consensus.cc:493] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.277004 18818 raft_consensus.cc:515] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.282105 18818 leader_election.cc:290] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.282541 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b2af1c0551436c8a2f2af3dd6b37e5" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:05.283036 18618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b2af1c0551436c8a2f2af3dd6b37e5" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:05.273214 18813 tablet_bootstrap.cc:492] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
W20260709 13:19:05.284780 18657 leader_election.cc:343] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.284977 18813 ts_tablet_manager.cc:1403] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.012s
W20260709 13:19:05.285559 18659 leader_election.cc:343] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.286121 18659 leader_election.cc:304] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b1c25cf3f84ea58304a6e112ff539b; no voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:05.287442 18818 raft_consensus.cc:2749] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.289322 18839 raft_consensus.cc:515] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.289474 18813 raft_consensus.cc:359] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.290387 18813 raft_consensus.cc:385] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.291786 18839 leader_election.cc:290] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:05.292194 18813 raft_consensus.cc:740] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.293375 18810 tablet_bootstrap.cc:654] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.293690 18618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ee81ccb1074ee685bae5c26cc42579" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:05.293944 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ee81ccb1074ee685bae5c26cc42579" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:05.293792 18813 consensus_queue.cc:260] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.295190 18618 raft_consensus.cc:3060] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.295358 18692 raft_consensus.cc:3060] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.294181 18841 raft_consensus.cc:697] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:05.300488 18841 consensus_queue.cc:237] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.302574 18813 ts_tablet_manager.cc:1434] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:19:05.304324 18813 tablet_bootstrap.cc:492] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:05.308996 18692 raft_consensus.cc:2468] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 1.
I20260709 13:19:05.309794 18808 tablet_bootstrap.cc:492] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:05.310536 18808 ts_tablet_manager.cc:1403] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.007s
I20260709 13:19:05.311539 18732 leader_election.cc:304] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.312773 18813 tablet_bootstrap.cc:654] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.313087 18839 raft_consensus.cc:2804] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.314128 18839 raft_consensus.cc:697] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:05.315148 18839 consensus_queue.cc:237] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.315851 18818 raft_consensus.cc:493] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.316448 18818 raft_consensus.cc:515] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.317220 18810 tablet_bootstrap.cc:492] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:05.317844 18810 ts_tablet_manager.cc:1403] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.017s
I20260709 13:19:05.320096 18818 leader_election.cc:290] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.328059 18618 raft_consensus.cc:2468] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 1.
I20260709 13:19:05.329198 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13c8fd8a9ab43f58884c1263ba8f616" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:05.330353 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13c8fd8a9ab43f58884c1263ba8f616" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
W20260709 13:19:05.330991 18657 leader_election.cc:343] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.332093 18808 raft_consensus.cc:359] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
W20260709 13:19:05.333324 18659 leader_election.cc:343] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.333941 18659 leader_election.cc:304] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b1c25cf3f84ea58304a6e112ff539b; no voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:05.334892 18818 raft_consensus.cc:2749] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.333317 18808 raft_consensus.cc:385] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.336304 18808 raft_consensus.cc:740] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.337252 18808 consensus_queue.cc:260] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.340387 18808 ts_tablet_manager.cc:1434] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 13:19:05.341631 18808 tablet_bootstrap.cc:492] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:05.345903 18513 catalog_manager.cc:5697] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 0 to 1, leader changed from <none> to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 1 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.349318 18810 raft_consensus.cc:359] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.350080 18810 raft_consensus.cc:385] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.350883 18810 raft_consensus.cc:740] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.351950 18810 consensus_queue.cc:260] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.353631 18813 tablet_bootstrap.cc:492] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:05.354691 18813 ts_tablet_manager.cc:1403] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.001s
I20260709 13:19:05.357438 18839 raft_consensus.cc:493] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.358131 18839 raft_consensus.cc:515] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.358902 18813 raft_consensus.cc:359] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.359961 18810 ts_tablet_manager.cc:1434] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.001s
I20260709 13:19:05.360158 18813 raft_consensus.cc:385] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.360486 18813 raft_consensus.cc:740] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.361224 18810 tablet_bootstrap.cc:492] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:05.361222 18813 consensus_queue.cc:260] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.363271 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:05.364058 18813 ts_tablet_manager.cc:1434] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:05.364741 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:05.365473 18617 raft_consensus.cc:2468] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 0.
I20260709 13:19:05.367359 18731 leader_election.cc:304] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
W20260709 13:19:05.368799 18732 leader_election.cc:343] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.369767 18839 leader_election.cc:290] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:05.369943 18810 tablet_bootstrap.cc:654] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.369886 18841 raft_consensus.cc:2804] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.370656 18841 raft_consensus.cc:493] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.371084 18841 raft_consensus.cc:3060] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.374258 18515 catalog_manager.cc:5697] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 0 to 1, leader changed from <none> to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 1 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.378835 18813 tablet_bootstrap.cc:492] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:05.385082 18808 tablet_bootstrap.cc:654] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.386147 18841 raft_consensus.cc:515] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.386847 18813 tablet_bootstrap.cc:654] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.389652 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:05.390563 18617 raft_consensus.cc:3060] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.404294 18841 leader_election.cc:290] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:05.405251 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
W20260709 13:19:05.407609 18732 leader_election.cc:343] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.408910 18815 raft_consensus.cc:493] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.409741 18815 raft_consensus.cc:515] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.413033 18815 leader_election.cc:290] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.414857 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059f35cd2c5447549d0134c5eea2f999" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:05.415418 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059f35cd2c5447549d0134c5eea2f999" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:05.416004 18692 raft_consensus.cc:2468] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:05.416778 18767 raft_consensus.cc:2468] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:05.418084 18583 leader_election.cc:304] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.407430 18617 raft_consensus.cc:2468] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 1.
I20260709 13:19:05.421772 18815 raft_consensus.cc:2804] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.422485 18815 raft_consensus.cc:493] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.423125 18815 raft_consensus.cc:3060] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.422856 18731 leader_election.cc:304] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:05.424988 18841 raft_consensus.cc:2804] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.427016 18841 raft_consensus.cc:697] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:05.428345 18841 consensus_queue.cc:237] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.433885 18810 tablet_bootstrap.cc:492] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:05.434904 18810 ts_tablet_manager.cc:1403] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.003s
I20260709 13:19:05.437012 18815 raft_consensus.cc:515] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.442420 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059f35cd2c5447549d0134c5eea2f999" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:05.443302 18692 raft_consensus.cc:3060] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.444401 18810 raft_consensus.cc:359] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.444916 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059f35cd2c5447549d0134c5eea2f999" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:05.445349 18810 raft_consensus.cc:385] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.445677 18767 raft_consensus.cc:3060] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.445744 18810 raft_consensus.cc:740] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.448731 18813 tablet_bootstrap.cc:492] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:05.449218 18813 ts_tablet_manager.cc:1403] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.071s	user 0.030s	sys 0.034s
I20260709 13:19:05.450958 18810 consensus_queue.cc:260] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.452281 18692 raft_consensus.cc:2468] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:05.452805 18815 leader_election.cc:290] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.451900 18813 raft_consensus.cc:359] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.453524 18813 raft_consensus.cc:385] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.453821 18813 raft_consensus.cc:740] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.454627 18810 ts_tablet_manager.cc:1434] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:19:05.455039 18808 tablet_bootstrap.cc:492] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:05.454782 18813 consensus_queue.cc:260] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.455651 18808 ts_tablet_manager.cc:1403] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.114s	user 0.034s	sys 0.033s
I20260709 13:19:05.455984 18583 leader_election.cc:304] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.459069 18808 raft_consensus.cc:359] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.460070 18808 raft_consensus.cc:385] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.460065 18818 raft_consensus.cc:493] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.460897 18808 raft_consensus.cc:740] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.461160 18818 raft_consensus.cc:515] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.461810 18808 consensus_queue.cc:260] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.465147 18808 ts_tablet_manager.cc:1434] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:19:05.466534 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8af952bdad465d80c0fa044046163e" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:05.467321 18808 tablet_bootstrap.cc:492] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:05.467430 18617 raft_consensus.cc:2468] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 0.
I20260709 13:19:05.467566 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8af952bdad465d80c0fa044046163e" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:05.468322 18818 leader_election.cc:290] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.468665 18766 raft_consensus.cc:2468] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 0.
I20260709 13:19:05.468948 18813 ts_tablet_manager.cc:1434] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 13:19:05.470062 18659 leader_election.cc:304] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.472752 18818 raft_consensus.cc:2804] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.473176 18818 raft_consensus.cc:493] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.473547 18818 raft_consensus.cc:3060] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.475288 18808 tablet_bootstrap.cc:654] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.477037 18815 raft_consensus.cc:2804] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.477962 18815 raft_consensus.cc:697] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:05.479228 18815 consensus_queue.cc:237] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.483476 18818 raft_consensus.cc:515] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.489562 18818 leader_election.cc:290] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.483079 18767 raft_consensus.cc:2468] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:05.490350 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8af952bdad465d80c0fa044046163e" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:05.456032 18810 tablet_bootstrap.cc:492] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:05.491122 18617 raft_consensus.cc:3060] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.497429 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8af952bdad465d80c0fa044046163e" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:05.498885 18810 tablet_bootstrap.cc:654] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.498433 18767 raft_consensus.cc:3060] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.503557 18834 raft_consensus.cc:493] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.504335 18834 raft_consensus.cc:515] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.505931 18808 tablet_bootstrap.cc:492] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:05.506554 18808 ts_tablet_manager.cc:1403] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.028s
I20260709 13:19:05.507335 18834 leader_election.cc:290] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.509269 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b2af1c0551436c8a2f2af3dd6b37e5" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:05.510030 18766 raft_consensus.cc:2468] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:05.509876 18808 raft_consensus.cc:359] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.510779 18808 raft_consensus.cc:385] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.511134 18808 raft_consensus.cc:740] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.511577 18584 leader_election.cc:304] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
I20260709 13:19:05.512219 18808 consensus_queue.cc:260] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.515036 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b2af1c0551436c8a2f2af3dd6b37e5" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:05.515878 18692 raft_consensus.cc:2468] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:05.486963 18515 catalog_manager.cc:5697] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 0 to 1, leader changed from <none> to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 1 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.518329 18808 ts_tablet_manager.cc:1434] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:19:05.518805 18834 raft_consensus.cc:2804] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.519234 18834 raft_consensus.cc:493] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.519600 18834 raft_consensus.cc:3060] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.517436 18516 catalog_manager.cc:5697] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.519750 18808 tablet_bootstrap.cc:492] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:05.527292 18808 tablet_bootstrap.cc:654] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.527637 18810 tablet_bootstrap.cc:492] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:05.528172 18810 ts_tablet_manager.cc:1403] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.016s
I20260709 13:19:05.532070 18810 raft_consensus.cc:359] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.533471 18810 raft_consensus.cc:385] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.533866 18810 raft_consensus.cc:740] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.534849 18810 consensus_queue.cc:260] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.538055 18810 ts_tablet_manager.cc:1434] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:05.539384 18810 tablet_bootstrap.cc:492] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:05.548645 18810 tablet_bootstrap.cc:654] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.556577 18834 raft_consensus.cc:515] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.559890 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b2af1c0551436c8a2f2af3dd6b37e5" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:05.560547 18692 raft_consensus.cc:3060] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.569878 18692 raft_consensus.cc:2468] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:05.570974 18583 leader_election.cc:304] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.571951 18815 raft_consensus.cc:2804] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.572850 18767 raft_consensus.cc:2468] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 1.
I20260709 13:19:05.574714 18659 leader_election.cc:304] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.576761 18818 raft_consensus.cc:2804] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.578320 18617 raft_consensus.cc:2468] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 1.
I20260709 13:19:05.580318 18818 raft_consensus.cc:697] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Becoming Leader. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:05.582584 18815 raft_consensus.cc:697] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:05.582923 18818 consensus_queue.cc:237] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.583940 18815 consensus_queue.cc:237] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.587252 18834 leader_election.cc:290] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.591742 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b2af1c0551436c8a2f2af3dd6b37e5" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:05.593415 18767 raft_consensus.cc:3060] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.598490 18810 tablet_bootstrap.cc:492] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:05.599362 18810 ts_tablet_manager.cc:1403] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.060s	user 0.034s	sys 0.020s
I20260709 13:19:05.599809 18808 tablet_bootstrap.cc:492] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:05.600387 18808 ts_tablet_manager.cc:1403] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.042s
I20260709 13:19:05.604292 18810 raft_consensus.cc:359] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.605729 18810 raft_consensus.cc:385] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.606196 18810 raft_consensus.cc:740] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.607041 18808 raft_consensus.cc:359] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.607868 18808 raft_consensus.cc:385] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.608036 18810 consensus_queue.cc:260] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.611099 18810 ts_tablet_manager.cc:1434] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:19:05.608131 18808 raft_consensus.cc:740] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.613363 18808 consensus_queue.cc:260] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.612471 18767 raft_consensus.cc:2468] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:05.615594 18515 catalog_manager.cc:5697] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130). New cstate: current_term: 1 leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.619771 18808 ts_tablet_manager.cc:1434] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:19:05.618988 18512 catalog_manager.cc:5697] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.625993 18818 raft_consensus.cc:493] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.626704 18818 raft_consensus.cc:515] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.629088 18818 leader_election.cc:290] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.629927 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2f94b4b2bb4bf9b849edebed15af13" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:05.630780 18617 raft_consensus.cc:2468] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 0.
I20260709 13:19:05.632165 18657 leader_election.cc:304] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.633157 18818 raft_consensus.cc:2804] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.633517 18818 raft_consensus.cc:493] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.633426 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2f94b4b2bb4bf9b849edebed15af13" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:05.634151 18818 raft_consensus.cc:3060] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.634406 18766 raft_consensus.cc:2468] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 0.
I20260709 13:19:05.637073 18815 consensus_queue.cc:1048] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.644446 18818 raft_consensus.cc:515] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.647682 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2f94b4b2bb4bf9b849edebed15af13" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:05.648370 18617 raft_consensus.cc:3060] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.651376 18818 leader_election.cc:290] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.653254 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2f94b4b2bb4bf9b849edebed15af13" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:05.654280 18766 raft_consensus.cc:3060] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.654814 18617 raft_consensus.cc:2468] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 1.
I20260709 13:19:05.655961 18657 leader_election.cc:304] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.657644 18818 raft_consensus.cc:2804] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.658195 18818 raft_consensus.cc:697] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Becoming Leader. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:05.659915 18818 consensus_queue.cc:237] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.662250 18815 consensus_queue.cc:1048] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:05.666126 18766 raft_consensus.cc:2468] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 1.
I20260709 13:19:05.679134 18514 catalog_manager.cc:5697] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130). New cstate: current_term: 1 leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.734772 18818 raft_consensus.cc:493] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.735402 18818 raft_consensus.cc:515] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.737370 18818 leader_election.cc:290] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.738756 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:05.739128 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:05.739522 18617 raft_consensus.cc:2393] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8b1c25cf3f84ea58304a6e112ff539b in current term 1: Already voted for candidate 670ea2028d3c4fb8960a99604387fcdc in this term.
I20260709 13:19:05.740772 18659 leader_election.cc:304] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8b1c25cf3f84ea58304a6e112ff539b; no voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:05.741562 18818 raft_consensus.cc:3060] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.747519 18818 raft_consensus.cc:2749] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.787819 18841 consensus_queue.cc:1048] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.794251 18841 consensus_queue.cc:1048] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.800170 18841 consensus_queue.cc:1048] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.801030 18844 consensus_queue.cc:1048] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:05.802839 18834 raft_consensus.cc:493] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.803504 18834 raft_consensus.cc:515] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.806581 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13c8fd8a9ab43f58884c1263ba8f616" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:05.809012 18834 leader_election.cc:290] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.807396 18692 raft_consensus.cc:2468] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:05.812433 18583 leader_election.cc:304] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.813354 18834 raft_consensus.cc:2804] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.813825 18834 raft_consensus.cc:493] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.814213 18834 raft_consensus.cc:3060] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.817119 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13c8fd8a9ab43f58884c1263ba8f616" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:05.817942 18767 raft_consensus.cc:2468] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:05.825624 18834 raft_consensus.cc:515] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.829998 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13c8fd8a9ab43f58884c1263ba8f616" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:05.830727 18693 raft_consensus.cc:3060] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.840786 18693 raft_consensus.cc:2468] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:05.840889 18834 leader_election.cc:290] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:05.842263 18583 leader_election.cc:304] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:05.842994 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13c8fd8a9ab43f58884c1263ba8f616" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:05.843336 18834 raft_consensus.cc:2804] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.843689 18767 raft_consensus.cc:3060] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.844460 18834 raft_consensus.cc:697] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:05.845264 18834 consensus_queue.cc:237] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:05.851955 18767 raft_consensus.cc:2468] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:05.853418 18514 catalog_manager.cc:5697] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.861285 18844 consensus_queue.cc:1048] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.880278 18839 consensus_queue.cc:1048] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.947386 18834 consensus_queue.cc:1048] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.955041 18834 consensus_queue.cc:1048] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.965204 18862 consensus_queue.cc:1048] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:05.980885 18862 consensus_queue.cc:1048] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:06.043149 18882 consensus_queue.cc:1048] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:06.057049 18882 consensus_queue.cc:1048] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:06.061357 18815 consensus_queue.cc:1048] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:06.071048 18815 consensus_queue.cc:1048] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:06.100283 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52968579e768489dbbda4f45debd689c"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
mode: GRACEFUL
new_leader_uuid: "e4f8b938d317462dad5c7a368ad661c4"
 from {username='slave'} at 127.0.0.1:37070
I20260709 13:19:06.101220 18767 raft_consensus.cc:606] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Received request to transfer leadership to TS e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:06.108326 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58ee81ccb1074ee685bae5c26cc42579"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
mode: GRACEFUL
new_leader_uuid: "e4f8b938d317462dad5c7a368ad661c4"
 from {username='slave'} at 127.0.0.1:37070
I20260709 13:19:06.109017 18767 raft_consensus.cc:606] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Received request to transfer leadership to TS e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:06.114920 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
mode: GRACEFUL
new_leader_uuid: "e4f8b938d317462dad5c7a368ad661c4"
 from {username='slave'} at 127.0.0.1:37070
I20260709 13:19:06.115489 18767 raft_consensus.cc:606] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Received request to transfer leadership to TS e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:06.136474 18617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42b2af1c0551436c8a2f2af3dd6b37e5"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
mode: GRACEFUL
new_leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:38860
I20260709 13:19:06.137138 18617 raft_consensus.cc:606] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Received request to transfer leadership to TS e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:06.143390 18617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "059f35cd2c5447549d0134c5eea2f999"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
mode: GRACEFUL
new_leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:38860
I20260709 13:19:06.143967 18617 raft_consensus.cc:606] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Received request to transfer leadership to TS e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:06.152983 18617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d13c8fd8a9ab43f58884c1263ba8f616"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
mode: GRACEFUL
new_leader_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:38860
I20260709 13:19:06.153560 18617 raft_consensus.cc:606] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Received request to transfer leadership to TS 670ea2028d3c4fb8960a99604387fcdc
I20260709 13:19:06.341893 18877 raft_consensus.cc:993] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc: : Instructing follower e4f8b938d317462dad5c7a368ad661c4 to start an election
I20260709 13:19:06.342417 18839 raft_consensus.cc:1081] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Signalling peer e4f8b938d317462dad5c7a368ad661c4 to start an election
I20260709 13:19:06.344188 18617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52968579e768489dbbda4f45debd689c"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:19:06.344712 18617 raft_consensus.cc:493] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:06.344992 18617 raft_consensus.cc:3060] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.349622 18877 raft_consensus.cc:993] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc: : Instructing follower e4f8b938d317462dad5c7a368ad661c4 to start an election
I20260709 13:19:06.350246 18839 raft_consensus.cc:1081] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Signalling peer e4f8b938d317462dad5c7a368ad661c4 to start an election
I20260709 13:19:06.352300 18618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:19:06.352043 18617 raft_consensus.cc:515] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.352985 18618 raft_consensus.cc:493] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:06.353449 18618 raft_consensus.cc:3060] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.354830 18617 leader_election.cc:290] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:06.355531 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52968579e768489dbbda4f45debd689c" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:06.356768 18693 raft_consensus.cc:3060] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.356740 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52968579e768489dbbda4f45debd689c" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:06.356824 18890 consensus_queue.cc:1048] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:06.357935 18767 raft_consensus.cc:3055] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:06.358341 18767 raft_consensus.cc:740] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:06.359321 18767 consensus_queue.cc:260] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.360859 18767 raft_consensus.cc:3060] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.365855 18618 raft_consensus.cc:515] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.369266 18767 raft_consensus.cc:2468] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 2.
I20260709 13:19:06.370913 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:06.371610 18767 raft_consensus.cc:3055] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:06.371975 18767 raft_consensus.cc:740] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:06.372884 18767 consensus_queue.cc:260] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.374302 18767 raft_consensus.cc:3060] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.374857 18693 raft_consensus.cc:2468] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 2.
I20260709 13:19:06.376415 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a403836d14e42268fbc3098bda76d4e" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:06.376958 18583 leader_election.cc:304] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:06.378093 18834 raft_consensus.cc:2804] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.378599 18834 raft_consensus.cc:697] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:06.379527 18834 consensus_queue.cc:237] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.377139 18692 raft_consensus.cc:3060] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.383572 18767 raft_consensus.cc:2468] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 2.
I20260709 13:19:06.386806 18584 leader_election.cc:304] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
I20260709 13:19:06.387696 18890 raft_consensus.cc:2804] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.388226 18890 raft_consensus.cc:697] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:06.389290 18618 leader_election.cc:290] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:06.389112 18890 consensus_queue.cc:237] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.392196 18834 consensus_queue.cc:1048] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:06.392969 18692 raft_consensus.cc:2468] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 2.
I20260709 13:19:06.399272 18841 raft_consensus.cc:993] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc: : Instructing follower e4f8b938d317462dad5c7a368ad661c4 to start an election
I20260709 13:19:06.399909 18841 raft_consensus.cc:1081] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Signalling peer e4f8b938d317462dad5c7a368ad661c4 to start an election
I20260709 13:19:06.402870 18618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58ee81ccb1074ee685bae5c26cc42579"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:19:06.403627 18890 raft_consensus.cc:993] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4: : Instructing follower 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:06.403728 18618 raft_consensus.cc:493] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:06.404480 18861 raft_consensus.cc:1081] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Signalling peer 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:06.404475 18618 raft_consensus.cc:3060] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.406840 18766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d13c8fd8a9ab43f58884c1263ba8f616"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:37054
I20260709 13:19:06.407496 18766 raft_consensus.cc:493] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:06.407936 18766 raft_consensus.cc:3060] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.413179 18618 raft_consensus.cc:515] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.413306 18514 catalog_manager.cc:5697] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 1 to 2, leader changed from 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131) to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.415567 18618 leader_election.cc:290] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:06.415220 18514 catalog_manager.cc:5697] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 1 to 2, leader changed from 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131) to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.416486 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ee81ccb1074ee685bae5c26cc42579" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:06.417186 18693 raft_consensus.cc:3060] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.417001 18766 raft_consensus.cc:515] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.418280 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ee81ccb1074ee685bae5c26cc42579" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:06.418983 18767 raft_consensus.cc:3055] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:06.419327 18767 raft_consensus.cc:740] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:06.420360 18767 consensus_queue.cc:260] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.421759 18767 raft_consensus.cc:3060] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.424726 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13c8fd8a9ab43f58884c1263ba8f616" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:06.425774 18692 raft_consensus.cc:3060] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.429546 18618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13c8fd8a9ab43f58884c1263ba8f616" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:06.430428 18618 raft_consensus.cc:3055] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:06.431094 18618 raft_consensus.cc:740] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:06.432180 18618 consensus_queue.cc:260] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.433444 18618 raft_consensus.cc:3060] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.434391 18693 raft_consensus.cc:2468] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 2.
I20260709 13:19:06.435973 18583 leader_election.cc:304] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:06.436157 18767 raft_consensus.cc:2468] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 2.
I20260709 13:19:06.436934 18890 raft_consensus.cc:2804] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.437494 18890 raft_consensus.cc:697] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:06.438309 18890 consensus_queue.cc:237] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.438802 18766 leader_election.cc:290] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 2 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:06.442245 18692 raft_consensus.cc:2468] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 2.
I20260709 13:19:06.444401 18732 leader_election.cc:304] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:06.445708 18841 raft_consensus.cc:2804] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.446417 18841 raft_consensus.cc:697] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 2 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:06.447227 18890 raft_consensus.cc:993] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4: : Instructing follower e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:06.447847 18834 raft_consensus.cc:1081] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Signalling peer e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:06.447726 18841 consensus_queue.cc:237] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.449690 18618 raft_consensus.cc:2468] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 2.
I20260709 13:19:06.450420 18693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "059f35cd2c5447549d0134c5eea2f999"
dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:40368
I20260709 13:19:06.451197 18693 raft_consensus.cc:493] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:06.451638 18693 raft_consensus.cc:3060] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.460242 18693 raft_consensus.cc:515] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.461419 18512 catalog_manager.cc:5697] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 1 to 2, leader changed from e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129) to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 2 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.463780 18618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059f35cd2c5447549d0134c5eea2f999" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:06.464715 18618 raft_consensus.cc:3055] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:06.465059 18618 raft_consensus.cc:740] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:06.465879 18693 leader_election.cc:290] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:06.465890 18618 consensus_queue.cc:260] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.467166 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059f35cd2c5447549d0134c5eea2f999" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:06.467887 18766 raft_consensus.cc:3060] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.467964 18618 raft_consensus.cc:3060] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.474218 18514 catalog_manager.cc:5697] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 1 to 2, leader changed from 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131) to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.477007 18618 raft_consensus.cc:2468] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 2.
I20260709 13:19:06.477206 18766 raft_consensus.cc:2468] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 2.
I20260709 13:19:06.478374 18657 leader_election.cc:304] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:06.479375 18882 raft_consensus.cc:2804] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.479902 18882 raft_consensus.cc:697] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Becoming Leader. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:06.480654 18882 consensus_queue.cc:237] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.488627 18514 catalog_manager.cc:5697] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b reported cstate change: term changed from 1 to 2, leader changed from e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129) to e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130). New cstate: current_term: 2 leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.696142 18834 raft_consensus.cc:993] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4: : Instructing follower e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:06.696642 18890 raft_consensus.cc:1081] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Signalling peer e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:06.698407 18693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42b2af1c0551436c8a2f2af3dd6b37e5"
dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:40368
I20260709 13:19:06.699003 18693 raft_consensus.cc:493] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:06.699281 18693 raft_consensus.cc:3060] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.706586 18693 raft_consensus.cc:515] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.708966 18693 leader_election.cc:290] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:06.710050 18618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b2af1c0551436c8a2f2af3dd6b37e5" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:06.710386 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b2af1c0551436c8a2f2af3dd6b37e5" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:06.710829 18618 raft_consensus.cc:3055] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:06.711207 18766 raft_consensus.cc:3060] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.711232 18618 raft_consensus.cc:740] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:06.712256 18618 consensus_queue.cc:260] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.713378 18618 raft_consensus.cc:3060] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.718067 18766 raft_consensus.cc:2468] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 2.
I20260709 13:19:06.719807 18659 leader_election.cc:304] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:06.720873 18818 raft_consensus.cc:2804] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.721410 18818 raft_consensus.cc:697] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Becoming Leader. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:06.721861 18618 raft_consensus.cc:2468] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 2.
I20260709 13:19:06.722404 18818 consensus_queue.cc:237] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:06.730225 18514 catalog_manager.cc:5697] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b reported cstate change: term changed from 1 to 2, leader changed from e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129) to e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130). New cstate: current_term: 2 leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.783087 18766 raft_consensus.cc:1275] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Refusing update from remote peer e4f8b938d317462dad5c7a368ad661c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.784624 18890 consensus_queue.cc:1048] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.793844 18693 raft_consensus.cc:1275] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Refusing update from remote peer e4f8b938d317462dad5c7a368ad661c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.795506 18890 consensus_queue.cc:1048] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.802870 18692 raft_consensus.cc:1275] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Refusing update from remote peer e4f8b938d317462dad5c7a368ad661c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.804598 18890 consensus_queue.cc:1048] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.814253 18766 raft_consensus.cc:1275] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Refusing update from remote peer e4f8b938d317462dad5c7a368ad661c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.816104 18861 consensus_queue.cc:1048] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.855968 18692 raft_consensus.cc:1275] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.857370 18841 consensus_queue.cc:1048] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.866905 18618 raft_consensus.cc:1275] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.868880 18841 consensus_queue.cc:1048] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.923800 18692 raft_consensus.cc:1275] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Refusing update from remote peer e4f8b938d317462dad5c7a368ad661c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.925740 18890 consensus_queue.cc:1048] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.937467 18766 raft_consensus.cc:1275] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Refusing update from remote peer e4f8b938d317462dad5c7a368ad661c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.939608 18861 consensus_queue.cc:1048] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:07.062414 18618 raft_consensus.cc:1275] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:07.064221 18818 consensus_queue.cc:1048] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:07.076735 18766 raft_consensus.cc:1275] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:07.079427 18862 consensus_queue.cc:1048] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:07.203591 18766 raft_consensus.cc:1275] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:07.205418 18862 consensus_queue.cc:1048] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:07.217577 18618 raft_consensus.cc:1275] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:07.219353 18818 consensus_queue.cc:1048] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.187196 18512 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48734:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:09.190372 18512 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:09.252815 18606 tablet_service.cc:1511] Processing CreateTablet for tablet c5c754da5fc842779c7f5eaaaf085f56 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:09.254453 18606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5c754da5fc842779c7f5eaaaf085f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.257225 18754 tablet_service.cc:1511] Processing CreateTablet for tablet c5c754da5fc842779c7f5eaaaf085f56 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:09.258852 18754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5c754da5fc842779c7f5eaaaf085f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.258342 18677 tablet_service.cc:1511] Processing CreateTablet for tablet c5c754da5fc842779c7f5eaaaf085f56 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:09.259990 18677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5c754da5fc842779c7f5eaaaf085f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.267915 18680 tablet_service.cc:1511] Processing CreateTablet for tablet fdaa707ac9c34059b57bd6cc1ddb0850 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:09.269549 18680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdaa707ac9c34059b57bd6cc1ddb0850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.269342 18603 tablet_service.cc:1511] Processing CreateTablet for tablet eb44f66e94944906afeadbd6bacc0851 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:09.270888 18603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb44f66e94944906afeadbd6bacc0851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.271369 18678 tablet_service.cc:1511] Processing CreateTablet for tablet eb44f66e94944906afeadbd6bacc0851 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:09.271792 18607 tablet_service.cc:1511] Processing CreateTablet for tablet fdaa707ac9c34059b57bd6cc1ddb0850 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:09.273308 18607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdaa707ac9c34059b57bd6cc1ddb0850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.279489 18602 tablet_service.cc:1511] Processing CreateTablet for tablet 90eddb5de2f24f0395c76002c0246ae7 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:09.281237 18602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90eddb5de2f24f0395c76002c0246ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.280972 18755 tablet_service.cc:1511] Processing CreateTablet for tablet fdaa707ac9c34059b57bd6cc1ddb0850 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:09.282357 18755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdaa707ac9c34059b57bd6cc1ddb0850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.283046 18681 tablet_service.cc:1511] Processing CreateTablet for tablet 90eddb5de2f24f0395c76002c0246ae7 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:09.285163 18678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb44f66e94944906afeadbd6bacc0851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.285821 18753 tablet_service.cc:1511] Processing CreateTablet for tablet eb44f66e94944906afeadbd6bacc0851 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:09.287402 18753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb44f66e94944906afeadbd6bacc0851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.292407 18681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90eddb5de2f24f0395c76002c0246ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.297101 18757 tablet_service.cc:1511] Processing CreateTablet for tablet 90eddb5de2f24f0395c76002c0246ae7 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:09.298995 18757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90eddb5de2f24f0395c76002c0246ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.299018 18604 tablet_service.cc:1511] Processing CreateTablet for tablet 134052ab4c784d2c80d4cc8ac4a0327b (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:09.304412 18604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134052ab4c784d2c80d4cc8ac4a0327b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.309873 18679 tablet_service.cc:1511] Processing CreateTablet for tablet 134052ab4c784d2c80d4cc8ac4a0327b (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:09.311558 18679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134052ab4c784d2c80d4cc8ac4a0327b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.325556 18756 tablet_service.cc:1511] Processing CreateTablet for tablet 134052ab4c784d2c80d4cc8ac4a0327b (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:09.327275 18756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134052ab4c784d2c80d4cc8ac4a0327b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.329049 18675 tablet_service.cc:1511] Processing CreateTablet for tablet 80421b61d7d7425492333eeda6c4bce0 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:09.330549 18675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80421b61d7d7425492333eeda6c4bce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.327103 18608 tablet_service.cc:1511] Processing CreateTablet for tablet 80421b61d7d7425492333eeda6c4bce0 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:09.333436 18608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80421b61d7d7425492333eeda6c4bce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.333714 18752 tablet_service.cc:1511] Processing CreateTablet for tablet 80421b61d7d7425492333eeda6c4bce0 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:09.335429 18752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80421b61d7d7425492333eeda6c4bce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.334965 18605 tablet_service.cc:1511] Processing CreateTablet for tablet da40fc628bb146e78988110faed9e278 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:09.336550 18605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da40fc628bb146e78988110faed9e278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.351639 18676 tablet_service.cc:1511] Processing CreateTablet for tablet da40fc628bb146e78988110faed9e278 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:09.353404 18676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da40fc628bb146e78988110faed9e278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.366011 18751 tablet_service.cc:1511] Processing CreateTablet for tablet da40fc628bb146e78988110faed9e278 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:09.367866 18751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da40fc628bb146e78988110faed9e278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.390038 18601 tablet_service.cc:1511] Processing CreateTablet for tablet 7443f0ed7a7f4f9c9b221abe0b39e464 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:09.391732 18601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7443f0ed7a7f4f9c9b221abe0b39e464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.412438 18750 tablet_service.cc:1511] Processing CreateTablet for tablet 7443f0ed7a7f4f9c9b221abe0b39e464 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:09.413585 18603 tablet_service.cc:1511] Processing CreateTablet for tablet c037383337a848bca333257360bdbe12 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:09.414775 18750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7443f0ed7a7f4f9c9b221abe0b39e464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.415163 18603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c037383337a848bca333257360bdbe12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.427664 18681 tablet_service.cc:1511] Processing CreateTablet for tablet 7443f0ed7a7f4f9c9b221abe0b39e464 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:09.441068 18757 tablet_service.cc:1511] Processing CreateTablet for tablet c037383337a848bca333257360bdbe12 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:09.442049 18681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7443f0ed7a7f4f9c9b221abe0b39e464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.442512 18917 tablet_bootstrap.cc:492] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:09.447615 18677 tablet_service.cc:1511] Processing CreateTablet for tablet c037383337a848bca333257360bdbe12 (DEFAULT_TABLE table=soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:09.442600 18757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c037383337a848bca333257360bdbe12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.450055 18677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c037383337a848bca333257360bdbe12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.441450 18918 tablet_bootstrap.cc:492] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:09.469288 18917 tablet_bootstrap.cc:654] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.450047 18919 tablet_bootstrap.cc:492] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:09.499322 18918 tablet_bootstrap.cc:654] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.517613 18919 tablet_bootstrap.cc:654] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.527858 18917 tablet_bootstrap.cc:492] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:09.529073 18917 ts_tablet_manager.cc:1403] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.087s	user 0.024s	sys 0.032s
I20260709 13:19:09.533522 18917 raft_consensus.cc:359] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.534533 18917 raft_consensus.cc:385] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.534947 18917 raft_consensus.cc:740] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.535799 18917 consensus_queue.cc:260] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.538229 18917 ts_tablet_manager.cc:1434] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:09.539369 18917 tablet_bootstrap.cc:492] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:09.547526 18917 tablet_bootstrap.cc:654] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.560259 18917 tablet_bootstrap.cc:492] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:09.560833 18917 ts_tablet_manager.cc:1403] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 13:19:09.564028 18917 raft_consensus.cc:359] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.564778 18917 raft_consensus.cc:385] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.565073 18917 raft_consensus.cc:740] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.565825 18917 consensus_queue.cc:260] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.568354 18917 ts_tablet_manager.cc:1434] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:19:09.569576 18917 tablet_bootstrap.cc:492] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:09.577275 18917 tablet_bootstrap.cc:654] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.587903 18919 tablet_bootstrap.cc:492] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:09.588235 18918 tablet_bootstrap.cc:492] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:09.588560 18919 ts_tablet_manager.cc:1403] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.139s	user 0.033s	sys 0.018s
I20260709 13:19:09.588797 18918 ts_tablet_manager.cc:1403] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.148s	user 0.032s	sys 0.049s
I20260709 13:19:09.589677 18917 tablet_bootstrap.cc:492] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:09.590271 18917 ts_tablet_manager.cc:1403] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:19:09.592350 18919 raft_consensus.cc:359] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.592810 18918 raft_consensus.cc:359] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.593566 18919 raft_consensus.cc:385] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.593622 18918 raft_consensus.cc:385] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.594144 18919 raft_consensus.cc:740] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.593578 18917 raft_consensus.cc:359] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.594318 18918 raft_consensus.cc:740] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.594718 18917 raft_consensus.cc:385] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.595108 18917 raft_consensus.cc:740] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.595068 18919 consensus_queue.cc:260] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.595167 18918 consensus_queue.cc:260] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.596331 18917 consensus_queue.cc:260] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.597847 18919 ts_tablet_manager.cc:1434] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:19:09.597847 18918 ts_tablet_manager.cc:1434] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:19:09.598784 18917 ts_tablet_manager.cc:1434] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.004s
I20260709 13:19:09.599269 18919 tablet_bootstrap.cc:492] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:09.599269 18918 tablet_bootstrap.cc:492] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:09.599810 18917 tablet_bootstrap.cc:492] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:09.608767 18919 tablet_bootstrap.cc:654] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.608767 18918 tablet_bootstrap.cc:654] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.609370 18917 tablet_bootstrap.cc:654] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.631335 18917 tablet_bootstrap.cc:492] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:09.631943 18917 ts_tablet_manager.cc:1403] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.017s
I20260709 13:19:09.635361 18917 raft_consensus.cc:359] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.636176 18917 raft_consensus.cc:385] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.636483 18917 raft_consensus.cc:740] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.637264 18917 consensus_queue.cc:260] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.639840 18917 ts_tablet_manager.cc:1434] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:19:09.641037 18917 tablet_bootstrap.cc:492] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:09.642370 18918 tablet_bootstrap.cc:492] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:09.642966 18919 tablet_bootstrap.cc:492] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:09.643965 18919 ts_tablet_manager.cc:1403] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.016s
I20260709 13:19:09.649020 18919 raft_consensus.cc:359] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.650007 18917 tablet_bootstrap.cc:654] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.650784 18918 ts_tablet_manager.cc:1403] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.019s
I20260709 13:19:09.650234 18919 raft_consensus.cc:385] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.655620 18919 raft_consensus.cc:740] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.656199 18918 raft_consensus.cc:359] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.656451 18919 consensus_queue.cc:260] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.657374 18918 raft_consensus.cc:385] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.657850 18918 raft_consensus.cc:740] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.659155 18919 ts_tablet_manager.cc:1434] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:19:09.658875 18918 consensus_queue.cc:260] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.660248 18919 tablet_bootstrap.cc:492] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:09.662348 18918 ts_tablet_manager.cc:1434] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:19:09.664031 18918 tablet_bootstrap.cc:492] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:09.669119 18919 tablet_bootstrap.cc:654] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.682041 18918 tablet_bootstrap.cc:654] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.705188 18918 tablet_bootstrap.cc:492] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:09.706079 18918 ts_tablet_manager.cc:1403] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.010s
I20260709 13:19:09.712225 18918 raft_consensus.cc:359] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.713661 18918 raft_consensus.cc:385] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.714191 18918 raft_consensus.cc:740] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.715418 18918 consensus_queue.cc:260] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.719245 18918 ts_tablet_manager.cc:1434] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:19:09.720713 18918 tablet_bootstrap.cc:492] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:09.732132 18918 tablet_bootstrap.cc:654] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:09.732151 18659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:43579, user_credentials={real_user=slave}} blocked reactor thread for 84616.4us
I20260709 13:19:09.747385 18918 tablet_bootstrap.cc:492] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:09.748955 18918 ts_tablet_manager.cc:1403] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.009s
I20260709 13:19:09.754544 18918 raft_consensus.cc:359] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.755934 18918 raft_consensus.cc:385] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.756417 18918 raft_consensus.cc:740] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
W20260709 13:19:09.757125 18657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:38279, user_credentials={real_user=slave}} blocked reactor thread for 117806us
I20260709 13:19:09.758144 18918 consensus_queue.cc:260] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.762301 18918 ts_tablet_manager.cc:1434] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:19:09.769881 18918 tablet_bootstrap.cc:492] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:09.771924 18917 tablet_bootstrap.cc:492] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:09.772640 18917 ts_tablet_manager.cc:1403] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.132s	user 0.033s	sys 0.038s
I20260709 13:19:09.776779 18919 tablet_bootstrap.cc:492] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:09.776260 18917 raft_consensus.cc:359] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.777429 18919 ts_tablet_manager.cc:1403] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.043s
I20260709 13:19:09.777679 18918 tablet_bootstrap.cc:654] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.777396 18917 raft_consensus.cc:385] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.778935 18917 raft_consensus.cc:740] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.779881 18917 consensus_queue.cc:260] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.780930 18919 raft_consensus.cc:359] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.781698 18919 raft_consensus.cc:385] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.782011 18919 raft_consensus.cc:740] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.782886 18919 consensus_queue.cc:260] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.785444 18919 ts_tablet_manager.cc:1434] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:09.787016 18919 tablet_bootstrap.cc:492] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:09.787082 18923 raft_consensus.cc:493] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.787678 18923 raft_consensus.cc:515] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.791476 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5c754da5fc842779c7f5eaaaf085f56" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:09.792271 18766 raft_consensus.cc:2468] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:09.794374 18584 leader_election.cc:304] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
I20260709 13:19:09.795374 18815 raft_consensus.cc:2804] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:09.795794 18815 raft_consensus.cc:493] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.795781 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5c754da5fc842779c7f5eaaaf085f56" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:09.796461 18815 raft_consensus.cc:3060] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.796959 18692 raft_consensus.cc:2468] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:09.797322 18918 tablet_bootstrap.cc:492] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:09.798187 18918 ts_tablet_manager.cc:1403] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.029s	user 0.025s	sys 0.000s
I20260709 13:19:09.798666 18923 leader_election.cc:290] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:09.801433 18917 ts_tablet_manager.cc:1434] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:19:09.802306 18905 raft_consensus.cc:493] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.802731 18917 tablet_bootstrap.cc:492] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:09.802893 18905 raft_consensus.cc:515] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.801986 18918 raft_consensus.cc:359] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.803787 18918 raft_consensus.cc:385] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.804101 18918 raft_consensus.cc:740] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.804950 18918 consensus_queue.cc:260] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.803272 18919 tablet_bootstrap.cc:654] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.806872 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:09.807690 18617 raft_consensus.cc:2468] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 0.
I20260709 13:19:09.809427 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:09.809729 18731 leader_election.cc:304] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
I20260709 13:19:09.810240 18692 raft_consensus.cc:2468] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 0.
I20260709 13:19:09.810957 18918 ts_tablet_manager.cc:1434] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.006s
I20260709 13:19:09.811050 18905 leader_election.cc:290] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:09.811930 18905 raft_consensus.cc:2804] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:09.812331 18918 tablet_bootstrap.cc:492] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:09.812361 18905 raft_consensus.cc:493] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.814533 18815 raft_consensus.cc:515] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.818208 18815 leader_election.cc:290] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:09.818593 18919 tablet_bootstrap.cc:492] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:09.819232 18919 ts_tablet_manager.cc:1403] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.006s
I20260709 13:19:09.819495 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5c754da5fc842779c7f5eaaaf085f56" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:09.820725 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5c754da5fc842779c7f5eaaaf085f56" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:09.820914 18692 raft_consensus.cc:3060] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.821470 18918 tablet_bootstrap.cc:654] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.821394 18766 raft_consensus.cc:3060] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.823141 18919 raft_consensus.cc:359] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.823951 18919 raft_consensus.cc:385] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.824255 18919 raft_consensus.cc:740] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.826597 18917 tablet_bootstrap.cc:654] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.830574 18919 consensus_queue.cc:260] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.833739 18905 raft_consensus.cc:3060] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.834314 18919 ts_tablet_manager.cc:1434] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:19:09.835533 18919 tablet_bootstrap.cc:492] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:09.847080 18692 raft_consensus.cc:2468] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:09.848904 18919 tablet_bootstrap.cc:654] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.849551 18583 leader_election.cc:304] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:09.851018 18815 raft_consensus.cc:2804] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:09.851724 18815 raft_consensus.cc:697] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:09.852905 18815 consensus_queue.cc:237] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.863714 18918 tablet_bootstrap.cc:492] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:09.864564 18918 ts_tablet_manager.cc:1403] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.052s	user 0.031s	sys 0.018s
I20260709 13:19:09.864359 18766 raft_consensus.cc:2468] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:09.868464 18918 raft_consensus.cc:359] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.873569 18515 catalog_manager.cc:5697] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.875533 18918 raft_consensus.cc:385] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:09.875770 18731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.129:38279, user_credentials={real_user=slave}} blocked reactor thread for 66132.5us
I20260709 13:19:09.875998 18918 raft_consensus.cc:740] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.877583 18918 consensus_queue.cc:260] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.880767 18918 ts_tablet_manager.cc:1434] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 13:19:09.882923 18918 tablet_bootstrap.cc:492] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:09.893812 18918 tablet_bootstrap.cc:654] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.909081 18918 tablet_bootstrap.cc:492] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:09.909953 18918 ts_tablet_manager.cc:1403] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.010s
I20260709 13:19:09.910737 18938 raft_consensus.cc:493] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.913213 18938 raft_consensus.cc:515] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.914669 18917 tablet_bootstrap.cc:492] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:09.908756 18905 raft_consensus.cc:515] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.914386 18918 raft_consensus.cc:359] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.915306 18917 ts_tablet_manager.cc:1403] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.113s	user 0.037s	sys 0.017s
I20260709 13:19:09.915709 18918 raft_consensus.cc:385] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.916193 18918 raft_consensus.cc:740] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.917265 18918 consensus_queue.cc:260] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.917979 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134052ab4c784d2c80d4cc8ac4a0327b" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:09.919699 18917 raft_consensus.cc:359] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.920511 18918 ts_tablet_manager.cc:1434] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.005s
I20260709 13:19:09.920606 18917 raft_consensus.cc:385] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.921098 18917 raft_consensus.cc:740] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.921927 18917 consensus_queue.cc:260] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
W20260709 13:19:09.921258 18731 leader_election.cc:343] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.922957 18918 tablet_bootstrap.cc:492] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:09.930800 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134052ab4c784d2c80d4cc8ac4a0327b" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:09.931582 18918 tablet_bootstrap.cc:654] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.931670 18692 raft_consensus.cc:2468] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 0.
I20260709 13:19:09.932677 18938 leader_election.cc:290] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:09.933332 18732 leader_election.cc:304] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:09.938527 18815 raft_consensus.cc:493] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.939095 18815 raft_consensus.cc:515] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.945902 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44f66e94944906afeadbd6bacc0851" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:09.946597 18918 tablet_bootstrap.cc:492] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:09.946870 18692 raft_consensus.cc:2468] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:09.947202 18918 ts_tablet_manager.cc:1403] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.006s
W20260709 13:19:09.937041 18564 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:09.952656 18583 leader_election.cc:304] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:09.954155 18923 raft_consensus.cc:2804] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:09.954741 18923 raft_consensus.cc:493] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.955192 18923 raft_consensus.cc:3060] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.951272 18918 raft_consensus.cc:359] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.958562 18918 raft_consensus.cc:385] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.958909 18918 raft_consensus.cc:740] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.961169 18938 raft_consensus.cc:493] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.951655 18815 leader_election.cc:290] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:09.962250 18938 raft_consensus.cc:515] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.965520 18938 leader_election.cc:290] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:09.966295 18938 raft_consensus.cc:2804] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:09.981616 18938 raft_consensus.cc:493] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.982065 18938 raft_consensus.cc:3060] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.972409 18918 consensus_queue.cc:260] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.937809 18905 leader_election.cc:290] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:09.977844 18919 tablet_bootstrap.cc:492] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:09.983877 18919 ts_tablet_manager.cc:1403] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.149s	user 0.042s	sys 0.037s
I20260709 13:19:09.987115 18919 raft_consensus.cc:359] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.987855 18919 raft_consensus.cc:385] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.988152 18919 raft_consensus.cc:740] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.991199 18923 raft_consensus.cc:515] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.992182 18918 ts_tablet_manager.cc:1434] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:19:09.993462 18923 leader_election.cc:290] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:09.994269 18919 consensus_queue.cc:260] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:09.995462 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44f66e94944906afeadbd6bacc0851" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:09.996174 18692 raft_consensus.cc:3060] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.996352 18918 tablet_bootstrap.cc:492] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b: Bootstrap starting.
I20260709 13:19:09.997193 18919 ts_tablet_manager.cc:1434] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:19:09.998339 18919 tablet_bootstrap.cc:492] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
W20260709 13:19:09.999845 18732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.130:38479, user_credentials={real_user=slave}} blocked reactor thread for 66615.9us
I20260709 13:19:10.005759 18692 raft_consensus.cc:2468] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:10.006732 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:10.007179 18583 leader_election.cc:304] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:10.007478 18693 raft_consensus.cc:3060] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.007735 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44f66e94944906afeadbd6bacc0851" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:10.008191 18923 raft_consensus.cc:2804] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.008989 18923 raft_consensus.cc:697] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:10.007081 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdaa707ac9c34059b57bd6cc1ddb0850" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:10.010123 18691 raft_consensus.cc:2468] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 0.
I20260709 13:19:10.010164 18923 consensus_queue.cc:237] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.022470 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:10.023605 18617 raft_consensus.cc:3060] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.017997 18693 raft_consensus.cc:2468] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 1.
I20260709 13:19:09.998335 18917 ts_tablet_manager.cc:1434] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.010s
I20260709 13:19:10.032884 18917 tablet_bootstrap.cc:492] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:10.044361 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44f66e94944906afeadbd6bacc0851" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
W20260709 13:19:10.047178 18584 leader_election.cc:343] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.048527 18616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdaa707ac9c34059b57bd6cc1ddb0850" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
W20260709 13:19:10.048799 18584 leader_election.cc:343] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.050099 18917 tablet_bootstrap.cc:654] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.051550 18945 raft_consensus.cc:493] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.039903 18938 raft_consensus.cc:515] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.052129 18919 tablet_bootstrap.cc:654] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.052110 18945 raft_consensus.cc:515] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.053395 18617 raft_consensus.cc:2468] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 1.
I20260709 13:19:10.054744 18945 leader_election.cc:290] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:10.054087 18732 leader_election.cc:304] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:10.056704 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:10.058007 18945 raft_consensus.cc:2804] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.056947 18732 leader_election.cc:304] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:10.058558 18945 raft_consensus.cc:493] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.058346 18938 leader_election.cc:290] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:10.059175 18945 raft_consensus.cc:3060] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:10.057588 18731 leader_election.cc:343] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.061278 18947 raft_consensus.cc:2804] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:10.061197 18731 leader_election.cc:343] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.062357 18947 raft_consensus.cc:697] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:10.063597 18947 consensus_queue.cc:237] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.066089 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134052ab4c784d2c80d4cc8ac4a0327b" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:10.064390 18918 tablet_bootstrap.cc:654] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.066795 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:10.069424 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134052ab4c784d2c80d4cc8ac4a0327b" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:10.070262 18693 raft_consensus.cc:2468] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 0.
I20260709 13:19:10.070727 18692 raft_consensus.cc:3060] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:10.074746 18731 leader_election.cc:343] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.089039 18692 raft_consensus.cc:2468] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 1.
I20260709 13:19:10.085047 18732 leader_election.cc:304] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:10.094904 18514 catalog_manager.cc:5697] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 0 to 1, leader changed from <none> to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 1 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.099852 18947 raft_consensus.cc:2804] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.100554 18947 raft_consensus.cc:493] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.101015 18947 raft_consensus.cc:3060] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.102322 18923 raft_consensus.cc:493] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.103149 18923 raft_consensus.cc:515] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.104877 18732 leader_election.cc:304] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:10.106580 18938 raft_consensus.cc:2804] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.107126 18938 raft_consensus.cc:697] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:10.108003 18938 consensus_queue.cc:237] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.108165 18923 leader_election.cc:290] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.109292 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80421b61d7d7425492333eeda6c4bce0" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:10.109818 18692 raft_consensus.cc:2468] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:10.115121 18583 leader_election.cc:304] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:10.112270 18919 tablet_bootstrap.cc:492] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:10.120447 18919 ts_tablet_manager.cc:1403] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.000s
I20260709 13:19:10.120774 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80421b61d7d7425492333eeda6c4bce0" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:10.121620 18767 raft_consensus.cc:2468] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:10.123018 18917 tablet_bootstrap.cc:492] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:10.119692 18815 raft_consensus.cc:2804] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.123667 18815 raft_consensus.cc:493] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.123804 18917 ts_tablet_manager.cc:1403] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.029s
I20260709 13:19:10.124107 18815 raft_consensus.cc:3060] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.124255 18919 raft_consensus.cc:359] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.125142 18919 raft_consensus.cc:385] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.125442 18919 raft_consensus.cc:740] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.127390 18917 raft_consensus.cc:359] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.128273 18917 raft_consensus.cc:385] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.128685 18917 raft_consensus.cc:740] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.137140 18918 tablet_bootstrap.cc:492] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b: No bootstrap required, opened a new log
I20260709 13:19:10.143242 18918 ts_tablet_manager.cc:1403] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent bootstrapping tablet: real 0.147s	user 0.018s	sys 0.010s
I20260709 13:19:10.126256 18919 consensus_queue.cc:260] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.139317 18947 raft_consensus.cc:515] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.147687 18815 raft_consensus.cc:515] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.150444 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
W20260709 13:19:10.152881 18731 leader_election.cc:343] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.137063 18945 raft_consensus.cc:515] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.153692 18923 raft_consensus.cc:493] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.154299 18923 raft_consensus.cc:515] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.154544 18919 ts_tablet_manager.cc:1434] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:19:10.155808 18945 leader_election.cc:290] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:10.156551 18923 leader_election.cc:290] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.157101 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdaa707ac9c34059b57bd6cc1ddb0850" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:10.157178 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134052ab4c784d2c80d4cc8ac4a0327b" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:10.157832 18692 raft_consensus.cc:3060] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.158141 18693 raft_consensus.cc:2393] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4f8b938d317462dad5c7a368ad661c4 in current term 1: Already voted for candidate 670ea2028d3c4fb8960a99604387fcdc in this term.
I20260709 13:19:10.158257 18947 leader_election.cc:290] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:10.139642 18917 consensus_queue.cc:260] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.160964 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134052ab4c784d2c80d4cc8ac4a0327b" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:10.157624 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdaa707ac9c34059b57bd6cc1ddb0850" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:10.167701 18584 leader_election.cc:304] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4; no voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:10.168577 18692 raft_consensus.cc:2468] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 1.
I20260709 13:19:10.170846 18918 raft_consensus.cc:359] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.171607 18918 raft_consensus.cc:385] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.163868 18919 tablet_bootstrap.cc:492] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:10.171901 18918 raft_consensus.cc:740] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.172214 18923 raft_consensus.cc:3060] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.172811 18918 consensus_queue.cc:260] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.175580 18918 ts_tablet_manager.cc:1434] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:19:10.178300 18919 tablet_bootstrap.cc:654] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.179140 18732 leader_election.cc:304] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
W20260709 13:19:10.180419 18731 leader_election.cc:343] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.180951 18947 raft_consensus.cc:2804] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.181519 18947 raft_consensus.cc:697] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:10.171744 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:10.182391 18947 consensus_queue.cc:237] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.183400 18693 raft_consensus.cc:3060] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.188429 18515 catalog_manager.cc:5697] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.164512 18917 ts_tablet_manager.cc:1434] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.008s
I20260709 13:19:10.195151 18815 leader_election.cc:290] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.195982 18917 tablet_bootstrap.cc:492] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:10.195781 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80421b61d7d7425492333eeda6c4bce0" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:10.196520 18767 raft_consensus.cc:3060] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.200621 18919 tablet_bootstrap.cc:492] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:10.201320 18919 ts_tablet_manager.cc:1403] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.008s
I20260709 13:19:10.204134 18917 tablet_bootstrap.cc:654] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.205219 18767 raft_consensus.cc:2468] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:10.206549 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80421b61d7d7425492333eeda6c4bce0" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:10.207402 18692 raft_consensus.cc:3060] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.206578 18584 leader_election.cc:304] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
I20260709 13:19:10.212894 18815 raft_consensus.cc:2804] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.213985 18923 raft_consensus.cc:2749] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.205031 18919 raft_consensus.cc:359] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.215325 18919 raft_consensus.cc:385] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.215906 18919 raft_consensus.cc:740] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.217257 18919 consensus_queue.cc:260] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.211248 18693 raft_consensus.cc:2468] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 1.
I20260709 13:19:10.224995 18923 raft_consensus.cc:493] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.221248 18514 catalog_manager.cc:5697] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 0 to 1, leader changed from <none> to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 1 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.225966 18923 raft_consensus.cc:515] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.225178 18732 leader_election.cc:304] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:10.230110 18923 leader_election.cc:290] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.231890 18947 raft_consensus.cc:2804] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.232496 18947 raft_consensus.cc:697] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:10.234524 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da40fc628bb146e78988110faed9e278" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:10.231213 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da40fc628bb146e78988110faed9e278" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
W20260709 13:19:10.237782 18584 leader_election.cc:343] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.237897 18691 raft_consensus.cc:2468] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 0.
I20260709 13:19:10.239567 18583 leader_election.cc:304] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 670ea2028d3c4fb8960a99604387fcdc
I20260709 13:19:10.233395 18947 consensus_queue.cc:237] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.226235 18692 raft_consensus.cc:2468] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:10.250442 18815 raft_consensus.cc:697] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:10.250916 18923 raft_consensus.cc:2804] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.255388 18815 consensus_queue.cc:237] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.256009 18923 raft_consensus.cc:493] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.256393 18923 raft_consensus.cc:3060] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.262014 18919 ts_tablet_manager.cc:1434] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.060s	user 0.018s	sys 0.014s
I20260709 13:19:10.259254 18962 consensus_queue.cc:1048] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:19:10.277132 18514 catalog_manager.cc:5697] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 0 to 1, leader changed from <none> to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 1 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.280650 18514 catalog_manager.cc:5697] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 0 to 1, leader changed from <none> to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 1 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.284394 18919 tablet_bootstrap.cc:492] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:10.288380 18923 raft_consensus.cc:515] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.300880 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da40fc628bb146e78988110faed9e278" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:10.300899 18917 tablet_bootstrap.cc:492] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:10.303112 18917 ts_tablet_manager.cc:1403] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.107s	user 0.022s	sys 0.047s
I20260709 13:19:10.302911 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da40fc628bb146e78988110faed9e278" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:10.301569 18692 raft_consensus.cc:3060] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:10.306244 18584 leader_election.cc:343] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.308276 18903 raft_consensus.cc:493] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.308944 18903 raft_consensus.cc:515] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.309952 18917 raft_consensus.cc:359] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.315145 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c037383337a848bca333257360bdbe12" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:10.314239 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c037383337a848bca333257360bdbe12" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:10.315339 18917 raft_consensus.cc:385] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.316077 18917 raft_consensus.cc:740] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.316277 18692 raft_consensus.cc:2468] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 1.
I20260709 13:19:10.316551 18923 leader_election.cc:290] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
W20260709 13:19:10.317337 18657 leader_election.cc:343] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.317163 18917 consensus_queue.cc:260] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.317598 18583 leader_election.cc:304] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 670ea2028d3c4fb8960a99604387fcdc
I20260709 13:19:10.311461 18903 leader_election.cc:290] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.318359 18767 raft_consensus.cc:2468] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 0.
I20260709 13:19:10.319018 18515 catalog_manager.cc:5697] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.322683 18659 leader_election.cc:304] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:10.323627 18903 raft_consensus.cc:2804] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.324019 18903 raft_consensus.cc:493] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.324401 18903 raft_consensus.cc:3060] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.320506 18923 raft_consensus.cc:2804] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.331555 18923 raft_consensus.cc:697] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:10.314965 18919 tablet_bootstrap.cc:654] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.332517 18923 consensus_queue.cc:237] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.337867 18917 ts_tablet_manager.cc:1434] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 13:19:10.339068 18917 tablet_bootstrap.cc:492] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc: Bootstrap starting.
I20260709 13:19:10.340251 18903 raft_consensus.cc:515] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.347839 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c037383337a848bca333257360bdbe12" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
W20260709 13:19:10.350339 18657 leader_election.cc:343] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.353739 18917 tablet_bootstrap.cc:654] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.355700 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c037383337a848bca333257360bdbe12" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:10.356706 18767 raft_consensus.cc:3060] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.361347 18919 tablet_bootstrap.cc:492] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:10.361166 18923 consensus_queue.cc:1048] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.362076 18919 ts_tablet_manager.cc:1403] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.019s
I20260709 13:19:10.366973 18919 raft_consensus.cc:359] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.368008 18919 raft_consensus.cc:385] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.368072 18767 raft_consensus.cc:2468] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 1.
I20260709 13:19:10.368364 18919 raft_consensus.cc:740] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.369292 18919 consensus_queue.cc:260] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.369788 18659 leader_election.cc:304] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:10.368021 18903 leader_election.cc:290] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 1 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.370999 18929 raft_consensus.cc:2804] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.362000 18514 catalog_manager.cc:5697] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.373368 18919 ts_tablet_manager.cc:1434] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:19:10.379213 18919 tablet_bootstrap.cc:492] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4: Bootstrap starting.
I20260709 13:19:10.383489 18929 raft_consensus.cc:697] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Becoming Leader. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:10.385156 18929 consensus_queue.cc:237] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.387594 18919 tablet_bootstrap.cc:654] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.405810 18917 tablet_bootstrap.cc:492] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc: No bootstrap required, opened a new log
I20260709 13:19:10.407080 18917 ts_tablet_manager.cc:1403] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc: Time spent bootstrapping tablet: real 0.068s	user 0.022s	sys 0.026s
I20260709 13:19:10.411409 18917 raft_consensus.cc:359] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.413429 18917 raft_consensus.cc:385] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.412344 18515 catalog_manager.cc:5697] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130). New cstate: current_term: 1 leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.413816 18917 raft_consensus.cc:740] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.414834 18917 consensus_queue.cc:260] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.415683 18919 tablet_bootstrap.cc:492] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4: No bootstrap required, opened a new log
I20260709 13:19:10.416599 18919 ts_tablet_manager.cc:1403] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4: Time spent bootstrapping tablet: real 0.038s	user 0.032s	sys 0.004s
I20260709 13:19:10.417359 18917 ts_tablet_manager.cc:1434] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:19:10.420635 18947 raft_consensus.cc:493] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.421202 18947 raft_consensus.cc:515] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.420418 18919 raft_consensus.cc:359] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.423383 18947 leader_election.cc:290] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:10.423478 18919 raft_consensus.cc:385] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.425076 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44f66e94944906afeadbd6bacc0851" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:10.427011 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44f66e94944906afeadbd6bacc0851" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:10.429042 18693 raft_consensus.cc:2393] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 670ea2028d3c4fb8960a99604387fcdc in current term 1: Already voted for candidate e4f8b938d317462dad5c7a368ad661c4 in this term.
I20260709 13:19:10.430294 18732 leader_election.cc:304] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc; no voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:10.431330 18919 raft_consensus.cc:740] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.432026 18945 raft_consensus.cc:3060] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.432292 18919 consensus_queue.cc:260] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.436146 18919 ts_tablet_manager.cc:1434] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.005s
I20260709 13:19:10.447077 18947 raft_consensus.cc:493] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.447741 18947 raft_consensus.cc:515] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.447484 18945 raft_consensus.cc:2749] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.454954 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da40fc628bb146e78988110faed9e278" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:10.452898 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da40fc628bb146e78988110faed9e278" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4f8b938d317462dad5c7a368ad661c4" is_pre_election: true
I20260709 13:19:10.455924 18693 raft_consensus.cc:2393] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 670ea2028d3c4fb8960a99604387fcdc in current term 1: Already voted for candidate e4f8b938d317462dad5c7a368ad661c4 in this term.
I20260709 13:19:10.457368 18731 leader_election.cc:304] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc; no voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:10.452217 18947 leader_election.cc:290] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:10.452500 18766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdaa707ac9c34059b57bd6cc1ddb0850"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
mode: GRACEFUL
new_leader_uuid: "e4f8b938d317462dad5c7a368ad661c4"
 from {username='slave'} at 127.0.0.1:37070
I20260709 13:19:10.459878 18766 raft_consensus.cc:606] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Received request to transfer leadership to TS e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:10.459933 18923 consensus_queue.cc:1048] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:10.460637 18947 raft_consensus.cc:3060] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.473786 18815 consensus_queue.cc:1048] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.480626 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
mode: GRACEFUL
new_leader_uuid: "e4f8b938d317462dad5c7a368ad661c4"
 from {username='slave'} at 127.0.0.1:37070
I20260709 13:19:10.481274 18767 raft_consensus.cc:606] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Received request to transfer leadership to TS e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:10.484593 18947 raft_consensus.cc:2749] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.489629 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "134052ab4c784d2c80d4cc8ac4a0327b"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
mode: GRACEFUL
new_leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:37070
I20260709 13:19:10.490360 18767 raft_consensus.cc:606] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Received request to transfer leadership to TS e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:10.496642 18615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80421b61d7d7425492333eeda6c4bce0"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
mode: GRACEFUL
new_leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:38860
I20260709 13:19:10.497231 18615 raft_consensus.cc:606] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Received request to transfer leadership to TS e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:10.504258 18615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da40fc628bb146e78988110faed9e278"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
mode: GRACEFUL
new_leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:38860
I20260709 13:19:10.504873 18615 raft_consensus.cc:606] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Received request to transfer leadership to TS e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:10.511619 18767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
mode: GRACEFUL
new_leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:37070
I20260709 13:19:10.512694 18767 raft_consensus.cc:606] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Received request to transfer leadership to TS e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:10.512774 18815 raft_consensus.cc:493] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.513360 18815 raft_consensus.cc:515] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.515686 18815 leader_election.cc:290] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.516635 18693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdaa707ac9c34059b57bd6cc1ddb0850" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:10.517840 18693 raft_consensus.cc:2393] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4f8b938d317462dad5c7a368ad661c4 in current term 1: Already voted for candidate 670ea2028d3c4fb8960a99604387fcdc in this term.
I20260709 13:19:10.518308 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdaa707ac9c34059b57bd6cc1ddb0850" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:10.519940 18584 leader_election.cc:304] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4; no voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:10.520951 18815 raft_consensus.cc:3060] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.534089 18815 raft_consensus.cc:2749] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.539585 18693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c037383337a848bca333257360bdbe12"
dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
mode: GRACEFUL
new_leader_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:40374
I20260709 13:19:10.540524 18693 raft_consensus.cc:606] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Received request to transfer leadership to TS 670ea2028d3c4fb8960a99604387fcdc
I20260709 13:19:10.552963 18947 consensus_queue.cc:1048] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:10.566105 18945 consensus_queue.cc:1048] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:10.570257 18945 consensus_queue.cc:1048] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.578382 18945 consensus_queue.cc:1048] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.581533 18947 raft_consensus.cc:993] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc: : Instructing follower e4f8b938d317462dad5c7a368ad661c4 to start an election
I20260709 13:19:10.581980 18938 raft_consensus.cc:993] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc: : Instructing follower e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:10.582515 18938 raft_consensus.cc:1081] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Signalling peer e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:10.582033 18947 raft_consensus.cc:1081] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Signalling peer e4f8b938d317462dad5c7a368ad661c4 to start an election
I20260709 13:19:10.584864 18693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "134052ab4c784d2c80d4cc8ac4a0327b"
dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:40372
I20260709 13:19:10.585701 18693 raft_consensus.cc:493] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:10.589452 18693 raft_consensus.cc:3060] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.590857 18617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:19:10.591856 18617 raft_consensus.cc:493] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:10.592406 18617 raft_consensus.cc:3060] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.597477 18949 consensus_queue.cc:1048] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.605831 18617 raft_consensus.cc:515] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.606590 18949 raft_consensus.cc:993] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc: : Instructing follower e4f8b938d317462dad5c7a368ad661c4 to start an election
I20260709 13:19:10.607386 18947 raft_consensus.cc:1081] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Signalling peer e4f8b938d317462dad5c7a368ad661c4 to start an election
I20260709 13:19:10.609627 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:10.608956 18617 leader_election.cc:290] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.610357 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:10.610307 18766 raft_consensus.cc:3055] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:10.623059 18766 raft_consensus.cc:740] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:10.616510 18938 consensus_queue.cc:1048] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:19:10.624518 18766 consensus_queue.cc:260] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.624996 18691 raft_consensus.cc:3060] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.625777 18615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdaa707ac9c34059b57bd6cc1ddb0850"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:19:10.626405 18615 raft_consensus.cc:493] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:10.626820 18615 raft_consensus.cc:3060] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.611178 18693 raft_consensus.cc:515] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.630918 18692 raft_consensus.cc:1240] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Rejecting Update request from peer 670ea2028d3c4fb8960a99604387fcdc for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:10.631934 18766 raft_consensus.cc:3060] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.632232 18693 leader_election.cc:290] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.635243 18938 consensus_queue.cc:1059] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:10.635568 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134052ab4c784d2c80d4cc8ac4a0327b" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:10.636114 18938 raft_consensus.cc:3055] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:10.636518 18938 raft_consensus.cc:740] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:10.637482 18938 consensus_queue.cc:260] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.638322 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134052ab4c784d2c80d4cc8ac4a0327b" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:10.638971 18938 raft_consensus.cc:3060] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.639199 18691 raft_consensus.cc:2468] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 2.
I20260709 13:19:10.640756 18583 leader_election.cc:304] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:10.641592 18815 raft_consensus.cc:2804] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:10.639020 18617 raft_consensus.cc:3060] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.642307 18815 raft_consensus.cc:697] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:10.643170 18815 consensus_queue.cc:237] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.644531 18963 consensus_queue.cc:1048] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.643671 18615 raft_consensus.cc:515] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.650614 18615 leader_election.cc:290] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 election: Requested vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.648015 18766 raft_consensus.cc:2468] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 2.
I20260709 13:19:10.650650 18618 raft_consensus.cc:1240] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Rejecting Update request from peer 670ea2028d3c4fb8960a99604387fcdc for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:10.655596 18947 consensus_queue.cc:1059] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:10.655227 18515 catalog_manager.cc:5697] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 1 to 2, leader changed from 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131) to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.656924 18947 raft_consensus.cc:3055] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:10.657305 18947 raft_consensus.cc:740] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:10.658921 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdaa707ac9c34059b57bd6cc1ddb0850" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:10.660750 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdaa707ac9c34059b57bd6cc1ddb0850" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:10.660892 18947 consensus_queue.cc:260] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.662298 18947 raft_consensus.cc:3060] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.660749 18617 raft_consensus.cc:2468] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 2.
I20260709 13:19:10.667171 18657 leader_election.cc:304] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:10.668788 18929 raft_consensus.cc:2804] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:10.669306 18929 raft_consensus.cc:697] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Becoming Leader. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:10.670145 18929 consensus_queue.cc:237] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.670805 18767 raft_consensus.cc:2468] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 2.
I20260709 13:19:10.690878 18766 raft_consensus.cc:2468] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4f8b938d317462dad5c7a368ad661c4 in term 2.
I20260709 13:19:10.693090 18584 leader_election.cc:304] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:10.695127 18962 raft_consensus.cc:2804] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:10.695706 18962 raft_consensus.cc:697] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Becoming Leader. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:10.696623 18962 consensus_queue.cc:237] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.698956 18815 consensus_queue.cc:1048] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.698726 18515 catalog_manager.cc:5697] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b reported cstate change: term changed from 1 to 2, leader changed from 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131) to e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130). New cstate: current_term: 2 leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.709658 18962 raft_consensus.cc:993] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4: : Instructing follower e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:10.710197 18962 raft_consensus.cc:1081] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Signalling peer e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:10.712849 18690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80421b61d7d7425492333eeda6c4bce0"
dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:40368
I20260709 13:19:10.713465 18690 raft_consensus.cc:493] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:10.714071 18690 raft_consensus.cc:3060] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.713188 18512 catalog_manager.cc:5697] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 reported cstate change: term changed from 1 to 2, leader changed from 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131) to e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "e4f8b938d317462dad5c7a368ad661c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.721293 18690 raft_consensus.cc:515] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.723567 18690 leader_election.cc:290] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.724659 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80421b61d7d7425492333eeda6c4bce0" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:10.725339 18617 raft_consensus.cc:3055] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:10.725703 18617 raft_consensus.cc:740] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:10.725737 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80421b61d7d7425492333eeda6c4bce0" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:10.726395 18766 raft_consensus.cc:3060] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.726683 18617 consensus_queue.cc:260] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.728199 18617 raft_consensus.cc:3060] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.733326 18766 raft_consensus.cc:2468] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 2.
I20260709 13:19:10.734833 18659 leader_election.cc:304] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:10.735744 18929 raft_consensus.cc:2804] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:10.736223 18929 raft_consensus.cc:697] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Becoming Leader. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:10.737383 18617 raft_consensus.cc:2468] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 2.
I20260709 13:19:10.737104 18929 consensus_queue.cc:237] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.737425 18962 consensus_queue.cc:1048] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.746320 18512 catalog_manager.cc:5697] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b reported cstate change: term changed from 1 to 2, leader changed from e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129) to e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130). New cstate: current_term: 2 leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.749480 18963 consensus_queue.cc:1048] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:10.760870 18815 raft_consensus.cc:993] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4: : Instructing follower e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:10.761386 18963 raft_consensus.cc:1081] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Signalling peer e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:10.763872 18690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da40fc628bb146e78988110faed9e278"
dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:40368
I20260709 13:19:10.764744 18690 raft_consensus.cc:493] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:10.765192 18690 raft_consensus.cc:3060] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.773651 18690 raft_consensus.cc:515] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.776146 18690 leader_election.cc:290] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.776846 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da40fc628bb146e78988110faed9e278" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:10.777113 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da40fc628bb146e78988110faed9e278" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:10.777566 18617 raft_consensus.cc:3055] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:10.777648 18766 raft_consensus.cc:3060] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.777896 18947 consensus_queue.cc:1048] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:10.778738 18617 raft_consensus.cc:740] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:10.779762 18617 consensus_queue.cc:260] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.781078 18617 raft_consensus.cc:3060] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.785148 18766 raft_consensus.cc:2468] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 2.
I20260709 13:19:10.786571 18659 leader_election.cc:304] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:10.787565 18929 raft_consensus.cc:2804] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:10.787887 18963 raft_consensus.cc:493] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.788203 18929 raft_consensus.cc:697] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Becoming Leader. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:10.788586 18963 raft_consensus.cc:515] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.789331 18929 consensus_queue.cc:237] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.791849 18938 raft_consensus.cc:993] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc: : Instructing follower e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:10.792403 18938 raft_consensus.cc:1081] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Signalling peer e8b1c25cf3f84ea58304a6e112ff539b to start an election
I20260709 13:19:10.793447 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c037383337a848bca333257360bdbe12" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:10.794337 18766 raft_consensus.cc:2393] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4f8b938d317462dad5c7a368ad661c4 in current term 1: Already voted for candidate e8b1c25cf3f84ea58304a6e112ff539b in this term.
I20260709 13:19:10.794128 18690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464"
dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
 from {username='slave'} at 127.0.0.1:40372
I20260709 13:19:10.794895 18690 raft_consensus.cc:493] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:10.795279 18690 raft_consensus.cc:3060] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.796944 18617 raft_consensus.cc:2468] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 2.
I20260709 13:19:10.799580 18618 raft_consensus.cc:3060] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.802933 18963 leader_election.cc:290] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.804566 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c037383337a848bca333257360bdbe12" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:10.806504 18690 raft_consensus.cc:515] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.808801 18690 leader_election.cc:290] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.809650 18615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:10.809929 18583 leader_election.cc:304] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4; no voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:10.811559 18962 raft_consensus.cc:3060] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.812004 18691 raft_consensus.cc:1240] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Rejecting Update request from peer 670ea2028d3c4fb8960a99604387fcdc for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:10.814191 18947 consensus_queue.cc:1059] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:10.811177 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464" candidate_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
I20260709 13:19:10.814944 18945 raft_consensus.cc:3055] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:10.815306 18945 raft_consensus.cc:740] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:10.816221 18945 consensus_queue.cc:260] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.817081 18947 consensus_queue.cc:1048] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:10.818281 18945 raft_consensus.cc:3060] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.818478 18512 catalog_manager.cc:5697] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b reported cstate change: term changed from 1 to 2, leader changed from e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129) to e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130). New cstate: current_term: 2 leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.822033 18962 raft_consensus.cc:2749] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.830505 18766 raft_consensus.cc:2468] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8b1c25cf3f84ea58304a6e112ff539b in term 2.
I20260709 13:19:10.832176 18659 leader_election.cc:304] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: e4f8b938d317462dad5c7a368ad661c4
I20260709 13:19:10.832984 18929 raft_consensus.cc:2804] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:10.833434 18929 raft_consensus.cc:697] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Becoming Leader. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:10.834086 18929 consensus_queue.cc:237] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.841980 18512 catalog_manager.cc:5697] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b reported cstate change: term changed from 1 to 2, leader changed from 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131) to e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130). New cstate: current_term: 2 leader_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.868582 18962 raft_consensus.cc:493] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.869113 18962 raft_consensus.cc:515] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.870963 18962 leader_election.cc:290] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479), 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579)
I20260709 13:19:10.872036 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670ea2028d3c4fb8960a99604387fcdc" is_pre_election: true
I20260709 13:19:10.872088 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464" candidate_uuid: "e4f8b938d317462dad5c7a368ad661c4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" is_pre_election: true
I20260709 13:19:10.872797 18766 raft_consensus.cc:2393] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4f8b938d317462dad5c7a368ad661c4 in current term 2: Already voted for candidate e8b1c25cf3f84ea58304a6e112ff539b in this term.
I20260709 13:19:10.874265 18584 leader_election.cc:304] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4f8b938d317462dad5c7a368ad661c4; no voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b
I20260709 13:19:10.875041 18962 raft_consensus.cc:3060] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.880246 18962 raft_consensus.cc:2749] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:10.889420 18929 consensus_queue.cc:1048] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:10.896375 18975 raft_consensus.cc:993] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b: : Instructing follower 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:10.896883 18903 raft_consensus.cc:1081] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Signalling peer 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:10.899195 18765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c037383337a848bca333257360bdbe12"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:37060
I20260709 13:19:10.902987 18765 raft_consensus.cc:493] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:10.903450 18765 raft_consensus.cc:3060] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.904378 18929 consensus_queue.cc:1048] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.913823 18765 raft_consensus.cc:515] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.918933 18765 leader_election.cc:290] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 2 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:10.920120 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c037383337a848bca333257360bdbe12" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:10.920378 18618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c037383337a848bca333257360bdbe12" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:10.920789 18691 raft_consensus.cc:3055] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:10.921100 18618 raft_consensus.cc:3060] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.921216 18691 raft_consensus.cc:740] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:10.922267 18691 consensus_queue.cc:260] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.923580 18691 raft_consensus.cc:3060] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.930437 18618 raft_consensus.cc:2468] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 2.
I20260709 13:19:10.930521 18691 raft_consensus.cc:2468] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 2.
I20260709 13:19:10.932111 18731 leader_election.cc:304] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
I20260709 13:19:10.932896 18945 raft_consensus.cc:2804] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:10.933547 18945 raft_consensus.cc:697] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 2 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:10.934509 18945 consensus_queue.cc:237] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:10.942449 18515 catalog_manager.cc:5697] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 1 to 2, leader changed from e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130) to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 2 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.057281 18766 raft_consensus.cc:1275] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Refusing update from remote peer e4f8b938d317462dad5c7a368ad661c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.058902 18963 consensus_queue.cc:1048] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:11.071134 18691 raft_consensus.cc:1275] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Refusing update from remote peer e4f8b938d317462dad5c7a368ad661c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.072883 18962 consensus_queue.cc:1048] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:11.077032 18766 raft_consensus.cc:1275] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Refusing update from remote peer e4f8b938d317462dad5c7a368ad661c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.079180 18815 consensus_queue.cc:1048] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:11.093171 18691 raft_consensus.cc:3060] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:11.101194 18691 raft_consensus.cc:1275] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Refusing update from remote peer e4f8b938d317462dad5c7a368ad661c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.102607 18962 consensus_queue.cc:1048] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:11.137630 18618 raft_consensus.cc:1275] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.139499 18975 consensus_queue.cc:1048] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:11.153177 18765 raft_consensus.cc:1275] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.154989 18975 consensus_queue.cc:1048] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:11.156788 18618 raft_consensus.cc:1275] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.159210 18975 consensus_queue.cc:1048] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:19:11.173367 18766 raft_consensus.cc:1275] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.178759 18975 consensus_queue.cc:1048] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:11.195829 18765 raft_consensus.cc:1275] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.197453 18975 consensus_queue.cc:1048] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:11.206372 18618 raft_consensus.cc:1275] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.208348 18929 consensus_queue.cc:1048] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:11.252712 18765 raft_consensus.cc:1275] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.254354 18929 consensus_queue.cc:1048] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:11.266680 18618 raft_consensus.cc:1275] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Refusing update from remote peer e8b1c25cf3f84ea58304a6e112ff539b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.268707 18903 consensus_queue.cc:1048] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:11.392987 18618 raft_consensus.cc:1275] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.394361 18945 consensus_queue.cc:1048] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:11.402277 18691 raft_consensus.cc:1275] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:11.404001 18945 consensus_queue.cc:1048] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:13.545837 18515 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48734:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:19:13.570657 18515 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48734:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:19:13.692997  6030 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:19:13.712996 19014 log.cc:927] Time spent T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:19:13.832683 19043 tablet.cc:1724] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:13.838307 19040 tablet.cc:1724] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:13.864547 19024 log.cc:927] Time spent T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:19:13.876034 19032 log.cc:927] Time spent T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:19:13.876622 19017 log.cc:927] Time spent T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4: Append to log took a long time: real 0.179s	user 0.003s	sys 0.000s
W20260709 13:19:13.877978 19013 log.cc:927] Time spent T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4: Append to log took a long time: real 0.166s	user 0.002s	sys 0.005s
W20260709 13:19:13.902315 18719 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:c5c754da5fc842779c7f5eaaaf085f56)
I20260709 13:19:13.910656 19048 tablet.cc:1724] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:13.914011 19051 tablet.cc:1724] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:13.924505 19033 log.cc:927] Time spent T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b: Append to log took a long time: real 0.099s	user 0.003s	sys 0.000s
W20260709 13:19:13.976840 18584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.131:43579, user_credentials={real_user=slave}} blocked reactor thread for 59561.9us
W20260709 13:19:14.008541 18719 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:80421b61d7d7425492333eeda6c4bce0)
W20260709 13:19:14.009874 18719 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:80421b61d7d7425492333eeda6c4bce0)
I20260709 13:19:14.053745 19048 tablet.cc:1724] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.102777 19056 tablet.cc:1724] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.103574 19066 tablet.cc:1724] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:14.105713 19053 log.cc:927] Time spent T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4: Append to log took a long time: real 0.166s	user 0.003s	sys 0.000s
W20260709 13:19:14.108156 19046 log.cc:927] Time spent T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc: Append to log took a long time: real 0.167s	user 0.000s	sys 0.002s
I20260709 13:19:14.077813 19059 tablet.cc:1724] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.040829 19043 tablet.cc:1724] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.157819 19064 tablet.cc:1724] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.170955 18689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464"
dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
mode: GRACEFUL
new_leader_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:40380
I20260709 13:19:14.171746 18689 raft_consensus.cc:606] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Received request to transfer leadership to TS 670ea2028d3c4fb8960a99604387fcdc
W20260709 13:19:14.181404 19058 log.cc:927] Time spent T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4: Append to log took a long time: real 0.113s	user 0.000s	sys 0.002s
I20260709 13:19:14.221915 19051 tablet.cc:1724] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:14.227216 19057 log.cc:927] Time spent T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:19:14.259196 19031 raft_consensus.cc:993] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b: : Instructing follower 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:14.259897 19031 raft_consensus.cc:1081] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Signalling peer 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:14.281452 19062 tablet.cc:1724] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.313829 19073 tablet.cc:1724] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.316943 19072 tablet.cc:1724] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.332034 19069 tablet.cc:1724] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.378831 19051 tablet.cc:1724] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.384919 18617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
mode: GRACEFUL
new_leader_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:38868
I20260709 13:19:14.385748 18617 raft_consensus.cc:606] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Received request to transfer leadership to TS 670ea2028d3c4fb8960a99604387fcdc
I20260709 13:19:14.392623  6030 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:19:14.393419  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:14.399778 18762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:37060
I20260709 13:19:14.400638 18762 raft_consensus.cc:493] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.401101 18762 raft_consensus.cc:3060] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.405530 18514 catalog_manager.cc:5789] TS 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579) does not have the latest schema for tablet c037383337a848bca333257360bdbe12 (table soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]). Expected version 1 got 0
I20260709 13:19:14.421676 19064 tablet.cc:1724] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.420599 19059 tablet.cc:1724] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.410531 19069 tablet.cc:1724] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.363157 19040 tablet.cc:1724] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.445838 18762 raft_consensus.cc:515] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.436522 19056 tablet.cc:1724] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.368074 19066 tablet.cc:1724] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.429982 19072 tablet.cc:1724] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.456766 18691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d8af952bdad465d80c0fa044046163e"
dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
mode: GRACEFUL
new_leader_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:40380
I20260709 13:19:14.462503 18691 raft_consensus.cc:606] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Received request to transfer leadership to TS 670ea2028d3c4fb8960a99604387fcdc
I20260709 13:19:14.439141 19048 tablet.cc:1724] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.471174 18617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52968579e768489dbbda4f45debd689c"
dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
mode: GRACEFUL
new_leader_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:38868
I20260709 13:19:14.471896 18617 raft_consensus.cc:606] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Received request to transfer leadership to TS 670ea2028d3c4fb8960a99604387fcdc
I20260709 13:19:14.472009 19043 tablet.cc:1724] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.473315  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:14.474081  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:14.480762 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:14.480973 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7443f0ed7a7f4f9c9b221abe0b39e464" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:14.481500 18617 raft_consensus.cc:3060] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.481731 18692 raft_consensus.cc:3055] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:14.482146 18692 raft_consensus.cc:740] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:14.483002 18692 consensus_queue.cc:260] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.484203 18692 raft_consensus.cc:3060] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.487403 18762 leader_election.cc:290] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 3 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:14.491142 18617 raft_consensus.cc:2468] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 3.
I20260709 13:19:14.492801 18731 leader_election.cc:304] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
I20260709 13:19:14.496069 19061 raft_consensus.cc:2804] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:14.496659 19061 raft_consensus.cc:697] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 3 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:14.497623 19061 consensus_queue.cc:237] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.508533 19062 tablet.cc:1724] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.509750 19059 tablet.cc:1724] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:14.516759 18692 raft_consensus.cc:2468] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 3.
I20260709 13:19:14.527032 18515 catalog_manager.cc:5697] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 2 to 3, leader changed from e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130) to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 3 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.529044 18515 catalog_manager.cc:5789] TS 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131:43579) does not have the latest schema for tablet 7443f0ed7a7f4f9c9b221abe0b39e464 (table soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e]). Expected version 1 got 0
I20260709 13:19:14.592298 18516 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab: soft_deleted_table [id=460b2324c05c40d6b8cd5aefb0cf652e] alter complete (version 1)
I20260709 13:19:14.743094 19021 raft_consensus.cc:993] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4: : Instructing follower 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:14.744453 19019 raft_consensus.cc:1081] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Signalling peer 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:14.746430 19034 raft_consensus.cc:993] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b: : Instructing follower 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:14.747491 19042 raft_consensus.cc:1081] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Signalling peer 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:14.749078 18762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52968579e768489dbbda4f45debd689c"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:37054
I20260709 13:19:14.750188 18762 raft_consensus.cc:493] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.750773 18762 raft_consensus.cc:3060] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.755679 18763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d8af952bdad465d80c0fa044046163e"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:37060
I20260709 13:19:14.757025 18763 raft_consensus.cc:493] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.757529 18763 raft_consensus.cc:3060] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.766116 19037 raft_consensus.cc:993] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4: : Instructing follower 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:14.767484 19037 raft_consensus.cc:1081] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Signalling peer 670ea2028d3c4fb8960a99604387fcdc to start an election
I20260709 13:19:14.773478 18761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7"
dest_uuid: "670ea2028d3c4fb8960a99604387fcdc"
 from {username='slave'} at 127.0.0.1:37054
I20260709 13:19:14.774339 18761 raft_consensus.cc:493] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.774986 18761 raft_consensus.cc:3060] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.776657 18763 raft_consensus.cc:515] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.780128 18763 leader_election.cc:290] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 2 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:14.781359 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8af952bdad465d80c0fa044046163e" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:14.781498 18762 raft_consensus.cc:515] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.782733 18617 raft_consensus.cc:3060] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.784543 18692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d8af952bdad465d80c0fa044046163e" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:14.785269 18692 raft_consensus.cc:3055] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:14.785579 18692 raft_consensus.cc:740] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8b1c25cf3f84ea58304a6e112ff539b, State: Running, Role: LEADER
I20260709 13:19:14.786932 18692 consensus_queue.cc:260] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.789314 18692 raft_consensus.cc:3060] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.791412 18616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52968579e768489dbbda4f45debd689c" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:14.792330 18616 raft_consensus.cc:3055] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:14.792714 18616 raft_consensus.cc:740] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:14.794116 18689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52968579e768489dbbda4f45debd689c" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:14.795178 18689 raft_consensus.cc:3060] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.795487 18617 raft_consensus.cc:2468] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 2.
I20260709 13:19:14.797400 18731 leader_election.cc:304] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
I20260709 13:19:14.797370 18616 consensus_queue.cc:260] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.799017 19070 raft_consensus.cc:2804] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:14.799753 19070 raft_consensus.cc:697] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 2 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:14.801999 19070 consensus_queue.cc:237] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.802577 18761 raft_consensus.cc:515] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.806249 18761 leader_election.cc:290] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 3 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:14.807168 18691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e8b1c25cf3f84ea58304a6e112ff539b"
I20260709 13:19:14.808419 18691 raft_consensus.cc:3060] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.806099 18689 raft_consensus.cc:2468] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 3.
I20260709 13:19:14.799630 18616 raft_consensus.cc:3060] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.811699 18732 leader_election.cc:304] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e8b1c25cf3f84ea58304a6e112ff539b; no voters: 
I20260709 13:19:14.812558 18617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90eddb5de2f24f0395c76002c0246ae7" candidate_uuid: "670ea2028d3c4fb8960a99604387fcdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e4f8b938d317462dad5c7a368ad661c4"
I20260709 13:19:14.813450 18617 raft_consensus.cc:3055] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:14.813874 18617 raft_consensus.cc:740] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4f8b938d317462dad5c7a368ad661c4, State: Running, Role: LEADER
I20260709 13:19:14.815321 18617 consensus_queue.cc:260] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.784447 18762 leader_election.cc:290] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 3 election: Requested vote from peers e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279), e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479)
I20260709 13:19:14.818357 19070 raft_consensus.cc:2804] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:14.819095 19070 raft_consensus.cc:697] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 3 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:14.820384 19070 consensus_queue.cc:237] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.824556 18692 raft_consensus.cc:2468] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 2.
I20260709 13:19:14.824411 18617 raft_consensus.cc:3060] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.824383 18616 raft_consensus.cc:2468] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 3.
I20260709 13:19:14.830046 18515 catalog_manager.cc:5697] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 1 to 2, leader changed from e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130) to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 2 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.834861 18617 raft_consensus.cc:2468] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 3.
I20260709 13:19:14.838341 18691 raft_consensus.cc:2468] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670ea2028d3c4fb8960a99604387fcdc in term 3.
I20260709 13:19:14.839761 18731 leader_election.cc:304] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670ea2028d3c4fb8960a99604387fcdc, e4f8b938d317462dad5c7a368ad661c4; no voters: 
I20260709 13:19:14.840837 19070 raft_consensus.cc:2804] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:14.841526 19070 raft_consensus.cc:697] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 3 LEADER]: Becoming Leader. State: Replica: 670ea2028d3c4fb8960a99604387fcdc, State: Running, Role: LEADER
I20260709 13:19:14.843312 19070 consensus_queue.cc:237] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } }
I20260709 13:19:14.859395 18515 catalog_manager.cc:5697] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 2 to 3, leader changed from e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129) to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 3 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.860848 18515 catalog_manager.cc:5697] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc reported cstate change: term changed from 2 to 3, leader changed from e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129) to 670ea2028d3c4fb8960a99604387fcdc (127.5.227.131). New cstate: current_term: 3 leader_uuid: "670ea2028d3c4fb8960a99604387fcdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670ea2028d3c4fb8960a99604387fcdc" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 43579 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.068612 18691 raft_consensus.cc:1275] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:15.071051 19070 consensus_queue.cc:1048] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:15.084807 18617 raft_consensus.cc:1275] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:15.087141 19070 consensus_queue.cc:1048] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:15.206712 18691 raft_consensus.cc:1275] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:15.208312 19070 consensus_queue.cc:1048] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:15.219313 18691 raft_consensus.cc:1275] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.222630 19086 consensus_queue.cc:1048] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:15.224800 18617 raft_consensus.cc:1275] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:15.227102 18945 consensus_queue.cc:1048] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:15.234472 18616 raft_consensus.cc:1275] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.237704 19061 consensus_queue.cc:1048] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:15.275940 18691 raft_consensus.cc:1275] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:15.277334 19061 consensus_queue.cc:1048] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b1c25cf3f84ea58304a6e112ff539b" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:15.287331 18616 raft_consensus.cc:1275] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Refusing update from remote peer 670ea2028d3c4fb8960a99604387fcdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:15.288986 19061 consensus_queue.cc:1048] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4f8b938d317462dad5c7a368ad661c4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 38279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:15.560268  6030 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:19:15.566299  6030 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:19:15.566932  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:15.575148  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:19:15.575745  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:16.616166  6030 tablet_server.cc:179] TabletServer@127.5.227.129:0 shutting down...
W20260709 13:19:16.630762 18731 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 128 similar messages]
W20260709 13:19:16.640264 18731 consensus_peers.cc:597] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc -> Peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Couldn't send request to peer e4f8b938d317462dad5c7a368ad661c4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.645377 18731 consensus_peers.cc:597] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc -> Peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Couldn't send request to peer e4f8b938d317462dad5c7a368ad661c4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.659238 18657 consensus_peers.cc:597] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b -> Peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Couldn't send request to peer e4f8b938d317462dad5c7a368ad661c4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.668817  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:16.669911  6030 tablet_replica.cc:333] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.671041  6030 raft_consensus.cc:2243] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.672132  6030 raft_consensus.cc:2272] T fdaa707ac9c34059b57bd6cc1ddb0850 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.675087  6030 tablet_replica.cc:333] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.675954  6030 raft_consensus.cc:2243] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.676723  6030 raft_consensus.cc:2272] T c037383337a848bca333257360bdbe12 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.680243  6030 tablet_replica.cc:333] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.680949  6030 raft_consensus.cc:2243] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.681524  6030 raft_consensus.cc:2272] T 134052ab4c784d2c80d4cc8ac4a0327b P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.684283  6030 tablet_replica.cc:333] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.685019  6030 raft_consensus.cc:2243] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.685683  6030 raft_consensus.cc:2272] T da40fc628bb146e78988110faed9e278 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.689675  6030 tablet_replica.cc:333] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.690541  6030 raft_consensus.cc:2243] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.691828  6030 raft_consensus.cc:2272] T eb44f66e94944906afeadbd6bacc0851 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.695173  6030 tablet_replica.cc:333] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.695914  6030 raft_consensus.cc:2243] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.697219  6030 raft_consensus.cc:2272] T c5c754da5fc842779c7f5eaaaf085f56 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.700675  6030 tablet_replica.cc:333] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.701378  6030 raft_consensus.cc:2243] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.701969  6030 raft_consensus.cc:2272] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.704707  6030 tablet_replica.cc:333] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.705379  6030 raft_consensus.cc:2243] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.706481  6030 raft_consensus.cc:2272] T 58ee81ccb1074ee685bae5c26cc42579 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.709817  6030 tablet_replica.cc:333] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.710971  6030 raft_consensus.cc:2243] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.711762  6030 raft_consensus.cc:2272] T 0d8af952bdad465d80c0fa044046163e P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.715497  6030 tablet_replica.cc:333] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.716185  6030 raft_consensus.cc:2243] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.716686  6030 raft_consensus.cc:2272] T 52968579e768489dbbda4f45debd689c P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.719332  6030 tablet_replica.cc:333] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.720157  6030 raft_consensus.cc:2243] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.720700  6030 raft_consensus.cc:2272] T 80421b61d7d7425492333eeda6c4bce0 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.723059  6030 tablet_replica.cc:333] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.723588  6030 raft_consensus.cc:2243] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.724064  6030 raft_consensus.cc:2272] T ea2f94b4b2bb4bf9b849edebed15af13 P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.727172  6030 tablet_replica.cc:333] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.727980  6030 raft_consensus.cc:2243] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.728708  6030 raft_consensus.cc:2272] T 059f35cd2c5447549d0134c5eea2f999 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.731676  6030 tablet_replica.cc:333] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.732270  6030 raft_consensus.cc:2243] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.733289  6030 raft_consensus.cc:2272] T 8a403836d14e42268fbc3098bda76d4e P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.736595  6030 tablet_replica.cc:333] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.737417  6030 raft_consensus.cc:2243] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.738071  6030 raft_consensus.cc:2272] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.740986  6030 tablet_replica.cc:333] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.741672  6030 raft_consensus.cc:2243] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.742233  6030 raft_consensus.cc:2272] T d13c8fd8a9ab43f58884c1263ba8f616 P e4f8b938d317462dad5c7a368ad661c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.744827  6030 tablet_replica.cc:333] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.745345  6030 raft_consensus.cc:2243] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.745760  6030 raft_consensus.cc:2272] T 90eddb5de2f24f0395c76002c0246ae7 P e4f8b938d317462dad5c7a368ad661c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.748337  6030 tablet_replica.cc:333] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4: stopping tablet replica
I20260709 13:19:16.748862  6030 raft_consensus.cc:2243] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.749848  6030 raft_consensus.cc:2272] T cf1ad187bd824b3e8639199cd787ce9f P e4f8b938d317462dad5c7a368ad661c4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:16.761489 18731 consensus_peers.cc:597] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc -> Peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Couldn't send request to peer e4f8b938d317462dad5c7a368ad661c4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.771720 18731 consensus_peers.cc:597] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc -> Peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Couldn't send request to peer e4f8b938d317462dad5c7a368ad661c4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.810341  6030 tablet_server.cc:196] TabletServer@127.5.227.129:0 shutdown complete.
W20260709 13:19:16.811653 18657 consensus_peers.cc:597] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b -> Peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Couldn't send request to peer e4f8b938d317462dad5c7a368ad661c4. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:38279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.820577 18731 consensus_peers.cc:597] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc -> Peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Couldn't send request to peer e4f8b938d317462dad5c7a368ad661c4. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:38279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.863121  6030 tablet_server.cc:179] TabletServer@127.5.227.130:0 shutting down...
W20260709 13:19:16.888505 18657 consensus_peers.cc:597] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b -> Peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Couldn't send request to peer e4f8b938d317462dad5c7a368ad661c4. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:38279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.904659  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:16.905915  6030 tablet_replica.cc:333] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.907441  6030 raft_consensus.cc:2243] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.908963  6030 raft_consensus.cc:2272] T da40fc628bb146e78988110faed9e278 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.912432  6030 tablet_replica.cc:333] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.913236  6030 raft_consensus.cc:2243] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.913921  6030 raft_consensus.cc:2272] T fdaa707ac9c34059b57bd6cc1ddb0850 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.916935  6030 tablet_replica.cc:333] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.917595  6030 raft_consensus.cc:2243] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.918182  6030 raft_consensus.cc:2272] T c5c754da5fc842779c7f5eaaaf085f56 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.920542  6030 tablet_replica.cc:333] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.921105  6030 raft_consensus.cc:2243] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.921609  6030 raft_consensus.cc:2272] T c037383337a848bca333257360bdbe12 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.923877  6030 tablet_replica.cc:333] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.924459  6030 raft_consensus.cc:2243] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.925323  6030 raft_consensus.cc:2272] T 134052ab4c784d2c80d4cc8ac4a0327b P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.928402  6030 tablet_replica.cc:333] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.928988  6030 raft_consensus.cc:2243] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.929515  6030 raft_consensus.cc:2272] T eb44f66e94944906afeadbd6bacc0851 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.932320  6030 tablet_replica.cc:333] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.933107  6030 raft_consensus.cc:2243] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.933866  6030 raft_consensus.cc:2272] T 8a403836d14e42268fbc3098bda76d4e P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.936360  6030 tablet_replica.cc:333] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.936964  6030 raft_consensus.cc:2243] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.937460  6030 raft_consensus.cc:2272] T 58ee81ccb1074ee685bae5c26cc42579 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.939801  6030 tablet_replica.cc:333] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.940960  6030 raft_consensus.cc:2243] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.941484  6030 raft_consensus.cc:2272] T 0d8af952bdad465d80c0fa044046163e P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.943881  6030 tablet_replica.cc:333] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.944509  6030 raft_consensus.cc:2243] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.945631  6030 raft_consensus.cc:2272] T 059f35cd2c5447549d0134c5eea2f999 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.948685  6030 tablet_replica.cc:333] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.949596  6030 raft_consensus.cc:2243] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.950902  6030 raft_consensus.cc:2272] T 80421b61d7d7425492333eeda6c4bce0 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.953753  6030 tablet_replica.cc:333] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.954416  6030 raft_consensus.cc:2243] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.955405  6030 raft_consensus.cc:2272] T ea2f94b4b2bb4bf9b849edebed15af13 P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.957811  6030 tablet_replica.cc:333] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.958492  6030 raft_consensus.cc:2243] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.959113  6030 raft_consensus.cc:2272] T 52968579e768489dbbda4f45debd689c P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.961365  6030 tablet_replica.cc:333] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.961946  6030 raft_consensus.cc:2243] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:16.962905  6030 raft_consensus.cc:2272] T 42b2af1c0551436c8a2f2af3dd6b37e5 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.965158  6030 tablet_replica.cc:333] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.966085  6030 raft_consensus.cc:2243] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.967134  6030 raft_consensus.cc:2272] T 7443f0ed7a7f4f9c9b221abe0b39e464 P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.970010  6030 tablet_replica.cc:333] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.970764  6030 raft_consensus.cc:2243] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.971364  6030 raft_consensus.cc:2272] T d13c8fd8a9ab43f58884c1263ba8f616 P e8b1c25cf3f84ea58304a6e112ff539b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.974263  6030 tablet_replica.cc:333] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.974943  6030 raft_consensus.cc:2243] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.975528  6030 raft_consensus.cc:2272] T 90eddb5de2f24f0395c76002c0246ae7 P e8b1c25cf3f84ea58304a6e112ff539b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:16.977804  6030 tablet_replica.cc:333] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b: stopping tablet replica
I20260709 13:19:16.978377  6030 raft_consensus.cc:2243] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:16.978956  6030 raft_consensus.cc:2272] T cf1ad187bd824b3e8639199cd787ce9f P e8b1c25cf3f84ea58304a6e112ff539b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.030938  6030 tablet_server.cc:196] TabletServer@127.5.227.130:0 shutdown complete.
W20260709 13:19:17.065340 18731 consensus_peers.cc:597] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc -> Peer e4f8b938d317462dad5c7a368ad661c4 (127.5.227.129:38279): Couldn't send request to peer e4f8b938d317462dad5c7a368ad661c4. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:38279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:17.084632  6030 tablet_server.cc:179] TabletServer@127.5.227.131:0 shutting down...
I20260709 13:19:17.139882  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:17.140743  6030 tablet_replica.cc:333] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.141839  6030 raft_consensus.cc:2243] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.142725  6030 raft_consensus.cc:2272] T da40fc628bb146e78988110faed9e278 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.145432  6030 tablet_replica.cc:333] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.146951  6030 raft_consensus.cc:2243] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.147665  6030 raft_consensus.cc:2272] T eb44f66e94944906afeadbd6bacc0851 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.150385  6030 tablet_replica.cc:333] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.151386  6030 raft_consensus.cc:2243] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:17.152669  6030 raft_consensus.cc:2272] T c037383337a848bca333257360bdbe12 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.155566  6030 tablet_replica.cc:333] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.156301  6030 raft_consensus.cc:2243] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.156905  6030 raft_consensus.cc:2272] T 134052ab4c784d2c80d4cc8ac4a0327b P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.159713  6030 tablet_replica.cc:333] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.160426  6030 raft_consensus.cc:2243] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.161047  6030 raft_consensus.cc:2272] T c5c754da5fc842779c7f5eaaaf085f56 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.163885  6030 tablet_replica.cc:333] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.164669  6030 raft_consensus.cc:2243] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.165270  6030 raft_consensus.cc:2272] T cf1ad187bd824b3e8639199cd787ce9f P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.168830  6030 tablet_replica.cc:333] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.169811  6030 raft_consensus.cc:2243] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:17.170909  6030 raft_consensus.cc:2272] T 90eddb5de2f24f0395c76002c0246ae7 P 670ea2028d3c4fb8960a99604387fcdc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:17.172611 18732 consensus_peers.cc:597] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc -> Peer e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479): Couldn't send request to peer e8b1c25cf3f84ea58304a6e112ff539b. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:38479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:17.175781  6030 tablet_replica.cc:333] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.176803  6030 raft_consensus.cc:2243] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.177702  6030 raft_consensus.cc:2272] T 42b2af1c0551436c8a2f2af3dd6b37e5 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:17.180994 18732 consensus_peers.cc:597] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc -> Peer e8b1c25cf3f84ea58304a6e112ff539b (127.5.227.130:38479): Couldn't send request to peer e8b1c25cf3f84ea58304a6e112ff539b. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:38479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:17.181182  6030 tablet_replica.cc:333] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.182380  6030 raft_consensus.cc:2243] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.183112  6030 raft_consensus.cc:2272] T 80421b61d7d7425492333eeda6c4bce0 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.186519  6030 tablet_replica.cc:333] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.187309  6030 raft_consensus.cc:2243] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.187815  6030 raft_consensus.cc:2272] T ea2f94b4b2bb4bf9b849edebed15af13 P 670ea2028d3c4fb8960a99604387fcdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.190330  6030 tablet_replica.cc:333] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.191035  6030 raft_consensus.cc:2243] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.191566  6030 raft_consensus.cc:2272] T 059f35cd2c5447549d0134c5eea2f999 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.194082  6030 tablet_replica.cc:333] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.194734  6030 raft_consensus.cc:2243] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:17.195654  6030 raft_consensus.cc:2272] T 0d8af952bdad465d80c0fa044046163e P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.198053  6030 tablet_replica.cc:333] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.198690  6030 raft_consensus.cc:2243] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.199159  6030 raft_consensus.cc:2272] T 58ee81ccb1074ee685bae5c26cc42579 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.201572  6030 tablet_replica.cc:333] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.202098  6030 raft_consensus.cc:2243] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.202549  6030 raft_consensus.cc:2272] T 8a403836d14e42268fbc3098bda76d4e P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.204981  6030 tablet_replica.cc:333] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.205665  6030 raft_consensus.cc:2243] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.206336  6030 raft_consensus.cc:2272] T fdaa707ac9c34059b57bd6cc1ddb0850 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.208734  6030 tablet_replica.cc:333] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.209271  6030 raft_consensus.cc:2243] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:17.210225  6030 raft_consensus.cc:2272] T 7443f0ed7a7f4f9c9b221abe0b39e464 P 670ea2028d3c4fb8960a99604387fcdc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.213382  6030 tablet_replica.cc:333] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.214053  6030 raft_consensus.cc:2243] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:17.215137  6030 raft_consensus.cc:2272] T d13c8fd8a9ab43f58884c1263ba8f616 P 670ea2028d3c4fb8960a99604387fcdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.218235  6030 tablet_replica.cc:333] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc: stopping tablet replica
I20260709 13:19:17.218873  6030 raft_consensus.cc:2243] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:17.219889  6030 raft_consensus.cc:2272] T 52968579e768489dbbda4f45debd689c P 670ea2028d3c4fb8960a99604387fcdc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.275122  6030 tablet_server.cc:196] TabletServer@127.5.227.131:0 shutdown complete.
I20260709 13:19:17.322360  6030 master.cc:562] Master@127.5.227.190:37357 shutting down...
I20260709 13:19:17.360751  6030 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:17.361323  6030 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:17.361632  6030 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6693369d6ebf43038389c271891fa5ab: stopping tablet replica
I20260709 13:19:17.384667  6030 master.cc:584] Master@127.5.227.190:37357 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13738 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:19:17.449496  6030 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.227.190:33443
I20260709 13:19:17.450942  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:17.458155 19101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:17.458443 19102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:17.459313 19104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:17.460177  6030 server_base.cc:1061] running on GCE node
I20260709 13:19:17.461158  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:17.461349  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:17.461465  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603157461454 us; error 0 us; skew 500 ppm
I20260709 13:19:17.461936  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:17.464855  6030 webserver.cc:533] Webserver started at http://127.5.227.190:45855/ using document root <none> and password file <none>
I20260709 13:19:17.465416  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:17.465620  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:17.465855  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:17.467865  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/master-0-root/instance:
uuid: "69f02094b55b4908a75296ba678fada1"
format_stamp: "Formatted at 2026-07-09 13:19:17 on dist-test-slave-tbwl"
I20260709 13:19:17.473124  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:19:17.477684 19109 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:17.478827  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:19:17.479166  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/master-0-root
uuid: "69f02094b55b4908a75296ba678fada1"
format_stamp: "Formatted at 2026-07-09 13:19:17 on dist-test-slave-tbwl"
I20260709 13:19:17.479470  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:17.494910  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:17.496249  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:17.543486  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.190:33443
I20260709 13:19:17.543619 19160 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.190:33443 every 8 connection(s)
I20260709 13:19:17.548157 19161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.563172 19161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1: Bootstrap starting.
I20260709 13:19:17.568416 19161 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:17.573561 19161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1: No bootstrap required, opened a new log
I20260709 13:19:17.576009 19161 raft_consensus.cc:359] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f02094b55b4908a75296ba678fada1" member_type: VOTER }
I20260709 13:19:17.576428 19161 raft_consensus.cc:385] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:17.576704 19161 raft_consensus.cc:740] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f02094b55b4908a75296ba678fada1, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.577426 19161 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f02094b55b4908a75296ba678fada1" member_type: VOTER }
I20260709 13:19:17.577845 19161 raft_consensus.cc:399] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:17.578111 19161 raft_consensus.cc:493] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:17.578413 19161 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:17.583899 19161 raft_consensus.cc:515] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f02094b55b4908a75296ba678fada1" member_type: VOTER }
I20260709 13:19:17.584537 19161 leader_election.cc:304] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69f02094b55b4908a75296ba678fada1; no voters: 
I20260709 13:19:17.585843 19161 leader_election.cc:290] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:17.586581 19164 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:17.588524 19164 raft_consensus.cc:697] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [term 1 LEADER]: Becoming Leader. State: Replica: 69f02094b55b4908a75296ba678fada1, State: Running, Role: LEADER
I20260709 13:19:17.589412 19161 sys_catalog.cc:565] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:17.589337 19164 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f02094b55b4908a75296ba678fada1" member_type: VOTER }
I20260709 13:19:17.595078 19165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69f02094b55b4908a75296ba678fada1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f02094b55b4908a75296ba678fada1" member_type: VOTER } }
I20260709 13:19:17.595880 19165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:17.595827 19166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69f02094b55b4908a75296ba678fada1. Latest consensus state: current_term: 1 leader_uuid: "69f02094b55b4908a75296ba678fada1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f02094b55b4908a75296ba678fada1" member_type: VOTER } }
I20260709 13:19:17.596689 19166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:17.599393 19171 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:17.608160 19171 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:17.609364  6030 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:17.619236 19171 catalog_manager.cc:1383] Generated new cluster ID: e3e054c70ade4e6abb5d885121ca642d
I20260709 13:19:17.619587 19171 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:17.644218 19171 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:17.645723 19171 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:17.659698 19171 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1: Generated new TSK 0
I20260709 13:19:17.660451 19171 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:17.676970  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:17.684198 19182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:17.685333 19183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:17.693915  6030 server_base.cc:1061] running on GCE node
W20260709 13:19:17.693770 19185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:17.695283  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:17.695520  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:17.695721  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603157695705 us; error 0 us; skew 500 ppm
I20260709 13:19:17.696231  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:17.699214  6030 webserver.cc:533] Webserver started at http://127.5.227.129:46335/ using document root <none> and password file <none>
I20260709 13:19:17.699695  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:17.699862  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:17.700078  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:17.701398  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-0-root/instance:
uuid: "505976ec5ba248f4816824b4186f2ef4"
format_stamp: "Formatted at 2026-07-09 13:19:17 on dist-test-slave-tbwl"
I20260709 13:19:17.707499  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:19:17.712030 19190 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:17.713287  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:19:17.713697  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-0-root
uuid: "505976ec5ba248f4816824b4186f2ef4"
format_stamp: "Formatted at 2026-07-09 13:19:17 on dist-test-slave-tbwl"
I20260709 13:19:17.714020  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:17.730792  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:17.732338  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:17.734126  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:17.737067  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:17.737298  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:17.737651  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:17.737823  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:17.792557  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.129:41071
I20260709 13:19:17.792716 19252 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.129:41071 every 8 connection(s)
I20260709 13:19:17.797956  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:17.805635 19257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:17.807003 19258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:17.813485  6030 server_base.cc:1061] running on GCE node
W20260709 13:19:17.813999 19260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:17.814039 19253 heartbeater.cc:344] Connected to a master server at 127.5.227.190:33443
I20260709 13:19:17.814728 19253 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:17.815766 19253 heartbeater.cc:507] Master 127.5.227.190:33443 requested a full tablet report, sending...
I20260709 13:19:17.816102  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:17.816370  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:17.816562  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603157816545 us; error 0 us; skew 500 ppm
I20260709 13:19:17.817149  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:17.818519 19126 ts_manager.cc:194] Registered new tserver with Master: 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071)
I20260709 13:19:17.820195  6030 webserver.cc:533] Webserver started at http://127.5.227.130:38439/ using document root <none> and password file <none>
I20260709 13:19:17.820945  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:17.821173  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:17.821293 19126 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52604
I20260709 13:19:17.821506  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:17.823128  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-1-root/instance:
uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
format_stamp: "Formatted at 2026-07-09 13:19:17 on dist-test-slave-tbwl"
I20260709 13:19:17.828814  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:17.833654 19265 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:17.834910  6030 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:17.835259  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-1-root
uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
format_stamp: "Formatted at 2026-07-09 13:19:17 on dist-test-slave-tbwl"
I20260709 13:19:17.835600  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:17.848718  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:17.849967  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:17.852258  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:17.855266  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:17.855517  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:17.856074  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:17.856258  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:17.909478  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.130:39857
I20260709 13:19:17.909652 19327 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.130:39857 every 8 connection(s)
I20260709 13:19:17.915733  6030 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:17.924331 19331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:17.926967 19332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:17.929912 19334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:17.931241 19328 heartbeater.cc:344] Connected to a master server at 127.5.227.190:33443
I20260709 13:19:17.931803  6030 server_base.cc:1061] running on GCE node
I20260709 13:19:17.932051 19328 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:17.933115  6030 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:17.933373 19328 heartbeater.cc:507] Master 127.5.227.190:33443 requested a full tablet report, sending...
W20260709 13:19:17.933449  6030 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:17.934017  6030 hybrid_clock.cc:648] HybridClock initialized: now 1783603157933997 us; error 0 us; skew 500 ppm
I20260709 13:19:17.934839  6030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:17.936640 19126 ts_manager.cc:194] Registered new tserver with Master: 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:17.937897  6030 webserver.cc:533] Webserver started at http://127.5.227.131:43315/ using document root <none> and password file <none>
I20260709 13:19:17.938385 19126 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52610
I20260709 13:19:17.938510  6030 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:17.938922  6030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:17.939216  6030 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:17.940639  6030 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-2-root/instance:
uuid: "213472259ea74d45821f555378f40a08"
format_stamp: "Formatted at 2026-07-09 13:19:17 on dist-test-slave-tbwl"
I20260709 13:19:17.945792  6030 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:19:17.951370 19339 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:17.952564  6030 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:19:17.952940  6030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-2-root
uuid: "213472259ea74d45821f555378f40a08"
format_stamp: "Formatted at 2026-07-09 13:19:17 on dist-test-slave-tbwl"
I20260709 13:19:17.953440  6030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskQ9jH6S/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602741015013-6030-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:17.969164  6030 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:17.971143  6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:17.972862  6030 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:17.975471  6030 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:17.975777  6030 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:17.976060  6030 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:17.976251  6030 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:18.027594  6030 rpc_server.cc:307] RPC server started. Bound to: 127.5.227.131:40775
I20260709 13:19:18.027709 19401 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.227.131:40775 every 8 connection(s)
I20260709 13:19:18.046079 19402 heartbeater.cc:344] Connected to a master server at 127.5.227.190:33443
I20260709 13:19:18.046640 19402 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:18.047546 19402 heartbeater.cc:507] Master 127.5.227.190:33443 requested a full tablet report, sending...
I20260709 13:19:18.050316 19126 ts_manager.cc:194] Registered new tserver with Master: 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:18.050724  6030 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018922939s
I20260709 13:19:18.052029 19126 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52612
I20260709 13:19:18.081251 19126 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52614:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:18.084440 19126 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:18.169636 19367 tablet_service.cc:1511] Processing CreateTablet for tablet ff7dfa40d76147fab5fe548a04fae866 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:18.169675 19366 tablet_service.cc:1511] Processing CreateTablet for tablet 27a1ae7fb63a4c05b369caeacfce820e (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:18.174096 19365 tablet_service.cc:1511] Processing CreateTablet for tablet b9be79dba975466182f64fa951f51bcc (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:18.177420 19366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a1ae7fb63a4c05b369caeacfce820e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.178293 19365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9be79dba975466182f64fa951f51bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.180438 19367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7dfa40d76147fab5fe548a04fae866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.187407 19293 tablet_service.cc:1511] Processing CreateTablet for tablet ff7dfa40d76147fab5fe548a04fae866 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:18.189043 19293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7dfa40d76147fab5fe548a04fae866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.192557 19292 tablet_service.cc:1511] Processing CreateTablet for tablet 27a1ae7fb63a4c05b369caeacfce820e (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:18.193269 19218 tablet_service.cc:1511] Processing CreateTablet for tablet ff7dfa40d76147fab5fe548a04fae866 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:18.194845 19218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7dfa40d76147fab5fe548a04fae866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.196084 19291 tablet_service.cc:1511] Processing CreateTablet for tablet b9be79dba975466182f64fa951f51bcc (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:18.199819 19217 tablet_service.cc:1511] Processing CreateTablet for tablet 27a1ae7fb63a4c05b369caeacfce820e (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:18.201049 19215 tablet_service.cc:1511] Processing CreateTablet for tablet d2172ced591b46b798d4ca34a7616333 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:18.199819 19216 tablet_service.cc:1511] Processing CreateTablet for tablet b9be79dba975466182f64fa951f51bcc (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:18.201504 19217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a1ae7fb63a4c05b369caeacfce820e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.204541 19364 tablet_service.cc:1511] Processing CreateTablet for tablet d2172ced591b46b798d4ca34a7616333 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:18.206051 19417 tablet_bootstrap.cc:492] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:18.206284 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2172ced591b46b798d4ca34a7616333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.206414 19289 tablet_service.cc:1511] Processing CreateTablet for tablet 6980a49d31dc4a2e8c3d48742d78e30f (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:18.208119 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2172ced591b46b798d4ca34a7616333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.207882 19363 tablet_service.cc:1511] Processing CreateTablet for tablet 6980a49d31dc4a2e8c3d48742d78e30f (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:18.204617 19290 tablet_service.cc:1511] Processing CreateTablet for tablet d2172ced591b46b798d4ca34a7616333 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:18.211002 19292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a1ae7fb63a4c05b369caeacfce820e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.211234 19216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9be79dba975466182f64fa951f51bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.212036 19363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6980a49d31dc4a2e8c3d48742d78e30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.214742 19289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6980a49d31dc4a2e8c3d48742d78e30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.219077 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2172ced591b46b798d4ca34a7616333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.223089 19291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9be79dba975466182f64fa951f51bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.232362 19214 tablet_service.cc:1511] Processing CreateTablet for tablet 6980a49d31dc4a2e8c3d48742d78e30f (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:18.234233 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6980a49d31dc4a2e8c3d48742d78e30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.236243 19213 tablet_service.cc:1511] Processing CreateTablet for tablet fd1b8780c15a44bca12c6b9448682755 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:18.239612 19417 tablet_bootstrap.cc:654] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.247051 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1b8780c15a44bca12c6b9448682755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.268707 19419 tablet_bootstrap.cc:492] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:18.276327 19418 tablet_bootstrap.cc:492] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:18.279637 19417 tablet_bootstrap.cc:492] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:18.280396 19288 tablet_service.cc:1511] Processing CreateTablet for tablet fd1b8780c15a44bca12c6b9448682755 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:18.280411 19417 ts_tablet_manager.cc:1403] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.000s
I20260709 13:19:18.282116 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1b8780c15a44bca12c6b9448682755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.285029 19417 raft_consensus.cc:359] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.288290 19417 raft_consensus.cc:385] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.288674 19419 tablet_bootstrap.cc:654] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.288770 19417 raft_consensus.cc:740] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.286374 19418 tablet_bootstrap.cc:654] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.286499 19364 tablet_service.cc:1511] Processing CreateTablet for tablet fd1b8780c15a44bca12c6b9448682755 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:18.291759 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1b8780c15a44bca12c6b9448682755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.290159 19417 consensus_queue.cc:260] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.310801 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 79799f339c9540ae8e8e1cc240e6cce0 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:18.315349 19419 tablet_bootstrap.cc:492] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:18.317039 19419 ts_tablet_manager.cc:1403] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.006s
I20260709 13:19:18.317554 19218 tablet_service.cc:1511] Processing CreateTablet for tablet 79799f339c9540ae8e8e1cc240e6cce0 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:18.319134 19218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79799f339c9540ae8e8e1cc240e6cce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.320531 19419 raft_consensus.cc:359] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:18.321400 19419 raft_consensus.cc:385] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.321720 19419 raft_consensus.cc:740] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.305025 19418 tablet_bootstrap.cc:492] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:18.322876 19418 ts_tablet_manager.cc:1403] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.047s	user 0.000s	sys 0.018s
I20260709 13:19:18.333451 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79799f339c9540ae8e8e1cc240e6cce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.336169 19419 consensus_queue.cc:260] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:18.326436 19418 raft_consensus.cc:359] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.348810 19367 tablet_service.cc:1511] Processing CreateTablet for tablet 79799f339c9540ae8e8e1cc240e6cce0 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:18.349673 19217 tablet_service.cc:1511] Processing CreateTablet for tablet 4c861a0f1e0c403ab763c5d866e754d9 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:18.350394 19367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79799f339c9540ae8e8e1cc240e6cce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.351135 19217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c861a0f1e0c403ab763c5d866e754d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.350996 19288 tablet_service.cc:1511] Processing CreateTablet for tablet 4c861a0f1e0c403ab763c5d866e754d9 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:18.352348 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c861a0f1e0c403ab763c5d866e754d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.356550 19287 tablet_service.cc:1511] Processing CreateTablet for tablet 2bbdde43fc3f48de80b94903fc565079 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:18.358127 19287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bbdde43fc3f48de80b94903fc565079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.341508 19418 raft_consensus.cc:385] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.356564 19366 tablet_service.cc:1511] Processing CreateTablet for tablet 4c861a0f1e0c403ab763c5d866e754d9 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:18.354483 19216 tablet_service.cc:1511] Processing CreateTablet for tablet 2bbdde43fc3f48de80b94903fc565079 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:18.363296 19366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c861a0f1e0c403ab763c5d866e754d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.363672 19216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bbdde43fc3f48de80b94903fc565079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.366044 19402 heartbeater.cc:499] Master 127.5.227.190:33443 was elected leader, sending a full tablet report...
I20260709 13:19:18.367900 19363 tablet_service.cc:1511] Processing CreateTablet for tablet 2bbdde43fc3f48de80b94903fc565079 (DEFAULT_TABLE table=test-workload [id=9a458759c4bf432091e07e56be5f9637]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:18.369462 19363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bbdde43fc3f48de80b94903fc565079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:18.369715 19417 ts_tablet_manager.cc:1434] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.039s
I20260709 13:19:18.384991 19253 heartbeater.cc:499] Master 127.5.227.190:33443 was elected leader, sending a full tablet report...
I20260709 13:19:18.384979 19424 raft_consensus.cc:493] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.387288 19424 raft_consensus.cc:515] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:18.381359 19418 raft_consensus.cc:740] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.391691 19418 consensus_queue.cc:260] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.418941 19417 tablet_bootstrap.cc:492] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:18.435087 19419 ts_tablet_manager.cc:1434] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.118s	user 0.014s	sys 0.010s
I20260709 13:19:18.436673 19419 tablet_bootstrap.cc:492] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:18.435061 19424 leader_election.cc:290] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 213472259ea74d45821f555378f40a08 (127.5.227.131:40775), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:18.462674 19418 ts_tablet_manager.cc:1434] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.139s	user 0.010s	sys 0.019s
I20260709 13:19:18.468550 19328 heartbeater.cc:499] Master 127.5.227.190:33443 was elected leader, sending a full tablet report...
I20260709 13:19:18.483687 19418 tablet_bootstrap.cc:492] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:18.517498 19419 tablet_bootstrap.cc:654] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.527393 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
W20260709 13:19:18.530040 19192 leader_election.cc:343] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:18.530866 19112 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.227.129:41071, user_credentials={real_user=slave}} blocked reactor thread for 58817.7us
W20260709 13:19:18.533138 19403 tablet.cc:2406] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:18.547266 19418 tablet_bootstrap.cc:654] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.549572 19417 tablet_bootstrap.cc:654] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.549391 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:18.571463 19426 raft_consensus.cc:493] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.572508 19426 raft_consensus.cc:515] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.582139 19426 leader_election.cc:290] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:18.606725 19417 tablet_bootstrap.cc:492] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:18.607427 19419 tablet_bootstrap.cc:492] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:18.607923 19417 ts_tablet_manager.cc:1403] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.214s	user 0.013s	sys 0.017s
I20260709 13:19:18.608320 19419 ts_tablet_manager.cc:1403] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.172s	user 0.027s	sys 0.004s
W20260709 13:19:18.612478 19174 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:19:18.612820 19192 leader_election.cc:343] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.613637 19192 leader_election.cc:304] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4; no voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:18.612547 19419 raft_consensus.cc:359] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.614916 19424 raft_consensus.cc:2749] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.615173 19419 raft_consensus.cc:385] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.615648 19419 raft_consensus.cc:740] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.616866 19419 consensus_queue.cc:260] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.618104 19425 raft_consensus.cc:493] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.618613 19425 raft_consensus.cc:515] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.619352 19419 ts_tablet_manager.cc:1434] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:19:18.620707 19419 tablet_bootstrap.cc:492] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:18.620980 19418 tablet_bootstrap.cc:492] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:18.621281 19425 leader_election.cc:290] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:18.621773 19418 ts_tablet_manager.cc:1403] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.138s	user 0.036s	sys 0.037s
I20260709 13:19:18.618610 19417 raft_consensus.cc:359] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.623809 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be79dba975466182f64fa951f51bcc" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:18.624691 19377 raft_consensus.cc:2468] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 0.
I20260709 13:19:18.626302 19192 leader_election.cc:304] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 505976ec5ba248f4816824b4186f2ef4; no voters: 
I20260709 13:19:18.627324 19425 raft_consensus.cc:2804] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.627717 19425 raft_consensus.cc:493] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.627614 19418 raft_consensus.cc:359] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.628259 19425 raft_consensus.cc:3060] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.623840 19417 raft_consensus.cc:385] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.628896 19417 raft_consensus.cc:740] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.629045 19419 tablet_bootstrap.cc:654] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.630023 19417 consensus_queue.cc:260] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.635989 19417 ts_tablet_manager.cc:1434] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:19:18.637275 19417 tablet_bootstrap.cc:492] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:18.638784 19418 raft_consensus.cc:385] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.639158 19418 raft_consensus.cc:740] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.640035 19418 consensus_queue.cc:260] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.642706 19418 ts_tablet_manager.cc:1434] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:19:18.643931 19418 tablet_bootstrap.cc:492] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:18.644794 19417 tablet_bootstrap.cc:654] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.646921 19425 raft_consensus.cc:515] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.651386 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be79dba975466182f64fa951f51bcc" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:18.652164 19377 raft_consensus.cc:3060] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.655351 19425 leader_election.cc:290] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Requested vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:18.656924 19418 tablet_bootstrap.cc:654] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.667996 19377 raft_consensus.cc:2468] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 1.
I20260709 13:19:18.670291 19419 tablet_bootstrap.cc:492] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:18.670136 19192 leader_election.cc:304] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 505976ec5ba248f4816824b4186f2ef4; no voters: 
I20260709 13:19:18.671212 19419 ts_tablet_manager.cc:1403] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.014s
I20260709 13:19:18.671566 19425 raft_consensus.cc:2804] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.672267 19425 raft_consensus.cc:697] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Becoming Leader. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Running, Role: LEADER
I20260709 13:19:18.673214 19425 consensus_queue.cc:237] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.678272 19417 tablet_bootstrap.cc:492] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:18.679147 19417 ts_tablet_manager.cc:1403] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 13:19:18.689296 19417 raft_consensus.cc:359] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:18.690423 19417 raft_consensus.cc:385] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.690842 19417 raft_consensus.cc:740] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.691361 19418 tablet_bootstrap.cc:492] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:18.692134 19418 ts_tablet_manager.cc:1403] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.009s
I20260709 13:19:18.691778 19417 consensus_queue.cc:260] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:18.692225 19419 raft_consensus.cc:359] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.693246 19419 raft_consensus.cc:385] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.693624 19419 raft_consensus.cc:740] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.695312 19417 ts_tablet_manager.cc:1434] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:19:18.696098 19418 raft_consensus.cc:359] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.696893 19417 tablet_bootstrap.cc:492] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:18.696985 19418 raft_consensus.cc:385] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.697475 19418 raft_consensus.cc:740] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.699381 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2172ced591b46b798d4ca34a7616333" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
W20260709 13:19:18.701454 19267 leader_election.cc:343] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.694845 19419 consensus_queue.cc:260] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.698562 19418 consensus_queue.cc:260] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.704967 19419 ts_tablet_manager.cc:1434] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.033s	user 0.000s	sys 0.009s
I20260709 13:19:18.706893 19419 tablet_bootstrap.cc:492] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:18.707135 19418 ts_tablet_manager.cc:1434] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:19:18.708310 19418 tablet_bootstrap.cc:492] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:18.714282 19419 tablet_bootstrap.cc:654] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.715278 19418 tablet_bootstrap.cc:654] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.718684 19417 tablet_bootstrap.cc:654] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.721029 19423 raft_consensus.cc:493] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.722110 19423 raft_consensus.cc:515] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:18.738523 19423 leader_election.cc:290] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:18.782465 19419 tablet_bootstrap.cc:492] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:18.783214 19419 ts_tablet_manager.cc:1403] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.077s	user 0.022s	sys 0.016s
I20260709 13:19:18.783461 19417 tablet_bootstrap.cc:492] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:18.784058 19417 ts_tablet_manager.cc:1403] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.087s	user 0.037s	sys 0.035s
I20260709 13:19:18.788681 19418 tablet_bootstrap.cc:492] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:18.788615 19419 raft_consensus.cc:359] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.789535 19418 ts_tablet_manager.cc:1403] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.038s
I20260709 13:19:18.789798 19419 raft_consensus.cc:385] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.790565 19419 raft_consensus.cc:740] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.789388 19417 raft_consensus.cc:359] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.791462 19417 raft_consensus.cc:385] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.791924 19417 raft_consensus.cc:740] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.791740 19419 consensus_queue.cc:260] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.793298 19417 consensus_queue.cc:260] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.793646 19418 raft_consensus.cc:359] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:18.794588 19418 raft_consensus.cc:385] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.794893 19419 ts_tablet_manager.cc:1434] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:19:18.794958 19418 raft_consensus.cc:740] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.796443 19419 tablet_bootstrap.cc:492] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:18.796243 19418 consensus_queue.cc:260] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:18.797140 19417 ts_tablet_manager.cc:1434] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 13:19:18.798583 19417 tablet_bootstrap.cc:492] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:18.798815 19418 ts_tablet_manager.cc:1434] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:19:18.800168 19418 tablet_bootstrap.cc:492] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:18.804836 19419 tablet_bootstrap.cc:654] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.807292 19417 tablet_bootstrap.cc:654] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.807310 19418 tablet_bootstrap.cc:654] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.817808 19419 tablet_bootstrap.cc:492] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:18.817996 19418 tablet_bootstrap.cc:492] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:18.818763 19419 ts_tablet_manager.cc:1403] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:19:18.818909 19418 ts_tablet_manager.cc:1403] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:19:18.822570 19419 raft_consensus.cc:359] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.823443 19419 raft_consensus.cc:385] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.823757 19419 raft_consensus.cc:740] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.823640 19418 raft_consensus.cc:359] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.824611 19418 raft_consensus.cc:385] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.824973 19418 raft_consensus.cc:740] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.825068 19419 consensus_queue.cc:260] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.826447 19426 raft_consensus.cc:493] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.826736 19417 tablet_bootstrap.cc:492] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:18.827486 19417 ts_tablet_manager.cc:1403] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.011s
I20260709 13:19:18.827147 19426 raft_consensus.cc:515] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.831576 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6980a49d31dc4a2e8c3d48742d78e30f" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:18.828172 19419 ts_tablet_manager.cc:1434] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:18.832096 19417 raft_consensus.cc:359] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.835567 19377 raft_consensus.cc:2468] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:18.835981 19417 raft_consensus.cc:385] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.836601 19419 tablet_bootstrap.cc:492] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:18.836592 19417 raft_consensus.cc:740] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.837474 19267 leader_election.cc:304] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:18.838461 19417 consensus_queue.cc:260] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.841578 19417 ts_tablet_manager.cc:1434] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:19:18.842970 19417 tablet_bootstrap.cc:492] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:18.827932 19418 consensus_queue.cc:260] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.833703 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be79dba975466182f64fa951f51bcc" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:18.847965 19419 tablet_bootstrap.cc:654] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.831238 19426 leader_election.cc:290] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:18.848444 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9be79dba975466182f64fa951f51bcc" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:18.848744 19426 raft_consensus.cc:493] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.849367 19426 raft_consensus.cc:515] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:18.854288 19447 raft_consensus.cc:2804] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.855371 19447 raft_consensus.cc:493] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.855602 19418 ts_tablet_manager.cc:1434] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.004s
I20260709 13:19:18.856137 19447 raft_consensus.cc:3060] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.857267 19418 tablet_bootstrap.cc:492] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:18.870544 19426 leader_election.cc:290] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 213472259ea74d45821f555378f40a08 (127.5.227.131:40775), 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071)
I20260709 13:19:18.848505 19303 raft_consensus.cc:2468] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 0.
I20260709 13:19:18.890383 19447 raft_consensus.cc:515] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.901957 19447 leader_election.cc:290] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:18.906033 19419 tablet_bootstrap.cc:492] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:18.906744 19419 ts_tablet_manager.cc:1403] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.070s	user 0.028s	sys 0.016s
I20260709 13:19:18.910221 19419 raft_consensus.cc:359] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.911569 19419 raft_consensus.cc:385] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.911985 19419 raft_consensus.cc:740] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.912882 19419 consensus_queue.cc:260] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.915484 19419 ts_tablet_manager.cc:1434] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:19:18.915757 19228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2172ced591b46b798d4ca34a7616333" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:18.916757 19419 tablet_bootstrap.cc:492] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:18.916646 19228 raft_consensus.cc:2468] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:18.919083 19228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6980a49d31dc4a2e8c3d48742d78e30f" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:18.919843 19228 raft_consensus.cc:2468] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:18.921276 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:18.922166 19227 raft_consensus.cc:2468] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:18.924122 19268 leader_election.cc:304] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 213472259ea74d45821f555378f40a08
I20260709 13:19:18.925202 19419 tablet_bootstrap.cc:654] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.925789 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6980a49d31dc4a2e8c3d48742d78e30f" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:18.926587 19227 raft_consensus.cc:3060] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.927287 19447 raft_consensus.cc:2804] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.927858 19447 raft_consensus.cc:493] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.928332 19447 raft_consensus.cc:3060] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.931026 19268 leader_election.cc:304] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:18.932744 19445 raft_consensus.cc:2804] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.933552 19445 raft_consensus.cc:493] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.934083 19445 raft_consensus.cc:3060] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.937674 19419 tablet_bootstrap.cc:492] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:18.938381 19419 ts_tablet_manager.cc:1403] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 13:19:18.939898 19447 raft_consensus.cc:515] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.941844 19419 raft_consensus.cc:359] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.942790 19419 raft_consensus.cc:385] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.943115 19419 raft_consensus.cc:740] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.943374 19447 leader_election.cc:290] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:18.943869 19445 raft_consensus.cc:515] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:18.944185 19419 consensus_queue.cc:260] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.947291 19228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2172ced591b46b798d4ca34a7616333" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:18.948110 19228 raft_consensus.cc:3060] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.948514 19419 ts_tablet_manager.cc:1434] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:18.949846 19419 tablet_bootstrap.cc:492] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:18.951967 19376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6980a49d31dc4a2e8c3d48742d78e30f" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:18.952932 19376 raft_consensus.cc:3060] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.955421 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2172ced591b46b798d4ca34a7616333" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:18.956295 19375 raft_consensus.cc:3060] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.957597 19419 tablet_bootstrap.cc:654] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.962545 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:18.963522 19226 raft_consensus.cc:2468] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 0.
I20260709 13:19:18.965193 19376 raft_consensus.cc:2468] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:18.955268 19447 raft_consensus.cc:493] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.967355 19267 leader_election.cc:304] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:18.969139 19446 raft_consensus.cc:2804] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.969758 19446 raft_consensus.cc:697] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:18.970005 19419 tablet_bootstrap.cc:492] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:18.971004 19419 ts_tablet_manager.cc:1403] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 13:19:18.971235 19446 consensus_queue.cc:237] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.967394 19447 raft_consensus.cc:515] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.974053 19419 raft_consensus.cc:359] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.974871 19419 raft_consensus.cc:385] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.975147 19419 raft_consensus.cc:740] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.975873 19419 consensus_queue.cc:260] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:18.977528 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:18.976269 19342 leader_election.cc:304] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 505976ec5ba248f4816824b4186f2ef4; no voters: 
I20260709 13:19:18.978286 19419 ts_tablet_manager.cc:1434] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:18.978960 19228 raft_consensus.cc:2468] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:18.979548 19419 tablet_bootstrap.cc:492] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:18.980370 19268 leader_election.cc:304] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:18.981235 19426 raft_consensus.cc:2804] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.987804 19419 tablet_bootstrap.cc:654] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.996538 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:18.983060 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:18.991219 19425 raft_consensus.cc:493] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.000185 19225 raft_consensus.cc:3060] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.000357 19425 raft_consensus.cc:515] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.004192 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79799f339c9540ae8e8e1cc240e6cce0" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:19.000484 19303 raft_consensus.cc:2393] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 213472259ea74d45821f555378f40a08 in current term 1: Already voted for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in this term.
W20260709 13:19:19.006112 19192 leader_election.cc:343] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.994227 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:18.991199 19376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b8780c15a44bca12c6b9448682755" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:19.012023 19419 tablet_bootstrap.cc:492] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:18.988456 19375 raft_consensus.cc:2468] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:19.012991 19419 ts_tablet_manager.cc:1403] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.016s
I20260709 13:19:19.013357 19425 leader_election.cc:290] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
W20260709 13:19:19.014673 19267 leader_election.cc:343] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.993449 19447 leader_election.cc:290] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:19.011299 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79799f339c9540ae8e8e1cc240e6cce0" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:18.978371 19377 raft_consensus.cc:2468] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:19.015844 19445 leader_election.cc:290] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Requested vote from peers 213472259ea74d45821f555378f40a08 (127.5.227.131:40775), 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071)
I20260709 13:19:19.016470 19423 raft_consensus.cc:2804] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:19:19.017268 19192 leader_election.cc:343] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.016404 19419 raft_consensus.cc:359] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.017831 19192 leader_election.cc:304] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4; no voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:19.018080 19419 raft_consensus.cc:385] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.018716 19419 raft_consensus.cc:740] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.019461 19425 raft_consensus.cc:2749] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:19.019889 19419 consensus_queue.cc:260] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.020701 19225 raft_consensus.cc:2468] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:19.022055 19268 leader_election.cc:304] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 213472259ea74d45821f555378f40a08
I20260709 13:19:18.991473 19227 raft_consensus.cc:2468] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:19.011324 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b8780c15a44bca12c6b9448682755" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:19.023238 19226 raft_consensus.cc:2468] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:19.023404 19445 raft_consensus.cc:2804] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:19.024068 19445 raft_consensus.cc:697] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:19.025118 19268 leader_election.cc:304] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 213472259ea74d45821f555378f40a08
I20260709 13:19:19.025291 19445 consensus_queue.cc:237] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:19.026947 19447 raft_consensus.cc:2804] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:19.027431 19447 raft_consensus.cc:493] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.027828 19447 raft_consensus.cc:3060] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.015158 19418 tablet_bootstrap.cc:654] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.032789 19417 tablet_bootstrap.cc:654] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.037839 19426 raft_consensus.cc:697] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:19.039112 19426 consensus_queue.cc:237] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.022589 19419 ts_tablet_manager.cc:1434] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:19.049504 19125 catalog_manager.cc:5697] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "505976ec5ba248f4816824b4186f2ef4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.052318 19447 raft_consensus.cc:515] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.056876 19423 raft_consensus.cc:493] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.057394 19423 raft_consensus.cc:3060] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.059543 19418 tablet_bootstrap.cc:492] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:19.060434 19418 ts_tablet_manager.cc:1403] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.203s	user 0.027s	sys 0.015s
I20260709 13:19:19.064071 19418 raft_consensus.cc:359] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.064872 19418 raft_consensus.cc:385] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.065205 19418 raft_consensus.cc:740] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.066099 19418 consensus_queue.cc:260] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.067164 19423 raft_consensus.cc:515] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:19.068688 19418 ts_tablet_manager.cc:1434] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:19.073107 19423 leader_election.cc:290] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:19.073978 19418 tablet_bootstrap.cc:492] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:19.074524 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:19.076818 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:19.078558 19417 tablet_bootstrap.cc:492] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:19.079869 19417 ts_tablet_manager.cc:1403] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.237s	user 0.014s	sys 0.011s
I20260709 13:19:19.084355 19418 tablet_bootstrap.cc:654] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.079916 19225 raft_consensus.cc:2393] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 213472259ea74d45821f555378f40a08 in current term 1: Already voted for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in this term.
I20260709 13:19:19.086452 19342 leader_election.cc:304] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 213472259ea74d45821f555378f40a08; no voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:19.087921 19417 raft_consensus.cc:359] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.088495 19447 leader_election.cc:290] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:19.089052 19423 raft_consensus.cc:2749] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:19.089872 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b8780c15a44bca12c6b9448682755" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:19.090466 19417 raft_consensus.cc:385] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.090987 19417 raft_consensus.cc:740] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.091337 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b8780c15a44bca12c6b9448682755" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:19.092101 19225 raft_consensus.cc:3060] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.092437 19417 consensus_queue.cc:260] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.093716 19375 raft_consensus.cc:3060] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.096064 19417 ts_tablet_manager.cc:1434] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:19:19.097654 19417 tablet_bootstrap.cc:492] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:19.101994 19425 raft_consensus.cc:493] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.102823 19425 raft_consensus.cc:515] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.106319 19417 tablet_bootstrap.cc:654] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.106319 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:19.106963 19123 catalog_manager.cc:5697] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:19.109935 19192 leader_election.cc:343] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.111721 19425 leader_election.cc:290] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:19.113569 19418 tablet_bootstrap.cc:492] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:19.113358 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:19.115063 19418 ts_tablet_manager.cc:1403] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.041s	user 0.029s	sys 0.008s
W20260709 13:19:19.116421 19192 leader_election.cc:343] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.117118 19192 leader_election.cc:304] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4; no voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:19.118661 19425 raft_consensus.cc:2749] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:19.120035 19418 raft_consensus.cc:359] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.121816 19418 raft_consensus.cc:385] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.122345 19418 raft_consensus.cc:740] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.109959 19123 catalog_manager.cc:5697] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:19.123648 19418 consensus_queue.cc:260] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.124684 19123 catalog_manager.cc:5697] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.127652 19418 ts_tablet_manager.cc:1434] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 13:19:19.129026 19375 raft_consensus.cc:2468] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:19.129576 19418 tablet_bootstrap.cc:492] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:19.132781 19225 raft_consensus.cc:2468] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:19.135040 19268 leader_election.cc:304] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:19.136166 19447 raft_consensus.cc:2804] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:19.136736 19447 raft_consensus.cc:697] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:19.137657 19447 consensus_queue.cc:237] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.140654 19418 tablet_bootstrap.cc:654] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.141820 19417 tablet_bootstrap.cc:492] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:19.143025 19417 ts_tablet_manager.cc:1403] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.014s
I20260709 13:19:19.147392 19417 raft_consensus.cc:359] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.148715 19417 raft_consensus.cc:385] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.149217 19417 raft_consensus.cc:740] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.150432 19417 consensus_queue.cc:260] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.152698 19418 tablet_bootstrap.cc:492] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:19.153373 19418 ts_tablet_manager.cc:1403] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:19:19.153944 19417 ts_tablet_manager.cc:1434] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:19:19.155611 19417 tablet_bootstrap.cc:492] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:19.157327 19418 raft_consensus.cc:359] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.158214 19418 raft_consensus.cc:385] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.158511 19418 raft_consensus.cc:740] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.159480 19418 consensus_queue.cc:260] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.162232 19418 ts_tablet_manager.cc:1434] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:19:19.163494 19418 tablet_bootstrap.cc:492] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:19.164700 19417 tablet_bootstrap.cc:654] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.169703 19425 raft_consensus.cc:493] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.170444 19425 raft_consensus.cc:515] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.172721 19418 tablet_bootstrap.cc:654] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.174220 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a1ae7fb63a4c05b369caeacfce820e" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:19.175129 19303 raft_consensus.cc:2468] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 0.
I20260709 13:19:19.176504 19126 catalog_manager.cc:5697] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.177650 19425 leader_election.cc:290] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:19.177543 19192 leader_election.cc:304] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:19.180859 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a1ae7fb63a4c05b369caeacfce820e" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:19.181833 19375 raft_consensus.cc:2468] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 0.
I20260709 13:19:19.184804 19425 raft_consensus.cc:2804] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:19.185529 19425 raft_consensus.cc:493] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.186020 19425 raft_consensus.cc:3060] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.192255 19418 tablet_bootstrap.cc:492] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:19.192876 19418 ts_tablet_manager.cc:1403] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.007s
I20260709 13:19:19.195783 19417 tablet_bootstrap.cc:492] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:19.196489 19417 ts_tablet_manager.cc:1403] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.041s	user 0.029s	sys 0.002s
I20260709 13:19:19.196146 19418 raft_consensus.cc:359] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.196992 19418 raft_consensus.cc:385] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.197299 19418 raft_consensus.cc:740] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.197461 19425 raft_consensus.cc:515] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.198050 19418 consensus_queue.cc:260] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.199899 19418 ts_tablet_manager.cc:1434] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:19.200996 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a1ae7fb63a4c05b369caeacfce820e" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:19.201665 19303 raft_consensus.cc:3060] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.203315 19417 raft_consensus.cc:359] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.204438 19417 raft_consensus.cc:385] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.204653 19425 leader_election.cc:290] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Requested vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:19.204790 19417 raft_consensus.cc:740] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.205976 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a1ae7fb63a4c05b369caeacfce820e" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:19.206611 19375 raft_consensus.cc:3060] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.205861 19417 consensus_queue.cc:260] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.209017 19417 ts_tablet_manager.cc:1434] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:19:19.210112 19417 tablet_bootstrap.cc:492] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:19.211669 19303 raft_consensus.cc:2468] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 1.
I20260709 13:19:19.213390 19192 leader_election.cc:304] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:19.216507 19417 tablet_bootstrap.cc:654] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.216625 19425 raft_consensus.cc:2804] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:19.217355 19425 raft_consensus.cc:697] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Becoming Leader. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Running, Role: LEADER
I20260709 13:19:19.218286 19425 consensus_queue.cc:237] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.221922 19375 raft_consensus.cc:2468] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 1.
I20260709 13:19:19.228268 19303 raft_consensus.cc:3060] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.229049 19424 consensus_queue.cc:1048] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.230324 19417 tablet_bootstrap.cc:492] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:19.231137 19417 ts_tablet_manager.cc:1403] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 13:19:19.234731 19417 raft_consensus.cc:359] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.236022 19417 raft_consensus.cc:385] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.236851 19417 raft_consensus.cc:740] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.236462 19123 catalog_manager.cc:5697] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "505976ec5ba248f4816824b4186f2ef4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.238386 19417 consensus_queue.cc:260] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.240881 19425 consensus_queue.cc:1048] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.242214 19417 ts_tablet_manager.cc:1434] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:19:19.269209 19447 raft_consensus.cc:493] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.269989 19447 raft_consensus.cc:515] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.272692 19447 leader_election.cc:290] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:19.273983 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79799f339c9540ae8e8e1cc240e6cce0" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:19.274853 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79799f339c9540ae8e8e1cc240e6cce0" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:19.275724 19375 raft_consensus.cc:2468] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:19.275342 19225 raft_consensus.cc:2468] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:19.277696 19267 leader_election.cc:304] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:19.278779 19447 raft_consensus.cc:2804] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:19.279201 19447 raft_consensus.cc:493] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.279541 19447 raft_consensus.cc:3060] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.289059 19447 raft_consensus.cc:515] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.291255 19447 leader_election.cc:290] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:19.291980 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79799f339c9540ae8e8e1cc240e6cce0" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:19.292713 19225 raft_consensus.cc:3060] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.293506 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79799f339c9540ae8e8e1cc240e6cce0" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:19.294212 19377 raft_consensus.cc:3060] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.300206 19225 raft_consensus.cc:2468] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:19.301230 19377 raft_consensus.cc:2468] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:19.301502 19268 leader_election.cc:304] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:19.302600 19447 raft_consensus.cc:2804] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:19.303144 19447 raft_consensus.cc:697] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:19.303993 19447 consensus_queue.cc:237] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.312789 19123 catalog_manager.cc:5697] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.362274 19423 raft_consensus.cc:493] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.362884 19423 raft_consensus.cc:515] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.365053 19423 leader_election.cc:290] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:19.365914 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bbdde43fc3f48de80b94903fc565079" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:19.366187 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bbdde43fc3f48de80b94903fc565079" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:19.366779 19225 raft_consensus.cc:2468] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 0.
I20260709 13:19:19.366806 19303 raft_consensus.cc:2468] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 0.
I20260709 13:19:19.368381 19341 leader_election.cc:304] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:19.369208 19423 raft_consensus.cc:2804] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:19.369639 19423 raft_consensus.cc:493] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.369990 19423 raft_consensus.cc:3060] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.373457 19447 consensus_queue.cc:1048] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.378767 19423 raft_consensus.cc:515] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.380004 19447 consensus_queue.cc:1048] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.382602 19423 leader_election.cc:290] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:19.383342 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bbdde43fc3f48de80b94903fc565079" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:19.384124 19227 raft_consensus.cc:3060] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.384245 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bbdde43fc3f48de80b94903fc565079" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:19.384975 19303 raft_consensus.cc:3060] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.393538 19303 raft_consensus.cc:2468] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 1.
I20260709 13:19:19.394028 19227 raft_consensus.cc:2468] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 1.
I20260709 13:19:19.395044 19341 leader_election.cc:304] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:19.396489 19423 raft_consensus.cc:2804] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:19.397233 19423 raft_consensus.cc:697] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Becoming Leader. State: Replica: 213472259ea74d45821f555378f40a08, State: Running, Role: LEADER
I20260709 13:19:19.398041 19423 consensus_queue.cc:237] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.412099 19123 catalog_manager.cc:5697] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 213472259ea74d45821f555378f40a08 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "213472259ea74d45821f555378f40a08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:19.516244 19447 consensus_queue.cc:1048] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.530808 19453 consensus_queue.cc:1048] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.537022 19453 consensus_queue.cc:1048] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.551034 19453 consensus_queue.cc:1048] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.584393 19453 consensus_queue.cc:1048] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.596166 19445 consensus_queue.cc:1048] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.617259 19423 raft_consensus.cc:493] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.617761 19423 raft_consensus.cc:515] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.619688 19423 leader_election.cc:290] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:19.620746 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:19.620954 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
W20260709 13:19:19.621356 19174 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:19.621481 19225 raft_consensus.cc:2468] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 0.
I20260709 13:19:19.621748 19303 raft_consensus.cc:2468] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 0.
I20260709 13:19:19.622843 19342 leader_election.cc:304] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 505976ec5ba248f4816824b4186f2ef4; no voters: 
I20260709 13:19:19.623507 19423 raft_consensus.cc:2804] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:19.623853 19423 raft_consensus.cc:493] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.624135 19423 raft_consensus.cc:3060] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.629599 19423 raft_consensus.cc:515] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.631449 19423 leader_election.cc:290] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:19.632465 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:19.632752 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:19.633267 19225 raft_consensus.cc:3060] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.633720 19303 raft_consensus.cc:3060] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.639242 19225 raft_consensus.cc:2468] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 1.
I20260709 13:19:19.640131 19303 raft_consensus.cc:2468] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 1.
I20260709 13:19:19.640590 19342 leader_election.cc:304] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 505976ec5ba248f4816824b4186f2ef4; no voters: 
I20260709 13:19:19.641502 19423 raft_consensus.cc:2804] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:19.641927 19423 raft_consensus.cc:697] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Becoming Leader. State: Replica: 213472259ea74d45821f555378f40a08, State: Running, Role: LEADER
I20260709 13:19:19.642756 19423 consensus_queue.cc:237] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:19.650382 19123 catalog_manager.cc:5697] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 213472259ea74d45821f555378f40a08 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "213472259ea74d45821f555378f40a08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:19.685757 19475 consensus_queue.cc:1048] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.697108 19426 consensus_queue.cc:1048] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.703524 19475 consensus_queue.cc:1048] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.717468 19447 consensus_queue.cc:1048] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.755614 19303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866"
dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
mode: GRACEFUL
new_leader_uuid: "505976ec5ba248f4816824b4186f2ef4"
 from {username='slave'} at 127.0.0.1:52412
I20260709 13:19:19.756276 19303 raft_consensus.cc:606] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Received request to transfer leadership to TS 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:19.770036 19303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2172ced591b46b798d4ca34a7616333"
dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
mode: GRACEFUL
new_leader_uuid: "505976ec5ba248f4816824b4186f2ef4"
 from {username='slave'} at 127.0.0.1:52412
I20260709 13:19:19.770716 19303 raft_consensus.cc:606] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Received request to transfer leadership to TS 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:19.796779 19375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9"
dest_uuid: "213472259ea74d45821f555378f40a08"
mode: GRACEFUL
new_leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
 from {username='slave'} at 127.0.0.1:50046
I20260709 13:19:19.797385 19375 raft_consensus.cc:606] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Received request to transfer leadership to TS 941e2213bc1f4ba09ef0d0674a51ddf0
W20260709 13:19:19.889690 19324 debug-util.cc:398] Leaking SignalData structure 0x7b080028ade0 after lost signal to thread 6033
W20260709 13:19:19.891222 19324 debug-util.cc:398] Leaking SignalData structure 0x7b080020f920 after lost signal to thread 19160
W20260709 13:19:19.893036 19324 debug-util.cc:398] Leaking SignalData structure 0x7b080022d9c0 after lost signal to thread 19256
I20260709 13:19:19.983556 19423 consensus_queue.cc:1048] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.987439 19445 raft_consensus.cc:993] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0: : Instructing follower 505976ec5ba248f4816824b4186f2ef4 to start an election
I20260709 13:19:19.987998 19445 raft_consensus.cc:1081] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Signalling peer 505976ec5ba248f4816824b4186f2ef4 to start an election
I20260709 13:19:19.990051 19225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2172ced591b46b798d4ca34a7616333"
dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
 from {username='slave'} at 127.0.0.1:59450
I20260709 13:19:19.990732 19225 raft_consensus.cc:493] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.991194 19225 raft_consensus.cc:3060] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.004776 19225 raft_consensus.cc:515] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:20.005537 19498 consensus_queue.cc:1048] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:20.009120 19225 leader_election.cc:290] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 2 election: Requested vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:20.008782 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2172ced591b46b798d4ca34a7616333" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:20.017362 19303 raft_consensus.cc:3055] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:20.018215 19303 raft_consensus.cc:740] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:20.019513 19303 consensus_queue.cc:260] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:20.021333 19303 raft_consensus.cc:3060] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.021922 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2172ced591b46b798d4ca34a7616333" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:20.022729 19375 raft_consensus.cc:3060] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.030978 19426 raft_consensus.cc:993] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0: : Instructing follower 505976ec5ba248f4816824b4186f2ef4 to start an election
I20260709 13:19:20.030812 19303 raft_consensus.cc:2468] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 2.
I20260709 13:19:20.031626 19426 raft_consensus.cc:1081] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Signalling peer 505976ec5ba248f4816824b4186f2ef4 to start an election
I20260709 13:19:20.032501 19192 leader_election.cc:304] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:20.033563 19475 raft_consensus.cc:2804] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:20.033979 19225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866"
dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
 from {username='slave'} at 127.0.0.1:59450
I20260709 13:19:20.034948 19225 raft_consensus.cc:493] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:20.034094 19475 raft_consensus.cc:697] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 2 LEADER]: Becoming Leader. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Running, Role: LEADER
I20260709 13:19:20.036317 19475 consensus_queue.cc:237] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:20.037420 19375 raft_consensus.cc:2468] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 2.
I20260709 13:19:20.035396 19225 raft_consensus.cc:3060] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.046737 19125 catalog_manager.cc:5697] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 reported cstate change: term changed from 1 to 2, leader changed from 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130) to 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "505976ec5ba248f4816824b4186f2ef4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:20.051803 19225 raft_consensus.cc:515] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:20.056317 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:20.057148 19375 raft_consensus.cc:3060] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.062398 19225 leader_election.cc:290] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 2 election: Requested vote from peers 213472259ea74d45821f555378f40a08 (127.5.227.131:40775), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:20.067544 19375 raft_consensus.cc:2468] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 2.
I20260709 13:19:20.069509 19192 leader_election.cc:304] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 505976ec5ba248f4816824b4186f2ef4; no voters: 
I20260709 13:19:20.070492 19475 raft_consensus.cc:2804] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:20.071051 19475 raft_consensus.cc:697] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 2 LEADER]: Becoming Leader. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Running, Role: LEADER
I20260709 13:19:20.071926 19475 consensus_queue.cc:237] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:20.073405 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:20.074313 19302 raft_consensus.cc:3055] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:20.074812 19302 raft_consensus.cc:740] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:20.076041 19302 consensus_queue.cc:260] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:20.077677 19302 raft_consensus.cc:3060] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.078811 19423 consensus_queue.cc:1048] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:20.090029 19302 raft_consensus.cc:2468] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 2.
I20260709 13:19:20.092130 19125 catalog_manager.cc:5697] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 reported cstate change: term changed from 1 to 2, leader changed from 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130) to 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "505976ec5ba248f4816824b4186f2ef4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:20.096415 19423 consensus_queue.cc:1048] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:20.109416 19498 raft_consensus.cc:993] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08: : Instructing follower 941e2213bc1f4ba09ef0d0674a51ddf0 to start an election
I20260709 13:19:20.109923 19498 raft_consensus.cc:1081] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Signalling peer 941e2213bc1f4ba09ef0d0674a51ddf0 to start an election
I20260709 13:19:20.112761 19303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9"
dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
 from {username='slave'} at 127.0.0.1:52408
I20260709 13:19:20.113505 19303 raft_consensus.cc:493] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:20.114053 19303 raft_consensus.cc:3060] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.131052 19303 raft_consensus.cc:515] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:20.132462 19302 raft_consensus.cc:1240] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Rejecting Update request from peer 213472259ea74d45821f555378f40a08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:20.134579 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:20.135543 19227 raft_consensus.cc:3060] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.136760 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:20.137349 19423 consensus_queue.cc:1059] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:20.134848 19303 leader_election.cc:290] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 2 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:20.140194 19375 raft_consensus.cc:3055] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:20.141355 19375 raft_consensus.cc:740] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Running, Role: LEADER
I20260709 13:19:20.142165 19375 consensus_queue.cc:260] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:20.143615 19375 raft_consensus.cc:3060] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.144943 19227 raft_consensus.cc:2468] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 2.
I20260709 13:19:20.147084 19268 leader_election.cc:304] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:20.148356 19445 raft_consensus.cc:2804] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:20.149130 19445 raft_consensus.cc:697] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:20.150214 19445 consensus_queue.cc:237] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:20.153313 19375 raft_consensus.cc:2468] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 2.
W20260709 13:19:20.155627 19423 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:19:20.161090 19125 catalog_manager.cc:5697] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 1 to 2, leader changed from 213472259ea74d45821f555378f40a08 (127.5.227.131) to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 2 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:20.521266 19303 raft_consensus.cc:1275] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Refusing update from remote peer 505976ec5ba248f4816824b4186f2ef4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.523399 19502 consensus_queue.cc:1048] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.542562 19375 raft_consensus.cc:1275] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Refusing update from remote peer 505976ec5ba248f4816824b4186f2ef4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.544474 19503 consensus_queue.cc:1048] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:20.562088 19375 raft_consensus.cc:1275] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Refusing update from remote peer 505976ec5ba248f4816824b4186f2ef4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.563726 19503 consensus_queue.cc:1048] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.580983 19303 raft_consensus.cc:1275] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Refusing update from remote peer 505976ec5ba248f4816824b4186f2ef4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.582604 19503 consensus_queue.cc:1048] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:20.616257 19375 raft_consensus.cc:1275] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Refusing update from remote peer 941e2213bc1f4ba09ef0d0674a51ddf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.617890 19445 consensus_queue.cc:1048] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.634533 19227 raft_consensus.cc:1275] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Refusing update from remote peer 941e2213bc1f4ba09ef0d0674a51ddf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.639242 19447 consensus_queue.cc:1048] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:22.838330 19123 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52624:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:22.842414 19123 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:22.913395 19216 tablet_service.cc:1511] Processing CreateTablet for tablet b504e939f6604e108e7857a8eadcdb9c (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:22.914901 19216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b504e939f6604e108e7857a8eadcdb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.917436 19363 tablet_service.cc:1511] Processing CreateTablet for tablet b504e939f6604e108e7857a8eadcdb9c (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:22.918926 19363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b504e939f6604e108e7857a8eadcdb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.921065 19217 tablet_service.cc:1511] Processing CreateTablet for tablet cd6a450de2e74cde9e79e8e3945a6bf3 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:22.922856 19217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6a450de2e74cde9e79e8e3945a6bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.923460 19367 tablet_service.cc:1511] Processing CreateTablet for tablet cd6a450de2e74cde9e79e8e3945a6bf3 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:22.924998 19367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6a450de2e74cde9e79e8e3945a6bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.928400 19288 tablet_service.cc:1511] Processing CreateTablet for tablet b504e939f6604e108e7857a8eadcdb9c (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:22.928608 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd5a8307b3146ccb8a0212389c8d59f (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:22.930125 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b504e939f6604e108e7857a8eadcdb9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.931952 19287 tablet_service.cc:1511] Processing CreateTablet for tablet cd6a450de2e74cde9e79e8e3945a6bf3 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:22.935353 19213 tablet_service.cc:1511] Processing CreateTablet for tablet 5191ac17b3c14da88c043052f7596b12 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:22.937230 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5191ac17b3c14da88c043052f7596b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.937017 19292 tablet_service.cc:1511] Processing CreateTablet for tablet 5191ac17b3c14da88c043052f7596b12 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:22.939218 19292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5191ac17b3c14da88c043052f7596b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.940416 19364 tablet_service.cc:1511] Processing CreateTablet for tablet 5191ac17b3c14da88c043052f7596b12 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:22.941691 19287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6a450de2e74cde9e79e8e3945a6bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.942101 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5191ac17b3c14da88c043052f7596b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.935479 19218 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd5a8307b3146ccb8a0212389c8d59f (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:22.944371 19218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd5a8307b3146ccb8a0212389c8d59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.945297 19291 tablet_service.cc:1511] Processing CreateTablet for tablet 71df5f549ecc496aa86fe68e021fbc24 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:22.946862 19291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71df5f549ecc496aa86fe68e021fbc24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.931952 19366 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd5a8307b3146ccb8a0212389c8d59f (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:22.949764 19366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd5a8307b3146ccb8a0212389c8d59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.949885 19214 tablet_service.cc:1511] Processing CreateTablet for tablet 71df5f549ecc496aa86fe68e021fbc24 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:22.951525 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71df5f549ecc496aa86fe68e021fbc24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.955363 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd5a8307b3146ccb8a0212389c8d59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.958953 19365 tablet_service.cc:1511] Processing CreateTablet for tablet 71df5f549ecc496aa86fe68e021fbc24 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:22.960677 19365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71df5f549ecc496aa86fe68e021fbc24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.963312 19215 tablet_service.cc:1511] Processing CreateTablet for tablet 964a8aeb615a4077a685c9f9b1a77097 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:22.964984 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964a8aeb615a4077a685c9f9b1a77097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.973582 19293 tablet_service.cc:1511] Processing CreateTablet for tablet 964a8aeb615a4077a685c9f9b1a77097 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:22.975260 19293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964a8aeb615a4077a685c9f9b1a77097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.976713 19362 tablet_service.cc:1511] Processing CreateTablet for tablet 964a8aeb615a4077a685c9f9b1a77097 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:22.978294 19362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964a8aeb615a4077a685c9f9b1a77097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.979789 19212 tablet_service.cc:1511] Processing CreateTablet for tablet d4f5976eabdd449899ff90c1277750e0 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:22.981971 19212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f5976eabdd449899ff90c1277750e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.982888 19289 tablet_service.cc:1511] Processing CreateTablet for tablet d4f5976eabdd449899ff90c1277750e0 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:22.984444 19289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f5976eabdd449899ff90c1277750e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.993183 19361 tablet_service.cc:1511] Processing CreateTablet for tablet d4f5976eabdd449899ff90c1277750e0 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:22.996445 19211 tablet_service.cc:1511] Processing CreateTablet for tablet df2dad9a95aa4504b7c8b393525e0a3d (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:22.998302 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2dad9a95aa4504b7c8b393525e0a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.999156 19361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f5976eabdd449899ff90c1277750e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:22.999459 19286 tablet_service.cc:1511] Processing CreateTablet for tablet df2dad9a95aa4504b7c8b393525e0a3d (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:23.001384 19286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2dad9a95aa4504b7c8b393525e0a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.003818 19360 tablet_service.cc:1511] Processing CreateTablet for tablet df2dad9a95aa4504b7c8b393525e0a3d (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:23.006212 19360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2dad9a95aa4504b7c8b393525e0a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.006491 19210 tablet_service.cc:1511] Processing CreateTablet for tablet 89a3fd4ea62c41e4b4a48cbcd961a6b3 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:23.008229 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a3fd4ea62c41e4b4a48cbcd961a6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.037936 19359 tablet_service.cc:1511] Processing CreateTablet for tablet 89a3fd4ea62c41e4b4a48cbcd961a6b3 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:23.039605 19359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a3fd4ea62c41e4b4a48cbcd961a6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.063745 19285 tablet_service.cc:1511] Processing CreateTablet for tablet 89a3fd4ea62c41e4b4a48cbcd961a6b3 (DEFAULT_TABLE table=soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:23.065522 19285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a3fd4ea62c41e4b4a48cbcd961a6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.120956 19519 tablet_bootstrap.cc:492] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:23.135331 19519 tablet_bootstrap.cc:654] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:23.171298 19192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.130:39857, user_credentials={real_user=slave}} blocked reactor thread for 60455.5us
I20260709 13:19:23.221611 19519 tablet_bootstrap.cc:492] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:23.222285 19519 ts_tablet_manager.cc:1403] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.009s
I20260709 13:19:23.225898 19519 raft_consensus.cc:359] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.226809 19519 raft_consensus.cc:385] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.227181 19519 raft_consensus.cc:740] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.228214 19519 consensus_queue.cc:260] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.231038 19519 ts_tablet_manager.cc:1434] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:19:23.232519 19519 tablet_bootstrap.cc:492] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:23.264398 19523 tablet_bootstrap.cc:492] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:23.268380 19519 tablet_bootstrap.cc:654] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.269155 19522 tablet_bootstrap.cc:492] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:23.277740 19523 tablet_bootstrap.cc:654] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.286612 19522 tablet_bootstrap.cc:654] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.299320 19523 tablet_bootstrap.cc:492] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:23.299963 19522 tablet_bootstrap.cc:492] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:23.300223 19523 ts_tablet_manager.cc:1403] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.008s
I20260709 13:19:23.300798 19522 ts_tablet_manager.cc:1403] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.000s
I20260709 13:19:23.304312 19523 raft_consensus.cc:359] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.307772 19523 raft_consensus.cc:385] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.308162 19523 raft_consensus.cc:740] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.308516 19519 tablet_bootstrap.cc:492] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:23.308827 19445 raft_consensus.cc:493] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.309232 19519 ts_tablet_manager.cc:1403] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.014s
I20260709 13:19:23.309051 19523 consensus_queue.cc:260] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.309535 19445 raft_consensus.cc:515] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.313055 19519 raft_consensus.cc:359] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.313278 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:23.313897 19519 raft_consensus.cc:385] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.314265 19519 raft_consensus.cc:740] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.315279 19519 consensus_queue.cc:260] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
W20260709 13:19:23.316044 19268 leader_election.cc:343] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.320170 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
W20260709 13:19:23.322175 19267 leader_election.cc:343] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.322793 19267 leader_election.cc:304] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 213472259ea74d45821f555378f40a08, 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:23.324277 19445 leader_election.cc:290] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:23.335300 19445 raft_consensus.cc:2749] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.304616 19522 raft_consensus.cc:359] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.341989 19522 raft_consensus.cc:385] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.342957 19522 raft_consensus.cc:740] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.344321 19523 ts_tablet_manager.cc:1434] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.001s
I20260709 13:19:23.344475 19522 consensus_queue.cc:260] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.351614 19522 ts_tablet_manager.cc:1434] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:19:23.363970 19522 tablet_bootstrap.cc:492] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:23.371906 19522 tablet_bootstrap.cc:654] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.346225 19523 tablet_bootstrap.cc:492] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:23.387976 19519 ts_tablet_manager.cc:1434] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.078s	user 0.023s	sys 0.043s
I20260709 13:19:23.389460 19519 tablet_bootstrap.cc:492] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:23.390307 19523 tablet_bootstrap.cc:654] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.397960 19519 tablet_bootstrap.cc:654] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.398160 19522 tablet_bootstrap.cc:492] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:23.399251 19522 ts_tablet_manager.cc:1403] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.000s
I20260709 13:19:23.405256 19519 tablet_bootstrap.cc:492] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:23.405982 19519 ts_tablet_manager.cc:1403] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 13:19:23.409284 19519 raft_consensus.cc:359] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.410045 19519 raft_consensus.cc:385] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.410395 19519 raft_consensus.cc:740] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.411291 19519 consensus_queue.cc:260] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.413537 19522 raft_consensus.cc:359] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.414428 19522 raft_consensus.cc:385] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.414786 19522 raft_consensus.cc:740] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.417074 19519 ts_tablet_manager.cc:1434] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:19:23.417127 19523 tablet_bootstrap.cc:492] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:23.417974 19523 ts_tablet_manager.cc:1403] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.004s
I20260709 13:19:23.418532 19519 tablet_bootstrap.cc:492] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:23.421638 19523 raft_consensus.cc:359] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.422652 19523 raft_consensus.cc:385] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.428398 19519 tablet_bootstrap.cc:654] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.428534 19523 raft_consensus.cc:740] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.429668 19523 consensus_queue.cc:260] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.427510 19522 consensus_queue.cc:260] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.433353 19522 ts_tablet_manager.cc:1434] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:19:23.439360 19523 ts_tablet_manager.cc:1434] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.007s
I20260709 13:19:23.440757 19523 tablet_bootstrap.cc:492] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:23.442799 19522 tablet_bootstrap.cc:492] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:23.452170 19522 tablet_bootstrap.cc:654] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.459275 19523 tablet_bootstrap.cc:654] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.459967 19519 tablet_bootstrap.cc:492] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:23.460641 19519 ts_tablet_manager.cc:1403] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.015s
I20260709 13:19:23.465792 19519 raft_consensus.cc:359] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.466666 19519 raft_consensus.cc:385] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.466986 19519 raft_consensus.cc:740] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.467906 19519 consensus_queue.cc:260] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.471244 19519 ts_tablet_manager.cc:1434] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:19:23.475451 19519 tablet_bootstrap.cc:492] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:23.485816 19519 tablet_bootstrap.cc:654] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.503854 19506 raft_consensus.cc:493] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.504609 19506 raft_consensus.cc:515] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.508407 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2dad9a95aa4504b7c8b393525e0a3d" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:23.508662 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2dad9a95aa4504b7c8b393525e0a3d" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:23.510151 19506 leader_election.cc:290] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
W20260709 13:19:23.510723 19341 leader_election.cc:343] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.512539 19522 tablet_bootstrap.cc:492] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
W20260709 13:19:23.512746 19342 leader_election.cc:343] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.513509 19522 ts_tablet_manager.cc:1403] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.017s
I20260709 13:19:23.513545 19342 leader_election.cc:304] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 213472259ea74d45821f555378f40a08; no voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:23.512526 19523 tablet_bootstrap.cc:492] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:23.515220 19506 raft_consensus.cc:2749] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.515897 19523 ts_tablet_manager.cc:1403] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.008s
I20260709 13:19:23.517781 19522 raft_consensus.cc:359] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.518738 19522 raft_consensus.cc:385] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.519066 19522 raft_consensus.cc:740] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.519279 19523 raft_consensus.cc:359] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.520159 19523 raft_consensus.cc:385] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.520473 19523 raft_consensus.cc:740] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.529047 19523 consensus_queue.cc:260] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.531836 19519 tablet_bootstrap.cc:492] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:23.531725 19522 consensus_queue.cc:260] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.532650 19519 ts_tablet_manager.cc:1403] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.003s
I20260709 13:19:23.535140 19522 ts_tablet_manager.cc:1434] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:19:23.538678 19522 tablet_bootstrap.cc:492] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:23.546325 19519 raft_consensus.cc:359] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.547197 19519 raft_consensus.cc:385] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.547541 19519 raft_consensus.cc:740] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.548806 19519 consensus_queue.cc:260] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.551481 19523 ts_tablet_manager.cc:1434] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:19:23.552160 19522 tablet_bootstrap.cc:654] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.556746 19519 ts_tablet_manager.cc:1434] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:19:23.558462 19519 tablet_bootstrap.cc:492] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:23.559526 19523 tablet_bootstrap.cc:492] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:23.569089 19519 tablet_bootstrap.cc:654] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.574787 19528 raft_consensus.cc:493] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.575987 19528 raft_consensus.cc:515] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.580092 19528 leader_election.cc:290] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:23.581310 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5976eabdd449899ff90c1277750e0" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:23.582703 19523 tablet_bootstrap.cc:654] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:23.583209 19267 leader_election.cc:343] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.583264 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5976eabdd449899ff90c1277750e0" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
W20260709 13:19:23.585567 19268 leader_election.cc:343] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.586179 19268 leader_election.cc:304] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 213472259ea74d45821f555378f40a08, 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:23.587374 19528 raft_consensus.cc:2749] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.592340 19522 tablet_bootstrap.cc:492] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:23.593166 19522 ts_tablet_manager.cc:1403] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.011s
I20260709 13:19:23.596149 19519 tablet_bootstrap.cc:492] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:23.596979 19519 ts_tablet_manager.cc:1403] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.009s
I20260709 13:19:23.599155 19522 raft_consensus.cc:359] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.600397 19522 raft_consensus.cc:385] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.600809 19522 raft_consensus.cc:740] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.600605 19519 raft_consensus.cc:359] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.601809 19519 raft_consensus.cc:385] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.602206 19519 raft_consensus.cc:740] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.602101 19522 consensus_queue.cc:260] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.603437 19519 consensus_queue.cc:260] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.606711 19519 ts_tablet_manager.cc:1434] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:19:23.609660 19523 tablet_bootstrap.cc:492] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:23.610419 19523 ts_tablet_manager.cc:1403] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.016s
I20260709 13:19:23.614692 19522 ts_tablet_manager.cc:1434] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:19:23.616202 19522 tablet_bootstrap.cc:492] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:23.614974 19523 raft_consensus.cc:359] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.626016 19523 raft_consensus.cc:385] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.617843 19519 tablet_bootstrap.cc:492] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:23.618438 19521 raft_consensus.cc:493] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.626523 19523 raft_consensus.cc:740] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.627337 19522 tablet_bootstrap.cc:654] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.627053 19521 raft_consensus.cc:515] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.627889 19523 consensus_queue.cc:260] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.629666 19521 leader_election.cc:290] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:23.630355 19523 ts_tablet_manager.cc:1434] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:19:23.632193 19523 tablet_bootstrap.cc:492] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:23.637878 19519 tablet_bootstrap.cc:654] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.639739 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd5a8307b3146ccb8a0212389c8d59f" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:23.640672 19302 raft_consensus.cc:2468] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 0.
I20260709 13:19:23.642165 19523 tablet_bootstrap.cc:654] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.642019 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd5a8307b3146ccb8a0212389c8d59f" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:23.645890 19192 leader_election.cc:304] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
W20260709 13:19:23.647125 19192 leader_election.cc:343] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.648554 19520 raft_consensus.cc:2804] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:23.649003 19520 raft_consensus.cc:493] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.649349 19520 raft_consensus.cc:3060] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.652248 19506 raft_consensus.cc:493] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.652887 19506 raft_consensus.cc:515] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.659153 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964a8aeb615a4077a685c9f9b1a77097" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
W20260709 13:19:23.660974 19341 leader_election.cc:343] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.656996 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964a8aeb615a4077a685c9f9b1a77097" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
W20260709 13:19:23.663574 19342 leader_election.cc:343] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.664279 19342 leader_election.cc:304] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 213472259ea74d45821f555378f40a08; no voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:23.655342 19506 leader_election.cc:290] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:23.665551 19537 raft_consensus.cc:2749] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:23.679497 19174 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:23.684247 19522 tablet_bootstrap.cc:492] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:23.676225 19520 raft_consensus.cc:515] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.684960 19522 ts_tablet_manager.cc:1403] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.004s
I20260709 13:19:23.686450 19519 tablet_bootstrap.cc:492] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:23.687227 19519 ts_tablet_manager.cc:1403] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.029s
I20260709 13:19:23.688066 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd5a8307b3146ccb8a0212389c8d59f" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:23.688637 19522 raft_consensus.cc:359] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.689178 19302 raft_consensus.cc:3060] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.689548 19520 leader_election.cc:290] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Requested vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:23.689548 19522 raft_consensus.cc:385] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.690316 19522 raft_consensus.cc:740] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.690968 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd5a8307b3146ccb8a0212389c8d59f" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:23.691267 19522 consensus_queue.cc:260] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.692525 19537 raft_consensus.cc:493] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.693159 19192 leader_election.cc:343] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.693472 19537 raft_consensus.cc:515] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.692469 19519 raft_consensus.cc:359] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.695963 19519 raft_consensus.cc:385] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.696331 19519 raft_consensus.cc:740] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.697151 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6a450de2e74cde9e79e8e3945a6bf3" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:23.697156 19519 consensus_queue.cc:260] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.697506 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6a450de2e74cde9e79e8e3945a6bf3" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:23.698019 19227 raft_consensus.cc:2468] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 0.
I20260709 13:19:23.698369 19303 raft_consensus.cc:2468] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 0.
I20260709 13:19:23.699892 19341 leader_election.cc:304] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:23.700866 19506 raft_consensus.cc:2804] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:23.701556 19506 raft_consensus.cc:493] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.701967 19506 raft_consensus.cc:3060] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.704079 19519 ts_tablet_manager.cc:1434] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:19:23.704523 19302 raft_consensus.cc:2468] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 1.
I20260709 13:19:23.707744 19523 tablet_bootstrap.cc:492] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:23.708434 19523 ts_tablet_manager.cc:1403] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.022s
I20260709 13:19:23.711206 19192 leader_election.cc:304] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 213472259ea74d45821f555378f40a08
I20260709 13:19:23.698031 19537 leader_election.cc:290] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:23.712340 19523 raft_consensus.cc:359] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.713392 19523 raft_consensus.cc:385] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.713779 19523 raft_consensus.cc:740] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.713935 19520 raft_consensus.cc:2804] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:23.715024 19519 tablet_bootstrap.cc:492] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:23.714962 19523 consensus_queue.cc:260] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.717952 19523 ts_tablet_manager.cc:1434] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:19:23.719241 19523 tablet_bootstrap.cc:492] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:23.715626 19520 raft_consensus.cc:697] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Becoming Leader. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Running, Role: LEADER
I20260709 13:19:23.724503 19520 consensus_queue.cc:237] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.726876 19523 tablet_bootstrap.cc:654] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.723016 19506 raft_consensus.cc:515] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.722517 19519 tablet_bootstrap.cc:654] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.730980 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6a450de2e74cde9e79e8e3945a6bf3" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:23.731741 19302 raft_consensus.cc:3060] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.734201 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6a450de2e74cde9e79e8e3945a6bf3" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:23.734920 19227 raft_consensus.cc:3060] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.737424 19506 leader_election.cc:290] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:23.747710 19302 raft_consensus.cc:2468] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 1.
I20260709 13:19:23.749444 19341 leader_election.cc:304] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:23.750679 19506 raft_consensus.cc:2804] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:23.751542 19506 raft_consensus.cc:697] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Becoming Leader. State: Replica: 213472259ea74d45821f555378f40a08, State: Running, Role: LEADER
I20260709 13:19:23.752569 19506 consensus_queue.cc:237] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.755548 19522 ts_tablet_manager.cc:1434] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.003s
I20260709 13:19:23.757407 19522 tablet_bootstrap.cc:492] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:23.766455 19519 tablet_bootstrap.cc:492] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:23.767210 19519 ts_tablet_manager.cc:1403] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.005s
I20260709 13:19:23.770610 19519 raft_consensus.cc:359] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.771449 19519 raft_consensus.cc:385] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.771824 19519 raft_consensus.cc:740] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.771514 19123 catalog_manager.cc:5697] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 213472259ea74d45821f555378f40a08 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "213472259ea74d45821f555378f40a08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.772621 19519 consensus_queue.cc:260] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.775851 19519 ts_tablet_manager.cc:1434] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:23.777073 19519 tablet_bootstrap.cc:492] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0: Bootstrap starting.
I20260709 13:19:23.781888 19528 raft_consensus.cc:493] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.785607 19125 catalog_manager.cc:5697] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "505976ec5ba248f4816824b4186f2ef4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.782608 19528 raft_consensus.cc:515] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.791162 19528 leader_election.cc:290] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:23.793401 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964a8aeb615a4077a685c9f9b1a77097" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:23.788127 19227 raft_consensus.cc:2468] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 1.
I20260709 13:19:23.793727 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964a8aeb615a4077a685c9f9b1a77097" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
W20260709 13:19:23.795591 19268 leader_election.cc:343] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.794305 19375 raft_consensus.cc:2468] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:23.797143 19519 tablet_bootstrap.cc:654] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.798146 19267 leader_election.cc:304] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:23.798905 19523 tablet_bootstrap.cc:492] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:23.799269 19528 raft_consensus.cc:2804] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:23.799875 19528 raft_consensus.cc:493] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.800180 19523 ts_tablet_manager.cc:1403] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.020s
I20260709 13:19:23.800607 19528 raft_consensus.cc:3060] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.804301 19506 raft_consensus.cc:493] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.805691 19506 raft_consensus.cc:515] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.811481 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:23.813975 19523 raft_consensus.cc:359] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
W20260709 13:19:23.814337 19342 leader_election.cc:343] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.815017 19523 raft_consensus.cc:385] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.815429 19523 raft_consensus.cc:740] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.816362 19523 consensus_queue.cc:260] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.818436 19523 ts_tablet_manager.cc:1434] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:19:23.818089 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:23.818858 19522 tablet_bootstrap.cc:654] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.819900 19523 tablet_bootstrap.cc:492] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08: Bootstrap starting.
W20260709 13:19:23.821748 19341 leader_election.cc:343] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.822428 19341 leader_election.cc:304] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 213472259ea74d45821f555378f40a08; no voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:23.823814 19506 leader_election.cc:290] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:23.824051 19537 raft_consensus.cc:2749] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.827929 19523 tablet_bootstrap.cc:654] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.835551 19520 raft_consensus.cc:493] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.836757 19520 raft_consensus.cc:515] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.838549 19519 tablet_bootstrap.cc:492] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0: No bootstrap required, opened a new log
I20260709 13:19:23.839275 19520 leader_election.cc:290] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:23.839280 19519 ts_tablet_manager.cc:1403] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.018s
I20260709 13:19:23.840250 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b504e939f6604e108e7857a8eadcdb9c" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:23.840456 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b504e939f6604e108e7857a8eadcdb9c" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:23.841017 19302 raft_consensus.cc:2468] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 0.
W20260709 13:19:23.842038 19192 leader_election.cc:343] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.842904 19192 leader_election.cc:304] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 213472259ea74d45821f555378f40a08
I20260709 13:19:23.843240 19519 raft_consensus.cc:359] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.844149 19519 raft_consensus.cc:385] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.844345 19520 raft_consensus.cc:2804] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:23.844422 19519 raft_consensus.cc:740] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.845098 19520 raft_consensus.cc:493] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.845645 19519 consensus_queue.cc:260] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.845502 19520 raft_consensus.cc:3060] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.850170 19519 ts_tablet_manager.cc:1434] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:19:23.852249 19528 raft_consensus.cc:515] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.855649 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964a8aeb615a4077a685c9f9b1a77097" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
W20260709 13:19:23.857923 19268 leader_election.cc:343] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.858741 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964a8aeb615a4077a685c9f9b1a77097" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:23.862505 19375 raft_consensus.cc:3060] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.865971 19522 tablet_bootstrap.cc:492] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:23.866742 19522 ts_tablet_manager.cc:1403] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.009s
I20260709 13:19:23.858942 19528 leader_election.cc:290] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:23.871556 19520 raft_consensus.cc:515] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.874900 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b504e939f6604e108e7857a8eadcdb9c" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:23.875609 19302 raft_consensus.cc:3060] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.878769 19522 raft_consensus.cc:359] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.880079 19522 raft_consensus.cc:385] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.880527 19522 raft_consensus.cc:740] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.883045 19520 leader_election.cc:290] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Requested vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:23.887573 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b504e939f6604e108e7857a8eadcdb9c" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:23.889526 19503 raft_consensus.cc:493] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.890790 19503 raft_consensus.cc:515] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.893290 19503 leader_election.cc:290] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:23.893973 19375 raft_consensus.cc:2468] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:23.895991 19267 leader_election.cc:304] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:23.897162 19528 raft_consensus.cc:2804] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:23.897732 19528 raft_consensus.cc:697] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:23.900283 19522 consensus_queue.cc:260] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
W20260709 13:19:23.901292 19192 leader_election.cc:343] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.901767 19528 consensus_queue.cc:237] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.903517 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:23.903630 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:23.904711 19303 raft_consensus.cc:2468] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 0.
I20260709 13:19:23.912798 19529 raft_consensus.cc:493] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.913455 19529 raft_consensus.cc:515] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
W20260709 13:19:23.945855 19192 leader_election.cc:343] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.946211 19522 ts_tablet_manager.cc:1434] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.001s
I20260709 13:19:23.947024 19192 leader_election.cc:304] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 213472259ea74d45821f555378f40a08
I20260709 13:19:23.947613 19523 tablet_bootstrap.cc:492] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:23.948480 19520 raft_consensus.cc:2804] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:23.948931 19529 leader_election.cc:290] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:23.948949 19520 raft_consensus.cc:493] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.948722 19302 raft_consensus.cc:2468] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 1.
I20260709 13:19:23.949646 19520 raft_consensus.cc:3060] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.950460 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
W20260709 13:19:23.953500 19268 leader_election.cc:343] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.948288 19523 ts_tablet_manager.cc:1403] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.010s
I20260709 13:19:23.947516 19522 tablet_bootstrap.cc:492] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:23.958156 19523 raft_consensus.cc:359] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.959065 19523 raft_consensus.cc:385] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.959416 19523 raft_consensus.cc:740] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.960237 19523 consensus_queue.cc:260] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.966917 19520 raft_consensus.cc:515] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.966512 19192 leader_election.cc:304] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 213472259ea74d45821f555378f40a08
I20260709 13:19:23.972292 19520 leader_election.cc:290] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Requested vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:23.968595 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:23.977977 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:23.978278 19377 raft_consensus.cc:2468] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:23.972527 19522 tablet_bootstrap.cc:654] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.972937 19555 raft_consensus.cc:2804] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:23.973965 19523 ts_tablet_manager.cc:1434] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:19:23.979530 19555 raft_consensus.cc:697] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Becoming Leader. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Running, Role: LEADER
W20260709 13:19:23.979631 19192 leader_election.cc:343] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 213472259ea74d45821f555378f40a08 (127.5.227.131:40775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:23.980322 19523 tablet_bootstrap.cc:492] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:23.980545 19555 consensus_queue.cc:237] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:23.984087 19267 leader_election.cc:304] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:23.976254 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:23.975651 19126 catalog_manager.cc:5697] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.992842 19523 tablet_bootstrap.cc:654] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.993232 19302 raft_consensus.cc:3060] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.998884 19529 raft_consensus.cc:2804] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:23.999593 19529 raft_consensus.cc:493] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.999708 19520 raft_consensus.cc:493] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.000415 19529 raft_consensus.cc:3060] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.000507 19520 raft_consensus.cc:515] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.006870 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964a8aeb615a4077a685c9f9b1a77097" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:24.008452 19302 raft_consensus.cc:2468] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 1.
I20260709 13:19:24.011658 19520 leader_election.cc:290] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:24.013559 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964a8aeb615a4077a685c9f9b1a77097" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:24.015038 19377 raft_consensus.cc:2393] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 505976ec5ba248f4816824b4186f2ef4 in current term 1: Already voted for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in this term.
I20260709 13:19:24.017798 19192 leader_election.cc:304] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4; no voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:24.019845 19529 raft_consensus.cc:515] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.020890 19192 leader_election.cc:304] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 213472259ea74d45821f555378f40a08
I20260709 13:19:24.021698 19520 raft_consensus.cc:3060] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.022019 19521 raft_consensus.cc:2804] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.022588 19521 raft_consensus.cc:697] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Becoming Leader. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Running, Role: LEADER
I20260709 13:19:24.023558 19521 consensus_queue.cc:237] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.024150 19522 tablet_bootstrap.cc:492] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:24.024362 19529 leader_election.cc:290] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:24.024910 19522 ts_tablet_manager.cc:1403] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.019s
I20260709 13:19:24.027058 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:24.028196 19522 raft_consensus.cc:359] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.028937 19522 raft_consensus.cc:385] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.029304 19522 raft_consensus.cc:740] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.029471 19523 tablet_bootstrap.cc:492] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:24.030200 19523 ts_tablet_manager.cc:1403] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.006s
I20260709 13:19:24.030097 19522 consensus_queue.cc:260] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
W20260709 13:19:24.028853 19268 leader_election.cc:343] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.031905 19520 raft_consensus.cc:2749] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.032836 19522 ts_tablet_manager.cc:1434] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:24.033998 19522 tablet_bootstrap.cc:492] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:24.034085 19523 raft_consensus.cc:359] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.035019 19523 raft_consensus.cc:385] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.035363 19523 raft_consensus.cc:740] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.036257 19523 consensus_queue.cc:260] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.038996 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:24.039811 19377 raft_consensus.cc:3060] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.041491 19522 tablet_bootstrap.cc:654] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.045732 19125 catalog_manager.cc:5697] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "505976ec5ba248f4816824b4186f2ef4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:24.063498 19523 ts_tablet_manager.cc:1434] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:19:24.055158 19529 raft_consensus.cc:493] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.064831 19523 tablet_bootstrap.cc:492] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08: Bootstrap starting.
I20260709 13:19:24.064975 19529 raft_consensus.cc:515] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.068925 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:24.070043 19529 leader_election.cc:290] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:24.052140 19506 raft_consensus.cc:493] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.071139 19523 tablet_bootstrap.cc:654] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.071084 19506 raft_consensus.cc:515] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.073649 19506 leader_election.cc:290] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
W20260709 13:19:24.074991 19268 leader_election.cc:343] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.077595 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:24.078819 19375 raft_consensus.cc:2468] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:24.079583 19377 raft_consensus.cc:2468] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:24.082814 19267 leader_election.cc:304] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:24.084314 19267 leader_election.cc:304] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:24.085611 19528 raft_consensus.cc:2804] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.086114 19528 raft_consensus.cc:493] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.086362 19529 raft_consensus.cc:2804] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.086499 19528 raft_consensus.cc:3060] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.087033 19529 raft_consensus.cc:697] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:24.087939 19529 consensus_queue.cc:237] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.095460 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:24.086115 19506 raft_consensus.cc:493] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.098124 19506 raft_consensus.cc:515] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.098385 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:24.098950 19522 tablet_bootstrap.cc:492] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:24.099677 19522 ts_tablet_manager.cc:1403] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.066s	user 0.024s	sys 0.025s
W20260709 13:19:24.100428 19342 leader_election.cc:343] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.102222 19506 leader_election.cc:290] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:24.102398 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5976eabdd449899ff90c1277750e0" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:24.103960 19303 raft_consensus.cc:2468] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 0.
I20260709 13:19:24.102989 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5976eabdd449899ff90c1277750e0" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:24.104738 19227 raft_consensus.cc:2468] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 0.
I20260709 13:19:24.105487 19341 leader_election.cc:304] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:24.105827 19126 catalog_manager.cc:5697] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129). New cstate: current_term: 1 leader_uuid: "505976ec5ba248f4816824b4186f2ef4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:24.108973 19506 raft_consensus.cc:2804] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.109736 19506 raft_consensus.cc:493] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.110700 19506 raft_consensus.cc:3060] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.115206 19445 raft_consensus.cc:493] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.114380 19522 raft_consensus.cc:359] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.115943 19445 raft_consensus.cc:515] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.116047 19522 raft_consensus.cc:385] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.116931 19522 raft_consensus.cc:740] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.118420 19445 leader_election.cc:290] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:24.118114 19522 consensus_queue.cc:260] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.120601 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2dad9a95aa4504b7c8b393525e0a3d" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:24.123687 19522 ts_tablet_manager.cc:1434] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:19:24.123492 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2dad9a95aa4504b7c8b393525e0a3d" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
W20260709 13:19:24.123570 19268 leader_election.cc:343] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.124521 19377 raft_consensus.cc:2468] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 0.
I20260709 13:19:24.126089 19267 leader_election.cc:304] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:24.122821 19555 raft_consensus.cc:493] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.126891 19555 raft_consensus.cc:515] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.127862 19528 raft_consensus.cc:515] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.129146 19555 leader_election.cc:290] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:24.129354 19537 raft_consensus.cc:493] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.133519 19537 raft_consensus.cc:515] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.133942 19302 raft_consensus.cc:2393] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 213472259ea74d45821f555378f40a08 in current term 1: Already voted for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in this term.
I20260709 13:19:24.135769 19537 leader_election.cc:290] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:24.138011 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd5a8307b3146ccb8a0212389c8d59f" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:24.138232 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd5a8307b3146ccb8a0212389c8d59f" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:24.139061 19301 raft_consensus.cc:2393] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 213472259ea74d45821f555378f40a08 in current term 1: Already voted for candidate 505976ec5ba248f4816824b4186f2ef4 in this term.
I20260709 13:19:24.131980 19445 raft_consensus.cc:2804] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.139106 19341 leader_election.cc:304] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 213472259ea74d45821f555378f40a08; no voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:24.139820 19445 raft_consensus.cc:493] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.140280 19445 raft_consensus.cc:3060] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.141217 19537 raft_consensus.cc:3060] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.132122 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:24.143397 19303 raft_consensus.cc:2393] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 505976ec5ba248f4816824b4186f2ef4 in current term 1: Already voted for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in this term.
I20260709 13:19:24.144546 19342 leader_election.cc:304] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 213472259ea74d45821f555378f40a08; no voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:24.131177 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:24.132783 19522 tablet_bootstrap.cc:492] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4: Bootstrap starting.
I20260709 13:19:24.129864 19506 raft_consensus.cc:515] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.154510 19375 raft_consensus.cc:3060] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.154502 19506 leader_election.cc:290] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:24.160338 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5976eabdd449899ff90c1277750e0" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:24.161412 19303 raft_consensus.cc:3060] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.160377 19125 catalog_manager.cc:5697] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:24.181142 19521 consensus_queue.cc:1048] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.187318 19537 raft_consensus.cc:2749] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.188005 19523 tablet_bootstrap.cc:492] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08: No bootstrap required, opened a new log
I20260709 13:19:24.188692 19523 ts_tablet_manager.cc:1403] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08: Time spent bootstrapping tablet: real 0.124s	user 0.022s	sys 0.021s
I20260709 13:19:24.188012 19303 raft_consensus.cc:2468] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 1.
I20260709 13:19:24.189664 19227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5976eabdd449899ff90c1277750e0" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:24.190505 19377 raft_consensus.cc:2468] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 1.
I20260709 13:19:24.190804 19227 raft_consensus.cc:3060] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.192708 19192 leader_election.cc:304] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 213472259ea74d45821f555378f40a08, 505976ec5ba248f4816824b4186f2ef4; no voters: 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:24.194181 19555 raft_consensus.cc:2804] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.194682 19555 raft_consensus.cc:493] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.195075 19555 raft_consensus.cc:3060] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.195608 19341 leader_election.cc:304] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:24.198889 19564 raft_consensus.cc:2804] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.199561 19564 raft_consensus.cc:697] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Becoming Leader. State: Replica: 213472259ea74d45821f555378f40a08, State: Running, Role: LEADER
I20260709 13:19:24.200543 19564 consensus_queue.cc:237] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.208721 19523 raft_consensus.cc:359] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.212606 19522 tablet_bootstrap.cc:654] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.214295 19528 leader_election.cc:290] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:24.215302 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:24.216189 19445 raft_consensus.cc:515] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.216630 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:24.227142 19521 consensus_queue.cc:1048] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.218029 19506 raft_consensus.cc:2749] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.225098 19523 raft_consensus.cc:385] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.229804 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2dad9a95aa4504b7c8b393525e0a3d" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:24.230372 19523 raft_consensus.cc:740] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.231364 19523 consensus_queue.cc:260] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
W20260709 13:19:24.232326 19268 leader_election.cc:343] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.233624 19523 ts_tablet_manager.cc:1434] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 13:19:24.236002 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2dad9a95aa4504b7c8b393525e0a3d" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:24.236960 19374 raft_consensus.cc:3060] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.239781 19537 raft_consensus.cc:493] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.240702 19537 raft_consensus.cc:515] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.244156 19377 raft_consensus.cc:2468] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:24.245886 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b504e939f6604e108e7857a8eadcdb9c" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:24.246680 19267 leader_election.cc:304] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:24.247762 19528 raft_consensus.cc:2804] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.248338 19528 raft_consensus.cc:697] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:24.248857 19537 leader_election.cc:290] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:24.249306 19528 consensus_queue.cc:237] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.249684 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b504e939f6604e108e7857a8eadcdb9c" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:24.251196 19303 raft_consensus.cc:2393] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 213472259ea74d45821f555378f40a08 in current term 1: Already voted for candidate 505976ec5ba248f4816824b4186f2ef4 in this term.
I20260709 13:19:24.252578 19341 leader_election.cc:304] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 213472259ea74d45821f555378f40a08; no voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:24.254266 19537 raft_consensus.cc:3060] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.204511 19227 raft_consensus.cc:2468] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 1.
I20260709 13:19:24.244763 19445 leader_election.cc:290] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:24.273774 19125 catalog_manager.cc:5697] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 213472259ea74d45821f555378f40a08 (127.5.227.131). New cstate: current_term: 1 leader_uuid: "213472259ea74d45821f555378f40a08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.286897 19555 raft_consensus.cc:515] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.295775 19225 raft_consensus.cc:2393] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in current term 1: Already voted for candidate 505976ec5ba248f4816824b4186f2ef4 in this term.
I20260709 13:19:24.296711 19506 consensus_queue.cc:1048] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.298959 19374 raft_consensus.cc:2468] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 1.
I20260709 13:19:24.299055 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:24.300453 19555 leader_election.cc:290] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Requested vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:24.300539 19267 leader_election.cc:304] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:24.302222 19537 raft_consensus.cc:2749] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.302994 19529 raft_consensus.cc:2804] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.302073 19376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:24.304601 19376 raft_consensus.cc:2393] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 505976ec5ba248f4816824b4186f2ef4 in current term 1: Already voted for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in this term.
I20260709 13:19:24.303555 19529 raft_consensus.cc:697] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:24.311653 19192 leader_election.cc:304] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4; no voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:24.311510 19529 consensus_queue.cc:237] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.319823 19555 raft_consensus.cc:2749] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.326748 19522 tablet_bootstrap.cc:492] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4: No bootstrap required, opened a new log
I20260709 13:19:24.327553 19522 ts_tablet_manager.cc:1403] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4: Time spent bootstrapping tablet: real 0.195s	user 0.022s	sys 0.021s
I20260709 13:19:24.332648 19522 raft_consensus.cc:359] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.333428 19522 raft_consensus.cc:385] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.333721 19522 raft_consensus.cc:740] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.335537 19126 catalog_manager.cc:5697] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:24.343317 19522 consensus_queue.cc:260] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.348580 19522 ts_tablet_manager.cc:1434] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:19:24.340884 19564 consensus_queue.cc:1048] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:19:24.379220 19445 consensus_queue.cc:1048] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.420147 19528 consensus_queue.cc:1048] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.443238 19126 catalog_manager.cc:5697] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 1 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:24.452275 19564 raft_consensus.cc:493] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.453825 19564 raft_consensus.cc:515] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.457598 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505976ec5ba248f4816824b4186f2ef4" is_pre_election: true
I20260709 13:19:24.459182 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:24.460438 19303 raft_consensus.cc:2393] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 213472259ea74d45821f555378f40a08 in current term 1: Already voted for candidate 505976ec5ba248f4816824b4186f2ef4 in this term.
I20260709 13:19:24.461587 19521 raft_consensus.cc:493] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.462021 19341 leader_election.cc:304] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 213472259ea74d45821f555378f40a08; no voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:24.463147 19506 raft_consensus.cc:3060] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.462224 19521 raft_consensus.cc:515] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.474009 19506 raft_consensus.cc:2749] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.474604 19564 leader_election.cc:290] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:24.475322 19375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:24.475397 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:24.476472 19375 raft_consensus.cc:2393] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 505976ec5ba248f4816824b4186f2ef4 in current term 1: Already voted for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in this term.
I20260709 13:19:24.478116 19192 leader_election.cc:304] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4; no voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:24.479058 19555 raft_consensus.cc:3060] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.474030 19521 leader_election.cc:290] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:24.490929 19555 raft_consensus.cc:2749] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.491437 19520 consensus_queue.cc:1048] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.496767 19521 consensus_queue.cc:1048] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.507069 19520 consensus_queue.cc:1048] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:24.518608 19376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd6a450de2e74cde9e79e8e3945a6bf3"
dest_uuid: "213472259ea74d45821f555378f40a08"
mode: GRACEFUL
new_leader_uuid: "505976ec5ba248f4816824b4186f2ef4"
 from {username='slave'} at 127.0.0.1:50046
I20260709 13:19:24.519745 19376 raft_consensus.cc:606] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Received request to transfer leadership to TS 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:24.524315 19520 consensus_queue.cc:1048] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:24.557986 19503 raft_consensus.cc:493] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.558593 19503 raft_consensus.cc:515] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.561471 19503 leader_election.cc:290] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:24.565042 19376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2dad9a95aa4504b7c8b393525e0a3d" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "213472259ea74d45821f555378f40a08" is_pre_election: true
I20260709 13:19:24.566370 19376 raft_consensus.cc:2393] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 505976ec5ba248f4816824b4186f2ef4 in current term 1: Already voted for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in this term.
I20260709 13:19:24.565356 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df2dad9a95aa4504b7c8b393525e0a3d" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" is_pre_election: true
I20260709 13:19:24.570436 19192 leader_election.cc:304] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4; no voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:24.571430 19503 raft_consensus.cc:3060] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.585359 19302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12"
dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
mode: GRACEFUL
new_leader_uuid: "505976ec5ba248f4816824b4186f2ef4"
 from {username='slave'} at 127.0.0.1:52412
I20260709 13:19:24.585942 19566 consensus_queue.cc:1048] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.586714 19302 raft_consensus.cc:606] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Received request to transfer leadership to TS 505976ec5ba248f4816824b4186f2ef4
I20260709 13:19:24.620812 19566 consensus_queue.cc:1048] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:24.639674 19503 raft_consensus.cc:2749] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.676105 19227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24"
dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
mode: GRACEFUL
new_leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
 from {username='slave'} at 127.0.0.1:59460
I20260709 13:19:24.676963 19227 raft_consensus.cc:606] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Received request to transfer leadership to TS 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:24.690435 19375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4f5976eabdd449899ff90c1277750e0"
dest_uuid: "213472259ea74d45821f555378f40a08"
mode: GRACEFUL
new_leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
 from {username='slave'} at 127.0.0.1:50046
I20260709 13:19:24.691151 19375 raft_consensus.cc:606] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Received request to transfer leadership to TS 941e2213bc1f4ba09ef0d0674a51ddf0
I20260709 13:19:24.700794 19302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3"
dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
mode: GRACEFUL
new_leader_uuid: "213472259ea74d45821f555378f40a08"
 from {username='slave'} at 127.0.0.1:52412
I20260709 13:19:24.701555 19302 raft_consensus.cc:606] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Received request to transfer leadership to TS 213472259ea74d45821f555378f40a08
I20260709 13:19:24.730458 19506 consensus_queue.cc:1048] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.798355 19566 consensus_queue.cc:1048] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.801446 19445 consensus_queue.cc:1048] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.805788 19506 consensus_queue.cc:1048] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.826076 19529 consensus_queue.cc:1048] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.834164 19445 consensus_queue.cc:1048] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.909057 19564 raft_consensus.cc:993] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08: : Instructing follower 941e2213bc1f4ba09ef0d0674a51ddf0 to start an election
I20260709 13:19:24.910202 19564 raft_consensus.cc:1081] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Signalling peer 941e2213bc1f4ba09ef0d0674a51ddf0 to start an election
I20260709 13:19:24.920092 19302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4f5976eabdd449899ff90c1277750e0"
dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
 from {username='slave'} at 127.0.0.1:52408
I20260709 13:19:24.921211 19302 raft_consensus.cc:493] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:24.921767 19302 raft_consensus.cc:3060] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:24.937208 19528 raft_consensus.cc:993] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0: : Instructing follower 505976ec5ba248f4816824b4186f2ef4 to start an election
I20260709 13:19:24.938076 19528 raft_consensus.cc:1081] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Signalling peer 505976ec5ba248f4816824b4186f2ef4 to start an election
I20260709 13:19:24.945772 19227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12"
dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
 from {username='slave'} at 127.0.0.1:59450
I20260709 13:19:24.946475 19227 raft_consensus.cc:493] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:24.946918 19227 raft_consensus.cc:3060] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:24.970165 19302 raft_consensus.cc:515] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.971724 19303 raft_consensus.cc:1240] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Rejecting Update request from peer 213472259ea74d45821f555378f40a08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:24.975234 19506 consensus_queue.cc:1059] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:24.976337 19506 raft_consensus.cc:3055] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:24.976723 19506 raft_consensus.cc:740] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Running, Role: LEADER
I20260709 13:19:24.978801 19520 raft_consensus.cc:993] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4: : Instructing follower 941e2213bc1f4ba09ef0d0674a51ddf0 to start an election
I20260709 13:19:24.978057 19506 consensus_queue.cc:260] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.979557 19520 raft_consensus.cc:1081] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Signalling peer 941e2213bc1f4ba09ef0d0674a51ddf0 to start an election
I20260709 13:19:24.980242 19506 raft_consensus.cc:3060] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:24.982026 19537 raft_consensus.cc:993] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08: : Instructing follower 505976ec5ba248f4816824b4186f2ef4 to start an election
I20260709 13:19:24.982120 19301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24"
dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
 from {username='slave'} at 127.0.0.1:52406
I20260709 13:19:24.983100 19564 raft_consensus.cc:1081] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Signalling peer 505976ec5ba248f4816824b4186f2ef4 to start an election
I20260709 13:19:24.983187 19301 raft_consensus.cc:493] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:24.984498 19301 raft_consensus.cc:3060] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:24.985353 19226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd6a450de2e74cde9e79e8e3945a6bf3"
dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
 from {username='slave'} at 127.0.0.1:59444
I20260709 13:19:24.986090 19226 raft_consensus.cc:493] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:24.986521 19226 raft_consensus.cc:3060] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:24.990509 19227 raft_consensus.cc:515] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:24.997316 19226 raft_consensus.cc:515] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.000675 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5976eabdd449899ff90c1277750e0" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:25.001324 19303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6a450de2e74cde9e79e8e3945a6bf3" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:25.001667 19225 raft_consensus.cc:3060] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:25.002099 19303 raft_consensus.cc:3060] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:25.002976 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6a450de2e74cde9e79e8e3945a6bf3" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:25.003835 19374 raft_consensus.cc:3055] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:25.004393 19302 leader_election.cc:290] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 2 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:25.004825 19377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f5976eabdd449899ff90c1277750e0" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:25.004433 19374 raft_consensus.cc:740] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 213472259ea74d45821f555378f40a08, State: Running, Role: LEADER
I20260709 13:19:25.017284 19374 consensus_queue.cc:260] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.018987 19374 raft_consensus.cc:3060] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:25.018747 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:25.019989 19300 raft_consensus.cc:3055] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:25.020346 19300 raft_consensus.cc:740] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:25.021445 19300 consensus_queue.cc:260] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.022035 19227 leader_election.cc:290] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 2 election: Requested vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:25.022756 19376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5191ac17b3c14da88c043052f7596b12" candidate_uuid: "505976ec5ba248f4816824b4186f2ef4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:25.023640 19376 raft_consensus.cc:3060] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:25.024374 19529 raft_consensus.cc:993] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0: : Instructing follower 213472259ea74d45821f555378f40a08 to start an election
I20260709 13:19:25.024930 19529 raft_consensus.cc:1081] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Signalling peer 213472259ea74d45821f555378f40a08 to start an election
I20260709 13:19:25.025204 19225 raft_consensus.cc:2468] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 2.
I20260709 13:19:25.026875 19268 leader_election.cc:304] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:25.027683 19300 raft_consensus.cc:3060] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:25.027478 19375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3"
dest_uuid: "213472259ea74d45821f555378f40a08"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:19:25.030589 19375 raft_consensus.cc:493] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:25.030980 19445 raft_consensus.cc:2804] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:25.032047 19445 raft_consensus.cc:697] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:25.033439 19445 consensus_queue.cc:237] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.031138 19375 raft_consensus.cc:3060] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:25.004554 19226 leader_election.cc:290] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 2 election: Requested vote from peers 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:25.039597 19300 raft_consensus.cc:2468] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 2.
I20260709 13:19:25.041632 19192 leader_election.cc:304] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:25.043018 19555 raft_consensus.cc:2804] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:25.043684 19555 raft_consensus.cc:697] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 2 LEADER]: Becoming Leader. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Running, Role: LEADER
I20260709 13:19:25.044893 19555 consensus_queue.cc:237] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.052031 19374 raft_consensus.cc:2468] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 2.
I20260709 13:19:25.075336 19377 raft_consensus.cc:2468] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 2.
I20260709 13:19:25.076928 19192 leader_election.cc:304] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 505976ec5ba248f4816824b4186f2ef4; no voters: 
I20260709 13:19:25.069988 19301 raft_consensus.cc:515] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.077752 19376 raft_consensus.cc:2468] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 2.
I20260709 13:19:25.082360 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:25.083107 19226 raft_consensus.cc:3055] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:25.083534 19226 raft_consensus.cc:740] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Running, Role: LEADER
I20260709 13:19:25.084879 19376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71df5f549ecc496aa86fe68e021fbc24" candidate_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "213472259ea74d45821f555378f40a08"
I20260709 13:19:25.086489 19301 leader_election.cc:290] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 2 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 213472259ea74d45821f555378f40a08 (127.5.227.131:40775)
I20260709 13:19:25.074458 19375 raft_consensus.cc:515] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.090088 19521 raft_consensus.cc:2804] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:25.090848 19521 raft_consensus.cc:697] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 2 LEADER]: Becoming Leader. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Running, Role: LEADER
I20260709 13:19:25.091676 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:25.085916 19376 raft_consensus.cc:3060] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:25.092640 19302 raft_consensus.cc:3055] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:25.093014 19302 raft_consensus.cc:740] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:25.094645 19375 leader_election.cc:290] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 2 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:25.091758 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a3fd4ea62c41e4b4a48cbcd961a6b3" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:25.094470 19302 consensus_queue.cc:260] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.095714 19225 raft_consensus.cc:3060] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:25.096683 19302 raft_consensus.cc:3060] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:25.101282 19226 consensus_queue.cc:260] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.103412 19226 raft_consensus.cc:3060] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:25.103578 19521 consensus_queue.cc:237] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.120399 19226 raft_consensus.cc:2468] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 2.
I20260709 13:19:25.120378 19302 raft_consensus.cc:2468] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 2.
I20260709 13:19:25.122382 19268 leader_election.cc:304] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 505976ec5ba248f4816824b4186f2ef4, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:25.122969 19341 leader_election.cc:304] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
W20260709 13:19:25.123132 19192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.227.131:40775, user_credentials={real_user=slave}} blocked reactor thread for 46297.2us
I20260709 13:19:25.123925 19445 raft_consensus.cc:2804] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:25.124125 19506 raft_consensus.cc:2804] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:25.124670 19445 raft_consensus.cc:697] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 LEADER]: Becoming Leader. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:25.124775 19506 raft_consensus.cc:697] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 2 LEADER]: Becoming Leader. State: Replica: 213472259ea74d45821f555378f40a08, State: Running, Role: LEADER
I20260709 13:19:25.126523 19445 consensus_queue.cc:237] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.126545 19506 consensus_queue.cc:237] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:25.106125 19376 raft_consensus.cc:2468] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 941e2213bc1f4ba09ef0d0674a51ddf0 in term 2.
I20260709 13:19:25.120431 19225 raft_consensus.cc:2468] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 2.
I20260709 13:19:25.137722 19303 raft_consensus.cc:2468] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 505976ec5ba248f4816824b4186f2ef4 in term 2.
I20260709 13:19:25.487485 19226 raft_consensus.cc:1275] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Refusing update from remote peer 941e2213bc1f4ba09ef0d0674a51ddf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:25.489132 19445 consensus_queue.cc:1048] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:25.508176 19301 raft_consensus.cc:1275] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Refusing update from remote peer 505976ec5ba248f4816824b4186f2ef4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:25.512040 19303 raft_consensus.cc:1275] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Refusing update from remote peer 505976ec5ba248f4816824b4186f2ef4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:25.513607 19521 consensus_queue.cc:1048] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:25.515656 19521 consensus_queue.cc:1048] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:25.526834 19225 raft_consensus.cc:1275] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Refusing update from remote peer 941e2213bc1f4ba09ef0d0674a51ddf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:25.529356 19445 consensus_queue.cc:1048] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:25.533619 19377 raft_consensus.cc:1275] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Refusing update from remote peer 941e2213bc1f4ba09ef0d0674a51ddf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:25.534759 19125 catalog_manager.cc:5697] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 reported cstate change: term changed from 1 to 2, leader changed from 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130) to 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "505976ec5ba248f4816824b4186f2ef4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.539620 19126 catalog_manager.cc:5697] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 1 to 2, leader changed from 213472259ea74d45821f555378f40a08 (127.5.227.131) to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 2 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.553337 19126 catalog_manager.cc:5697] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 reported cstate change: term changed from 1 to 2, leader changed from 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129) to 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130). New cstate: current_term: 2 leader_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.558302 19566 consensus_queue.cc:1048] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:25.560781 19226 raft_consensus.cc:1275] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Refusing update from remote peer 213472259ea74d45821f555378f40a08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:25.563592 19506 consensus_queue.cc:1048] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:25.565924 19376 raft_consensus.cc:1275] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Refusing update from remote peer 941e2213bc1f4ba09ef0d0674a51ddf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:25.570799 19376 raft_consensus.cc:1275] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Refusing update from remote peer 505976ec5ba248f4816824b4186f2ef4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:25.572829 19520 consensus_queue.cc:1048] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:25.587801 19124 catalog_manager.cc:5697] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 reported cstate change: term changed from 1 to 2, leader changed from 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130) to 213472259ea74d45821f555378f40a08 (127.5.227.131). New cstate: current_term: 2 leader_uuid: "213472259ea74d45821f555378f40a08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:25.604753 19528 consensus_queue.cc:1048] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:25.613301 19372 raft_consensus.cc:1275] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Refusing update from remote peer 505976ec5ba248f4816824b4186f2ef4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:25.619614 19596 consensus_queue.cc:1048] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:25.619921 19301 raft_consensus.cc:1275] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Refusing update from remote peer 213472259ea74d45821f555378f40a08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:25.622345 19603 consensus_queue.cc:1048] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:25.665900 19124 catalog_manager.cc:5697] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 reported cstate change: term changed from 1 to 2, leader changed from 213472259ea74d45821f555378f40a08 (127.5.227.131) to 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129). New cstate: current_term: 2 leader_uuid: "505976ec5ba248f4816824b4186f2ef4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:26.355579 19157 debug-util.cc:398] Leaking SignalData structure 0x7b0800061e60 after lost signal to thread 6033
W20260709 13:19:26.356948 19157 debug-util.cc:398] Leaking SignalData structure 0x7b08000effc0 after lost signal to thread 19160
W20260709 13:19:26.358331 19157 debug-util.cc:398] Leaking SignalData structure 0x7b08003010e0 after lost signal to thread 19252
W20260709 13:19:26.359534 19157 debug-util.cc:398] Leaking SignalData structure 0x7b08002de740 after lost signal to thread 19327
W20260709 13:19:26.360672 19157 debug-util.cc:398] Leaking SignalData structure 0x7b0800058de0 after lost signal to thread 19401
I20260709 13:19:27.712743 19125 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52624:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:19:27.754612 19125 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52624:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:19:27.796619  6030 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:28.213117 19666 tablet.cc:1724] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:28.210748 19656 log.cc:927] Time spent T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
W20260709 13:19:28.304970 19268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.227.129:41071, user_credentials={real_user=slave}} blocked reactor thread for 70103us
W20260709 13:19:28.322470 19652 log.cc:927] Time spent T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4: Append to log took a long time: real 0.206s	user 0.000s	sys 0.003s
W20260709 13:19:28.325979 19662 log.cc:927] Time spent T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:19:28.329543 19644 log.cc:927] Time spent T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08: Append to log took a long time: real 0.212s	user 0.003s	sys 0.001s
W20260709 13:19:28.362071 19668 log.cc:927] Time spent T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:19:28.361325 19675 tablet.cc:1724] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:28.372053 19667 log.cc:927] Time spent T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:28.383065 19678 tablet.cc:1724] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.386003 19679 tablet.cc:1724] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.395977 19685 tablet.cc:1724] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.338176 19669 tablet.cc:1724] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:28.428315 19673 log.cc:927] Time spent T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:19:28.424523 19680 tablet.cc:1724] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:28.422508 19664 log.cc:927] Time spent T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:19:28.460063 19679 tablet.cc:1724] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.499095 19675 tablet.cc:1724] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.523005 19302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9"
dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
mode: GRACEFUL
new_leader_uuid: "213472259ea74d45821f555378f40a08"
 from {username='slave'} at 127.0.0.1:33554
I20260709 13:19:28.524077 19302 raft_consensus.cc:606] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 LEADER]: Received request to transfer leadership to TS 213472259ea74d45821f555378f40a08
I20260709 13:19:28.459791 19684 tablet.cc:1724] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.529778 19678 tablet.cc:1724] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.546667 19691 tablet.cc:1724] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.550035 19686 tablet.cc:1724] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.556039 19669 tablet.cc:1724] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.574925 19687 tablet.cc:1724] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.615150 19675 tablet.cc:1724] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.629323 19666 tablet.cc:1724] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.635814 19692 tablet.cc:1724] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.636204 19691 tablet.cc:1724] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.633062 19685 tablet.cc:1724] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.660579 19684 tablet.cc:1724] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.666792 19679 tablet.cc:1724] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.674242 19684 tablet.cc:1724] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.645956 19680 tablet.cc:1724] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.687151 19226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866"
dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
mode: GRACEFUL
new_leader_uuid: "213472259ea74d45821f555378f40a08"
 from {username='slave'} at 127.0.0.1:38506
I20260709 13:19:28.687961 19226 raft_consensus.cc:606] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 2 LEADER]: Received request to transfer leadership to TS 213472259ea74d45821f555378f40a08
I20260709 13:19:28.685851 19685 tablet.cc:1724] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.691987 19679 tablet.cc:1724] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.694869  6030 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:28.696024  6030 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:28.709380 19680 tablet.cc:1724] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:28.747597 19126 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1: soft_deleted_table [id=59bdaee4f92e4499b6eaf33e8a903621] alter complete (version 1)
I20260709 13:19:28.844105 19677 raft_consensus.cc:993] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0: : Instructing follower 213472259ea74d45821f555378f40a08 to start an election
I20260709 13:19:28.844887 19681 raft_consensus.cc:1081] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 LEADER]: Signalling peer 213472259ea74d45821f555378f40a08 to start an election
I20260709 13:19:28.847249 19375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9"
dest_uuid: "213472259ea74d45821f555378f40a08"
 from {username='slave'} at 127.0.0.1:50030
I20260709 13:19:28.847992 19375 raft_consensus.cc:493] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:28.848448 19375 raft_consensus.cc:3060] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.856918 19375 raft_consensus.cc:515] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:28.860562 19375 leader_election.cc:290] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 3 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:28.861901 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:28.867632 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c861a0f1e0c403ab763c5d866e754d9" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:28.868548 19301 raft_consensus.cc:3055] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:28.868978 19301 raft_consensus.cc:740] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 941e2213bc1f4ba09ef0d0674a51ddf0, State: Running, Role: LEADER
I20260709 13:19:28.873343 19226 raft_consensus.cc:3060] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.870107 19301 consensus_queue.cc:260] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:28.883601 19301 raft_consensus.cc:3060] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.885383 19226 raft_consensus.cc:2468] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 3.
I20260709 13:19:28.896126 19342 leader_election.cc:304] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 505976ec5ba248f4816824b4186f2ef4; no voters: 
I20260709 13:19:28.897480 19614 raft_consensus.cc:2804] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:28.898108 19614 raft_consensus.cc:697] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 3 LEADER]: Becoming Leader. State: Replica: 213472259ea74d45821f555378f40a08, State: Running, Role: LEADER
I20260709 13:19:28.899175 19614 consensus_queue.cc:237] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } }
I20260709 13:19:28.915591 19301 raft_consensus.cc:2468] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 3.
I20260709 13:19:28.918089 19125 catalog_manager.cc:5697] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 reported cstate change: term changed from 2 to 3, leader changed from 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130) to 213472259ea74d45821f555378f40a08 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "213472259ea74d45821f555378f40a08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.996007 19672 raft_consensus.cc:993] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4: : Instructing follower 213472259ea74d45821f555378f40a08 to start an election
I20260709 13:19:28.996651 19661 raft_consensus.cc:1081] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 2 LEADER]: Signalling peer 213472259ea74d45821f555378f40a08 to start an election
I20260709 13:19:28.998920 19375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866"
dest_uuid: "213472259ea74d45821f555378f40a08"
 from {username='slave'} at 127.0.0.1:50024
I20260709 13:19:28.999647 19375 raft_consensus.cc:493] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:29.000056 19375 raft_consensus.cc:3060] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:29.009455 19375 raft_consensus.cc:515] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:29.012670 19375 leader_election.cc:290] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 3 election: Requested vote from peers 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071), 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857)
I20260709 13:19:29.012907 19226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "505976ec5ba248f4816824b4186f2ef4"
I20260709 13:19:29.013810 19226 raft_consensus.cc:3055] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:29.014007 19301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7dfa40d76147fab5fe548a04fae866" candidate_uuid: "213472259ea74d45821f555378f40a08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0"
I20260709 13:19:29.014249 19226 raft_consensus.cc:740] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 505976ec5ba248f4816824b4186f2ef4, State: Running, Role: LEADER
I20260709 13:19:29.015455 19226 consensus_queue.cc:260] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:29.017136 19226 raft_consensus.cc:3060] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:29.017284 19301 raft_consensus.cc:3060] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:29.028156 19301 raft_consensus.cc:2468] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 3.
I20260709 13:19:29.029824 19341 leader_election.cc:304] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 213472259ea74d45821f555378f40a08, 941e2213bc1f4ba09ef0d0674a51ddf0; no voters: 
I20260709 13:19:29.031076 19614 raft_consensus.cc:2804] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:29.031664 19614 raft_consensus.cc:697] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 3 LEADER]: Becoming Leader. State: Replica: 213472259ea74d45821f555378f40a08, State: Running, Role: LEADER
I20260709 13:19:29.032747 19614 consensus_queue.cc:237] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } }
I20260709 13:19:29.033360 19226 raft_consensus.cc:2468] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 213472259ea74d45821f555378f40a08 in term 3.
I20260709 13:19:29.046917 19125 catalog_manager.cc:5697] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 reported cstate change: term changed from 2 to 3, leader changed from 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129) to 213472259ea74d45821f555378f40a08 (127.5.227.131). New cstate: current_term: 3 leader_uuid: "213472259ea74d45821f555378f40a08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "213472259ea74d45821f555378f40a08" member_type: VOTER last_known_addr { host: "127.5.227.131" port: 40775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.315138 19226 raft_consensus.cc:1275] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 3 FOLLOWER]: Refusing update from remote peer 213472259ea74d45821f555378f40a08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:29.317046 19614 consensus_queue.cc:1048] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:29.340701 19301 raft_consensus.cc:1275] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 3 FOLLOWER]: Refusing update from remote peer 213472259ea74d45821f555378f40a08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:29.370857 19689 consensus_queue.cc:1048] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:29.475395 19226 raft_consensus.cc:1275] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 3 FOLLOWER]: Refusing update from remote peer 213472259ea74d45821f555378f40a08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:29.477218 19689 consensus_queue.cc:1048] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505976ec5ba248f4816824b4186f2ef4" member_type: VOTER last_known_addr { host: "127.5.227.129" port: 41071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:29.489317 19301 raft_consensus.cc:1275] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 3 FOLLOWER]: Refusing update from remote peer 213472259ea74d45821f555378f40a08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:29.491595 19703 consensus_queue.cc:1048] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "941e2213bc1f4ba09ef0d0674a51ddf0" member_type: VOTER last_known_addr { host: "127.5.227.130" port: 39857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:29.800472  6030 tablet_server.cc:179] TabletServer@127.5.227.129:0 shutting down...
W20260709 13:19:29.811826 19342 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
W20260709 13:19:29.819664 19342 consensus_peers.cc:597] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 -> Peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Couldn't send request to peer 505976ec5ba248f4816824b4186f2ef4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:29.829042 19342 consensus_peers.cc:597] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 -> Peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Couldn't send request to peer 505976ec5ba248f4816824b4186f2ef4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:29.837652 19268 consensus_peers.cc:597] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 -> Peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Couldn't send request to peer 505976ec5ba248f4816824b4186f2ef4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:29.861927 19342 consensus_peers.cc:597] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 -> Peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Couldn't send request to peer 505976ec5ba248f4816824b4186f2ef4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:29.869524  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:29.870682  6030 tablet_replica.cc:333] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.872009  6030 raft_consensus.cc:2243] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:29.873384  6030 raft_consensus.cc:2272] T 5191ac17b3c14da88c043052f7596b12 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.877635  6030 tablet_replica.cc:333] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.878849  6030 raft_consensus.cc:2243] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:29.879540  6030 raft_consensus.cc:2272] T d4f5976eabdd449899ff90c1277750e0 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.882128  6030 tablet_replica.cc:333] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.882928  6030 raft_consensus.cc:2243] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:29.883484  6030 raft_consensus.cc:2272] T df2dad9a95aa4504b7c8b393525e0a3d P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.886350  6030 tablet_replica.cc:333] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.887362  6030 raft_consensus.cc:2243] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:29.888041  6030 raft_consensus.cc:2272] T 71df5f549ecc496aa86fe68e021fbc24 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.891667  6030 tablet_replica.cc:333] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.892479  6030 raft_consensus.cc:2243] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:29.893544  6030 raft_consensus.cc:2272] T cd6a450de2e74cde9e79e8e3945a6bf3 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.897742  6030 tablet_replica.cc:333] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.898948  6030 raft_consensus.cc:2243] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:29.900005  6030 raft_consensus.cc:2272] T b504e939f6604e108e7857a8eadcdb9c P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.903030  6030 tablet_replica.cc:333] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.903762  6030 raft_consensus.cc:2243] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:29.904318  6030 raft_consensus.cc:2272] T 964a8aeb615a4077a685c9f9b1a77097 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.907236  6030 tablet_replica.cc:333] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.908104  6030 raft_consensus.cc:2243] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:29.909385  6030 raft_consensus.cc:2272] T 0cd5a8307b3146ccb8a0212389c8d59f P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.914259  6030 tablet_replica.cc:333] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.915367  6030 raft_consensus.cc:2243] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:29.916823  6030 raft_consensus.cc:2272] T d2172ced591b46b798d4ca34a7616333 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:29.916882 19268 consensus_peers.cc:597] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 -> Peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Couldn't send request to peer 505976ec5ba248f4816824b4186f2ef4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:29.920851  6030 tablet_replica.cc:333] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.921690  6030 raft_consensus.cc:2243] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:29.922302  6030 raft_consensus.cc:2272] T 4c861a0f1e0c403ab763c5d866e754d9 P 505976ec5ba248f4816824b4186f2ef4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.925933  6030 tablet_replica.cc:333] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.927428  6030 raft_consensus.cc:2243] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:29.928239  6030 raft_consensus.cc:2272] T fd1b8780c15a44bca12c6b9448682755 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.931680  6030 tablet_replica.cc:333] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.932866  6030 raft_consensus.cc:2243] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:29.933519  6030 raft_consensus.cc:2272] T 79799f339c9540ae8e8e1cc240e6cce0 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.937309  6030 tablet_replica.cc:333] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.938078  6030 raft_consensus.cc:2243] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:29.938719  6030 raft_consensus.cc:2272] T 6980a49d31dc4a2e8c3d48742d78e30f P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.941700  6030 tablet_replica.cc:333] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.942330  6030 raft_consensus.cc:2243] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:29.942973  6030 raft_consensus.cc:2272] T 2bbdde43fc3f48de80b94903fc565079 P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.946508  6030 tablet_replica.cc:333] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.947387  6030 raft_consensus.cc:2243] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:29.948825  6030 raft_consensus.cc:2272] T 27a1ae7fb63a4c05b369caeacfce820e P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.952049  6030 tablet_replica.cc:333] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.952920  6030 raft_consensus.cc:2243] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:29.953874  6030 raft_consensus.cc:2272] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 505976ec5ba248f4816824b4186f2ef4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.957038  6030 tablet_replica.cc:333] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.957633  6030 raft_consensus.cc:2243] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:29.958592  6030 raft_consensus.cc:2272] T b9be79dba975466182f64fa951f51bcc P 505976ec5ba248f4816824b4186f2ef4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:29.961428  6030 tablet_replica.cc:333] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4: stopping tablet replica
I20260709 13:19:29.961993  6030 raft_consensus.cc:2243] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:29.962466  6030 raft_consensus.cc:2272] T ff7dfa40d76147fab5fe548a04fae866 P 505976ec5ba248f4816824b4186f2ef4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:29.989957 19268 consensus_peers.cc:597] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 -> Peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Couldn't send request to peer 505976ec5ba248f4816824b4186f2ef4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.023442  6030 tablet_server.cc:196] TabletServer@127.5.227.129:0 shutdown complete.
W20260709 13:19:30.028504 19342 consensus_peers.cc:597] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 -> Peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Couldn't send request to peer 505976ec5ba248f4816824b4186f2ef4. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:41071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.073824 19268 consensus_peers.cc:597] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 -> Peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Couldn't send request to peer 505976ec5ba248f4816824b4186f2ef4. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:41071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.078933  6030 tablet_server.cc:179] TabletServer@127.5.227.130:0 shutting down...
W20260709 13:19:30.102802 19268 consensus_peers.cc:597] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 -> Peer 505976ec5ba248f4816824b4186f2ef4 (127.5.227.129:41071): Couldn't send request to peer 505976ec5ba248f4816824b4186f2ef4. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.129:41071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.131120  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:30.132356  6030 tablet_replica.cc:333] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.133859  6030 raft_consensus.cc:2243] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.134557  6030 raft_consensus.cc:2272] T 5191ac17b3c14da88c043052f7596b12 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.137717  6030 tablet_replica.cc:333] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.138538  6030 raft_consensus.cc:2243] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.139688  6030 raft_consensus.cc:2272] T 964a8aeb615a4077a685c9f9b1a77097 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.142989  6030 tablet_replica.cc:333] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.143846  6030 raft_consensus.cc:2243] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.144440  6030 raft_consensus.cc:2272] T 0cd5a8307b3146ccb8a0212389c8d59f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.147447  6030 tablet_replica.cc:333] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.148262  6030 raft_consensus.cc:2243] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.148835  6030 raft_consensus.cc:2272] T b504e939f6604e108e7857a8eadcdb9c P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.151568  6030 tablet_replica.cc:333] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.152302  6030 raft_consensus.cc:2243] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.152897  6030 raft_consensus.cc:2272] T cd6a450de2e74cde9e79e8e3945a6bf3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.157260  6030 tablet_replica.cc:333] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.158226  6030 raft_consensus.cc:2243] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.159255  6030 raft_consensus.cc:2272] T d4f5976eabdd449899ff90c1277750e0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.161782  6030 tablet_replica.cc:333] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.162400  6030 raft_consensus.cc:2243] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.163028  6030 raft_consensus.cc:2272] T d2172ced591b46b798d4ca34a7616333 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.165800  6030 tablet_replica.cc:333] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.166468  6030 raft_consensus.cc:2243] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.167126  6030 raft_consensus.cc:2272] T 4c861a0f1e0c403ab763c5d866e754d9 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.170423  6030 tablet_replica.cc:333] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.171190  6030 raft_consensus.cc:2243] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.171799  6030 raft_consensus.cc:2272] T 2bbdde43fc3f48de80b94903fc565079 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.174537  6030 tablet_replica.cc:333] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.175328  6030 raft_consensus.cc:2243] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.175984  6030 raft_consensus.cc:2272] T 27a1ae7fb63a4c05b369caeacfce820e P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.178917  6030 tablet_replica.cc:333] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.179638  6030 raft_consensus.cc:2243] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.180215  6030 raft_consensus.cc:2272] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.183142  6030 tablet_replica.cc:333] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.183812  6030 raft_consensus.cc:2243] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.184509  6030 raft_consensus.cc:2272] T b9be79dba975466182f64fa951f51bcc P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.187359  6030 tablet_replica.cc:333] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.188037  6030 raft_consensus.cc:2243] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.189082  6030 raft_consensus.cc:2272] T 79799f339c9540ae8e8e1cc240e6cce0 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.191625  6030 tablet_replica.cc:333] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.192261  6030 raft_consensus.cc:2243] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.193352  6030 raft_consensus.cc:2272] T 6980a49d31dc4a2e8c3d48742d78e30f P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.197224  6030 tablet_replica.cc:333] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.198479  6030 raft_consensus.cc:2243] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.199844  6030 raft_consensus.cc:2272] T fd1b8780c15a44bca12c6b9448682755 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.203305  6030 tablet_replica.cc:333] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.204064  6030 raft_consensus.cc:2243] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.204625  6030 raft_consensus.cc:2272] T ff7dfa40d76147fab5fe548a04fae866 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.208396  6030 tablet_replica.cc:333] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.209056  6030 raft_consensus.cc:2243] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.209973  6030 raft_consensus.cc:2272] T df2dad9a95aa4504b7c8b393525e0a3d P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.213073  6030 tablet_replica.cc:333] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0: stopping tablet replica
I20260709 13:19:30.213805  6030 raft_consensus.cc:2243] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.214956  6030 raft_consensus.cc:2272] T 71df5f549ecc496aa86fe68e021fbc24 P 941e2213bc1f4ba09ef0d0674a51ddf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.303109  6030 tablet_server.cc:196] TabletServer@127.5.227.130:0 shutdown complete.
I20260709 13:19:30.349843  6030 tablet_server.cc:179] TabletServer@127.5.227.131:0 shutting down...
W20260709 13:19:30.417025 19341 consensus_peers.cc:597] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 -> Peer 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857): Couldn't send request to peer 941e2213bc1f4ba09ef0d0674a51ddf0. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:39857: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.431092  6030 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:30.432281  6030 tablet_replica.cc:333] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.433243  6030 raft_consensus.cc:2243] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.433884  6030 raft_consensus.cc:2272] T d4f5976eabdd449899ff90c1277750e0 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.436522  6030 tablet_replica.cc:333] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.437203  6030 raft_consensus.cc:2243] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.437734  6030 raft_consensus.cc:2272] T 5191ac17b3c14da88c043052f7596b12 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.440231  6030 tablet_replica.cc:333] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.440927  6030 raft_consensus.cc:2243] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.441447  6030 raft_consensus.cc:2272] T b504e939f6604e108e7857a8eadcdb9c P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.443941  6030 tablet_replica.cc:333] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.444684  6030 raft_consensus.cc:2243] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.445216  6030 raft_consensus.cc:2272] T cd6a450de2e74cde9e79e8e3945a6bf3 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.447651  6030 tablet_replica.cc:333] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.448302  6030 raft_consensus.cc:2243] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.448797  6030 raft_consensus.cc:2272] T 0cd5a8307b3146ccb8a0212389c8d59f P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.451365  6030 tablet_replica.cc:333] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.452119  6030 raft_consensus.cc:2243] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.452646  6030 raft_consensus.cc:2272] T 964a8aeb615a4077a685c9f9b1a77097 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.455152  6030 tablet_replica.cc:333] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.455856  6030 raft_consensus.cc:2243] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.456537  6030 raft_consensus.cc:2272] T d2172ced591b46b798d4ca34a7616333 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.459745  6030 tablet_replica.cc:333] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.460558  6030 raft_consensus.cc:2243] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.461654  6030 raft_consensus.cc:2272] T 4c861a0f1e0c403ab763c5d866e754d9 P 213472259ea74d45821f555378f40a08 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:30.462196 19341 consensus_peers.cc:597] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 -> Peer 941e2213bc1f4ba09ef0d0674a51ddf0 (127.5.227.130:39857): Couldn't send request to peer 941e2213bc1f4ba09ef0d0674a51ddf0. Status: Network error: Client connection negotiation failed: client connection to 127.5.227.130:39857: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.464287  6030 tablet_replica.cc:333] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.465015  6030 raft_consensus.cc:2243] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.465546  6030 raft_consensus.cc:2272] T fd1b8780c15a44bca12c6b9448682755 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.468066  6030 tablet_replica.cc:333] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.468708  6030 raft_consensus.cc:2243] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.469547  6030 raft_consensus.cc:2272] T ff7dfa40d76147fab5fe548a04fae866 P 213472259ea74d45821f555378f40a08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.473302  6030 tablet_replica.cc:333] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.473963  6030 raft_consensus.cc:2243] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.474884  6030 raft_consensus.cc:2272] T 2bbdde43fc3f48de80b94903fc565079 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.477360  6030 tablet_replica.cc:333] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.478027  6030 raft_consensus.cc:2243] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.478570  6030 raft_consensus.cc:2272] T 27a1ae7fb63a4c05b369caeacfce820e P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.481063  6030 tablet_replica.cc:333] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.481702  6030 raft_consensus.cc:2243] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.482206  6030 raft_consensus.cc:2272] T 79799f339c9540ae8e8e1cc240e6cce0 P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.484647  6030 tablet_replica.cc:333] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.485257  6030 raft_consensus.cc:2243] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.485790  6030 raft_consensus.cc:2272] T 6980a49d31dc4a2e8c3d48742d78e30f P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.488453  6030 tablet_replica.cc:333] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.489018  6030 raft_consensus.cc:2243] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.489517  6030 raft_consensus.cc:2272] T 71df5f549ecc496aa86fe68e021fbc24 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.491873  6030 tablet_replica.cc:333] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.492447  6030 raft_consensus.cc:2243] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.493005  6030 raft_consensus.cc:2272] T df2dad9a95aa4504b7c8b393525e0a3d P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.495620  6030 tablet_replica.cc:333] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.496236  6030 raft_consensus.cc:2243] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.497084  6030 raft_consensus.cc:2272] T 89a3fd4ea62c41e4b4a48cbcd961a6b3 P 213472259ea74d45821f555378f40a08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.499498  6030 tablet_replica.cc:333] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08: stopping tablet replica
I20260709 13:19:30.500052  6030 raft_consensus.cc:2243] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.500535  6030 raft_consensus.cc:2272] T b9be79dba975466182f64fa951f51bcc P 213472259ea74d45821f555378f40a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.539516  6030 tablet_server.cc:196] TabletServer@127.5.227.131:0 shutdown complete.
I20260709 13:19:30.584506  6030 master.cc:562] Master@127.5.227.190:33443 shutting down...
I20260709 13:19:30.625047  6030 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.625707  6030 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.626117  6030 tablet_replica.cc:333] T 00000000000000000000000000000000 P 69f02094b55b4908a75296ba678fada1: stopping tablet replica
W20260709 13:19:31.645562  6030 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19157)
I20260709 13:19:32.087550  6030 master.cc:584] Master@127.5.227.190:33443 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (14701 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (28439 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (430965 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:19:32.153614  6030 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 437 messages since previous log ~18 seconds ago
I20260709 13:19:32.153972  6030 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 437 messages since previous log ~18 seconds ago
I20260709 13:19:32.154194  6030 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 431 messages since previous log ~18 seconds ago
I20260709 13:19:32.154433  6030 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~42 seconds ago
I20260709 13:19:32.155138  6030 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~42 seconds ago
I20260709 13:19:32.155344  6030 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~275 seconds ago
I20260709 13:19:32.155579  6030 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~275 seconds ago
I20260709 13:19:32.155845  6030 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~185 seconds ago
I20260709 13:19:32.156067  6030 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 14 messages since previous log ~2 seconds ago
I20260709 13:19:32.156391  6030 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~13 seconds ago
